2024-09-21T03:41:27.243 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T03:41:27.267 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T03:41:27.388 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485 branch: wip-pdonnell-testing-20240920.212106-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/postgres}} email: pdonnell@redhat.com first_in_suite: false job_id: '7913485' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-pdonnell-testing-20240920.212106-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon warn on pool no app: false mon: mon op complaint time: 120 osd: osd op complaint time: 180 conf: mds: mds_bal_replicate_threshold: 1 mgr: cephsqlite lock renewal timeout: 900000 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 1843221895adccfb3b692060251dd6a0183bc410 subvols: create: 2 subvol_options: --size 25000000000 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 1843221895adccfb3b692060251dd6a0183bc410 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20240920.212106-debug sha1: 1843221895adccfb3b692060251dd6a0183bc410 owner: scheduled_pdonnell@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 7864 sha1: 1843221895adccfb3b692060251dd6a0183bc410 sleep_before_teardown: 0 subset: 67/512 suite: fs suite_branch: wip-pdonnell-testing-20240920.212106-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 1843221895adccfb3b692060251dd6a0183bc410 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGo6BMScuzqWHISAJ/YYxtIDhBj6pyU/b93d5ntbXfX2wibSoGgYoGagwWXGN4fhHiLsF8LYY9rmTrK9i3Tji2U= smithi060.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHN1OBCubab2HHZ6dDnnjTbG8VxBLsA9hiUsMvpTAAc5HvdBtvM62HG0EsjSiVI5/ZDbCMED1oUIjCljN65rmR4= smithi073.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL7auf3GIHnBOW3uprBVzJ7Hw1yjHy/fQzW1Ga5fw9ljBF+ASvL2NSGowd1yPHJJwq2bOr1/RpMKdr38M903xd4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - quiescer: null - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-20_23:48:22 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 2024-09-21T03:41:27.388 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa; will attempt to use it 2024-09-21T03:41:27.388 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_1843221895adccfb3b692060251dd6a0183bc410/qa/tasks 2024-09-21T03:41:27.389 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T03:41:27.390 INFO:teuthology.task.internal:Checking packages... 2024-09-21T03:41:27.409 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '1843221895adccfb3b692060251dd6a0183bc410' 2024-09-21T03:41:27.409 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T03:41:27.409 INFO:teuthology.packaging:ref: None 2024-09-21T03:41:27.409 INFO:teuthology.packaging:tag: None 2024-09-21T03:41:27.409 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:41:27.409 INFO:teuthology.packaging:sha1: 1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:41:27.410 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-pdonnell-testing-20240920.212106-debug 2024-09-21T03:41:27.550 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5120.g18432218 2024-09-21T03:41:27.551 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T03:41:27.565 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T03:41:27.565 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T03:41:27.598 INFO:teuthology.task.internal:Saving configuration 2024-09-21T03:41:27.618 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T03:41:27.625 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T03:41:27.650 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:36:29.036768', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGo6BMScuzqWHISAJ/YYxtIDhBj6pyU/b93d5ntbXfX2wibSoGgYoGagwWXGN4fhHiLsF8LYY9rmTrK9i3Tji2U='} 2024-09-21T03:41:27.674 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi060.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:36:29.034775', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHN1OBCubab2HHZ6dDnnjTbG8VxBLsA9hiUsMvpTAAc5HvdBtvM62HG0EsjSiVI5/ZDbCMED1oUIjCljN65rmR4='} 2024-09-21T03:41:27.697 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi073.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 03:36:29.038489', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBL7auf3GIHnBOW3uprBVzJ7Hw1yjHy/fQzW1Ga5fw9ljBF+ASvL2NSGowd1yPHJJwq2bOr1/RpMKdr38M903xd4='} 2024-09-21T03:41:27.697 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T03:41:27.703 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-21T03:41:27.704 INFO:teuthology.task.internal:roles: ubuntu@smithi060.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-21T03:41:27.704 INFO:teuthology.task.internal:roles: ubuntu@smithi073.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-21T03:41:27.704 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T03:41:27.789 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f00af0d0160>, signals=[15]) 2024-09-21T03:41:27.789 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T03:41:27.795 INFO:teuthology.task.internal:Opening connections... 2024-09-21T03:41:27.795 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-09-21T03:41:27.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:41:27.872 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T03:41:27.873 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:41:27.947 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi073.front.sepia.ceph.com 2024-09-21T03:41:27.948 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:41:28.022 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T03:41:28.029 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-09-21T03:41:28.048 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-09-21T03:41:28.048 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-09-21T03:41:28.106 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="CentOS Stream" 2024-09-21T03:41:28.106 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="9" 2024-09-21T03:41:28.106 INFO:teuthology.orchestra.run.smithi022.stdout:ID="centos" 2024-09-21T03:41:28.106 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:41:28.106 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="9" 2024-09-21T03:41:28.106 INFO:teuthology.orchestra.run.smithi022.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:41:28.106 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:41:28.107 INFO:teuthology.orchestra.run.smithi022.stdout:ANSI_COLOR="0;31" 2024-09-21T03:41:28.107 INFO:teuthology.orchestra.run.smithi022.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:41:28.107 INFO:teuthology.orchestra.run.smithi022.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:41:28.107 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:41:28.107 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:41:28.107 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:41:28.107 INFO:teuthology.orchestra.run.smithi022.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:41:28.108 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-09-21T03:41:28.132 DEBUG:teuthology.orchestra.run.smithi060:> uname -m 2024-09-21T03:41:28.150 INFO:teuthology.orchestra.run.smithi060.stdout:x86_64 2024-09-21T03:41:28.150 DEBUG:teuthology.orchestra.run.smithi060:> cat /etc/os-release 2024-09-21T03:41:28.208 INFO:teuthology.orchestra.run.smithi060.stdout:NAME="CentOS Stream" 2024-09-21T03:41:28.208 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION="9" 2024-09-21T03:41:28.208 INFO:teuthology.orchestra.run.smithi060.stdout:ID="centos" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:VERSION_ID="9" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:ANSI_COLOR="0;31" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:41:28.209 INFO:teuthology.orchestra.run.smithi060.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:41:28.210 INFO:teuthology.lock.ops:Updating smithi060.front.sepia.ceph.com on lock server 2024-09-21T03:41:28.231 DEBUG:teuthology.orchestra.run.smithi073:> uname -m 2024-09-21T03:41:28.250 INFO:teuthology.orchestra.run.smithi073.stdout:x86_64 2024-09-21T03:41:28.250 DEBUG:teuthology.orchestra.run.smithi073:> cat /etc/os-release 2024-09-21T03:41:28.308 INFO:teuthology.orchestra.run.smithi073.stdout:NAME="CentOS Stream" 2024-09-21T03:41:28.308 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION="9" 2024-09-21T03:41:28.308 INFO:teuthology.orchestra.run.smithi073.stdout:ID="centos" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:ID_LIKE="rhel fedora" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:VERSION_ID="9" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:PLATFORM_ID="platform:el9" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:ANSI_COLOR="0;31" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:LOGO="fedora-logo-icon" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:HOME_URL="https://centos.org/" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T03:41:28.309 INFO:teuthology.orchestra.run.smithi073.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T03:41:28.309 INFO:teuthology.lock.ops:Updating smithi073.front.sepia.ceph.com on lock server 2024-09-21T03:41:28.331 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T03:41:28.341 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T03:41:28.347 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T03:41:28.347 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:41:28.350 DEBUG:teuthology.orchestra.run.smithi060:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:41:28.352 DEBUG:teuthology.orchestra.run.smithi073:> test '!' -e /home/ubuntu/cephtest 2024-09-21T03:41:28.368 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T03:41:28.374 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T03:41:28.374 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:41:28.407 DEBUG:teuthology.orchestra.run.smithi060:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:41:28.409 DEBUG:teuthology.orchestra.run.smithi073:> test -z $(ls -A /var/lib/ceph) 2024-09-21T03:41:28.636 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T03:41:28.722 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T03:41:28.738 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T03:41:28.738 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T03:41:28.738 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:41:28.739 DEBUG:teuthology.orchestra.run.smithi060:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:41:28.739 DEBUG:teuthology.orchestra.run.smithi073:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T03:41:28.756 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:41:28.757 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-21T03:41:28.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:41:28.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:41:28.760 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-21T03:41:28.760 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-09-21T03:41:28.816 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-503.el9.x86_64 2024-09-21T03:41:28.817 INFO:teuthology.task.kernel:Running kernel on smithi060: 5.14.0-503.el9.x86_64 2024-09-21T03:41:28.817 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum install -y kernel 2024-09-21T03:41:28.820 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-503.el9.x86_64 2024-09-21T03:41:28.820 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-503.el9.x86_64 2024-09-21T03:41:28.820 INFO:teuthology.task.kernel:Running kernel on smithi022: 5.14.0-503.el9.x86_64 2024-09-21T03:41:28.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum install -y kernel 2024-09-21T03:41:28.821 INFO:teuthology.task.kernel:Running kernel on smithi073: 5.14.0-503.el9.x86_64 2024-09-21T03:41:28.821 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum install -y kernel 2024-09-21T03:41:31.025 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 19 MB/s | 8.3 MB 00:00 2024-09-21T03:41:31.362 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.3 MB 00:00 2024-09-21T03:41:32.507 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 4.2 MB/s | 8.3 MB 00:01 2024-09-21T03:41:33.172 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-21T03:41:35.476 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 6.2 MB/s | 20 MB 00:03 2024-09-21T03:41:35.650 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 9.9 MB/s | 20 MB 00:02 2024-09-21T03:41:37.739 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 9.7 MB/s | 6.5 MB 00:00 2024-09-21T03:41:39.315 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 67 kB/s | 19 kB 00:00 2024-09-21T03:41:40.142 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-21T03:41:40.227 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 29 MB/s | 23 MB 00:00 2024-09-21T03:41:41.234 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-21T03:41:41.592 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-21T03:41:42.738 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-21T03:41:42.985 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-21T03:41:43.948 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T03:41:45.950 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 34 kB/s | 1.7 kB 00:00 2024-09-21T03:41:47.923 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T03:41:47.923 INFO:teuthology.orchestra.run.smithi060.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T03:41:48.018 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T03:41:48.024 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout: Package Architecture Version Repository Size 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T03:41:48.025 INFO:teuthology.orchestra.run.smithi060.stdout:================================================================================ 2024-09-21T03:41:48.026 INFO:teuthology.orchestra.run.smithi060.stdout:Install 4 Packages 2024-09-21T03:41:48.026 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:41:48.026 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 79 M 2024-09-21T03:41:48.026 INFO:teuthology.orchestra.run.smithi060.stdout:Installed size: 126 M 2024-09-21T03:41:48.026 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T03:41:48.143 INFO:teuthology.orchestra.run.smithi060.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 373 kB/s | 36 kB 00:00 2024-09-21T03:41:48.210 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-21T03:41:48.535 INFO:teuthology.orchestra.run.smithi060.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-21T03:41:49.019 INFO:teuthology.orchestra.run.smithi060.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-21T03:41:49.286 INFO:teuthology.orchestra.run.smithi060.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 25 MB/s | 29 MB 00:01 2024-09-21T03:41:49.286 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:41:49.286 INFO:teuthology.orchestra.run.smithi060.stdout:Total 63 MB/s | 79 MB 00:01 2024-09-21T03:41:49.603 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-21T03:41:50.002 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T03:41:50.075 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T03:41:50.075 INFO:teuthology.orchestra.run.smithi073.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T03:41:50.172 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-21T03:41:50.181 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-21T03:41:50.181 INFO:teuthology.orchestra.run.smithi073.stdout: Package Architecture Version Repository Size 2024-09-21T03:41:50.181 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-21T03:41:50.181 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-21T03:41:50.181 INFO:teuthology.orchestra.run.smithi073.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T03:41:50.181 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-21T03:41:50.182 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T03:41:50.182 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T03:41:50.182 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T03:41:50.182 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:41:50.182 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-21T03:41:50.182 INFO:teuthology.orchestra.run.smithi073.stdout:================================================================================ 2024-09-21T03:41:50.182 INFO:teuthology.orchestra.run.smithi073.stdout:Install 4 Packages 2024-09-21T03:41:50.182 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:41:50.183 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 79 M 2024-09-21T03:41:50.183 INFO:teuthology.orchestra.run.smithi073.stdout:Installed size: 126 M 2024-09-21T03:41:50.183 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-21T03:41:50.402 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T03:41:50.403 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T03:41:50.753 INFO:teuthology.orchestra.run.smithi073.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 66 kB/s | 36 kB 00:00 2024-09-21T03:41:51.420 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T03:41:51.420 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T03:41:51.535 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T03:41:51.535 INFO:teuthology.orchestra.run.smithi022.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T03:41:51.604 INFO:teuthology.orchestra.run.smithi073.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 11 MB/s | 16 MB 00:01 2024-09-21T03:41:51.642 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-09-21T03:41:51.653 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-09-21T03:41:51.653 INFO:teuthology.orchestra.run.smithi022.stdout: Package Architecture Version Repository Size 2024-09-21T03:41:51.653 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-09-21T03:41:51.653 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-09-21T03:41:51.653 INFO:teuthology.orchestra.run.smithi022.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T03:41:51.653 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-09-21T03:41:51.653 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T03:41:51.653 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T03:41:51.654 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T03:41:51.654 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:41:51.654 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-09-21T03:41:51.654 INFO:teuthology.orchestra.run.smithi022.stdout:================================================================================ 2024-09-21T03:41:51.654 INFO:teuthology.orchestra.run.smithi022.stdout:Install 4 Packages 2024-09-21T03:41:51.654 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:41:51.655 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 79 M 2024-09-21T03:41:51.655 INFO:teuthology.orchestra.run.smithi022.stdout:Installed size: 126 M 2024-09-21T03:41:51.655 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-09-21T03:41:51.772 INFO:teuthology.orchestra.run.smithi022.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 373 kB/s | 36 kB 00:00 2024-09-21T03:41:52.262 INFO:teuthology.orchestra.run.smithi073.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 17 MB/s | 35 MB 00:02 2024-09-21T03:41:52.405 INFO:teuthology.orchestra.run.smithi022.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-21T03:41:52.830 INFO:teuthology.orchestra.run.smithi022.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 30 MB/s | 35 MB 00:01 2024-09-21T03:41:52.996 INFO:teuthology.orchestra.run.smithi073.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 13 MB/s | 29 MB 00:02 2024-09-21T03:41:52.996 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:41:52.996 INFO:teuthology.orchestra.run.smithi073.stdout:Total 28 MB/s | 79 MB 00:02 2024-09-21T03:41:53.247 INFO:teuthology.orchestra.run.smithi022.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 19 MB/s | 29 MB 00:01 2024-09-21T03:41:53.247 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:41:53.248 INFO:teuthology.orchestra.run.smithi022.stdout:Total 49 MB/s | 79 MB 00:01 2024-09-21T03:41:53.678 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-21T03:41:53.955 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-09-21T03:41:54.021 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-21T03:41:54.022 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-21T03:41:54.117 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T03:41:54.339 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-09-21T03:41:54.339 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-09-21T03:41:54.800 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:41:54.889 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:41:54.995 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-21T03:41:54.995 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-21T03:41:55.322 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-09-21T03:41:55.322 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-09-21T03:41:57.428 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-21T03:41:57.646 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:41:57.782 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:41:57.903 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-09-21T03:41:58.165 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:41:58.263 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:41:58.560 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:41:58.640 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:42:01.013 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:42:01.156 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:42:01.411 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:42:01.544 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:42:02.905 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:42:02.949 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:06.009 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:42:06.198 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:06.659 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:42:06.703 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:08.103 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:11.059 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:11.855 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:46.660 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:46.700 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:47.068 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:47.068 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:42:47.068 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:42:47.068 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:42:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:42:47.912 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T03:42:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T03:42:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T03:42:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T03:42:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T03:42:47.912 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:42:47.912 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T03:42:48.250 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:42:48.344 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:42:48.345 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:42:48.345 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T03:42:48.345 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T03:42:48.345 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T03:42:48.346 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-21T03:42:48.346 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi060.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T03:42:48.346 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:42:48.404 INFO:teuthology.orchestra.run.smithi060.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:42:48.405 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:42:48.405 DEBUG:teuthology.orchestra.run.smithi060:> sudo rpm -qi grub2-tools 2024-09-21T03:42:48.436 INFO:teuthology.orchestra.run.smithi060.stdout:Name : grub2-tools 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Epoch : 1 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Version : 2.06 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Release : 82.el9 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Architecture: x86_64 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Group : Unspecified 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Size : 8274670 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:License : GPLv3+ 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T03:42:48.437 INFO:teuthology.orchestra.run.smithi060.stdout:Packager : builder@centos.org 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout:Vendor : CentOS 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout:Summary : Support tools for GRUB. 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout:Description : 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout:hardware devices. 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:42:48.438 INFO:teuthology.orchestra.run.smithi060.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T03:42:48.439 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T03:42:48.439 INFO:teuthology.task.kernel:Updating grub on smithi060 to boot 5.14.0-508.el9.x86_64 2024-09-21T03:42:48.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T03:42:49.089 INFO:teuthology.orchestra.run.smithi060.stderr:Generating grub configuration file ... 2024-09-21T03:42:49.440 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:49.482 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:49.862 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:49.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:42:49.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:42:49.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:42:50.383 INFO:teuthology.orchestra.run.smithi060.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T03:42:50.421 INFO:teuthology.orchestra.run.smithi060.stderr:done 2024-09-21T03:42:50.423 DEBUG:teuthology.orchestra.run.smithi060:> mktemp 2024-09-21T03:42:50.438 INFO:teuthology.orchestra.run.smithi060.stdout:/tmp/tmp.JCcnYmQy2B 2024-09-21T03:42:50.438 DEBUG:teuthology.orchestra.run.smithi060:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.JCcnYmQy2B 2024-09-21T03:42:50.509 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 0666 /tmp/tmp.JCcnYmQy2B 2024-09-21T03:42:50.652 DEBUG:teuthology.orchestra.remote:smithi060:/tmp/tmp.JCcnYmQy2B is 6KB 2024-09-21T03:42:50.671 DEBUG:teuthology.orchestra.run.smithi060:> rm -fr /tmp/tmp.JCcnYmQy2B 2024-09-21T03:42:50.686 DEBUG:teuthology.orchestra.run.smithi060:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T03:42:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:42:50.700 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-21T03:42:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T03:42:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T03:42:50.700 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T03:42:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T03:42:50.701 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:42:50.701 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-21T03:42:50.755 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T03:42:50.755 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T03:42:50.755 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T03:42:50.755 INFO:teuthology.orchestra.run.smithi060.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T03:42:50.757 DEBUG:teuthology.orchestra.run.smithi060:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T03:42:50.896 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:50.910 DEBUG:teuthology.orchestra.run.smithi060:> sudo shutdown -r now 2024-09-21T03:42:50.938 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:51.045 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:42:51.119 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:42:51.120 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:42:51.120 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T03:42:51.120 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T03:42:51.120 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T03:42:51.120 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-21T03:42:51.120 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi073.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T03:42:51.121 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:42:51.178 INFO:teuthology.orchestra.run.smithi073.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:42:51.179 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:42:51.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo rpm -qi grub2-tools 2024-09-21T03:42:51.211 INFO:teuthology.orchestra.run.smithi073.stdout:Name : grub2-tools 2024-09-21T03:42:51.211 INFO:teuthology.orchestra.run.smithi073.stdout:Epoch : 1 2024-09-21T03:42:51.211 INFO:teuthology.orchestra.run.smithi073.stdout:Version : 2.06 2024-09-21T03:42:51.211 INFO:teuthology.orchestra.run.smithi073.stdout:Release : 82.el9 2024-09-21T03:42:51.211 INFO:teuthology.orchestra.run.smithi073.stdout:Architecture: x86_64 2024-09-21T03:42:51.211 INFO:teuthology.orchestra.run.smithi073.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T03:42:51.211 INFO:teuthology.orchestra.run.smithi073.stdout:Group : Unspecified 2024-09-21T03:42:51.211 INFO:teuthology.orchestra.run.smithi073.stdout:Size : 8274670 2024-09-21T03:42:51.211 INFO:teuthology.orchestra.run.smithi073.stdout:License : GPLv3+ 2024-09-21T03:42:51.211 INFO:teuthology.orchestra.run.smithi073.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:Packager : builder@centos.org 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:Vendor : CentOS 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:Summary : Support tools for GRUB. 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:Description : 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout:hardware devices. 2024-09-21T03:42:51.212 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:42:51.213 INFO:teuthology.orchestra.run.smithi073.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T03:42:51.213 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T03:42:51.213 INFO:teuthology.task.kernel:Updating grub on smithi073 to boot 5.14.0-508.el9.x86_64 2024-09-21T03:42:51.214 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T03:42:51.262 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:51.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T03:42:51.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T03:42:51.263 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T03:42:51.942 INFO:teuthology.orchestra.run.smithi073.stderr:Generating grub configuration file ... 2024-09-21T03:42:52.114 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T03:42:52.114 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:42:52.115 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-09-21T03:42:52.115 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T03:42:52.115 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T03:42:52.115 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T03:42:52.115 INFO:teuthology.orchestra.run.smithi022.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T03:42:52.115 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:42:52.115 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-09-21T03:42:52.469 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:42:52.558 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:42:52.559 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:42:52.559 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T03:42:52.559 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T03:42:52.559 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T03:42:52.559 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-21T03:42:52.559 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T03:42:52.559 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T03:42:52.618 INFO:teuthology.orchestra.run.smithi022.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T03:42:52.618 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T03:42:52.618 DEBUG:teuthology.orchestra.run.smithi022:> sudo rpm -qi grub2-tools 2024-09-21T03:42:52.656 INFO:teuthology.orchestra.run.smithi022.stdout:Name : grub2-tools 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Epoch : 1 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Version : 2.06 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Release : 82.el9 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: x86_64 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Group : Unspecified 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Size : 8274670 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:License : GPLv3+ 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T03:42:52.657 INFO:teuthology.orchestra.run.smithi022.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout:Packager : builder@centos.org 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout:Vendor : CentOS 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout:Summary : Support tools for GRUB. 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout:Description : 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout:hardware devices. 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:42:52.658 INFO:teuthology.orchestra.run.smithi022.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T03:42:52.659 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T03:42:52.659 INFO:teuthology.task.kernel:Updating grub on smithi022 to boot 5.14.0-508.el9.x86_64 2024-09-21T03:42:52.659 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T03:42:53.307 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2024-09-21T03:42:53.356 INFO:teuthology.orchestra.run.smithi073.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T03:42:53.388 INFO:teuthology.orchestra.run.smithi073.stderr:done 2024-09-21T03:42:53.390 DEBUG:teuthology.orchestra.run.smithi073:> mktemp 2024-09-21T03:42:53.445 INFO:teuthology.orchestra.run.smithi073.stdout:/tmp/tmp.VgK5CGQlBf 2024-09-21T03:42:53.445 DEBUG:teuthology.orchestra.run.smithi073:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VgK5CGQlBf 2024-09-21T03:42:53.515 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 0666 /tmp/tmp.VgK5CGQlBf 2024-09-21T03:42:53.659 DEBUG:teuthology.orchestra.remote:smithi073:/tmp/tmp.VgK5CGQlBf is 6KB 2024-09-21T03:42:53.679 DEBUG:teuthology.orchestra.run.smithi073:> rm -fr /tmp/tmp.VgK5CGQlBf 2024-09-21T03:42:53.693 DEBUG:teuthology.orchestra.run.smithi073:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T03:42:53.755 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T03:42:53.755 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T03:42:53.755 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T03:42:53.755 INFO:teuthology.orchestra.run.smithi073.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T03:42:53.756 DEBUG:teuthology.orchestra.run.smithi073:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T03:42:53.918 DEBUG:teuthology.orchestra.run.smithi073:> sudo shutdown -r now 2024-09-21T03:42:54.589 INFO:teuthology.orchestra.run.smithi022.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T03:42:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:done 2024-09-21T03:42:54.624 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-09-21T03:42:54.639 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.VkwzMoD8DP 2024-09-21T03:42:54.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.VkwzMoD8DP 2024-09-21T03:42:54.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.VkwzMoD8DP 2024-09-21T03:42:54.842 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.VkwzMoD8DP is 6KB 2024-09-21T03:42:54.890 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.VkwzMoD8DP 2024-09-21T03:42:54.905 DEBUG:teuthology.orchestra.run.smithi022:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T03:42:54.968 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T03:42:54.968 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T03:42:54.968 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T03:42:54.968 INFO:teuthology.orchestra.run.smithi022.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T03:42:54.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T03:42:55.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2024-09-21T03:43:20.923 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-21T03:43:20.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T03:43:20.924 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:43:23.922 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-21T03:43:23.923 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-21T03:43:23.923 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:43:25.130 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-21T03:43:25.131 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-21T03:43:25.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:44:20.933 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T03:44:23.928 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T03:44:25.134 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T03:44:29.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T03:44:29.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:44:30.291 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-21T03:44:30.619 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T03:44:30.619 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T03:44:30.620 DEBUG:teuthology.orchestra.run.smithi060:> uname -r 2024-09-21T03:44:30.635 INFO:teuthology.orchestra.run.smithi060.stdout:5.14.0-508.el9.x86_64 2024-09-21T03:44:30.635 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T03:44:30.636 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T03:44:30.636 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T03:44:31.637 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-21T03:44:31.637 DEBUG:teuthology.orchestra.run.smithi060:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T03:44:31.800 INFO:teuthology.orchestra.run.smithi060.stdout:ttyS1 2024-09-21T03:44:31.829 DEBUG:teuthology.parallel:result is None 2024-09-21T03:44:32.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-21T03:44:32.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:44:34.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-21T03:44:34.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:44:34.526 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-09-21T03:44:34.982 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-21T03:44:34.982 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T03:44:34.983 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-09-21T03:44:34.998 INFO:teuthology.orchestra.run.smithi022.stdout:5.14.0-508.el9.x86_64 2024-09-21T03:44:34.998 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T03:44:34.999 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T03:44:34.999 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T03:44:35.999 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-21T03:44:35.999 DEBUG:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T03:44:36.060 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2024-09-21T03:44:36.078 DEBUG:teuthology.parallel:result is None 2024-09-21T03:44:36.622 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-21T03:44:37.001 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-21T03:44:37.001 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-21T03:44:37.001 DEBUG:teuthology.orchestra.run.smithi073:> uname -r 2024-09-21T03:44:37.015 INFO:teuthology.orchestra.run.smithi073.stdout:5.14.0-508.el9.x86_64 2024-09-21T03:44:37.015 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T03:44:37.016 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T03:44:37.016 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T03:44:38.016 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-21T03:44:38.017 DEBUG:teuthology.orchestra.run.smithi073:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T03:44:38.089 INFO:teuthology.orchestra.run.smithi073.stdout:ttyS1 2024-09-21T03:44:38.112 DEBUG:teuthology.parallel:result is None 2024-09-21T03:44:38.112 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T03:44:38.119 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T03:44:38.119 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:44:38.122 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:44:38.125 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T03:44:38.141 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T03:44:38.147 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T03:44:38.153 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T03:44:38.153 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:44:38.179 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:44:38.184 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T03:44:38.219 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T03:44:38.226 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T03:44:38.226 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:44:38.245 DEBUG:teuthology.orchestra.run.smithi060:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:44:38.255 DEBUG:teuthology.orchestra.run.smithi073:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T03:44:38.275 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:44:38.282 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:44:38.286 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:44:38.288 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:44:38.292 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:44:38.301 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T03:44:38.302 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T03:44:38.310 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T03:44:38.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:44:38.329 DEBUG:teuthology.orchestra.run.smithi060:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:44:38.345 DEBUG:teuthology.orchestra.run.smithi073:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T03:44:38.373 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T03:44:38.381 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T03:44:38.381 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:44:38.398 DEBUG:teuthology.orchestra.run.smithi060:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:44:38.415 DEBUG:teuthology.orchestra.run.smithi073:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T03:44:38.431 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:44:38.493 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:44:38.545 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:44:38.625 DEBUG:teuthology.orchestra.run.smithi022:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:44:38.673 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:44:38.674 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:44:38.740 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:44:38.784 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:44:38.846 DEBUG:teuthology.orchestra.run.smithi060:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:44:38.928 DEBUG:teuthology.orchestra.run.smithi060:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:44:38.976 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:44:38.976 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:44:39.044 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:44:39.084 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T03:44:39.135 DEBUG:teuthology.orchestra.run.smithi073:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:44:39.205 DEBUG:teuthology.orchestra.run.smithi073:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T03:44:39.250 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:44:39.250 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T03:44:39.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-09-21T03:44:39.316 DEBUG:teuthology.orchestra.run.smithi060:> sudo service rsyslog restart 2024-09-21T03:44:39.318 DEBUG:teuthology.orchestra.run.smithi073:> sudo service rsyslog restart 2024-09-21T03:44:39.359 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:44:39.371 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:44:39.406 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T03:44:39.875 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T03:44:39.883 INFO:teuthology.task.internal:Starting timer... 2024-09-21T03:44:39.883 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T03:44:39.904 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T03:44:39.920 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T03:44:39.920 DEBUG:teuthology.orchestra.run.smithi022:> sudo service auditd rotate 2024-09-21T03:44:39.979 INFO:teuthology.orchestra.run.smithi022.stdout:Rotating logs: 2024-09-21T03:44:39.981 DEBUG:teuthology.orchestra.run.smithi060:> sudo service auditd rotate 2024-09-21T03:44:40.046 INFO:teuthology.orchestra.run.smithi060.stdout:Rotating logs: 2024-09-21T03:44:40.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo service auditd rotate 2024-09-21T03:44:40.108 INFO:teuthology.orchestra.run.smithi073.stdout:Rotating logs: 2024-09-21T03:44:40.110 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T03:44:40.110 DEBUG:teuthology.orchestra.run.smithi022:> /usr/sbin/getenforce 2024-09-21T03:44:40.133 INFO:teuthology.orchestra.run.smithi022.stdout:Permissive 2024-09-21T03:44:40.134 DEBUG:teuthology.orchestra.run.smithi060:> /usr/sbin/getenforce 2024-09-21T03:44:40.154 INFO:teuthology.orchestra.run.smithi060.stdout:Permissive 2024-09-21T03:44:40.154 DEBUG:teuthology.orchestra.run.smithi073:> /usr/sbin/getenforce 2024-09-21T03:44:40.178 INFO:teuthology.orchestra.run.smithi073.stdout:Permissive 2024-09-21T03:44:40.178 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi022.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi060.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi073.front.sepia.ceph.com': 'permissive'} 2024-09-21T03:44:40.178 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:44:40.209 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:44:40.209 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:44:40.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:44:40.238 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T03:44:40.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T03:44:40.262 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T03:44:40.263 DEBUG:teuthology.orchestra.run.smithi022:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:44:40.297 DEBUG:teuthology.orchestra.run.smithi060:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:44:40.336 DEBUG:teuthology.orchestra.run.smithi073:> sudo /usr/sbin/setenforce permissive 2024-09-21T03:44:40.369 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T03:44:40.378 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-21T03:44:40.381 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-21T03:44:40.498 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T03:44:40.866 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T03:44:40.867 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi060.front.sepia.ceph.com,smithi073.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T03:48:33.204 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi060.front.sepia.ceph.com'), Remote(name='ubuntu@smithi073.front.sepia.ceph.com')] 2024-09-21T03:48:33.205 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-21T03:48:33.206 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:48:33.345 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-09-21T03:48:33.432 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-09-21T03:48:33.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T03:48:33.433 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi060.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:48:33.508 DEBUG:teuthology.orchestra.run.smithi060:> true 2024-09-21T03:48:33.595 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi060.front.sepia.ceph.com' 2024-09-21T03:48:33.595 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-21T03:48:33.596 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi073.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T03:48:33.671 DEBUG:teuthology.orchestra.run.smithi073:> true 2024-09-21T03:48:33.756 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi073.front.sepia.ceph.com' 2024-09-21T03:48:33.757 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T03:48:33.769 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T03:48:33.769 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:48:33.769 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:48:33.772 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:48:33.772 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:48:33.774 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T03:48:33.774 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T03:48:33.802 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:48:33.804 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:48:33.818 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:48:33.820 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:48:33.830 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T03:48:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: ntpd: command not found 2024-09-21T03:48:33.847 INFO:teuthology.orchestra.run.smithi060.stderr:sudo: ntpd: command not found 2024-09-21T03:48:33.847 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T03:48:33.857 INFO:teuthology.orchestra.run.smithi022.stdout:506 Cannot talk to daemon 2024-09-21T03:48:33.859 INFO:teuthology.orchestra.run.smithi060.stdout:506 Cannot talk to daemon 2024-09-21T03:48:33.872 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:48:33.874 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:48:33.877 INFO:teuthology.orchestra.run.smithi073.stderr:sudo: ntpd: command not found 2024-09-21T03:48:33.887 INFO:teuthology.orchestra.run.smithi022.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:48:33.889 INFO:teuthology.orchestra.run.smithi060.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:48:33.890 INFO:teuthology.orchestra.run.smithi073.stdout:506 Cannot talk to daemon 2024-09-21T03:48:33.908 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T03:48:33.925 INFO:teuthology.orchestra.run.smithi073.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T03:48:33.943 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:48:33.948 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:48:33.948 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-21T03:48:33.948 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:33.948 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:33.948 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:33.948 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:33.950 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:48:33.954 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:48:33.954 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-21T03:48:33.954 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:33.954 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:33.954 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:33.954 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:34.000 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-21T03:48:34.004 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T03:48:34.004 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-21T03:48:34.004 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:34.005 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:34.005 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:34.005 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T03:48:34.005 INFO:teuthology.run_tasks:Running task install... 2024-09-21T03:48:34.017 DEBUG:teuthology.task.install:project ceph 2024-09-21T03:48:34.017 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'}} 2024-09-21T03:48:34.017 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410'} 2024-09-21T03:48:34.018 INFO:teuthology.task.install:Using flavor: default 2024-09-21T03:48:34.023 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T03:48:34.023 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-21T03:48:34.023 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:48:34.024 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:48:34.025 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:48:34.026 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:48:34.027 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'tag': None, 'wait_for_package': False} 2024-09-21T03:48:34.027 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:48:34.176 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:48:34.176 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:48:34.179 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:48:34.180 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:48:34.194 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/ 2024-09-21T03:48:34.194 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5120.g18432218 2024-09-21T03:48:34.283 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:48:34.284 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:48:34.284 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:48:34.292 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:48:34.292 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:48:34.292 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:48:34.298 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T03:48:34.299 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:48:34.299 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T03:48:34.311 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:48:34.312 DEBUG:teuthology.orchestra.run.smithi022:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:48:34.321 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:48:34.321 DEBUG:teuthology.orchestra.run.smithi073:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:48:34.326 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-21T03:48:34.326 DEBUG:teuthology.orchestra.run.smithi060:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1843221895adccfb3b692060251dd6a0183bc410/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T03:48:34.378 DEBUG:teuthology.orchestra.run.smithi022:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:48:34.391 DEBUG:teuthology.orchestra.run.smithi073:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:48:34.393 DEBUG:teuthology.orchestra.run.smithi060:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T03:48:34.455 DEBUG:teuthology.orchestra.run.smithi022:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:48:34.470 DEBUG:teuthology.orchestra.run.smithi073:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:48:34.471 DEBUG:teuthology.orchestra.run.smithi060:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T03:48:34.522 INFO:teuthology.orchestra.run.smithi022.stdout:check_obsoletes = 1 2024-09-21T03:48:34.522 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum clean all 2024-09-21T03:48:34.537 INFO:teuthology.orchestra.run.smithi073.stdout:check_obsoletes = 1 2024-09-21T03:48:34.538 INFO:teuthology.orchestra.run.smithi060.stdout:check_obsoletes = 1 2024-09-21T03:48:34.538 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum clean all 2024-09-21T03:48:34.539 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum clean all 2024-09-21T03:48:34.760 INFO:teuthology.orchestra.run.smithi022.stdout:45 files removed 2024-09-21T03:48:34.777 INFO:teuthology.orchestra.run.smithi073.stdout:45 files removed 2024-09-21T03:48:34.778 INFO:teuthology.orchestra.run.smithi060.stdout:45 files removed 2024-09-21T03:48:34.787 DEBUG:teuthology.orchestra.run.smithi022:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:48:34.804 DEBUG:teuthology.orchestra.run.smithi073:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:48:34.805 DEBUG:teuthology.orchestra.run.smithi060:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-21T03:48:35.366 INFO:teuthology.orchestra.run.smithi073.stdout:ceph packages for x86_64 306 kB/s | 84 kB 00:00 2024-09-21T03:48:35.368 INFO:teuthology.orchestra.run.smithi022.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-21T03:48:35.379 INFO:teuthology.orchestra.run.smithi060.stdout:ceph packages for x86_64 310 kB/s | 84 kB 00:00 2024-09-21T03:48:35.658 INFO:teuthology.orchestra.run.smithi073.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T03:48:35.661 INFO:teuthology.orchestra.run.smithi022.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-21T03:48:35.679 INFO:teuthology.orchestra.run.smithi060.stdout:ceph noarch packages 95 kB/s | 24 kB 00:00 2024-09-21T03:48:35.925 INFO:teuthology.orchestra.run.smithi073.stdout:ceph source packages 8.3 kB/s | 1.9 kB 00:00 2024-09-21T03:48:35.936 INFO:teuthology.orchestra.run.smithi022.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-21T03:48:35.955 INFO:teuthology.orchestra.run.smithi060.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-21T03:48:36.717 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.3 MB 00:00 2024-09-21T03:48:36.853 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.3 MB 00:00 2024-09-21T03:48:37.822 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - BaseOS 4.5 MB/s | 8.3 MB 00:01 2024-09-21T03:48:38.681 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-21T03:48:39.890 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - AppStream 21 MB/s | 20 MB 00:00 2024-09-21T03:48:40.668 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - AppStream 7.1 MB/s | 20 MB 00:02 2024-09-21T03:48:42.999 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-21T03:48:44.877 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-21T03:48:45.300 INFO:teuthology.orchestra.run.smithi022.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 19 kB 00:00 2024-09-21T03:48:45.674 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-21T03:48:46.120 INFO:teuthology.orchestra.run.smithi022.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-21T03:48:46.911 INFO:teuthology.orchestra.run.smithi073.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 19 kB 00:00 2024-09-21T03:48:47.191 INFO:teuthology.orchestra.run.smithi060.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 19 kB 00:00 2024-09-21T03:48:48.182 INFO:teuthology.orchestra.run.smithi073.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-21T03:48:48.262 INFO:teuthology.orchestra.run.smithi060.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T03:48:51.852 INFO:teuthology.orchestra.run.smithi022.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-21T03:48:53.605 INFO:teuthology.orchestra.run.smithi073.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T03:48:53.960 INFO:teuthology.orchestra.run.smithi060.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-09-21T03:48:54.147 INFO:teuthology.orchestra.run.smithi022.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:48:54.147 INFO:teuthology.orchestra.run.smithi022.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:48:54.160 INFO:teuthology.orchestra.run.smithi022.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:48:54.160 INFO:teuthology.orchestra.run.smithi022.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:48:54.161 INFO:teuthology.orchestra.run.smithi022.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:48:54.162 INFO:teuthology.orchestra.run.smithi022.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:48:54.164 INFO:teuthology.orchestra.run.smithi022.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:48:54.166 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:48:54.167 INFO:teuthology.orchestra.run.smithi022.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:48:54.235 INFO:teuthology.orchestra.run.smithi022.stdout:Dependencies resolved. 2024-09-21T03:48:54.262 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2024-09-21T03:48:54.262 INFO:teuthology.orchestra.run.smithi022.stdout: Package Arch Version Repository Size 2024-09-21T03:48:54.262 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2024-09-21T03:48:54.262 INFO:teuthology.orchestra.run.smithi022.stdout:Installing: 2024-09-21T03:48:54.262 INFO:teuthology.orchestra.run.smithi022.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:48:54.262 INFO:teuthology.orchestra.run.smithi022.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:48:54.263 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:48:54.264 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrading: 2024-09-21T03:48:54.265 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout:Installing dependencies: 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:48:54.266 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:48:54.267 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:48:54.268 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:48:54.269 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:48:54.270 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:48:54.271 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:48:54.272 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:48:54.273 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:48:54.274 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:48:54.274 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:48:54.274 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:48:54.274 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:48:54.274 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:48:54.274 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:48:54.274 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:48:54.274 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:48:54.274 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout:Installing weak dependencies: 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:48:54.275 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction Summary 2024-09-21T03:48:54.276 INFO:teuthology.orchestra.run.smithi022.stdout:======================================================================================= 2024-09-21T03:48:54.276 INFO:teuthology.orchestra.run.smithi022.stdout:Install 149 Packages 2024-09-21T03:48:54.276 INFO:teuthology.orchestra.run.smithi022.stdout:Upgrade 8 Packages 2024-09-21T03:48:54.276 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:48:54.276 INFO:teuthology.orchestra.run.smithi022.stdout:Total download size: 228 M 2024-09-21T03:48:54.276 INFO:teuthology.orchestra.run.smithi022.stdout:Downloading Packages: 2024-09-21T03:48:54.545 INFO:teuthology.orchestra.run.smithi022.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 55 kB/s | 6.6 kB 00:00 2024-09-21T03:48:54.770 INFO:teuthology.orchestra.run.smithi022.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 3.8 MB/s | 873 kB 00:00 2024-09-21T03:48:54.862 INFO:teuthology.orchestra.run.smithi022.stdout:(3/157): ceph-base-19.3.0-5120.g18432218.el9.x8 13 MB/s | 5.5 MB 00:00 2024-09-21T03:48:54.887 INFO:teuthology.orchestra.run.smithi022.stdout:(4/157): ceph-immutable-object-cache-19.3.0-512 1.2 MB/s | 148 kB 00:00 2024-09-21T03:48:54.996 INFO:teuthology.orchestra.run.smithi022.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 17 MB/s | 2.3 MB 00:00 2024-09-21T03:48:55.121 INFO:teuthology.orchestra.run.smithi022.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 6.5 MB/s | 1.5 MB 00:00 2024-09-21T03:48:55.221 INFO:teuthology.orchestra.run.smithi022.stdout:(7/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 22 MB/s | 5.0 MB 00:00 2024-09-21T03:48:55.688 INFO:teuthology.orchestra.run.smithi022.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 22 MB/s | 10 MB 00:00 2024-09-21T03:48:55.775 INFO:teuthology.orchestra.run.smithi073.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:48:55.776 INFO:teuthology.orchestra.run.smithi073.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:48:55.789 INFO:teuthology.orchestra.run.smithi073.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:48:55.790 INFO:teuthology.orchestra.run.smithi073.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:48:55.791 INFO:teuthology.orchestra.run.smithi073.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:48:55.793 INFO:teuthology.orchestra.run.smithi073.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:48:55.794 INFO:teuthology.orchestra.run.smithi073.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:48:55.797 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:48:55.798 INFO:teuthology.orchestra.run.smithi073.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:48:55.861 INFO:teuthology.orchestra.run.smithi073.stdout:Dependencies resolved. 2024-09-21T03:48:55.878 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-21T03:48:55.879 INFO:teuthology.orchestra.run.smithi073.stdout: Package Arch Version Repository Size 2024-09-21T03:48:55.879 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-21T03:48:55.879 INFO:teuthology.orchestra.run.smithi073.stdout:Installing: 2024-09-21T03:48:55.879 INFO:teuthology.orchestra.run.smithi073.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:48:55.879 INFO:teuthology.orchestra.run.smithi073.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:48:55.879 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:48:55.879 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:48:55.879 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:48:55.880 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:48:55.881 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrading: 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:48:55.882 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout:Installing dependencies: 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:48:55.883 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:48:55.884 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:48:55.885 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:48:55.886 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:48:55.887 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:48:55.888 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:48:55.889 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:48:55.890 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:48:55.891 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:48:55.892 INFO:teuthology.orchestra.run.smithi073.stdout:Installing weak dependencies: 2024-09-21T03:48:55.892 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:48:55.892 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:48:55.892 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction Summary 2024-09-21T03:48:55.892 INFO:teuthology.orchestra.run.smithi073.stdout:======================================================================================= 2024-09-21T03:48:55.892 INFO:teuthology.orchestra.run.smithi073.stdout:Install 149 Packages 2024-09-21T03:48:55.892 INFO:teuthology.orchestra.run.smithi073.stdout:Upgrade 8 Packages 2024-09-21T03:48:55.892 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:48:55.893 INFO:teuthology.orchestra.run.smithi073.stdout:Total download size: 228 M 2024-09-21T03:48:55.893 INFO:teuthology.orchestra.run.smithi073.stdout:Downloading Packages: 2024-09-21T03:48:55.897 INFO:teuthology.orchestra.run.smithi022.stdout:(9/157): ceph-common-19.3.0-5120.g18432218.el9. 14 MB/s | 20 MB 00:01 2024-09-21T03:48:55.922 INFO:teuthology.orchestra.run.smithi022.stdout:(10/157): ceph-selinux-19.3.0-5120.g18432218.el 108 kB/s | 25 kB 00:00 2024-09-21T03:48:55.981 INFO:teuthology.orchestra.run.smithi022.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 3.8 MB/s | 226 kB 00:00 2024-09-21T03:48:56.031 INFO:teuthology.orchestra.run.smithi022.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T03:48:56.081 INFO:teuthology.orchestra.run.smithi022.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 638 kB/s | 32 kB 00:00 2024-09-21T03:48:56.165 INFO:teuthology.orchestra.run.smithi022.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 9.0 MB/s | 766 kB 00:00 2024-09-21T03:48:56.215 INFO:teuthology.orchestra.run.smithi060.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:48:56.216 INFO:teuthology.orchestra.run.smithi060.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-21T03:48:56.223 INFO:teuthology.orchestra.run.smithi022.stdout:(15/157): libcephsqlite-19.3.0-5120.g18432218.e 2.7 MB/s | 158 kB 00:00 2024-09-21T03:48:56.230 INFO:teuthology.orchestra.run.smithi060.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-21T03:48:56.231 INFO:teuthology.orchestra.run.smithi060.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-21T03:48:56.234 INFO:teuthology.orchestra.run.smithi060.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-21T03:48:56.234 INFO:teuthology.orchestra.run.smithi060.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-21T03:48:56.235 INFO:teuthology.orchestra.run.smithi060.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-21T03:48:56.238 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-21T03:48:56.239 INFO:teuthology.orchestra.run.smithi060.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-21T03:48:56.291 INFO:teuthology.orchestra.run.smithi022.stdout:(16/157): librados-devel-19.3.0-5120.g18432218. 1.9 MB/s | 127 kB 00:00 2024-09-21T03:48:56.306 INFO:teuthology.orchestra.run.smithi060.stdout:Dependencies resolved. 2024-09-21T03:48:56.323 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-09-21T03:48:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: Package Arch Version Repository Size 2024-09-21T03:48:56.323 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-09-21T03:48:56.323 INFO:teuthology.orchestra.run.smithi060.stdout:Installing: 2024-09-21T03:48:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-21T03:48:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: ceph x86_64 2:19.3.0-5120.g18432218.el9 ceph 6.6 k 2024-09-21T03:48:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.5 M 2024-09-21T03:48:56.323 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 873 k 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr x86_64 2:19.3.0-5120.g18432218.el9 ceph 1.5 M 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 154 k 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 14 M 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 7.4 M 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 49 k 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 10 M 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test x86_64 2:19.3.0-5120.g18432218.el9 ceph 40 M 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 285 k 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 784 k 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 226 k 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell x86_64 2:19.3.0-5120.g18432218.el9 ceph 27 k 2024-09-21T03:48:56.324 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 18 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 32 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 766 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel x86_64 2:19.3.0-5120.g18432218.el9 ceph 127 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs x86_64 2:19.3.0-5120.g18432218.el9 ceph 161 k 2024-09-21T03:48:56.325 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados x86_64 2:19.3.0-5120.g18432218.el9 ceph 321 k 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 307 k 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw x86_64 2:19.3.0-5120.g18432218.el9 ceph 99 k 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse x86_64 2:19.3.0-5120.g18432218.el9 ceph 86 k 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.1 M 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd x86_64 2:19.3.0-5120.g18432218.el9 ceph 170 k 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrading: 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-21T03:48:56.326 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: librados2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.4 M 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 3.2 M 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout:Installing dependencies: 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 20 M 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 34 k 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds x86_64 2:19.3.0-5120.g18432218.el9 ceph 2.3 M 2024-09-21T03:48:56.327 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 292 k 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.0 M 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd x86_64 2:19.3.0-5120.g18432218.el9 ceph 18 M 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5120.g18432218.el9 ceph-noarch 16 k 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux x86_64 2:19.3.0-5120.g18432218.el9 ceph 25 k 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T03:48:56.328 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite x86_64 2:19.3.0-5120.g18432218.el9 ceph 158 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1 x86_64 2:19.3.0-5120.g18432218.el9 ceph 507 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2 x86_64 2:19.3.0-5120.g18432218.el9 ceph 5.3 M 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T03:48:56.329 INFO:teuthology.orchestra.run.smithi060.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T03:48:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T03:48:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T03:48:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T03:48:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T03:48:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T03:48:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-21T03:48:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T03:48:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T03:48:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T03:48:56.330 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse x86_64 2:19.3.0-5120.g18432218.el9 ceph 45 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common x86_64 2:19.3.0-5120.g18432218.el9 ceph 148 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-21T03:48:56.331 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T03:48:56.332 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T03:48:56.333 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T03:48:56.334 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T03:48:56.335 INFO:teuthology.orchestra.run.smithi060.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout:Installing weak dependencies: 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction Summary 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout:======================================================================================= 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout:Install 149 Packages 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout:Upgrade 8 Packages 2024-09-21T03:48:56.336 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:48:56.337 INFO:teuthology.orchestra.run.smithi060.stdout:Total download size: 228 M 2024-09-21T03:48:56.337 INFO:teuthology.orchestra.run.smithi060.stdout:Downloading Packages: 2024-09-21T03:48:56.374 INFO:teuthology.orchestra.run.smithi022.stdout:(17/157): libradosstriper1-19.3.0-5120.g1843221 6.0 MB/s | 507 kB 00:00 2024-09-21T03:48:56.431 INFO:teuthology.orchestra.run.smithi073.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 42 kB/s | 6.6 kB 00:00 2024-09-21T03:48:56.642 INFO:teuthology.orchestra.run.smithi022.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 20 MB/s | 5.3 MB 00:00 2024-09-21T03:48:56.700 INFO:teuthology.orchestra.run.smithi022.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 777 kB/s | 45 kB 00:00 2024-09-21T03:48:56.778 INFO:teuthology.orchestra.run.smithi060.stdout:(1/157): ceph-19.3.0-5120.g18432218.el9.x86_64. 43 kB/s | 6.6 kB 00:00 2024-09-21T03:48:56.823 INFO:teuthology.orchestra.run.smithi073.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 2.2 MB/s | 873 kB 00:00 2024-09-21T03:48:56.899 INFO:teuthology.orchestra.run.smithi073.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.9 MB/s | 148 kB 00:00 2024-09-21T03:48:56.900 INFO:teuthology.orchestra.run.smithi022.stdout:(20/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 10 MB/s | 18 MB 00:01 2024-09-21T03:48:56.925 INFO:teuthology.orchestra.run.smithi022.stdout:(21/157): python3-ceph-common-19.3.0-5120.g1843 659 kB/s | 148 kB 00:00 2024-09-21T03:48:56.984 INFO:teuthology.orchestra.run.smithi022.stdout:(22/157): python3-cephfs-19.3.0-5120.g18432218. 1.9 MB/s | 161 kB 00:00 2024-09-21T03:48:56.986 INFO:teuthology.orchestra.run.smithi060.stdout:(2/157): ceph-fuse-19.3.0-5120.g18432218.el9.x8 4.1 MB/s | 873 kB 00:00 2024-09-21T03:48:57.009 INFO:teuthology.orchestra.run.smithi022.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 3.7 MB/s | 321 kB 00:00 2024-09-21T03:48:57.060 INFO:teuthology.orchestra.run.smithi022.stdout:(24/157): python3-rbd-19.3.0-5120.g18432218.el9 4.0 MB/s | 307 kB 00:00 2024-09-21T03:48:57.087 INFO:teuthology.orchestra.run.smithi060.stdout:(3/157): ceph-immutable-object-cache-19.3.0-512 1.5 MB/s | 148 kB 00:00 2024-09-21T03:48:57.110 INFO:teuthology.orchestra.run.smithi022.stdout:(25/157): python3-rgw-19.3.0-5120.g18432218.el9 992 kB/s | 99 kB 00:00 2024-09-21T03:48:57.143 INFO:teuthology.orchestra.run.smithi022.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.0 MB/s | 86 kB 00:00 2024-09-21T03:48:57.153 INFO:teuthology.orchestra.run.smithi060.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 10 MB/s | 5.5 MB 00:00 2024-09-21T03:48:57.244 INFO:teuthology.orchestra.run.smithi022.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-21T03:48:57.302 INFO:teuthology.orchestra.run.smithi022.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 587 kB/s | 34 kB 00:00 2024-09-21T03:48:57.369 INFO:teuthology.orchestra.run.smithi022.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.3 MB/s | 154 kB 00:00 2024-09-21T03:48:57.396 INFO:teuthology.orchestra.run.smithi060.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 7.4 MB/s | 2.3 MB 00:00 2024-09-21T03:48:57.420 INFO:teuthology.orchestra.run.smithi022.stdout:(30/157): rbd-mirror-19.3.0-5120.g18432218.el9. 10 MB/s | 3.1 MB 00:00 2024-09-21T03:48:57.871 INFO:teuthology.orchestra.run.smithi060.stdout:(6/157): ceph-mon-19.3.0-5120.g18432218.el9.x86 10 MB/s | 5.0 MB 00:00 2024-09-21T03:48:57.982 INFO:teuthology.orchestra.run.smithi073.stdout:(4/157): ceph-base-19.3.0-5120.g18432218.el9.x8 3.2 MB/s | 5.5 MB 00:01 2024-09-21T03:48:57.995 INFO:teuthology.orchestra.run.smithi022.stdout:(31/157): ceph-test-19.3.0-5120.g18432218.el9.x 19 MB/s | 40 MB 00:02 2024-09-21T03:48:58.024 INFO:teuthology.orchestra.run.smithi073.stdout:(5/157): ceph-mds-19.3.0-5120.g18432218.el9.x86 2.0 MB/s | 2.3 MB 00:01 2024-09-21T03:48:58.070 INFO:teuthology.orchestra.run.smithi022.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 3.8 MB/s | 292 kB 00:00 2024-09-21T03:48:58.146 INFO:teuthology.orchestra.run.smithi022.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 657 kB/s | 49 kB 00:00 2024-09-21T03:48:58.221 INFO:teuthology.orchestra.run.smithi022.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 220 kB/s | 16 kB 00:00 2024-09-21T03:48:58.241 INFO:teuthology.orchestra.run.smithi073.stdout:(6/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 5.9 MB/s | 1.5 MB 00:00 2024-09-21T03:48:58.296 INFO:teuthology.orchestra.run.smithi022.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 3.7 MB/s | 285 kB 00:00 2024-09-21T03:48:58.430 INFO:teuthology.orchestra.run.smithi022.stdout:(36/157): ceph-mgr-diskprediction-local-19.3.0- 7.3 MB/s | 7.4 MB 00:01 2024-09-21T03:48:58.463 INFO:teuthology.orchestra.run.smithi022.stdout:(37/157): cephadm-19.3.0-5120.g18432218.el9.noa 4.6 MB/s | 784 kB 00:00 2024-09-21T03:48:58.497 INFO:teuthology.orchestra.run.smithi022.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 276 kB/s | 18 kB 00:00 2024-09-21T03:48:58.754 INFO:teuthology.orchestra.run.smithi060.stdout:(7/157): ceph-common-19.3.0-5120.g18432218.el9. 9.4 MB/s | 20 MB 00:02 2024-09-21T03:48:58.781 INFO:teuthology.orchestra.run.smithi022.stdout:(39/157): ceph-mgr-dashboard-19.3.0-5120.g18432 10 MB/s | 14 MB 00:01 2024-09-21T03:48:58.996 INFO:teuthology.orchestra.run.smithi060.stdout:(8/157): ceph-mgr-19.3.0-5120.g18432218.el9.x86 842 kB/s | 1.5 MB 00:01 2024-09-21T03:48:59.063 INFO:teuthology.orchestra.run.smithi060.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 379 kB/s | 25 kB 00:00 2024-09-21T03:48:59.214 INFO:teuthology.orchestra.run.smithi022.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 106 kB/s | 80 kB 00:00 2024-09-21T03:48:59.322 INFO:teuthology.orchestra.run.smithi060.stdout:(10/157): ceph-osd-19.3.0-5120.g18432218.el9.x8 12 MB/s | 18 MB 00:01 2024-09-21T03:48:59.333 INFO:teuthology.orchestra.run.smithi073.stdout:(7/157): ceph-osd-19.3.0-5120.g18432218.el9.x86 16 MB/s | 18 MB 00:01 2024-09-21T03:48:59.372 INFO:teuthology.orchestra.run.smithi060.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 4.4 MB/s | 226 kB 00:00 2024-09-21T03:48:59.422 INFO:teuthology.orchestra.run.smithi060.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 541 kB/s | 27 kB 00:00 2024-09-21T03:48:59.464 INFO:teuthology.orchestra.run.smithi022.stdout:(41/157): libgfortran-11.5.0-2.el9.x86_64.rpm 828 kB/s | 801 kB 00:00 2024-09-21T03:48:59.506 INFO:teuthology.orchestra.run.smithi060.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 380 kB/s | 32 kB 00:00 2024-09-21T03:48:59.523 INFO:teuthology.orchestra.run.smithi022.stdout:(42/157): libquadmath-11.5.0-2.el9.x86_64.rpm 263 kB/s | 191 kB 00:00 2024-09-21T03:48:59.639 INFO:teuthology.orchestra.run.smithi060.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 5.6 MB/s | 766 kB 00:00 2024-09-21T03:48:59.741 INFO:teuthology.orchestra.run.smithi073.stdout:(8/157): ceph-radosgw-19.3.0-5120.g18432218.el9 26 MB/s | 10 MB 00:00 2024-09-21T03:48:59.765 INFO:teuthology.orchestra.run.smithi060.stdout:(15/157): ceph-radosgw-19.3.0-5120.g18432218.el 10 MB/s | 10 MB 00:01 2024-09-21T03:48:59.775 INFO:teuthology.orchestra.run.smithi073.stdout:(9/157): ceph-selinux-19.3.0-5120.g18432218.el9 758 kB/s | 25 kB 00:00 2024-09-21T03:48:59.790 INFO:teuthology.orchestra.run.smithi060.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 1.0 MB/s | 158 kB 00:00 2024-09-21T03:48:59.815 INFO:teuthology.orchestra.run.smithi060.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 2.5 MB/s | 127 kB 00:00 2024-09-21T03:48:59.857 INFO:teuthology.orchestra.run.smithi060.stdout:(18/157): libradosstriper1-19.3.0-5120.g1843221 7.4 MB/s | 507 kB 00:00 2024-09-21T03:48:59.933 INFO:teuthology.orchestra.run.smithi060.stdout:(19/157): python3-ceph-argparse-19.3.0-5120.g18 601 kB/s | 45 kB 00:00 2024-09-21T03:49:00.000 INFO:teuthology.orchestra.run.smithi073.stdout:(10/157): ceph-mon-19.3.0-5120.g18432218.el9.x8 2.5 MB/s | 5.0 MB 00:01 2024-09-21T03:49:00.008 INFO:teuthology.orchestra.run.smithi060.stdout:(20/157): python3-ceph-common-19.3.0-5120.g1843 1.9 MB/s | 148 kB 00:00 2024-09-21T03:49:00.056 INFO:teuthology.orchestra.run.smithi022.stdout:(43/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 301 kB/s | 253 kB 00:00 2024-09-21T03:49:00.091 INFO:teuthology.orchestra.run.smithi060.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 1.9 MB/s | 161 kB 00:00 2024-09-21T03:49:00.126 INFO:teuthology.orchestra.run.smithi073.stdout:(11/157): cephfs-mirror-19.3.0-5120.g18432218.e 1.8 MB/s | 226 kB 00:00 2024-09-21T03:49:00.183 INFO:teuthology.orchestra.run.smithi060.stdout:(22/157): python3-rados-19.3.0-5120.g18432218.e 3.4 MB/s | 321 kB 00:00 2024-09-21T03:49:00.198 INFO:teuthology.orchestra.run.smithi022.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 158 kB/s | 106 kB 00:00 2024-09-21T03:49:00.217 INFO:teuthology.orchestra.run.smithi073.stdout:(12/157): cephfs-shell-19.3.0-5120.g18432218.el 295 kB/s | 27 kB 00:00 2024-09-21T03:49:00.284 INFO:teuthology.orchestra.run.smithi060.stdout:(23/157): python3-rbd-19.3.0-5120.g18432218.el9 3.0 MB/s | 307 kB 00:00 2024-09-21T03:49:00.309 INFO:teuthology.orchestra.run.smithi073.stdout:(13/157): libcephfs-devel-19.3.0-5120.g18432218 346 kB/s | 32 kB 00:00 2024-09-21T03:49:00.384 INFO:teuthology.orchestra.run.smithi060.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 994 kB/s | 99 kB 00:00 2024-09-21T03:49:00.485 INFO:teuthology.orchestra.run.smithi060.stdout:(25/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 862 kB/s | 86 kB 00:00 2024-09-21T03:49:00.507 INFO:teuthology.orchestra.run.smithi022.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 1.2 MB/s | 1.2 MB 00:01 2024-09-21T03:49:00.560 INFO:teuthology.orchestra.run.smithi060.stdout:(26/157): librgw2-19.3.0-5120.g18432218.el9.x86 7.1 MB/s | 5.3 MB 00:00 2024-09-21T03:49:00.757 INFO:teuthology.orchestra.run.smithi022.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 193 kB/s | 135 kB 00:00 2024-09-21T03:49:00.776 INFO:teuthology.orchestra.run.smithi073.stdout:(14/157): libcephfs2-19.3.0-5120.g18432218.el9. 1.6 MB/s | 766 kB 00:00 2024-09-21T03:49:00.860 INFO:teuthology.orchestra.run.smithi060.stdout:(27/157): rbd-mirror-19.3.0-5120.g18432218.el9. 8.3 MB/s | 3.1 MB 00:00 2024-09-21T03:49:00.899 INFO:teuthology.orchestra.run.smithi022.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 178 kB/s | 125 kB 00:00 2024-09-21T03:49:00.902 INFO:teuthology.orchestra.run.smithi060.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 828 kB/s | 34 kB 00:00 2024-09-21T03:49:00.944 INFO:teuthology.orchestra.run.smithi060.stdout:(29/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 443 kB/s | 170 kB 00:00 2024-09-21T03:49:00.969 INFO:teuthology.orchestra.run.smithi060.stdout:(30/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 2.3 MB/s | 154 kB 00:00 2024-09-21T03:49:01.143 INFO:teuthology.orchestra.run.smithi073.stdout:(15/157): ceph-test-19.3.0-5120.g18432218.el9.x 29 MB/s | 40 MB 00:01 2024-09-21T03:49:01.168 INFO:teuthology.orchestra.run.smithi073.stdout:(16/157): libcephsqlite-19.3.0-5120.g18432218.e 404 kB/s | 158 kB 00:00 2024-09-21T03:49:01.185 INFO:teuthology.orchestra.run.smithi073.stdout:(17/157): librados-devel-19.3.0-5120.g18432218. 3.0 MB/s | 127 kB 00:00 2024-09-21T03:49:01.249 INFO:teuthology.orchestra.run.smithi022.stdout:(48/157): python3-urllib3-1.26.5-6.el9.noarch.r 290 kB/s | 215 kB 00:00 2024-09-21T03:49:01.444 INFO:teuthology.orchestra.run.smithi073.stdout:(18/157): librgw2-19.3.0-5120.g18432218.el9.x86 20 MB/s | 5.3 MB 00:00 2024-09-21T03:49:01.469 INFO:teuthology.orchestra.run.smithi073.stdout:(19/157): libradosstriper1-19.3.0-5120.g1843221 1.6 MB/s | 507 kB 00:00 2024-09-21T03:49:01.495 INFO:teuthology.orchestra.run.smithi073.stdout:(20/157): python3-ceph-argparse-19.3.0-5120.g18 894 kB/s | 45 kB 00:00 2024-09-21T03:49:01.545 INFO:teuthology.orchestra.run.smithi073.stdout:(21/157): python3-cephfs-19.3.0-5120.g18432218. 3.1 MB/s | 161 kB 00:00 2024-09-21T03:49:01.570 INFO:teuthology.orchestra.run.smithi073.stdout:(22/157): python3-ceph-common-19.3.0-5120.g1843 1.4 MB/s | 148 kB 00:00 2024-09-21T03:49:01.575 INFO:teuthology.orchestra.run.smithi022.stdout:(49/157): automake-1.16.2-8.el9.noarch.rpm 844 kB/s | 689 kB 00:00 2024-09-21T03:49:01.578 INFO:teuthology.orchestra.run.smithi060.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 12 MB/s | 7.4 MB 00:00 2024-09-21T03:49:01.604 INFO:teuthology.orchestra.run.smithi073.stdout:(23/157): python3-rados-19.3.0-5120.g18432218.e 5.4 MB/s | 321 kB 00:00 2024-09-21T03:49:01.636 INFO:teuthology.orchestra.run.smithi060.stdout:(32/157): ceph-mgr-modules-core-19.3.0-5120.g18 4.9 MB/s | 292 kB 00:00 2024-09-21T03:49:01.662 INFO:teuthology.orchestra.run.smithi073.stdout:(24/157): python3-rgw-19.3.0-5120.g18432218.el9 1.7 MB/s | 99 kB 00:00 2024-09-21T03:49:01.683 INFO:teuthology.orchestra.run.smithi022.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 200 kB/s | 22 kB 00:00 2024-09-21T03:49:01.687 INFO:teuthology.orchestra.run.smithi060.stdout:(33/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 990 kB/s | 49 kB 00:00 2024-09-21T03:49:01.688 INFO:teuthology.orchestra.run.smithi073.stdout:(25/157): python3-rbd-19.3.0-5120.g18432218.el9 2.6 MB/s | 307 kB 00:00 2024-09-21T03:49:01.713 INFO:teuthology.orchestra.run.smithi073.stdout:(26/157): rbd-fuse-19.3.0-5120.g18432218.el9.x8 1.7 MB/s | 86 kB 00:00 2024-09-21T03:49:01.725 INFO:teuthology.orchestra.run.smithi022.stdout:(51/157): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-09-21T03:49:01.745 INFO:teuthology.orchestra.run.smithi060.stdout:(34/157): ceph-prometheus-alerts-19.3.0-5120.g1 283 kB/s | 16 kB 00:00 2024-09-21T03:49:01.750 INFO:teuthology.orchestra.run.smithi022.stdout:(52/157): boost-program-options-1.75.0-8.el9.x8 213 kB/s | 107 kB 00:00 2024-09-21T03:49:01.763 INFO:teuthology.orchestra.run.smithi073.stdout:(27/157): rbd-nbd-19.3.0-5120.g18432218.el9.x86 3.3 MB/s | 170 kB 00:00 2024-09-21T03:49:01.797 INFO:teuthology.orchestra.run.smithi073.stdout:(28/157): ceph-grafana-dashboards-19.3.0-5120.g 1.0 MB/s | 34 kB 00:00 2024-09-21T03:49:01.801 INFO:teuthology.orchestra.run.smithi022.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.6 MB/s | 313 kB 00:00 2024-09-21T03:49:01.804 INFO:teuthology.orchestra.run.smithi060.stdout:(35/157): ceph-volume-19.3.0-5120.g18432218.el9 4.8 MB/s | 285 kB 00:00 2024-09-21T03:49:01.826 INFO:teuthology.orchestra.run.smithi022.stdout:(54/157): flexiblas-3.0.4-8.el9.x86_64.rpm 325 kB/s | 33 kB 00:00 2024-09-21T03:49:01.847 INFO:teuthology.orchestra.run.smithi073.stdout:(29/157): ceph-mgr-cephadm-19.3.0-5120.g1843221 3.0 MB/s | 154 kB 00:00 2024-09-21T03:49:01.901 INFO:teuthology.orchestra.run.smithi022.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 182 kB/s | 18 kB 00:00 2024-09-21T03:49:01.904 INFO:teuthology.orchestra.run.smithi060.stdout:(36/157): cephadm-19.3.0-5120.g18432218.el9.noa 7.7 MB/s | 784 kB 00:00 2024-09-21T03:49:01.927 INFO:teuthology.orchestra.run.smithi022.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 111 kB/s | 11 kB 00:00 2024-09-21T03:49:01.996 INFO:teuthology.orchestra.run.smithi060.stdout:(37/157): cephfs-top-19.3.0-5120.g18432218.el9. 201 kB/s | 18 kB 00:00 2024-09-21T03:49:02.010 INFO:teuthology.orchestra.run.smithi022.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T03:49:02.044 INFO:teuthology.orchestra.run.smithi022.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.3 MB/s | 160 kB 00:00 2024-09-21T03:49:02.080 INFO:teuthology.orchestra.run.smithi060.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 956 kB/s | 80 kB 00:00 2024-09-21T03:49:02.119 INFO:teuthology.orchestra.run.smithi022.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 416 kB/s | 45 kB 00:00 2024-09-21T03:49:02.170 INFO:teuthology.orchestra.run.smithi022.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-09-21T03:49:02.196 INFO:teuthology.orchestra.run.smithi060.stdout:(39/157): libgfortran-11.5.0-2.el9.x86_64.rpm 6.7 MB/s | 801 kB 00:00 2024-09-21T03:49:02.237 INFO:teuthology.orchestra.run.smithi022.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-21T03:49:02.238 INFO:teuthology.orchestra.run.smithi060.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T03:49:02.279 INFO:teuthology.orchestra.run.smithi022.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 225 kB/s | 24 kB 00:00 2024-09-21T03:49:02.280 INFO:teuthology.orchestra.run.smithi060.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.9 MB/s | 253 kB 00:00 2024-09-21T03:49:02.345 INFO:teuthology.orchestra.run.smithi022.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 437 kB/s | 47 kB 00:00 2024-09-21T03:49:02.381 INFO:teuthology.orchestra.run.smithi073.stdout:(30/157): ceph-mgr-dashboard-19.3.0-5120.g18432 27 MB/s | 14 MB 00:00 2024-09-21T03:49:02.396 INFO:teuthology.orchestra.run.smithi022.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T03:49:02.454 INFO:teuthology.orchestra.run.smithi022.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-21T03:49:02.455 INFO:teuthology.orchestra.run.smithi060.stdout:(42/157): ceph-mgr-dashboard-19.3.0-5120.g18432 9.4 MB/s | 14 MB 00:01 2024-09-21T03:49:02.529 INFO:teuthology.orchestra.run.smithi022.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 288 kB/s | 38 kB 00:00 2024-09-21T03:49:02.564 INFO:teuthology.orchestra.run.smithi060.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 986 kB/s | 106 kB 00:00 2024-09-21T03:49:02.631 INFO:teuthology.orchestra.run.smithi060.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 2.0 MB/s | 135 kB 00:00 2024-09-21T03:49:02.648 INFO:teuthology.orchestra.run.smithi073.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 28 MB/s | 7.4 MB 00:00 2024-09-21T03:49:02.665 INFO:teuthology.orchestra.run.smithi060.stdout:(45/157): python3-cryptography-36.0.1-4.el9.x86 3.2 MB/s | 1.2 MB 00:00 2024-09-21T03:49:02.671 INFO:teuthology.orchestra.run.smithi022.stdout:(67/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.2 MB/s | 3.0 MB 00:00 2024-09-21T03:49:02.690 INFO:teuthology.orchestra.run.smithi060.stdout:(46/157): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-09-21T03:49:02.757 INFO:teuthology.orchestra.run.smithi060.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-09-21T03:49:02.814 INFO:teuthology.orchestra.run.smithi022.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-21T03:49:02.832 INFO:teuthology.orchestra.run.smithi073.stdout:(32/157): ceph-common-19.3.0-5120.g18432218.el9 3.0 MB/s | 20 MB 00:06 2024-09-21T03:49:02.857 INFO:teuthology.orchestra.run.smithi073.stdout:(33/157): ceph-mgr-modules-core-19.3.0-5120.g18 1.4 MB/s | 292 kB 00:00 2024-09-21T03:49:02.882 INFO:teuthology.orchestra.run.smithi073.stdout:(34/157): ceph-mgr-rook-19.3.0-5120.g18432218.e 987 kB/s | 49 kB 00:00 2024-09-21T03:49:02.907 INFO:teuthology.orchestra.run.smithi073.stdout:(35/157): ceph-prometheus-alerts-19.3.0-5120.g1 329 kB/s | 16 kB 00:00 2024-09-21T03:49:02.947 INFO:teuthology.orchestra.run.smithi022.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 6.7 MB/s | 910 kB 00:00 2024-09-21T03:49:02.966 INFO:teuthology.orchestra.run.smithi073.stdout:(36/157): rbd-mirror-19.3.0-5120.g18432218.el9. 2.4 MB/s | 3.1 MB 00:01 2024-09-21T03:49:02.991 INFO:teuthology.orchestra.run.smithi073.stdout:(37/157): ceph-volume-19.3.0-5120.g18432218.el9 2.6 MB/s | 285 kB 00:00 2024-09-21T03:49:03.017 INFO:teuthology.orchestra.run.smithi073.stdout:(38/157): cephfs-top-19.3.0-5120.g18432218.el9. 366 kB/s | 18 kB 00:00 2024-09-21T03:49:03.050 INFO:teuthology.orchestra.run.smithi073.stdout:(39/157): cephadm-19.3.0-5120.g18432218.el9.noa 5.4 MB/s | 784 kB 00:00 2024-09-21T03:49:03.134 INFO:teuthology.orchestra.run.smithi073.stdout:(40/157): fuse-2.9.9-16.el9.x86_64.rpm 562 kB/s | 80 kB 00:00 2024-09-21T03:49:03.166 INFO:teuthology.orchestra.run.smithi060.stdout:(48/157): ceph-test-19.3.0-5120.g18432218.el9.x 9.7 MB/s | 40 MB 00:04 2024-09-21T03:49:03.167 INFO:teuthology.orchestra.run.smithi073.stdout:(41/157): libquadmath-11.5.0-2.el9.x86_64.rpm 1.6 MB/s | 191 kB 00:00 2024-09-21T03:49:03.209 INFO:teuthology.orchestra.run.smithi073.stdout:(42/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.3 MB/s | 253 kB 00:00 2024-09-21T03:49:03.239 INFO:teuthology.orchestra.run.smithi022.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 471 kB/s | 137 kB 00:00 2024-09-21T03:49:03.251 INFO:teuthology.orchestra.run.smithi073.stdout:(43/157): libgfortran-11.5.0-2.el9.x86_64.rpm 3.3 MB/s | 801 kB 00:00 2024-09-21T03:49:03.276 INFO:teuthology.orchestra.run.smithi073.stdout:(44/157): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-09-21T03:49:03.319 INFO:teuthology.orchestra.run.smithi073.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-21T03:49:03.344 INFO:teuthology.orchestra.run.smithi073.stdout:(46/157): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-21T03:49:03.369 INFO:teuthology.orchestra.run.smithi073.stdout:(47/157): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-21T03:49:03.405 INFO:teuthology.orchestra.run.smithi073.stdout:(48/157): python3-cryptography-36.0.1-4.el9.x86 5.2 MB/s | 1.2 MB 00:00 2024-09-21T03:49:03.555 INFO:teuthology.orchestra.run.smithi073.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 714 kB/s | 107 kB 00:00 2024-09-21T03:49:03.580 INFO:teuthology.orchestra.run.smithi073.stdout:(50/157): automake-1.16.2-8.el9.noarch.rpm 2.8 MB/s | 689 kB 00:00 2024-09-21T03:49:03.597 INFO:teuthology.orchestra.run.smithi073.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 517 kB/s | 22 kB 00:00 2024-09-21T03:49:03.624 INFO:teuthology.orchestra.run.smithi060.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 233 kB/s | 107 kB 00:00 2024-09-21T03:49:03.631 INFO:teuthology.orchestra.run.smithi073.stdout:(52/157): bison-3.7.4-5.el9.x86_64.rpm 3.5 MB/s | 943 kB 00:00 2024-09-21T03:49:03.648 INFO:teuthology.orchestra.run.smithi073.stdout:(53/157): flexiblas-3.0.4-8.el9.x86_64.rpm 652 kB/s | 33 kB 00:00 2024-09-21T03:49:03.673 INFO:teuthology.orchestra.run.smithi073.stdout:(54/157): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-21T03:49:03.690 INFO:teuthology.orchestra.run.smithi073.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 434 kB/s | 18 kB 00:00 2024-09-21T03:49:03.715 INFO:teuthology.orchestra.run.smithi073.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 265 kB/s | 11 kB 00:00 2024-09-21T03:49:03.733 INFO:teuthology.orchestra.run.smithi060.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 201 kB/s | 22 kB 00:00 2024-09-21T03:49:03.774 INFO:teuthology.orchestra.run.smithi073.stdout:(57/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 21 MB/s | 3.0 MB 00:00 2024-09-21T03:49:03.799 INFO:teuthology.orchestra.run.smithi073.stdout:(58/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T03:49:03.824 INFO:teuthology.orchestra.run.smithi073.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 903 kB/s | 45 kB 00:00 2024-09-21T03:49:03.850 INFO:teuthology.orchestra.run.smithi073.stdout:(60/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-09-21T03:49:03.875 INFO:teuthology.orchestra.run.smithi073.stdout:(61/157): libtool-2.4.6-46.el9.x86_64.rpm 11 MB/s | 581 kB 00:00 2024-09-21T03:49:03.903 INFO:teuthology.orchestra.run.smithi060.stdout:(51/157): automake-1.16.2-8.el9.noarch.rpm 570 kB/s | 689 kB 00:01 2024-09-21T03:49:03.903 INFO:teuthology.orchestra.run.smithi073.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 487 kB/s | 24 kB 00:00 2024-09-21T03:49:03.926 INFO:teuthology.orchestra.run.smithi073.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-21T03:49:03.951 INFO:teuthology.orchestra.run.smithi073.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-21T03:49:03.985 INFO:teuthology.orchestra.run.smithi073.stdout:(65/157): librdkafka-1.6.1-102.el9.x86_64.rpm 3.5 MB/s | 662 kB 00:00 2024-09-21T03:49:04.008 INFO:teuthology.orchestra.run.smithi060.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-21T03:49:04.010 INFO:teuthology.orchestra.run.smithi073.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 657 kB/s | 38 kB 00:00 2024-09-21T03:49:04.033 INFO:teuthology.orchestra.run.smithi060.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 1.0 MB/s | 313 kB 00:00 2024-09-21T03:49:04.035 INFO:teuthology.orchestra.run.smithi073.stdout:(67/157): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-21T03:49:04.067 INFO:teuthology.orchestra.run.smithi060.stdout:(54/157): bison-3.7.4-5.el9.x86_64.rpm 720 kB/s | 943 kB 00:01 2024-09-21T03:49:04.110 INFO:teuthology.orchestra.run.smithi073.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-21T03:49:04.142 INFO:teuthology.orchestra.run.smithi060.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 167 kB/s | 18 kB 00:00 2024-09-21T03:49:04.176 INFO:teuthology.orchestra.run.smithi060.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 102 kB/s | 11 kB 00:00 2024-09-21T03:49:04.194 INFO:teuthology.orchestra.run.smithi073.stdout:(69/157): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-21T03:49:04.251 INFO:teuthology.orchestra.run.smithi060.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 1.5 MB/s | 171 kB 00:00 2024-09-21T03:49:04.261 INFO:teuthology.orchestra.run.smithi073.stdout:(70/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-21T03:49:04.285 INFO:teuthology.orchestra.run.smithi060.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.4 MB/s | 160 kB 00:00 2024-09-21T03:49:04.286 INFO:teuthology.orchestra.run.smithi073.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-21T03:49:04.320 INFO:teuthology.orchestra.run.smithi073.stdout:(72/157): postgresql-contrib-13.16-1.el9.x86_64 4.3 MB/s | 910 kB 00:00 2024-09-21T03:49:04.353 INFO:teuthology.orchestra.run.smithi073.stdout:(73/157): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-09-21T03:49:04.360 INFO:teuthology.orchestra.run.smithi060.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 417 kB/s | 45 kB 00:00 2024-09-21T03:49:04.379 INFO:teuthology.orchestra.run.smithi073.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-21T03:49:04.421 INFO:teuthology.orchestra.run.smithi073.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-21T03:49:04.496 INFO:teuthology.orchestra.run.smithi073.stdout:(76/157): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-21T03:49:04.519 INFO:teuthology.orchestra.run.smithi060.stdout:(60/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.9 MB/s | 3.0 MB 00:00 2024-09-21T03:49:04.521 INFO:teuthology.orchestra.run.smithi073.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-09-21T03:49:04.555 INFO:teuthology.orchestra.run.smithi073.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-21T03:49:04.577 INFO:teuthology.orchestra.run.smithi060.stdout:(61/157): librdkafka-1.6.1-102.el9.x86_64.rpm 2.2 MB/s | 662 kB 00:00 2024-09-21T03:49:04.588 INFO:teuthology.orchestra.run.smithi073.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 381 kB/s | 26 kB 00:00 2024-09-21T03:49:04.614 INFO:teuthology.orchestra.run.smithi073.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 326 kB/s | 19 kB 00:00 2024-09-21T03:49:04.628 INFO:teuthology.orchestra.run.smithi060.stdout:(62/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 226 kB/s | 24 kB 00:00 2024-09-21T03:49:04.639 INFO:teuthology.orchestra.run.smithi073.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-21T03:49:04.653 INFO:teuthology.orchestra.run.smithi060.stdout:(63/157): libtool-2.4.6-46.el9.x86_64.rpm 1.9 MB/s | 581 kB 00:00 2024-09-21T03:49:04.664 INFO:teuthology.orchestra.run.smithi073.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 691 kB/s | 35 kB 00:00 2024-09-21T03:49:04.687 INFO:teuthology.orchestra.run.smithi060.stdout:(64/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-21T03:49:04.745 INFO:teuthology.orchestra.run.smithi060.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T03:49:04.748 INFO:teuthology.orchestra.run.smithi073.stdout:(83/157): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-21T03:49:04.770 INFO:teuthology.orchestra.run.smithi060.stdout:(66/157): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-09-21T03:49:04.773 INFO:teuthology.orchestra.run.smithi073.stdout:(84/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-21T03:49:04.796 INFO:teuthology.orchestra.run.smithi060.stdout:(67/157): openblas-0.3.26-2.el9.x86_64.rpm 354 kB/s | 38 kB 00:00 2024-09-21T03:49:04.861 INFO:teuthology.orchestra.run.smithi073.stdout:(85/157): python3-oauthlib-3.1.1-5.el9.noarch.r 1.9 MB/s | 222 kB 00:00 2024-09-21T03:49:04.890 INFO:teuthology.orchestra.run.smithi073.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 661 kB/s | 77 kB 00:00 2024-09-21T03:49:04.916 INFO:teuthology.orchestra.run.smithi073.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 777 kB/s | 42 kB 00:00 2024-09-21T03:49:04.966 INFO:teuthology.orchestra.run.smithi073.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 269 kB 00:00 2024-09-21T03:49:04.991 INFO:teuthology.orchestra.run.smithi073.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T03:49:05.017 INFO:teuthology.orchestra.run.smithi073.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-09-21T03:49:05.021 INFO:teuthology.orchestra.run.smithi060.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 7.0 MB/s | 1.6 MB 00:00 2024-09-21T03:49:05.033 INFO:teuthology.orchestra.run.smithi073.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T03:49:05.050 INFO:teuthology.orchestra.run.smithi073.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.6 MB/s | 54 kB 00:00 2024-09-21T03:49:05.126 INFO:teuthology.orchestra.run.smithi073.stdout:(93/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-09-21T03:49:05.143 INFO:teuthology.orchestra.run.smithi073.stdout:(94/157): python3-toml-0.10.2-6.el9.noarch.rpm 453 kB/s | 42 kB 00:00 2024-09-21T03:49:05.146 INFO:teuthology.orchestra.run.smithi060.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 7.1 MB/s | 910 kB 00:00 2024-09-21T03:49:05.147 INFO:teuthology.orchestra.run.smithi022.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.7 MB/s | 4.4 MB 00:02 2024-09-21T03:49:05.168 INFO:teuthology.orchestra.run.smithi073.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-21T03:49:05.193 INFO:teuthology.orchestra.run.smithi073.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-21T03:49:05.218 INFO:teuthology.orchestra.run.smithi073.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 713 kB/s | 36 kB 00:00 2024-09-21T03:49:05.244 INFO:teuthology.orchestra.run.smithi073.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-21T03:49:05.263 INFO:teuthology.orchestra.run.smithi060.stdout:(70/157): postgresql-private-libs-13.16-1.el9.x 1.2 MB/s | 137 kB 00:00 2024-09-21T03:49:05.269 INFO:teuthology.orchestra.run.smithi073.stdout:(99/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-21T03:49:05.294 INFO:teuthology.orchestra.run.smithi073.stdout:(100/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-21T03:49:05.319 INFO:teuthology.orchestra.run.smithi073.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-21T03:49:05.345 INFO:teuthology.orchestra.run.smithi073.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T03:49:05.370 INFO:teuthology.orchestra.run.smithi073.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 892 kB/s | 45 kB 00:00 2024-09-21T03:49:05.404 INFO:teuthology.orchestra.run.smithi073.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 381 kB/s | 22 kB 00:00 2024-09-21T03:49:05.454 INFO:teuthology.orchestra.run.smithi073.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-21T03:49:05.488 INFO:teuthology.orchestra.run.smithi073.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T03:49:05.513 INFO:teuthology.orchestra.run.smithi073.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 780 kB/s | 19 kB 00:00 2024-09-21T03:49:05.547 INFO:teuthology.orchestra.run.smithi073.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.8 MB/s | 863 kB 00:00 2024-09-21T03:49:05.589 INFO:teuthology.orchestra.run.smithi073.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 629 kB/s | 26 kB 00:00 2024-09-21T03:49:05.622 INFO:teuthology.orchestra.run.smithi073.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-21T03:49:05.648 INFO:teuthology.orchestra.run.smithi073.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-21T03:49:05.665 INFO:teuthology.orchestra.run.smithi073.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 8.8 MB/s | 151 kB 00:00 2024-09-21T03:49:05.707 INFO:teuthology.orchestra.run.smithi073.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-21T03:49:05.874 INFO:teuthology.orchestra.run.smithi073.stdout:(114/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 19 MB/s | 16 MB 00:00 2024-09-21T03:49:05.907 INFO:teuthology.orchestra.run.smithi073.stdout:(115/157): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-09-21T03:49:05.924 INFO:teuthology.orchestra.run.smithi073.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 2.1 MB/s | 32 kB 00:00 2024-09-21T03:49:05.941 INFO:teuthology.orchestra.run.smithi073.stdout:(117/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 650 kB/s | 43 kB 00:00 2024-09-21T03:49:05.958 INFO:teuthology.orchestra.run.smithi073.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 420 kB/s | 14 kB 00:00 2024-09-21T03:49:05.992 INFO:teuthology.orchestra.run.smithi073.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T03:49:06.017 INFO:teuthology.orchestra.run.smithi073.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-21T03:49:06.051 INFO:teuthology.orchestra.run.smithi073.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 6.5 MB/s | 220 kB 00:00 2024-09-21T03:49:06.076 INFO:teuthology.orchestra.run.smithi073.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.5 MB/s | 303 kB 00:00 2024-09-21T03:49:06.135 INFO:teuthology.orchestra.run.smithi073.stdout:(123/157): libarrow-9.0.0-11.el9.x86_64.rpm 7.1 MB/s | 4.4 MB 00:00 2024-09-21T03:49:06.160 INFO:teuthology.orchestra.run.smithi073.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 429 kB/s | 11 kB 00:00 2024-09-21T03:49:06.185 INFO:teuthology.orchestra.run.smithi073.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 713 kB/s | 18 kB 00:00 2024-09-21T03:49:06.219 INFO:teuthology.orchestra.run.smithi073.stdout:(126/157): python3-grpcio-tools-1.46.7-10.el9.x 1.0 MB/s | 144 kB 00:00 2024-09-21T03:49:06.244 INFO:teuthology.orchestra.run.smithi073.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 395 kB/s | 23 kB 00:00 2024-09-21T03:49:06.269 INFO:teuthology.orchestra.run.smithi073.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-21T03:49:06.295 INFO:teuthology.orchestra.run.smithi073.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-21T03:49:06.320 INFO:teuthology.orchestra.run.smithi073.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T03:49:06.331 INFO:teuthology.orchestra.run.smithi022.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 1.3 MB/s | 4.9 MB 00:03 2024-09-21T03:49:06.345 INFO:teuthology.orchestra.run.smithi073.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T03:49:06.370 INFO:teuthology.orchestra.run.smithi073.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T03:49:06.404 INFO:teuthology.orchestra.run.smithi073.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-21T03:49:06.429 INFO:teuthology.orchestra.run.smithi073.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-21T03:49:06.463 INFO:teuthology.orchestra.run.smithi073.stdout:(135/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-21T03:49:06.489 INFO:teuthology.orchestra.run.smithi073.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T03:49:06.514 INFO:teuthology.orchestra.run.smithi073.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-21T03:49:06.522 INFO:teuthology.orchestra.run.smithi022.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 457 kB/s | 87 kB 00:00 2024-09-21T03:49:06.539 INFO:teuthology.orchestra.run.smithi073.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 609 kB/s | 31 kB 00:00 2024-09-21T03:49:06.564 INFO:teuthology.orchestra.run.smithi073.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T03:49:06.590 INFO:teuthology.orchestra.run.smithi073.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-21T03:49:06.615 INFO:teuthology.orchestra.run.smithi073.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-21T03:49:06.640 INFO:teuthology.orchestra.run.smithi073.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-21T03:49:06.665 INFO:teuthology.orchestra.run.smithi073.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T03:49:06.706 INFO:teuthology.orchestra.run.smithi022.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 663 kB/s | 1.0 MB 00:01 2024-09-21T03:49:06.724 INFO:teuthology.orchestra.run.smithi073.stdout:(144/157): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2024-09-21T03:49:06.749 INFO:teuthology.orchestra.run.smithi073.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2024-09-21T03:49:06.774 INFO:teuthology.orchestra.run.smithi073.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 801 kB/s | 20 kB 00:00 2024-09-21T03:49:06.791 INFO:teuthology.orchestra.run.smithi073.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-21T03:49:06.815 INFO:teuthology.orchestra.run.smithi022.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 565 kB/s | 61 kB 00:00 2024-09-21T03:49:06.817 INFO:teuthology.orchestra.run.smithi073.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-21T03:49:06.875 INFO:teuthology.orchestra.run.smithi073.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T03:49:07.092 INFO:teuthology.orchestra.run.smithi073.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 12 MB/s | 3.2 MB 00:00 2024-09-21T03:49:07.247 INFO:teuthology.orchestra.run.smithi022.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 566 kB/s | 245 kB 00:00 2024-09-21T03:49:07.392 INFO:teuthology.orchestra.run.smithi073.stdout:(151/157): librados2-19.3.0-5120.g18432218.el9. 5.6 MB/s | 3.4 MB 00:00 2024-09-21T03:49:07.493 INFO:teuthology.orchestra.run.smithi073.stdout:(152/157): NetworkManager-1.51.0-1.el9.x86_64.r 3.8 MB/s | 2.3 MB 00:00 2024-09-21T03:49:07.518 INFO:teuthology.orchestra.run.smithi073.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 327 kB/s | 41 kB 00:00 2024-09-21T03:49:07.585 INFO:teuthology.orchestra.run.smithi073.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.7 MB/s | 249 kB 00:00 2024-09-21T03:49:07.624 INFO:teuthology.orchestra.run.smithi022.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 660 kB/s | 248 kB 00:00 2024-09-21T03:49:07.635 INFO:teuthology.orchestra.run.smithi073.stdout:(155/157): NetworkManager-libnm-1.51.0-1.el9.x8 3.3 MB/s | 1.8 MB 00:00 2024-09-21T03:49:07.741 INFO:teuthology.orchestra.run.smithi022.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 220 kB/s | 26 kB 00:00 2024-09-21T03:49:07.819 INFO:teuthology.orchestra.run.smithi073.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 4.5 MB/s | 1.4 MB 00:00 2024-09-21T03:49:07.858 INFO:teuthology.orchestra.run.smithi022.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 164 kB/s | 19 kB 00:00 2024-09-21T03:49:08.055 INFO:teuthology.orchestra.run.smithi060.stdout:(71/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 1.3 MB/s | 4.4 MB 00:03 2024-09-21T03:49:08.158 INFO:teuthology.orchestra.run.smithi022.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 574 kB/s | 172 kB 00:00 2024-09-21T03:49:08.260 INFO:teuthology.orchestra.run.smithi073.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 2.4 MB 00:00 2024-09-21T03:49:08.267 INFO:teuthology.orchestra.run.smithi073.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:49:08.267 INFO:teuthology.orchestra.run.smithi073.stdout:Total 18 MB/s | 228 MB 00:12 2024-09-21T03:49:08.275 INFO:teuthology.orchestra.run.smithi022.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 297 kB/s | 35 kB 00:00 2024-09-21T03:49:09.330 INFO:teuthology.orchestra.run.smithi060.stdout:(72/157): openblas-openmp-0.3.26-2.el9.x86_64.r 1.1 MB/s | 4.9 MB 00:04 2024-09-21T03:49:09.517 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction check 2024-09-21T03:49:09.522 INFO:teuthology.orchestra.run.smithi060.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 457 kB/s | 87 kB 00:00 2024-09-21T03:49:09.597 INFO:teuthology.orchestra.run.smithi060.stdout:(74/157): protobuf-3.14.0-13.el9.x86_64.rpm 670 kB/s | 1.0 MB 00:01 2024-09-21T03:49:09.669 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction check succeeded. 2024-09-21T03:49:09.670 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction test 2024-09-21T03:49:09.714 INFO:teuthology.orchestra.run.smithi060.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 524 kB/s | 61 kB 00:00 2024-09-21T03:49:10.089 INFO:teuthology.orchestra.run.smithi060.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 653 kB/s | 245 kB 00:00 2024-09-21T03:49:10.456 INFO:teuthology.orchestra.run.smithi060.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 677 kB/s | 248 kB 00:00 2024-09-21T03:49:10.582 INFO:teuthology.orchestra.run.smithi060.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 205 kB/s | 26 kB 00:00 2024-09-21T03:49:10.690 INFO:teuthology.orchestra.run.smithi060.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 177 kB/s | 19 kB 00:00 2024-09-21T03:49:10.974 INFO:teuthology.orchestra.run.smithi060.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 608 kB/s | 172 kB 00:00 2024-09-21T03:49:11.082 INFO:teuthology.orchestra.run.smithi060.stdout:(81/157): python3-markupsafe-1.1.1-12.el9.x86_6 321 kB/s | 35 kB 00:00 2024-09-21T03:49:11.316 INFO:teuthology.orchestra.run.smithi060.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 977 kB/s | 5.8 MB 00:06 2024-09-21T03:49:11.691 INFO:teuthology.orchestra.run.smithi060.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 668 kB/s | 250 kB 00:00 2024-09-21T03:49:11.783 INFO:teuthology.orchestra.run.smithi022.stdout:(82/157): postgresql-server-13.16-1.el9.x86_64. 692 kB/s | 5.8 MB 00:08 2024-09-21T03:49:11.856 INFO:teuthology.orchestra.run.smithi073.stdout:Transaction test succeeded. 2024-09-21T03:49:11.857 INFO:teuthology.orchestra.run.smithi073.stdout:Running transaction 2024-09-21T03:49:12.075 INFO:teuthology.orchestra.run.smithi060.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 579 kB/s | 222 kB 00:00 2024-09-21T03:49:12.159 INFO:teuthology.orchestra.run.smithi022.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 668 kB/s | 250 kB 00:00 2024-09-21T03:49:12.267 INFO:teuthology.orchestra.run.smithi060.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 403 kB/s | 77 kB 00:00 2024-09-21T03:49:12.375 INFO:teuthology.orchestra.run.smithi060.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 390 kB/s | 42 kB 00:00 2024-09-21T03:49:12.542 INFO:teuthology.orchestra.run.smithi022.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 580 kB/s | 222 kB 00:00 2024-09-21T03:49:12.742 INFO:teuthology.orchestra.run.smithi022.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 386 kB/s | 77 kB 00:00 2024-09-21T03:49:12.851 INFO:teuthology.orchestra.run.smithi022.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 389 kB/s | 42 kB 00:00 2024-09-21T03:49:12.934 INFO:teuthology.orchestra.run.smithi060.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 482 kB/s | 269 kB 00:00 2024-09-21T03:49:13.218 INFO:teuthology.orchestra.run.smithi060.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 560 kB/s | 159 kB 00:00 2024-09-21T03:49:13.318 INFO:teuthology.orchestra.run.smithi022.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 577 kB/s | 269 kB 00:00 2024-09-21T03:49:13.610 INFO:teuthology.orchestra.run.smithi022.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 544 kB/s | 159 kB 00:00 2024-09-21T03:49:13.676 INFO:teuthology.orchestra.run.smithi060.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 609 kB/s | 279 kB 00:00 2024-09-21T03:49:13.793 INFO:teuthology.orchestra.run.smithi060.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 438 kB/s | 51 kB 00:00 2024-09-21T03:49:13.902 INFO:teuthology.orchestra.run.smithi060.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 495 kB/s | 54 kB 00:00 2024-09-21T03:49:14.077 INFO:teuthology.orchestra.run.smithi022.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 598 kB/s | 279 kB 00:00 2024-09-21T03:49:14.185 INFO:teuthology.orchestra.run.smithi022.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 471 kB/s | 51 kB 00:00 2024-09-21T03:49:14.294 INFO:teuthology.orchestra.run.smithi022.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 496 kB/s | 54 kB 00:00 2024-09-21T03:49:15.153 INFO:teuthology.orchestra.run.smithi022.stdout:(92/157): python3-babel-2.9.1-2.el9.noarch.rpm 708 kB/s | 6.0 MB 00:08 2024-09-21T03:49:15.261 INFO:teuthology.orchestra.run.smithi022.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-09-21T03:49:15.370 INFO:teuthology.orchestra.run.smithi022.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 407 kB/s | 44 kB 00:00 2024-09-21T03:49:15.704 INFO:teuthology.orchestra.run.smithi022.stdout:(95/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 703 kB/s | 5.1 MB 00:07 2024-09-21T03:49:15.745 INFO:teuthology.orchestra.run.smithi022.stdout:(96/157): qatlib-24.02.0-1.el9.x86_64.rpm 588 kB/s | 221 kB 00:00 2024-09-21T03:49:15.812 INFO:teuthology.orchestra.run.smithi022.stdout:(97/157): qatlib-service-24.02.0-1.el9.x86_64.r 331 kB/s | 36 kB 00:00 2024-09-21T03:49:15.854 INFO:teuthology.orchestra.run.smithi022.stdout:(98/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 436 kB/s | 47 kB 00:00 2024-09-21T03:49:15.963 INFO:teuthology.orchestra.run.smithi022.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-21T03:49:16.163 INFO:teuthology.orchestra.run.smithi022.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 479 kB/s | 96 kB 00:00 2024-09-21T03:49:16.288 INFO:teuthology.orchestra.run.smithi022.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 639 kB/s | 304 kB 00:00 2024-09-21T03:49:16.364 INFO:teuthology.orchestra.run.smithi022.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 318 kB/s | 64 kB 00:00 2024-09-21T03:49:16.397 INFO:teuthology.orchestra.run.smithi022.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 412 kB/s | 45 kB 00:00 2024-09-21T03:49:16.447 INFO:teuthology.orchestra.run.smithi022.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-21T03:49:16.506 INFO:teuthology.orchestra.run.smithi022.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-21T03:49:16.539 INFO:teuthology.orchestra.run.smithi022.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-21T03:49:16.565 INFO:teuthology.orchestra.run.smithi022.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 774 kB/s | 19 kB 00:00 2024-09-21T03:49:16.632 INFO:teuthology.orchestra.run.smithi022.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 3.6 MB/s | 863 kB 00:00 2024-09-21T03:49:16.707 INFO:teuthology.orchestra.run.smithi022.stdout:(109/157): libarrow-9.0.0-11.el9.x86_64.rpm 31 MB/s | 4.4 MB 00:00 2024-09-21T03:49:16.732 INFO:teuthology.orchestra.run.smithi022.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T03:49:16.758 INFO:teuthology.orchestra.run.smithi022.stdout:(111/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 207 kB/s | 26 kB 00:00 2024-09-21T03:49:16.783 INFO:teuthology.orchestra.run.smithi022.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T03:49:16.808 INFO:teuthology.orchestra.run.smithi022.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-21T03:49:16.842 INFO:teuthology.orchestra.run.smithi022.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-21T03:49:16.868 INFO:teuthology.orchestra.run.smithi022.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-21T03:49:16.893 INFO:teuthology.orchestra.run.smithi022.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-21T03:49:16.918 INFO:teuthology.orchestra.run.smithi022.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-21T03:49:16.943 INFO:teuthology.orchestra.run.smithi022.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T03:49:16.969 INFO:teuthology.orchestra.run.smithi022.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-21T03:49:16.994 INFO:teuthology.orchestra.run.smithi022.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T03:49:17.019 INFO:teuthology.orchestra.run.smithi022.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T03:49:17.053 INFO:teuthology.orchestra.run.smithi022.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 3.7 MB/s | 220 kB 00:00 2024-09-21T03:49:17.086 INFO:teuthology.orchestra.run.smithi022.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 4.3 MB/s | 144 kB 00:00 2024-09-21T03:49:17.112 INFO:teuthology.orchestra.run.smithi022.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-21T03:49:17.128 INFO:teuthology.orchestra.run.smithi022.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-21T03:49:17.145 INFO:teuthology.orchestra.run.smithi022.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 1.4 MB/s | 23 kB 00:00 2024-09-21T03:49:17.171 INFO:teuthology.orchestra.run.smithi022.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-09-21T03:49:17.188 INFO:teuthology.orchestra.run.smithi022.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 1.2 MB/s | 20 kB 00:00 2024-09-21T03:49:17.238 INFO:teuthology.orchestra.run.smithi022.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 9.3 MB/s | 2.0 MB 00:00 2024-09-21T03:49:17.255 INFO:teuthology.orchestra.run.smithi022.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 2.7 MB/s | 46 kB 00:00 2024-09-21T03:49:17.280 INFO:teuthology.orchestra.run.smithi022.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T03:49:17.306 INFO:teuthology.orchestra.run.smithi022.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T03:49:17.339 INFO:teuthology.orchestra.run.smithi022.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-21T03:49:17.364 INFO:teuthology.orchestra.run.smithi022.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 663 kB/s | 16 kB 00:00 2024-09-21T03:49:17.390 INFO:teuthology.orchestra.run.smithi022.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-21T03:49:17.415 INFO:teuthology.orchestra.run.smithi022.stdout:(136/157): python3-pecan-1.4.2-3.el9.noarch.rpm 2.4 MB/s | 272 kB 00:00 2024-09-21T03:49:17.511 INFO:teuthology.orchestra.run.smithi022.stdout:(137/157): python3-pyperclip-1.8.2-2.el9.noarch 234 kB/s | 28 kB 00:00 2024-09-21T03:49:17.541 INFO:teuthology.orchestra.run.smithi022.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 246 kB/s | 31 kB 00:00 2024-09-21T03:49:17.566 INFO:teuthology.orchestra.run.smithi022.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T03:49:17.591 INFO:teuthology.orchestra.run.smithi022.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 2.3 MB/s | 188 kB 00:00 2024-09-21T03:49:17.616 INFO:teuthology.orchestra.run.smithi022.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-21T03:49:17.642 INFO:teuthology.orchestra.run.smithi022.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T03:49:17.667 INFO:teuthology.orchestra.run.smithi022.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T03:49:17.701 INFO:teuthology.orchestra.run.smithi022.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-21T03:49:17.726 INFO:teuthology.orchestra.run.smithi022.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 804 kB/s | 20 kB 00:00 2024-09-21T03:49:17.752 INFO:teuthology.orchestra.run.smithi022.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-09-21T03:49:17.777 INFO:teuthology.orchestra.run.smithi022.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T03:49:17.836 INFO:teuthology.orchestra.run.smithi022.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T03:49:18.053 INFO:teuthology.orchestra.run.smithi022.stdout:(149/157): librados2-19.3.0-5120.g18432218.el9. 12 MB/s | 3.4 MB 00:00 2024-09-21T03:49:18.128 INFO:teuthology.orchestra.run.smithi022.stdout:(150/157): librbd1-19.3.0-5120.g18432218.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-21T03:49:18.202 INFO:teuthology.orchestra.run.smithi060.stdout:(92/157): python3-babel-2.9.1-2.el9.noarch.rpm 703 kB/s | 6.0 MB 00:08 2024-09-21T03:49:18.227 INFO:teuthology.orchestra.run.smithi073.stdout: Preparing : 1/1 2024-09-21T03:49:18.310 INFO:teuthology.orchestra.run.smithi060.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 385 kB/s | 42 kB 00:00 2024-09-21T03:49:18.331 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:49:18.444 INFO:teuthology.orchestra.run.smithi060.stdout:(94/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 709 kB/s | 5.1 MB 00:07 2024-09-21T03:49:18.463 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:49:18.469 INFO:teuthology.orchestra.run.smithi060.stdout:(95/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 278 kB/s | 44 kB 00:00 2024-09-21T03:49:18.578 INFO:teuthology.orchestra.run.smithi060.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 332 kB/s | 36 kB 00:00 2024-09-21T03:49:18.647 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:49:18.684 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:49:18.686 INFO:teuthology.orchestra.run.smithi060.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 438 kB/s | 47 kB 00:00 2024-09-21T03:49:18.709 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:49:18.766 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:49:18.811 INFO:teuthology.orchestra.run.smithi060.stdout:(98/157): qatlib-24.02.0-1.el9.x86_64.rpm 601 kB/s | 221 kB 00:00 2024-09-21T03:49:18.920 INFO:teuthology.orchestra.run.smithi060.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 534 kB/s | 58 kB 00:00 2024-09-21T03:49:19.111 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:49:19.120 INFO:teuthology.orchestra.run.smithi060.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 479 kB/s | 96 kB 00:00 2024-09-21T03:49:19.153 INFO:teuthology.orchestra.run.smithi022.stdout:(151/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.1 MB/s | 2.3 MB 00:01 2024-09-21T03:49:19.154 INFO:teuthology.orchestra.run.smithi060.stdout:(101/157): socat-1.7.4.1-6.el9.x86_64.rpm 650 kB/s | 304 kB 00:00 2024-09-21T03:49:19.196 INFO:teuthology.orchestra.run.smithi022.stdout:(152/157): NetworkManager-libnm-1.51.0-1.el9.x8 1.7 MB/s | 1.8 MB 00:01 2024-09-21T03:49:19.235 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:49:19.305 INFO:teuthology.orchestra.run.smithi060.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 414 kB/s | 45 kB 00:00 2024-09-21T03:49:19.321 INFO:teuthology.orchestra.run.smithi060.stdout:(103/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 317 kB/s | 64 kB 00:00 2024-09-21T03:49:19.345 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:49:19.346 INFO:teuthology.orchestra.run.smithi060.stdout:(104/157): lua-devel-5.4.4-4.el9.x86_64.rpm 267 kB/s | 22 kB 00:00 2024-09-21T03:49:19.369 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:49:19.413 INFO:teuthology.orchestra.run.smithi060.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-09-21T03:49:19.461 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:49:19.463 INFO:teuthology.orchestra.run.smithi060.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 6.0 MB/s | 308 kB 00:00 2024-09-21T03:49:19.489 INFO:teuthology.orchestra.run.smithi060.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 781 kB/s | 19 kB 00:00 2024-09-21T03:49:19.498 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:49:19.529 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:49:19.531 INFO:teuthology.orchestra.run.smithi060.stdout:(108/157): protobuf-compiler-3.14.0-13.el9.x86_ 4.0 MB/s | 863 kB 00:00 2024-09-21T03:49:19.573 INFO:teuthology.orchestra.run.smithi060.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 626 kB/s | 26 kB 00:00 2024-09-21T03:49:19.598 INFO:teuthology.orchestra.run.smithi060.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-21T03:49:19.631 INFO:teuthology.orchestra.run.smithi060.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-21T03:49:19.665 INFO:teuthology.orchestra.run.smithi060.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-21T03:49:19.698 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:49:19.732 INFO:teuthology.orchestra.run.smithi060.stdout:(113/157): libarrow-9.0.0-11.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-21T03:49:19.747 INFO:teuthology.orchestra.run.smithi022.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 69 kB/s | 41 kB 00:00 2024-09-21T03:49:19.763 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:49:19.766 INFO:teuthology.orchestra.run.smithi060.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-21T03:49:19.783 INFO:teuthology.orchestra.run.smithi060.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.5 MB/s | 43 kB 00:00 2024-09-21T03:49:19.791 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:49:19.808 INFO:teuthology.orchestra.run.smithi060.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 7.1 MB/s | 548 kB 00:00 2024-09-21T03:49:19.833 INFO:teuthology.orchestra.run.smithi060.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 640 kB/s | 32 kB 00:00 2024-09-21T03:49:19.859 INFO:teuthology.orchestra.run.smithi060.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-21T03:49:19.884 INFO:teuthology.orchestra.run.smithi060.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 3.4 MB/s | 172 kB 00:00 2024-09-21T03:49:19.901 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:49:19.909 INFO:teuthology.orchestra.run.smithi060.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-09-21T03:49:19.925 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:49:19.934 INFO:teuthology.orchestra.run.smithi060.stdout:(121/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-09-21T03:49:19.955 INFO:teuthology.orchestra.run.smithi022.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 328 kB/s | 249 kB 00:00 2024-09-21T03:49:19.959 INFO:teuthology.orchestra.run.smithi060.stdout:(122/157): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-21T03:49:19.985 INFO:teuthology.orchestra.run.smithi060.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-09-21T03:49:19.992 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:49:20.010 INFO:teuthology.orchestra.run.smithi060.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 432 kB/s | 11 kB 00:00 2024-09-21T03:49:20.018 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:49:20.035 INFO:teuthology.orchestra.run.smithi060.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 711 kB/s | 18 kB 00:00 2024-09-21T03:49:20.042 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:49:20.061 INFO:teuthology.orchestra.run.smithi060.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 925 kB/s | 23 kB 00:00 2024-09-21T03:49:20.086 INFO:teuthology.orchestra.run.smithi060.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 786 kB/s | 19 kB 00:00 2024-09-21T03:49:20.111 INFO:teuthology.orchestra.run.smithi060.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 784 kB/s | 20 kB 00:00 2024-09-21T03:49:20.195 INFO:teuthology.orchestra.run.smithi060.stdout:(129/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.8 MB/s | 2.0 MB 00:00 2024-09-21T03:49:20.220 INFO:teuthology.orchestra.run.smithi060.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-21T03:49:20.237 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:49:20.246 INFO:teuthology.orchestra.run.smithi060.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-21T03:49:20.271 INFO:teuthology.orchestra.run.smithi060.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-21T03:49:20.304 INFO:teuthology.orchestra.run.smithi060.stdout:(133/157): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-21T03:49:20.329 INFO:teuthology.orchestra.run.smithi060.stdout:(134/157): python3-pecan-1.4.2-3.el9.noarch.rpm 4.6 MB/s | 272 kB 00:00 2024-09-21T03:49:20.355 INFO:teuthology.orchestra.run.smithi060.stdout:(135/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-21T03:49:20.380 INFO:teuthology.orchestra.run.smithi060.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-21T03:49:20.405 INFO:teuthology.orchestra.run.smithi060.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-09-21T03:49:20.431 INFO:teuthology.orchestra.run.smithi060.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-21T03:49:20.434 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:49:20.541 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:49:20.556 INFO:teuthology.orchestra.run.smithi060.stdout:(139/157): python3-rsa-4.9-2.el9.noarch.rpm 473 kB/s | 59 kB 00:00 2024-09-21T03:49:20.606 INFO:teuthology.orchestra.run.smithi060.stdout:(140/157): python3-routes-2.5.1-5.el9.noarch.rp 940 kB/s | 188 kB 00:00 2024-09-21T03:49:20.632 INFO:teuthology.orchestra.run.smithi060.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 474 kB/s | 36 kB 00:00 2024-09-21T03:49:20.657 INFO:teuthology.orchestra.run.smithi060.stdout:(142/157): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-21T03:49:20.663 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:49:20.682 INFO:teuthology.orchestra.run.smithi060.stdout:(143/157): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-21T03:49:20.689 INFO:teuthology.orchestra.run.smithi022.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 1.4 MB/s | 1.4 MB 00:00 2024-09-21T03:49:20.708 INFO:teuthology.orchestra.run.smithi060.stdout:(144/157): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T03:49:20.733 INFO:teuthology.orchestra.run.smithi060.stdout:(145/157): python3-zc-lockfile-2.0-10.el9.noarc 802 kB/s | 20 kB 00:00 2024-09-21T03:49:20.743 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:49:20.758 INFO:teuthology.orchestra.run.smithi060.stdout:(146/157): python3-werkzeug-2.0.3-3.el9.1.noarc 5.5 MB/s | 427 kB 00:00 2024-09-21T03:49:20.784 INFO:teuthology.orchestra.run.smithi060.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-21T03:49:20.842 INFO:teuthology.orchestra.run.smithi060.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 19 MB/s | 1.6 MB 00:00 2024-09-21T03:49:20.956 INFO:teuthology.orchestra.run.smithi022.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.4 MB/s | 2.4 MB 00:00 2024-09-21T03:49:20.975 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:49:21.086 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:49:21.092 INFO:teuthology.orchestra.run.smithi060.stdout:(149/157): librbd1-19.3.0-5120.g18432218.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-21T03:49:21.114 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:49:21.142 INFO:teuthology.orchestra.run.smithi060.stdout:(150/157): librados2-19.3.0-5120.g18432218.el9. 9.4 MB/s | 3.4 MB 00:00 2024-09-21T03:49:21.148 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:49:21.213 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:49:21.258 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:49:21.290 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:49:21.341 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:49:21.374 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:49:21.402 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:49:21.470 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:49:21.524 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:49:21.526 INFO:teuthology.orchestra.run.smithi060.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 4.7 MB/s | 1.8 MB 00:00 2024-09-21T03:49:21.555 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:49:21.560 INFO:teuthology.orchestra.run.smithi060.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 1.2 MB/s | 41 kB 00:00 2024-09-21T03:49:21.599 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:49:21.651 INFO:teuthology.orchestra.run.smithi060.stdout:(153/157): NetworkManager-1.51.0-1.el9.x86_64.r 4.2 MB/s | 2.3 MB 00:00 2024-09-21T03:49:21.677 INFO:teuthology.orchestra.run.smithi060.stdout:(154/157): NetworkManager-tui-1.51.0-1.el9.x86_ 2.1 MB/s | 249 kB 00:00 2024-09-21T03:49:21.679 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:49:21.709 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:49:21.752 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:49:21.781 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:49:21.851 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:49:21.896 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:49:21.969 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:49:22.052 INFO:teuthology.orchestra.run.smithi060.stdout:(155/157): openssl-3.2.2-6.el9.x86_64.rpm 3.4 MB/s | 1.4 MB 00:00 2024-09-21T03:49:22.111 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:49:22.165 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:49:22.345 INFO:teuthology.orchestra.run.smithi060.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 3.6 MB/s | 2.4 MB 00:00 2024-09-21T03:49:22.689 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:49:22.785 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:49:22.814 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:49:22.849 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:49:22.887 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:49:22.929 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:49:23.080 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:49:23.124 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:49:23.215 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:49:23.271 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:49:23.344 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:49:23.384 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:49:23.420 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:49:23.466 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:49:23.502 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:49:23.545 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:49:23.587 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:49:23.725 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:49:23.924 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:49:24.074 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:49:24.178 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:49:24.215 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:49:24.256 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:49:24.288 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:49:24.313 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:49:24.405 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:49:24.531 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:49:24.571 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:49:24.601 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:49:24.633 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:49:24.675 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:49:24.707 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:49:24.737 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:49:24.771 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:49:24.805 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:49:24.846 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:49:24.880 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:49:24.966 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:49:25.010 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:49:25.050 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:49:25.153 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:49:25.201 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:49:25.916 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:49:25.965 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:49:25.999 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:49:26.099 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:49:26.154 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:49:26.198 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:49:26.278 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:49:26.327 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:49:26.509 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:49:26.541 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:49:26.626 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:49:27.282 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:49:27.398 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:49:28.655 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:49:28.747 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:49:28.774 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:49:28.807 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:49:29.138 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:49:29.187 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:49:29.279 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:49:29.309 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:49:29.345 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:49:29.865 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:49:29.890 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:49:29.961 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:49:29.984 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:49:32.566 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:49:32.597 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:49:33.169 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:49:33.208 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:49:33.308 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:49:33.308 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:49:33.308 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:49:33.308 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:33.343 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:49:37.410 INFO:teuthology.orchestra.run.smithi060.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 708 kB/s | 16 MB 00:23 2024-09-21T03:49:37.415 INFO:teuthology.orchestra.run.smithi060.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:49:37.415 INFO:teuthology.orchestra.run.smithi060.stdout:Total 5.5 MB/s | 228 MB 00:41 2024-09-21T03:49:38.054 INFO:teuthology.orchestra.run.smithi022.stdout:(157/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 700 kB/s | 16 MB 00:23 2024-09-21T03:49:38.060 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:49:38.060 INFO:teuthology.orchestra.run.smithi022.stdout:Total 5.2 MB/s | 228 MB 00:43 2024-09-21T03:49:38.628 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction check 2024-09-21T03:49:38.799 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction check succeeded. 2024-09-21T03:49:38.799 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction test 2024-09-21T03:49:39.273 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction check 2024-09-21T03:49:39.446 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction check succeeded. 2024-09-21T03:49:39.447 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction test 2024-09-21T03:49:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:Transaction test succeeded. 2024-09-21T03:49:41.194 INFO:teuthology.orchestra.run.smithi060.stdout:Running transaction 2024-09-21T03:49:41.781 INFO:teuthology.orchestra.run.smithi022.stdout:Transaction test succeeded. 2024-09-21T03:49:41.782 INFO:teuthology.orchestra.run.smithi022.stdout:Running transaction 2024-09-21T03:49:45.203 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:49:45.203 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /sys 2024-09-21T03:49:45.203 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /proc 2024-09-21T03:49:45.204 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /mnt 2024-09-21T03:49:45.204 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /var/tmp 2024-09-21T03:49:45.204 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /home 2024-09-21T03:49:45.204 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /root 2024-09-21T03:49:45.204 INFO:teuthology.orchestra.run.smithi073.stdout:skipping the directory /tmp 2024-09-21T03:49:45.204 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:45.382 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:49:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:49:45.399 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:49:45.399 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:49:45.399 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:47.010 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:49:47.037 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:49:47.037 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:49:47.037 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:49:47.037 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:49:47.037 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:49:47.037 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:47.277 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:49:47.301 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:49:47.301 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:49:47.301 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:49:47.301 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:49:47.301 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:49:47.301 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:47.778 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:49:47.802 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:49:47.803 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:49:47.803 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:49:47.803 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:49:47.803 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:49:47.803 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:47.917 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:49:47.952 INFO:teuthology.orchestra.run.smithi060.stdout: Preparing : 1/1 2024-09-21T03:49:47.974 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:49:48.029 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:49:48.055 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:49:48.094 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:49:48.174 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:49:48.214 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:49:48.215 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:49:48.219 INFO:teuthology.orchestra.run.smithi022.stdout: Preparing : 1/1 2024-09-21T03:49:48.240 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:49:48.262 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:49:48.295 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:49:48.333 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-21T03:49:48.339 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:49:48.372 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-21T03:49:48.427 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-21T03:49:48.429 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:49:48.475 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-21T03:49:48.509 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-21T03:49:48.560 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-21T03:49:48.577 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:49:48.620 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:49:48.652 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:49:48.680 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:49:48.721 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:49:48.808 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:49:48.932 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-21T03:49:48.938 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:49:48.959 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:49:49.015 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:49:49.046 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:49:49.051 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:49:49.052 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:49:49.078 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:49:49.080 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:49:49.110 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:49:49.144 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:49:49.164 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:49:49.169 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:49:49.202 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:49:49.290 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:49:49.295 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:49:49.324 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:49:49.345 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:49:49.354 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-21T03:49:49.372 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:49:49.483 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:49:49.506 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:49:49.544 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-21T03:49:49.557 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:49:49.582 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:49:49.605 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:49:49.614 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-21T03:49:49.641 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:49:49.758 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:49:49.784 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:49:49.811 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:49:49.850 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 15/165 2024-09-21T03:49:49.885 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:49:49.905 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-21T03:49:49.968 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:49:50.081 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:49:50.112 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:49:50.196 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:49:50.274 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:49:50.293 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-21T03:49:50.408 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-21T03:49:50.498 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:49:50.507 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:49:50.593 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:49:50.607 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:49:50.636 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:49:50.671 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:49:50.747 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:49:50.806 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:49:50.822 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-21T03:49:50.846 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:49:50.889 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:49:50.922 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:49:50.934 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-21T03:49:50.949 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:49:50.963 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-21T03:49:50.999 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-21T03:49:51.021 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:49:51.073 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:49:51.075 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-21T03:49:51.111 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:49:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-21T03:49:51.155 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:49:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-21T03:49:51.217 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-21T03:49:51.238 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:49:51.250 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-21T03:49:51.274 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:49:51.277 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-21T03:49:51.318 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:49:51.346 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:49:51.350 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-21T03:49:51.400 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-21T03:49:51.419 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:49:51.430 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-21T03:49:51.469 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:49:51.474 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-21T03:49:51.546 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:49:51.557 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-21T03:49:51.601 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 34/165 2024-09-21T03:49:51.645 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 35/165 2024-09-21T03:49:51.673 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 36/165 2024-09-21T03:49:51.682 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:49:51.731 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:49:51.746 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-21T03:49:51.797 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-21T03:49:51.874 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-21T03:49:52.019 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-21T03:49:52.075 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-21T03:49:52.281 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:49:52.360 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:49:52.360 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:49:52.404 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:49:52.416 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:49:52.447 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:49:52.485 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:49:52.528 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:49:52.637 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-21T03:49:52.689 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:49:52.730 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-21T03:49:52.738 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:49:52.765 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-21T03:49:52.816 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-21T03:49:52.833 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:49:52.854 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 46/165 2024-09-21T03:49:52.895 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:49:52.897 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-21T03:49:52.979 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:49:53.015 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:49:53.051 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:49:53.073 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-21T03:49:53.099 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:49:53.133 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-21T03:49:53.134 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:49:53.177 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:49:53.220 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:49:53.227 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-21T03:49:53.289 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-21T03:49:53.363 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:49:53.371 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-21T03:49:53.380 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:49:53.404 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:49:53.408 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:49:53.417 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-21T03:49:53.446 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:49:53.453 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-21T03:49:53.501 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-21T03:49:53.522 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:49:53.536 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-21T03:49:53.554 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:49:53.580 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-21T03:49:53.587 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:49:53.622 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-21T03:49:53.628 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:49:53.661 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:49:53.684 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:49:53.686 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:49:53.719 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:49:53.742 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:49:53.743 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:49:53.743 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:49:53.743 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:49:53.743 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:49:53.743 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:53.764 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-21T03:49:53.780 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:49:53.794 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:49:53.806 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:49:53.815 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-21T03:49:53.857 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-21T03:49:53.909 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:49:53.913 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:49:53.951 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:49:53.962 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-21T03:49:53.964 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:49:53.980 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:49:53.998 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-21T03:49:54.014 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:49:54.039 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-21T03:49:54.054 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:49:54.071 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-21T03:49:54.093 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:49:54.096 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-21T03:49:54.123 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:49:54.158 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:49:54.194 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:49:54.195 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-21T03:49:54.236 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:49:54.270 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:49:54.331 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-21T03:49:54.366 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-21T03:49:54.369 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:49:54.394 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-21T03:49:54.426 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:49:54.427 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-21T03:49:54.457 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:49:54.475 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-21T03:49:54.515 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-21T03:49:54.545 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-21T03:49:54.564 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:49:54.580 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-21T03:49:54.613 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-21T03:49:54.617 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:49:54.655 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-21T03:49:54.689 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-21T03:49:54.779 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-21T03:49:54.828 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-21T03:49:54.867 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-21T03:49:54.919 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:49:54.955 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:49:54.974 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-21T03:49:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:49:54.979 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:49:54.979 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:49:54.979 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:49:54.979 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:49:54.979 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:55.022 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:49:55.027 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-21T03:49:55.045 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:49:55.045 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:49:55.045 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:49:55.046 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:55.098 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:49:55.122 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:49:55.122 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:49:55.122 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:49:55.122 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:49:55.122 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:49:55.122 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:55.378 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:49:55.430 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:49:55.440 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:49:55.463 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:49:55.464 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:49:55.464 INFO:teuthology.orchestra.run.smithi073.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:49:55.464 INFO:teuthology.orchestra.run.smithi073.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:49:55.464 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:49:55.464 INFO:teuthology.orchestra.run.smithi073.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:49:55.464 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:49:55.568 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:49:55.628 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:49:55.673 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:49:55.763 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:49:55.788 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-21T03:49:55.799 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:49:55.832 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-21T03:49:55.874 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-21T03:49:55.985 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-21T03:49:55.991 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:49:56.022 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:49:56.040 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-21T03:49:56.085 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-21T03:49:56.102 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:49:56.174 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-21T03:49:56.212 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-21T03:49:56.402 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-21T03:49:56.425 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-21T03:49:56.513 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-21T03:49:56.785 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:49:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:49:57.208 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-21T03:49:57.327 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-21T03:49:58.232 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:49:58.318 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:49:58.346 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:49:58.379 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:49:58.658 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-21T03:49:58.722 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:49:58.737 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-21T03:49:58.766 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-21T03:49:58.766 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:49:58.799 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-21T03:49:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:49:58.890 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:49:58.927 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:49:59.153 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-21T03:49:59.253 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:49:59.349 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 102/165 2024-09-21T03:49:59.383 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 103/165 2024-09-21T03:49:59.419 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-21T03:49:59.453 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:49:59.480 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:49:59.500 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:49:59.534 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:49:59.553 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:49:59.564 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:49:59.593 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:49:59.625 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:49:59.653 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:49:59.858 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:49:59.908 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:49:59.938 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:49:59.947 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-21T03:49:59.968 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:49:59.972 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:50:00.014 INFO:teuthology.orchestra.run.smithi073.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:50:00.044 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 106/165 2024-09-21T03:50:00.074 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 107/165 2024-09-21T03:50:00.682 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:50:00.720 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:50:00.741 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:50:01.581 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:50:01.658 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:50:01.705 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:50:01.800 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:50:01.828 INFO:teuthology.orchestra.run.smithi073.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:50:01.853 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:50:01.879 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:50:01.880 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:50:01.927 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:50:01.961 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:50:01.971 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:50:01.972 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:50:02.056 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:50:02.081 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:50:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:50:02.086 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:50:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:50:02.266 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:50:02.333 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:50:02.398 INFO:teuthology.orchestra.run.smithi073.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:50:02.551 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:50:02.562 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:50:02.587 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:50:02.606 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:50:02.713 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:50:02.713 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:50:02.713 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:50:02.714 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:02.757 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:50:03.204 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 108/165 2024-09-21T03:50:03.249 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:50:03.341 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 109/165 2024-09-21T03:50:03.341 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T03:50:03.341 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T03:50:03.341 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:03.384 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:50:08.845 INFO:teuthology.orchestra.run.smithi073.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:50:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:50:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:50:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:50:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:50:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:50:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:50:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:50:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:50:08.846 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:50:08.847 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:50:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:50:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:50:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:50:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:50:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:50:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:50:08.848 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:50:08.859 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:50:08.860 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:50:08.861 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:50:08.862 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:50:08.863 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:50:08.864 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:50:08.865 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:50:08.866 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:50:08.867 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:50:08.868 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:50:08.869 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:50:08.870 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:50:08.870 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:50:08.870 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:50:08.870 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:50:08.870 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:50:08.870 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:50:08.870 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:50:08.870 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:50:11.182 INFO:teuthology.orchestra.run.smithi073.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:50:11.182 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout:Upgraded: 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout:Installed: 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:50:11.183 INFO:teuthology.orchestra.run.smithi073.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:11.184 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:50:11.185 INFO:teuthology.orchestra.run.smithi073.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.186 INFO:teuthology.orchestra.run.smithi073.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:50:11.187 INFO:teuthology.orchestra.run.smithi073.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:50:11.188 INFO:teuthology.orchestra.run.smithi073.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:50:11.189 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:50:11.190 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:50:11.191 INFO:teuthology.orchestra.run.smithi073.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:50:11.192 INFO:teuthology.orchestra.run.smithi073.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:50:11.193 INFO:teuthology.orchestra.run.smithi073.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:50:11.194 INFO:teuthology.orchestra.run.smithi073.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:50:11.195 INFO:teuthology.orchestra.run.smithi073.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:50:11.195 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:50:11.195 INFO:teuthology.orchestra.run.smithi073.stdout:Complete! 2024-09-21T03:50:11.638 DEBUG:teuthology.parallel:result is None 2024-09-21T03:50:15.136 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:50:15.136 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /sys 2024-09-21T03:50:15.136 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /proc 2024-09-21T03:50:15.136 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /mnt 2024-09-21T03:50:15.136 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /var/tmp 2024-09-21T03:50:15.136 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /home 2024-09-21T03:50:15.136 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /root 2024-09-21T03:50:15.137 INFO:teuthology.orchestra.run.smithi060.stdout:skipping the directory /tmp 2024-09-21T03:50:15.137 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:15.319 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:50:15.335 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:50:15.335 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:15.335 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:50:15.336 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:15.609 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 110/165 2024-09-21T03:50:15.609 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /sys 2024-09-21T03:50:15.609 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /proc 2024-09-21T03:50:15.609 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /mnt 2024-09-21T03:50:15.609 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /var/tmp 2024-09-21T03:50:15.609 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /home 2024-09-21T03:50:15.610 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /root 2024-09-21T03:50:15.610 INFO:teuthology.orchestra.run.smithi022.stdout:skipping the directory /tmp 2024-09-21T03:50:15.610 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:15.789 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:50:15.808 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 111/165 2024-09-21T03:50:15.808 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:15.808 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-21T03:50:15.808 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:16.980 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:50:17.008 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:50:17.008 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:17.008 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:50:17.008 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:50:17.008 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:50:17.008 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:17.239 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:50:17.263 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:50:17.263 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:17.263 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:50:17.264 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:50:17.264 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:50:17.264 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:17.458 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:50:17.486 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 112/165 2024-09-21T03:50:17.486 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:17.486 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T03:50:17.486 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:50:17.487 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T03:50:17.487 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:17.726 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:50:17.750 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 113/165 2024-09-21T03:50:17.751 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:17.751 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T03:50:17.751 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:50:17.751 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T03:50:17.751 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:17.756 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:50:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:50:17.781 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:17.781 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:50:17.781 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:50:17.781 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:50:17.781 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:17.887 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:50:17.945 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:50:18.009 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:50:18.205 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:50:18.243 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:50:18.266 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:50:18.268 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 114/165 2024-09-21T03:50:18.268 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:18.268 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T03:50:18.268 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:50:18.268 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T03:50:18.268 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:18.348 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:50:18.383 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-21T03:50:18.441 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-21T03:50:18.445 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:50:18.504 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-21T03:50:18.596 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:50:18.633 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:50:18.665 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:50:18.692 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:50:18.706 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-21T03:50:18.761 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-21T03:50:18.842 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-21T03:50:18.931 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-21T03:50:19.084 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-21T03:50:19.111 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:50:19.128 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-21T03:50:19.140 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:50:19.160 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-21T03:50:19.173 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:50:19.187 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-21T03:50:19.242 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:50:19.272 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:50:19.598 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:50:19.627 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephadm-2:19.3.0-5120.g18432218.el9.noarch 126/165 2024-09-21T03:50:19.660 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 127/165 2024-09-21T03:50:19.729 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 128/165 2024-09-21T03:50:19.758 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:50:22.669 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:50:22.728 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:50:23.137 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 129/165 2024-09-21T03:50:23.198 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:50:23.743 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:50:23.770 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:50:23.893 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:50:24.061 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:50:24.096 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:50:24.122 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:50:24.122 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:24.122 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:50:24.122 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:50:24.122 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:50:24.123 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:24.172 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:50:24.184 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:50:24.214 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 130/165 2024-09-21T03:50:24.240 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:50:24.287 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:50:24.344 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:50:24.362 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 131/165 2024-09-21T03:50:24.540 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 132/165 2024-09-21T03:50:24.599 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:50:24.624 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 133/165 2024-09-21T03:50:24.624 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:24.624 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T03:50:24.624 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:50:24.624 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T03:50:24.624 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:24.677 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:50:24.688 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 134/165 2024-09-21T03:50:24.791 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-2:19.3.0-5120.g18432218.el9.x86_64 135/165 2024-09-21T03:50:24.851 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 136/165 2024-09-21T03:50:25.360 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:50:25.391 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:50:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:50:25.416 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:25.416 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:50:25.416 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:50:25.416 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:50:25.416 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:25.458 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:50:25.483 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:50:25.483 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:25.483 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:50:25.483 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:25.534 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:50:25.558 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:50:25.559 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:25.559 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:50:25.559 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:50:25.559 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:50:25.559 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:25.871 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-21T03:50:25.894 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:50:25.895 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:50:25.918 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:50:25.919 INFO:teuthology.orchestra.run.smithi060.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:25.919 INFO:teuthology.orchestra.run.smithi060.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:50:25.919 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:50:25.919 INFO:teuthology.orchestra.run.smithi060.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:50:25.919 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:25.919 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 138/165 2024-09-21T03:50:25.919 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:25.919 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T03:50:25.920 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:50:25.920 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T03:50:25.920 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:25.971 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:50:25.995 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5120.g18432 139/165 2024-09-21T03:50:25.995 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:25.995 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T03:50:25.995 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:26.055 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:50:26.079 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 140/165 2024-09-21T03:50:26.080 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:26.080 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-21T03:50:26.080 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:50:26.080 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-21T03:50:26.080 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:26.422 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:50:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 141/165 2024-09-21T03:50:26.447 INFO:teuthology.orchestra.run.smithi022.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T03:50:26.447 INFO:teuthology.orchestra.run.smithi022.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T03:50:26.447 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:50:26.447 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T03:50:26.447 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:30.165 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:50:30.206 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:50:30.247 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:50:30.278 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:50:30.305 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:50:30.525 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:50:30.569 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:50:30.599 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:50:30.629 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:50:30.675 INFO:teuthology.orchestra.run.smithi060.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:50:30.694 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 142/165 2024-09-21T03:50:30.736 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 143/165 2024-09-21T03:50:30.776 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 144/165 2024-09-21T03:50:30.807 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-21T03:50:30.834 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-21T03:50:31.051 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 147/165 2024-09-21T03:50:31.098 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-21T03:50:31.136 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 149/165 2024-09-21T03:50:31.174 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-21T03:50:31.218 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:50:31.221 INFO:teuthology.orchestra.run.smithi022.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-21T03:50:31.256 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:50:31.276 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:50:31.866 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:50:31.902 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:50:31.923 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-21T03:50:32.183 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:50:32.277 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:50:32.323 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:50:32.421 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:50:32.455 INFO:teuthology.orchestra.run.smithi060.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:50:32.480 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:50:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:50:32.507 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:50:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:50:32.591 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:50:32.675 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:50:32.699 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:50:32.705 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:50:32.705 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:50:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 153/165 2024-09-21T03:50:32.885 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:50:32.885 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:50:32.923 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-21T03:50:32.952 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:50:32.974 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-21T03:50:33.020 INFO:teuthology.orchestra.run.smithi060.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:50:33.079 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-21T03:50:33.119 INFO:teuthology.orchestra.run.smithi022.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-21T03:50:33.144 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-21T03:50:33.169 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-21T03:50:33.169 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:50:33.254 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-21T03:50:33.254 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:50:33.338 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-21T03:50:33.363 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-21T03:50:33.368 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:50:33.368 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:50:33.556 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-21T03:50:33.557 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:50:33.641 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-21T03:50:33.708 INFO:teuthology.orchestra.run.smithi022.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:50:39.326 INFO:teuthology.orchestra.run.smithi060.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:50:39.326 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:50:39.326 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:50:39.326 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:50:39.326 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:50:39.326 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:50:39.326 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:50:39.327 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:50:39.328 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:50:39.340 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:50:39.340 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:50:39.340 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:50:39.340 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:50:39.340 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:50:39.340 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:50:39.340 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:50:39.340 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:50:39.340 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:50:39.340 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:50:39.341 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:50:39.341 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:50:39.341 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:50:39.341 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:50:39.341 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:50:39.341 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:50:39.341 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:50:39.341 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:50:39.341 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:50:39.341 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:50:39.342 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:50:39.343 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:50:39.344 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:50:39.345 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:50:39.346 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:50:39.347 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:50:39.348 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:50:39.349 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:50:39.350 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:50:39.350 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:50:39.350 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:50:39.350 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:50:39.350 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:50:39.350 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:50:39.350 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:50:39.350 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-2:19.3.0-5120.g18432218.el9.x86_64 1/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 3/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 4/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5120.g18432 5/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 6/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 7/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 8/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 9/165 2024-09-21T03:50:40.000 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 10/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 11/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 12/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 13/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 14/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_ 15/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 16/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 17/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados-devel-2:19.3.0-5120.g18432218.el9.x86_6 18/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libradosstriper1-2:19.3.0-5120.g18432218.el9.x86 19/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librgw2-2:19.3.0-5120.g18432218.el9.x86_64 20/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5120.g18432218.el 21/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ceph-common-2:19.3.0-5120.g18432218.el9. 22/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_6 23/165 2024-09-21T03:50:40.001 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 24/165 2024-09-21T03:50:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 25/165 2024-09-21T03:50:40.002 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 26/165 2024-09-21T03:50:40.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 27/165 2024-09-21T03:50:40.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 28/165 2024-09-21T03:50:40.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 29/165 2024-09-21T03:50:40.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5120.g18432218. 30/165 2024-09-21T03:50:40.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noa 31/165 2024-09-21T03:50:40.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.n 32/165 2024-09-21T03:50:40.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5120.g184 33/165 2024-09-21T03:50:40.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el 34/165 2024-09-21T03:50:40.013 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 35/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5120.g18432218.e 36/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 37/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephadm-2:19.3.0-5120.g18432218.el9.noarch 38/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 39/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-21T03:50:40.014 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-21T03:50:40.015 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-21T03:50:40.016 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-21T03:50:40.017 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-21T03:50:40.018 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-21T03:50:40.019 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-21T03:50:40.020 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-21T03:50:40.021 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-21T03:50:40.022 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:19.3.0-5120.g18432218.el9.x86_64 150/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:19.3.0-5120.g18432218.el9.x86_64 152/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-21T03:50:40.023 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-21T03:50:40.024 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-21T03:50:40.024 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-21T03:50:40.024 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-21T03:50:40.024 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-21T03:50:40.024 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-21T03:50:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:50:41.809 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:41.809 INFO:teuthology.orchestra.run.smithi060.stdout:Upgraded: 2024-09-21T03:50:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.810 INFO:teuthology.orchestra.run.smithi060.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:50:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:50:41.811 INFO:teuthology.orchestra.run.smithi060.stdout:Installed: 2024-09-21T03:50:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:50:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:50:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:50:41.811 INFO:teuthology.orchestra.run.smithi060.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:50:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.812 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:41.813 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.814 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:50:41.815 INFO:teuthology.orchestra.run.smithi060.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:50:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:50:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:50:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:50:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:50:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:50:41.816 INFO:teuthology.orchestra.run.smithi060.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:50:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:50:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:50:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:50:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.817 INFO:teuthology.orchestra.run.smithi060.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:50:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:50:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:50:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:50:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:50:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:50:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.818 INFO:teuthology.orchestra.run.smithi060.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:50:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:50:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:50:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:50:41.819 INFO:teuthology.orchestra.run.smithi060.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:50:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:50:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:50:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:50:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:50:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:50:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:50:41.820 INFO:teuthology.orchestra.run.smithi060.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:50:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:50:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:50:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:50:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:50:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:50:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:50:41.821 INFO:teuthology.orchestra.run.smithi060.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:50:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:50:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:50:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:50:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:50:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:50:41.822 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:50:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:50:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:50:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:50:41.823 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:50:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:50:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:50:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:50:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:50:41.824 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:50:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:50:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:50:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:50:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:50:41.825 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:50:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:50:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:50:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:50:41.826 INFO:teuthology.orchestra.run.smithi060.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:50:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:50:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:50:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:50:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:50:41.827 INFO:teuthology.orchestra.run.smithi060.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:50:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:50:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:50:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:50:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:50:41.828 INFO:teuthology.orchestra.run.smithi060.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:50:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:50:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:50:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:50:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:50:41.829 INFO:teuthology.orchestra.run.smithi060.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:50:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:50:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:50:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:50:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:50:41.830 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:50:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:50:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:50:41.831 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:50:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:50:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:50:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:50:41.832 INFO:teuthology.orchestra.run.smithi060.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:50:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:50:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:50:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:50:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:50:41.833 INFO:teuthology.orchestra.run.smithi060.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:50:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:50:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:50:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:50:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:50:41.834 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:50:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:50:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:50:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.835 INFO:teuthology.orchestra.run.smithi060.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:50:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:50:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:50:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:50:41.836 INFO:teuthology.orchestra.run.smithi060.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:50:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:50:41.837 INFO:teuthology.orchestra.run.smithi060.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:50:41.838 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:50:41.838 INFO:teuthology.orchestra.run.smithi060.stdout:Complete! 2024-09-21T03:50:42.211 DEBUG:teuthology.parallel:result is None 2024-09-21T03:50:42.972 INFO:teuthology.orchestra.run.smithi022.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-21T03:50:42.972 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:42.972 INFO:teuthology.orchestra.run.smithi022.stdout:Upgraded: 2024-09-21T03:50:42.972 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:42.972 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: librados2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: librbd1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout:Installed: 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: automake-1.16.2-8.el9.noarch 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: bison-3.7.4-5.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.973 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-grafana-dashboards-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-immutable-object-cache-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mds-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-rook-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:42.974 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mon-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-osd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-prometheus-alerts-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-radosgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-selinux-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-test-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-volume-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: cephadm-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-shell-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-top-2:19.3.0-5120.g18432218.el9.noarch 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: flex-2.6.4-9.el9.x86_64 2024-09-21T03:50:42.975 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: libcephfs2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: libcephsqlite-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.976 INFO:teuthology.orchestra.run.smithi022.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: librados-devel-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: librgw2-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-21T03:50:42.977 INFO:teuthology.orchestra.run.smithi022.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-13.16-1.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-21T03:50:42.978 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-common-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cephfs-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T03:50:42.979 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T03:50:42.980 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T03:50:42.981 INFO:teuthology.orchestra.run.smithi022.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T03:50:42.982 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rgw-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T03:50:42.983 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-fuse-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-mirror-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: rbd-nbd-2:19.3.0-5120.g18432218.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-21T03:50:42.984 INFO:teuthology.orchestra.run.smithi022.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T03:50:42.985 INFO:teuthology.orchestra.run.smithi022.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-21T03:50:42.985 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:50:42.985 INFO:teuthology.orchestra.run.smithi022.stdout:Complete! 2024-09-21T03:50:43.390 DEBUG:teuthology.parallel:result is None 2024-09-21T03:50:43.390 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:50:43.531 DEBUG:teuthology.orchestra.run.smithi022:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:50:43.554 INFO:teuthology.orchestra.run.smithi022.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:50:43.555 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:50:43.555 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:50:43.557 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:50:43.715 DEBUG:teuthology.orchestra.run.smithi060:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:50:43.743 INFO:teuthology.orchestra.run.smithi060.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:50:43.743 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:50:43.743 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:50:43.745 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:50:43.883 DEBUG:teuthology.orchestra.run.smithi073:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T03:50:43.910 INFO:teuthology.orchestra.run.smithi073.stdout:19.3.0-5120.g18432218.el9 2024-09-21T03:50:43.910 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5120.g18432218.el9 2024-09-21T03:50:43.910 INFO:teuthology.task.install:The correct ceph version 19.3.0-5120.g18432218 is installed. 2024-09-21T03:50:43.912 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T03:50:43.912 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:50:43.912 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:50:43.941 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:50:43.941 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:50:43.974 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:50:43.975 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T03:50:44.006 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T03:50:44.006 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:50:44.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:50:44.033 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:50:44.100 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:50:44.100 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:50:44.131 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:50:44.201 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:50:44.201 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T03:50:44.229 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T03:50:44.297 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T03:50:44.297 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:50:44.297 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:50:44.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:50:44.393 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:50:44.393 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:50:44.425 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:50:44.493 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:50:44.493 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T03:50:44.519 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T03:50:44.585 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T03:50:44.585 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:50:44.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:50:44.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:50:44.682 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:50:44.682 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:50:44.708 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:50:44.775 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:50:44.775 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T03:50:44.800 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T03:50:44.865 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T03:50:44.972 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mon warn on pool no app': False}, 'mon': {'mon op complaint time': 120}, 'osd': {'osd op complaint time': 180}}, 'conf': {'mds': {'mds_bal_replicate_threshold': 1}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T03:50:44.972 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:50:44.972 INFO:tasks.cephadm:Cluster fsid is ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:50:44.972 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T03:50:44.973 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.22', 'mon.b': '172.21.15.60', 'mon.c': '172.21.15.73'} 2024-09-21T03:50:44.973 INFO:tasks.cephadm:First mon is mon.a on smithi022 2024-09-21T03:50:44.973 INFO:tasks.cephadm:First mgr is x 2024-09-21T03:50:44.973 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T03:50:44.973 DEBUG:teuthology.orchestra.run.smithi022:> sudo hostname $(hostname -s) 2024-09-21T03:50:45.004 DEBUG:teuthology.orchestra.run.smithi060:> sudo hostname $(hostname -s) 2024-09-21T03:50:45.030 DEBUG:teuthology.orchestra.run.smithi073:> sudo hostname $(hostname -s) 2024-09-21T03:50:45.056 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-21T03:50:45.056 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:50:45.207 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.4.75+confusa13', 'job_name': 'ceph-dev-new-build/ARCH=arm64,AVAILABLE_ARCH=arm64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://4.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 00:04:17.484514', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['x86_64', 'source', 'arm64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': '1843221895adccfb3b692060251dd6a0183bc410', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83190/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5120-g18432218', 'node_name': '172.21.2.22+braggi22', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5120.g18432218'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-20 22:54:16.499090', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-pdonnell-testing-20240920.212106-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-21T03:50:45.349 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref wip-pdonnell-testing-20240920.212106-debug, sha1 1843221895adccfb3b692060251dd6a0183bc410 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:50:45.350 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T03:50:45.350 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm 2024-09-21T03:50:45.350 DEBUG:teuthology.orchestra.run.smithi022:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:50:45.927 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:50 /home/ubuntu/cephtest/cephadm 2024-09-21T03:50:45.927 DEBUG:teuthology.orchestra.run.smithi060:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:50:46.525 INFO:teuthology.orchestra.run.smithi060.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:50 /home/ubuntu/cephtest/cephadm 2024-09-21T03:50:46.525 DEBUG:teuthology.orchestra.run.smithi073:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/wip-pdonnell-testing-20240920.212106-debug/1843221895adccfb3b692060251dd6a0183bc410/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T03:50:47.087 INFO:teuthology.orchestra.run.smithi073.stdout:-rw-r--r--. 1 ubuntu ubuntu 804283 Sep 21 03:50 /home/ubuntu/cephtest/cephadm 2024-09-21T03:50:47.087 DEBUG:teuthology.orchestra.run.smithi022:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:50:47.107 DEBUG:teuthology.orchestra.run.smithi060:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:50:47.127 DEBUG:teuthology.orchestra.run.smithi073:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T03:50:47.162 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 on all hosts... 2024-09-21T03:50:47.162 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:50:47.164 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:50:47.170 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 pull 2024-09-21T03:50:48.759 INFO:teuthology.orchestra.run.smithi073.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:50:48.833 INFO:teuthology.orchestra.run.smithi022.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:50:48.873 INFO:teuthology.orchestra.run.smithi060.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:51:20.250 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-21T03:51:20.250 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:51:20.250 INFO:teuthology.orchestra.run.smithi073.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:51:20.250 INFO:teuthology.orchestra.run.smithi073.stdout: "repo_digests": [ 2024-09-21T03:51:20.250 INFO:teuthology.orchestra.run.smithi073.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:51:20.250 INFO:teuthology.orchestra.run.smithi073.stdout: ] 2024-09-21T03:51:20.250 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-21T03:51:21.932 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T03:51:21.933 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:51:21.933 INFO:teuthology.orchestra.run.smithi022.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:51:21.933 INFO:teuthology.orchestra.run.smithi022.stdout: "repo_digests": [ 2024-09-21T03:51:21.933 INFO:teuthology.orchestra.run.smithi022.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:51:21.933 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-21T03:51:21.933 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T03:51:22.918 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T03:51:22.918 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T03:51:22.918 INFO:teuthology.orchestra.run.smithi060.stdout: "image_id": "ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977", 2024-09-21T03:51:22.918 INFO:teuthology.orchestra.run.smithi060.stdout: "repo_digests": [ 2024-09-21T03:51:22.918 INFO:teuthology.orchestra.run.smithi060.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262" 2024-09-21T03:51:22.919 INFO:teuthology.orchestra.run.smithi060.stdout: ] 2024-09-21T03:51:22.919 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T03:51:22.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph 2024-09-21T03:51:22.978 DEBUG:teuthology.orchestra.run.smithi060:> sudo mkdir -p /etc/ceph 2024-09-21T03:51:23.007 DEBUG:teuthology.orchestra.run.smithi073:> sudo mkdir -p /etc/ceph 2024-09-21T03:51:23.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /etc/ceph 2024-09-21T03:51:23.069 DEBUG:teuthology.orchestra.run.smithi060:> sudo chmod 777 /etc/ceph 2024-09-21T03:51:23.094 DEBUG:teuthology.orchestra.run.smithi073:> sudo chmod 777 /etc/ceph 2024-09-21T03:51:23.122 INFO:tasks.cephadm:Writing seed config... 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [osd] bluestore compression mode = aggressive 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-09-21T03:51:23.123 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-09-21T03:51:23.124 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T03:51:23.124 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T03:51:23.124 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-09-21T03:51:23.124 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T03:51:23.124 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T03:51:23.124 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T03:51:23.124 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T03:51:23.124 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T03:51:23.124 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-21T03:51:23.124 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-09-21T03:51:23.125 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:51:23.125 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T03:51:23.142 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = ae19ad46-77cc-11ef-baf5-efdc52797490 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore compression mode = aggressive bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [mds] mds_bal_replicate_threshold = 1 2024-09-21T03:51:23.142 DEBUG:teuthology.orchestra.run.smithi022:mon.a> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.a.service 2024-09-21T03:51:23.185 DEBUG:teuthology.orchestra.run.smithi022:mgr.x> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.x.service 2024-09-21T03:51:23.227 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T03:51:23.227 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 -v bootstrap --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.22 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:51:23.441 INFO:teuthology.orchestra.run.smithi022.stdout:-------------------------------------------------------------------------------- 2024-09-21T03:51:23.441 INFO:teuthology.orchestra.run.smithi022.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', '-v', 'bootstrap', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.22', '--skip-admin-label'] 2024-09-21T03:51:23.442 INFO:teuthology.orchestra.run.smithi022.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T03:51:23.442 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying podman|docker is present... 2024-09-21T03:51:23.466 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5.2.2 2024-09-21T03:51:23.466 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying lvm2 is present... 2024-09-21T03:51:23.466 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying time synchronization is in place... 2024-09-21T03:51:23.474 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T03:51:23.475 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T03:51:23.481 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T03:51:23.481 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-21T03:51:23.488 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-09-21T03:51:23.494 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-09-21T03:51:23.494 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-09-21T03:51:23.494 INFO:teuthology.orchestra.run.smithi022.stdout:Repeating the final host check... 2024-09-21T03:51:23.518 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout 5.2.2 2024-09-21T03:51:23.518 INFO:teuthology.orchestra.run.smithi022.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T03:51:23.518 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl is present 2024-09-21T03:51:23.518 INFO:teuthology.orchestra.run.smithi022.stdout:lvcreate is present 2024-09-21T03:51:23.525 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T03:51:23.525 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T03:51:23.531 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T03:51:23.531 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-21T03:51:23.538 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout enabled 2024-09-21T03:51:23.545 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout active 2024-09-21T03:51:23.545 INFO:teuthology.orchestra.run.smithi022.stdout:Unit chronyd.service is enabled and running 2024-09-21T03:51:23.545 INFO:teuthology.orchestra.run.smithi022.stdout:Host looks OK 2024-09-21T03:51:23.545 INFO:teuthology.orchestra.run.smithi022.stdout:Cluster fsid: ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:51:23.545 INFO:teuthology.orchestra.run.smithi022.stdout:Acquiring lock 140099291957616 on /run/cephadm/ae19ad46-77cc-11ef-baf5-efdc52797490.lock 2024-09-21T03:51:23.545 INFO:teuthology.orchestra.run.smithi022.stdout:Lock 140099291957616 acquired on /run/cephadm/ae19ad46-77cc-11ef-baf5-efdc52797490.lock 2024-09-21T03:51:23.546 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 3300 ... 2024-09-21T03:51:23.546 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying IP 172.21.15.22 port 6789 ... 2024-09-21T03:51:23.546 INFO:teuthology.orchestra.run.smithi022.stdout:Base mon IP(s) is [172.21.15.22:3300, 172.21.15.22:6789], mon addrv is [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-21T03:51:23.549 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.22 metric 100 2024-09-21T03:51:23.549 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.22 metric 100 2024-09-21T03:51:23.552 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T03:51:23.552 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T03:51:23.552 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1771sec hoplimit 64 pref medium 2024-09-21T03:51:23.554 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T03:51:23.555 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T03:51:23.555 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T03:51:23.555 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T03:51:23.555 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-09-21T03:51:23.555 INFO:teuthology.orchestra.run.smithi022.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T03:51:23.555 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-09-21T03:51:23.556 INFO:teuthology.orchestra.run.smithi022.stdout:Mon IP `172.21.15.22` is in CIDR network `172.21.0.0/20` 2024-09-21T03:51:23.556 INFO:teuthology.orchestra.run.smithi022.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T03:51:23.556 INFO:teuthology.orchestra.run.smithi022.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T03:51:23.556 INFO:teuthology.orchestra.run.smithi022.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:51:23.993 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stdout ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T03:51:23.993 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410... 2024-09-21T03:51:23.994 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T03:51:23.994 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:8425bc7408d91b180e7fdc62f23e7ae6603757f4f36e9969a4eaf9fd9416b764 2024-09-21T03:51:23.994 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T03:51:23.994 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Copying config sha256:ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 2024-09-21T03:51:23.994 INFO:teuthology.orchestra.run.smithi022.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T03:51:24.932 INFO:teuthology.orchestra.run.smithi022.stdout:ceph: stdout ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T03:51:24.932 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph version: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev) 2024-09-21T03:51:24.933 INFO:teuthology.orchestra.run.smithi022.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T03:51:25.962 INFO:teuthology.orchestra.run.smithi022.stdout:stat: stdout 167 167 2024-09-21T03:51:25.962 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial keys... 2024-09-21T03:51:26.926 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQC+Qu5mUIJoFBAAFanXKcqCBtHrl0XAZOKGGA== 2024-09-21T03:51:27.873 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQC/Qu5mn7g8DxAAO33KYTvge1y62MKIWBslgw== 2024-09-21T03:51:28.837 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph-authtool: stdout AQDAQu5mIk0dCxAArckhUVQbqBzViHUmFv+LiA== 2024-09-21T03:51:28.839 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial monmap... 2024-09-21T03:51:29.810 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T03:51:29.810 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T03:51:29.811 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:51:29.811 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T03:51:29.811 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool for a [v2:172.21.15.22:3300,v1:172.21.15.22:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T03:51:29.811 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = quincy 2024-09-21T03:51:29.811 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: set fsid to ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:51:29.811 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T03:51:29.811 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:51:29.811 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mon... 2024-09-21T03:51:30.724 INFO:teuthology.orchestra.run.smithi022.stdout:create mon.a on 2024-09-21T03:51:30.938 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T03:51:31.089 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T03:51:31.294 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-ae19ad46-77cc-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-ae19ad46-77cc-11ef-baf5-efdc52797490.target. 2024-09-21T03:51:31.294 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-ae19ad46-77cc-11ef-baf5-efdc52797490.target → /etc/systemd/system/ceph-ae19ad46-77cc-11ef-baf5-efdc52797490.target. 2024-09-21T03:51:31.538 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.a 2024-09-21T03:51:31.538 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.a.service: Unit ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.a.service not loaded. 2024-09-21T03:51:31.718 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ae19ad46-77cc-11ef-baf5-efdc52797490.target.wants/ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.a.service → /etc/systemd/system/ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@.service. 2024-09-21T03:51:32.264 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:51:32.264 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-21T03:51:32.271 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:51:32.272 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-21T03:51:32.272 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-21T03:51:32.272 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T03:51:32.272 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon to start... 2024-09-21T03:51:32.272 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mon... 2024-09-21T03:51:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:32 smithi022 systemd[1]: Started Ceph mon.a for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:51:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T03:51:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: monmap epoch 1 2024-09-21T03:51:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:51:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: last_changed 2024-09-21T03:51:29.173395+0000 2024-09-21T03:51:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: created 2024-09-21T03:51:29.173395+0000 2024-09-21T03:51:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: min_mon_release 19 (squid) 2024-09-21T03:51:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: election_strategy: 1 2024-09-21T03:51:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-21T03:51:33.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: fsmap 2024-09-21T03:51:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T03:51:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: mgrmap e1: no daemons active 2024-09-21T03:51:33.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:33 smithi022 ceph-mon[30645]: from='client.? 172.21.15.22:0/876891414' entity='client.admin' cmd={"prefix": "status"} : dispatch 2024-09-21T03:51:33.392 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T03:51:33.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout id: ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:51:33.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T03:51:33.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:33.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout services: 2024-09-21T03:51:33.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.59806s) 2024-09-21T03:51:33.394 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T03:51:33.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T03:51:33.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:33.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout data: 2024-09-21T03:51:33.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T03:51:33.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T03:51:33.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T03:51:33.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T03:51:33.395 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:33.395 INFO:teuthology.orchestra.run.smithi022.stdout:mon is available 2024-09-21T03:51:33.395 INFO:teuthology.orchestra.run.smithi022.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T03:51:34.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:34 smithi022 ceph-mon[30645]: from='client.? 172.21.15.22:0/1166638068' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T03:51:34.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:34 smithi022 ceph-mon[30645]: from='client.? 172.21.15.22:0/1166638068' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T03:51:34.486 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:34.486 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T03:51:34.486 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:51:34.486 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T03:51:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T03:51:34.488 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T03:51:34.488 INFO:teuthology.orchestra.run.smithi022.stdout:Generating new minimal ceph.conf... 2024-09-21T03:51:35.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:35 smithi022 ceph-mon[30645]: from='client.? 172.21.15.22:0/3779385332' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:51:35.647 INFO:teuthology.orchestra.run.smithi022.stdout:Restarting the monitor... 2024-09-21T03:51:35.914 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:35 smithi022 systemd[1]: Stopping Ceph mon.a for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:51:36.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:35 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a[30641]: 2024-09-21T03:51:35.912+0000 7f6ef6c3d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T03:51:36.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:35 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a[30641]: 2024-09-21T03:51:35.912+0000 7f6ef6c3d640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T03:51:36.172 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:35 smithi022 podman[30888]: 2024-09-21 03:51:35.932937397 +0000 UTC m=+0.119039892 container died 9bad8c6f2ecf81177e4ee630e7890eaacb8487c53f459a5dd4acc2a604e74cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:51:36.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:36 smithi022 podman[30888]: 2024-09-21 03:51:36.269813204 +0000 UTC m=+0.455915742 container cleanup 9bad8c6f2ecf81177e4ee630e7890eaacb8487c53f459a5dd4acc2a604e74cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-09-21T03:51:36.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:36 smithi022 bash[30888]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a 2024-09-21T03:51:36.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:36 smithi022 podman[30900]: 2024-09-21 03:51:36.428961906 +0000 UTC m=+0.493442087 container remove 9bad8c6f2ecf81177e4ee630e7890eaacb8487c53f459a5dd4acc2a604e74cd0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2) 2024-09-21T03:51:36.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:36 smithi022 systemd[1]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T03:51:36.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:36 smithi022 systemd[1]: Stopped Ceph mon.a for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:51:36.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:36 smithi022 systemd[1]: Starting Ceph mon.a for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:51:37.096 INFO:teuthology.orchestra.run.smithi022.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T03:51:37.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:36 smithi022 podman[30995]: 2024-09-21 03:51:36.846282168 +0000 UTC m=+0.103399215 container create f3c4fd300993fc30636de0160a9c7947e35d463292dfbb0bc726d2d237a79c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-21T03:51:37.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:36 smithi022 podman[30995]: 2024-09-21 03:51:36.759575463 +0000 UTC m=+0.016692525 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:51:37.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 podman[30995]: 2024-09-21 03:51:37.031939083 +0000 UTC m=+0.289056144 container init f3c4fd300993fc30636de0160a9c7947e35d463292dfbb0bc726d2d237a79c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T03:51:37.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 podman[30995]: 2024-09-21 03:51:37.035045163 +0000 UTC m=+0.292162218 container start f3c4fd300993fc30636de0160a9c7947e35d463292dfbb0bc726d2d237a79c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T03:51:37.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T03:51:37.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: pidfile_write: ignore empty --pid-file 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: load: jerasure load: lrc 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: RocksDB version: 7.9.2 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Git sha 0 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: DB SUMMARY 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: DB Session ID: Z10X2QWGMOBDY9TK39H3 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: CURRENT file: CURRENT 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T03:51:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 94288 ; 2024-09-21T03:51:37.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.error_if_exists: 0 2024-09-21T03:51:37.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.create_if_missing: 0 2024-09-21T03:51:37.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.paranoid_checks: 1 2024-09-21T03:51:37.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T03:51:37.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.env: 0x5582d639bd60 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.info_log: 0x5582dadaf360 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.statistics: (nil) 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.use_fsync: 0 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_log_file_size: 0 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T03:51:37.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.allow_fallocate: 1 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.use_direct_reads: 0 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.db_log_dir: 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.wal_dir: 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T03:51:37.103 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.write_buffer_manager: 0x5582dadb3d60 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.unordered_write: 0 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T03:51:37.104 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.row_cache: None 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.wal_filter: None 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.two_write_queues: 0 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.wal_compression: 0 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.atomic_flush: 0 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T03:51:37.105 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.log_readahead_size: 0 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_background_jobs: 2 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_background_compactions: -1 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_subcompactions: 1 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T03:51:37.106 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_open_files: -1 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_background_flushes: -1 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Compression algorithms supported: 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: kZSTD supported: 0 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: kXpressCompression supported: 0 2024-09-21T03:51:37.107 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: kBZip2Compression supported: 0 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: kLZ4Compression supported: 1 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: kZlibCompression supported: 1 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: kSnappyCompression supported: 1 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.merge_operator: 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_filter: None 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T03:51:37.108 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5582dadaefa0) 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks: 1 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: pin_top_level_index_and_filter: 1 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_type: 0 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_index_type: 0 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_shortening: 1 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: checksum: 4 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: no_block_cache: 0 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache: 0x5582d6d73610 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_name: BinnedLRUCache 2024-09-21T03:51:37.109 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_options: 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: capacity : 536870912 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_shard_bits : 4 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: strict_capacity_limit : 0 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: high_pri_pool_ratio: 0.000 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_cache_compressed: (nil) 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: persistent_cache: (nil) 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size: 4096 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_size_deviation: 10 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_restart_interval: 16 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: index_block_restart_interval: 1 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: metadata_block_size: 4096 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: partition_filters: 0 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: use_delta_encoding: 1 2024-09-21T03:51:37.110 INFO:journalctl@ceph.mon.a.smithi022.stdout: filter_policy: bloomfilter 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout: whole_key_filtering: 1 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout: verify_compression: 0 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout: read_amp_bytes_per_bit: 0 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout: format_version: 5 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_index_compression: 1 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout: block_align: 0 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout: max_auto_readahead_size: 262144 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout: prepopulate_block_cache: 0 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout: initial_auto_readahead_size: 8192 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compression: NoCompression 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T03:51:37.111 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.num_levels: 7 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:51:37.112 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:51:37.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T03:51:37.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T03:51:37.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T03:51:37.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T03:51:37.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:51:37.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:51:37.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T03:51:37.113 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T03:51:37.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:51:37.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T03:51:37.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T03:51:37.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T03:51:37.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T03:51:37.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T03:51:37.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T03:51:37.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T03:51:37.114 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T03:51:37.115 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T03:51:37.116 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.inplace_update_support: 0 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.bloom_locality: 0 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.max_successive_merges: 0 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.ttl: 2592000 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T03:51:37.117 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.enable_blob_files: false 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.min_blob_size: 0 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T03:51:37.118 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 97b11cb3-6408-46c7-b517-25d912b431fb 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890697071111, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890697072295, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 90592, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 281, "table_properties": {"data_size": 88633, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11462, "raw_average_key_size": 47, "raw_value_size": 82113, "raw_average_value_size": 342, "num_data_blocks": 12, "num_entries": 240, "num_filter_entries": 240, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726890697, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "97b11cb3-6408-46c7-b517-25d912b431fb", "db_session_id": "Z10X2QWGMOBDY9TK39H3", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890697072399, "job": 1, "event": "recovery_finished"} 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5582dadd2a80 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: DB pointer 0x5582dbb78000 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** DB Stats ** 2024-09-21T03:51:37.119 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: L0 2/0 90.33 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 121.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: Sum 2/0 90.33 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 121.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:51:37.120 INFO:journalctl@ceph.mon.a.smithi022.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 121.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** Compaction Stats [default] ** 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 121.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T03:51:37.121 INFO:journalctl@ceph.mon.a.smithi022.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout: Cumulative compaction: 0.00 GB write, 25.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout: Interval compaction: 0.00 GB write, 25.22 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache BinnedLRUCache@0x5582d6d73610#2 capacity: 512.00 MB usage: 1.31 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.84 KB,0.000160933%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: starting mon.a rank 0 at public addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] at bind addrs [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: mon.a@-1(???) e1 preinit fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: mon.a@-1(???).mds e1 new map 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: mon.a@-1(???).mds e1 print_map 2024-09-21T03:51:37.122 INFO:journalctl@ceph.mon.a.smithi022.stdout: e1 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout: btime 2024-09-21T03:51:32:216802+0000 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout: legacy client fscid: -1 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout: 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout: No filesystems configured 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 bash[30995]: f3c4fd300993fc30636de0160a9c7947e35d463292dfbb0bc726d2d237a79c85 2024-09-21T03:51:37.123 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 systemd[1]: Started Ceph mon.a for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:51:37.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-21T03:51:37.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: monmap epoch 1 2024-09-21T03:51:37.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:51:37.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: last_changed 2024-09-21T03:51:29.173395+0000 2024-09-21T03:51:37.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: created 2024-09-21T03:51:29.173395+0000 2024-09-21T03:51:37.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: min_mon_release 19 (squid) 2024-09-21T03:51:37.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: election_strategy: 1 2024-09-21T03:51:37.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-21T03:51:37.390 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: fsmap 2024-09-21T03:51:37.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T03:51:37.391 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:37 smithi022 ceph-mon[31015]: mgrmap e1: no daemons active 2024-09-21T03:51:38.159 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T03:51:38.180 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:51:38.180 INFO:teuthology.orchestra.run.smithi022.stdout:Creating mgr... 2024-09-21T03:51:38.181 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T03:51:38.181 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T03:51:38.443 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.x 2024-09-21T03:51:38.443 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Failed to reset failed state of unit ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.x.service: Unit ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.x.service not loaded. 2024-09-21T03:51:38.602 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-ae19ad46-77cc-11ef-baf5-efdc52797490.target.wants/ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.x.service → /etc/systemd/system/ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@.service. 2024-09-21T03:51:39.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:38 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1703231027' entity='client.admin' 2024-09-21T03:51:39.099 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:51:38 smithi022 podman[31227]: 2024-09-21 03:51:38.739401726 +0000 UTC m=+0.016964748 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 2024-09-21T03:51:40.099 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:51:39 smithi022 podman[31227]: 2024-09-21 03:51:39.633326038 +0000 UTC m=+0.910889080 container create b2c9cbad686bdc1881b92fb26da20f358f2a52012c9f27cceab44598b34f5505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T03:51:41.849 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:51:41 smithi022 podman[31227]: 2024-09-21 03:51:41.466816874 +0000 UTC m=+2.744379886 container init b2c9cbad686bdc1881b92fb26da20f358f2a52012c9f27cceab44598b34f5505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:51:41.849 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:51:41 smithi022 podman[31227]: 2024-09-21 03:51:41.470625984 +0000 UTC m=+2.748188991 container start b2c9cbad686bdc1881b92fb26da20f358f2a52012c9f27cceab44598b34f5505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T03:51:42.572 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:51:42.572 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-21T03:51:42.579 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:51:42.579 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-21T03:51:42.579 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-21T03:51:42.580 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T03:51:42.589 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:51:42.589 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-21T03:51:42.598 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:51:42.598 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-21T03:51:42.598 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-21T03:51:42.598 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-21T03:51:42.598 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr to start... 2024-09-21T03:51:42.599 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr... 2024-09-21T03:51:42.849 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:51:42 smithi022 bash[31227]: b2c9cbad686bdc1881b92fb26da20f358f2a52012c9f27cceab44598b34f5505 2024-09-21T03:51:42.849 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:51:42 smithi022 systemd[1]: Started Ceph mgr.x for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:51:46.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:45 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1396891179' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:51:47.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: Activating manager daemon x 2024-09-21T03:51:47.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: mgrmap e2: x(active, starting, since 0.00367904s) 2024-09-21T03:51:47.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: from='mgr.14100 172.21.15.22:0/1612657642' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:51:47.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: from='mgr.14100 172.21.15.22:0/1612657642' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:51:47.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: from='mgr.14100 172.21.15.22:0/1612657642' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:51:47.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: from='mgr.14100 172.21.15.22:0/1612657642' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:51:47.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: from='mgr.14100 172.21.15.22:0/1612657642' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:51:47.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: Manager daemon x is now available 2024-09-21T03:51:47.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: from='mgr.14100 172.21.15.22:0/1612657642' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:51:47.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: from='mgr.14100 172.21.15.22:0/1612657642' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:51:47.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: from='mgr.14100 172.21.15.22:0/1612657642' entity='mgr.x' 2024-09-21T03:51:47.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: from='mgr.14100 172.21.15.22:0/1612657642' entity='mgr.x' 2024-09-21T03:51:47.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:46 smithi022 ceph-mon[31015]: from='mgr.14100 172.21.15.22:0/1612657642' entity='mgr.x' 2024-09-21T03:51:49.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:48 smithi022 ceph-mon[31015]: mgrmap e3: x(active, since 1.00883s) 2024-09-21T03:51:50.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:49 smithi022 ceph-mon[31015]: mgrmap e4: x(active, since 2s) 2024-09-21T03:51:52.029 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:52.029 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:51:52.029 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T03:51:52.029 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:51:52.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:51:52.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:51:52.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:51:52.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:52.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:51:52.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:51:52.030 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:51:52.032 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:51:52.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:51:52.033 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:51:52.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:51:52.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:51:52.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:51:52.036 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:51:52.037 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:51:32:216802+0000", 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:52.038 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:51:52.039 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:51:52.039 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:51:32.217594+0000", 2024-09-21T03:51:52.039 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:51:52.039 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:52.039 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:51:52.039 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:51:52.039 INFO:teuthology.orchestra.run.smithi022.stdout:mgr not available, waiting (1/15)... 2024-09-21T03:51:55.005 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:54 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3322382950' entity='client.admin' cmd={"prefix": "status", "format": "json-pretty"} : dispatch 2024-09-21T03:51:55.309 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:55.312 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:51:55.312 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T03:51:55.312 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T03:51:55.312 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T03:51:55.312 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T03:51:55.312 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T03:51:55.312 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:55.312 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T03:51:55.312 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 0 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "a" 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "quorum_age": 17, 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T03:51:55.313 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T03:51:55.314 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T03:51:55.314 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T03:51:55.314 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T03:51:55.314 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T03:51:55.317 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:55.317 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T03:51:55.317 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T03:51:55.317 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T03:51:55.317 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T03:51:55.317 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T03:51:55.317 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T03:51:55.317 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T03:51:55.317 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T03:51:32:216802+0000", 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T03:51:55.318 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ], 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T03:51:32.217594+0000", 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout }, 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:51:55.319 INFO:teuthology.orchestra.run.smithi022.stdout:mgr is available 2024-09-21T03:51:56.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:55 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1299318180' entity='client.admin' cmd={"prefix": "config assimilate-conf"} : dispatch 2024-09-21T03:51:56.450 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:56.450 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T03:51:56.450 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout fsid = ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:51:56.450 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-21T03:51:56.450 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.22:3300,v1:172.21.15.22:6789] 2024-09-21T03:51:56.450 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T03:51:56.450 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T03:51:56.450 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T03:51:56.450 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T03:51:56.450 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:56.451 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T03:51:56.451 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T03:51:56.451 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 2024-09-21T03:51:56.451 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T03:51:56.451 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T03:51:56.451 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T03:51:56.451 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T03:51:56.451 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T03:51:56.451 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T03:51:56.451 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling cephadm module... 2024-09-21T03:51:57.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:57 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/572005901' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "cephadm"} : dispatch 2024-09-21T03:51:57.599 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:51:57 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: ignoring --setuser ceph since I am not root 2024-09-21T03:51:57.599 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:51:57 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: ignoring --setgroup ceph since I am not root 2024-09-21T03:51:58.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:58 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/572005901' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T03:51:58.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:58 smithi022 ceph-mon[31015]: mgrmap e5: x(active, since 10s) 2024-09-21T03:51:59.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:51:59 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1801149714' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T03:52:00.142 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:52:00.143 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T03:52:00.143 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:52:00.143 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T03:52:00.143 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T03:52:00.143 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:52:00.143 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-09-21T03:52:00.143 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 5... 2024-09-21T03:52:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:02 smithi022 ceph-mon[31015]: Active manager daemon x restarted 2024-09-21T03:52:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:02 smithi022 ceph-mon[31015]: Activating manager daemon x 2024-09-21T03:52:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:02 smithi022 ceph-mon[31015]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T03:52:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:02 smithi022 ceph-mon[31015]: mgrmap e6: x(active, starting, since 0.00393784s) 2024-09-21T03:52:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:02 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:52:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:02 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:52:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:02 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:52:02.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:02 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:52:02.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:02 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:52:02.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:02 smithi022 ceph-mon[31015]: Manager daemon x is now available 2024-09-21T03:52:03.997 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:52:03.997 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T03:52:03.997 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T03:52:03.997 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:52:03.998 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 5 is available 2024-09-21T03:52:03.998 INFO:teuthology.orchestra.run.smithi022.stdout:Verifying orchestrator module is enabled... 2024-09-21T03:52:04.709 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:04.709 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:04.709 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: Found migration_current of "None". Setting to last migration. 2024-09-21T03:52:04.709 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:04.709 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:04.709 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:04.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:04.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:52:04.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:52:04.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T03:52:04.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: mgrmap e7: x(active, since 1.00598s) 2024-09-21T03:52:04.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:04 smithi022 ceph-mon[31015]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T03:52:05.367 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T03:52:05.103+0000 7fb11c983640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:52:05] ENGINE Error in HTTPServer.serve 2024-09-21T03:52:05.367 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: Traceback (most recent call last): 2024-09-21T03:52:05.367 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:52:05.367 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: self._connections.run(self.expiration_interval) 2024-09-21T03:52:05.367 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:52:05.367 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: self._run(expiration_interval) 2024-09-21T03:52:05.367 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:52:05.367 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:52:05.367 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:52:05.367 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:52:05.368 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:52:05.368 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: s = self.context.wrap_socket( 2024-09-21T03:52:05.368 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:52:05.368 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: return self.sslsocket_class._create( 2024-09-21T03:52:05.368 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:52:05.368 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: self.do_handshake() 2024-09-21T03:52:05.368 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:52:05.368 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: self._sslobj.do_handshake() 2024-09-21T03:52:05.368 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:52:05.368 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T03:52:05.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3635258404' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "orchestrator"} : dispatch 2024-09-21T03:52:05.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-mon[31015]: [21/Sep/2024:03:52:04] ENGINE Bus STARTING 2024-09-21T03:52:05.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-mon[31015]: [21/Sep/2024:03:52:05] ENGINE Serving on https://172.21.15.22:7150 2024-09-21T03:52:05.668 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-mon[31015]: [21/Sep/2024:03:52:05] ENGINE Error in HTTPServer.serve 2024-09-21T03:52:05.668 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-09-21T03:52:05.668 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:52:05.668 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:52:05.668 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:52:05.668 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-09-21T03:52:05.668 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:52:05.669 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-mon[31015]: [21/Sep/2024:03:52:05] ENGINE Serving on http://172.21.15.22:8765 2024-09-21T03:52:05.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-mon[31015]: [21/Sep/2024:03:52:05] ENGINE Bus STARTED 2024-09-21T03:52:05.670 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:05 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:05.971 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr module 'orchestrator' is already enabled (always-on) 2024-09-21T03:52:05.971 INFO:teuthology.orchestra.run.smithi022.stdout:Setting orchestrator backend to cephadm... 2024-09-21T03:52:06.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:06 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3635258404' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "orchestrator"}]': finished 2024-09-21T03:52:06.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:06 smithi022 ceph-mon[31015]: mgrmap e8: x(active, since 2s) 2024-09-21T03:52:07.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:07 smithi022 ceph-mon[31015]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:07.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:07 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:07.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:07 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:08.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T03:52:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:Generating ssh key... 2024-09-21T03:52:09.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:08 smithi022 ceph-mon[31015]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:09.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: Generating public/private rsa key pair. 2024-09-21T03:52:09.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: Your identification has been saved in /tmp/tmp9gsjsshj/key 2024-09-21T03:52:09.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: Your public key has been saved in /tmp/tmp9gsjsshj/key.pub 2024-09-21T03:52:09.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: The key fingerprint is: 2024-09-21T03:52:09.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: SHA256:N/eXRRGuqcZUZ6oeAWqCbDT1AQfMkfiY8nGUOvk0m5g ceph-ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:52:09.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: The key's randomart image is: 2024-09-21T03:52:09.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: +---[RSA 3072]----+ 2024-09-21T03:52:09.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: | +=*o o.| 2024-09-21T03:52:09.561 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: | ..*o . . .| 2024-09-21T03:52:09.562 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: | oB . . . +.| 2024-09-21T03:52:09.562 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: | .oBo= . . . *. | 2024-09-21T03:52:09.562 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: | o+O.+oS oo.+ .| 2024-09-21T03:52:09.562 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: | .E +o .oo+. o| 2024-09-21T03:52:09.562 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: | * ...| 2024-09-21T03:52:09.562 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: | o . . | 2024-09-21T03:52:09.562 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: | . | 2024-09-21T03:52:09.562 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: +----[SHA256]-----+ 2024-09-21T03:52:09.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-mon[31015]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:09.811 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-mon[31015]: Generating ssh key... 2024-09-21T03:52:09.812 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:09.812 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:09 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:11.005 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIhbydFp3LGjt1H34clpHaUcWDOXJEJ+MCuaEKHvGOtCtq4Ds2xkvu8uGECvkZiR/Jd/dZC/cqgJICPX1wnht3Acj1odwpJWQtD4w/CZjYan2LLQK02kldGcqFHNZL14F2tbD73PlTLfJ0UYjQ4sKbyxSGZ2v5UG0bF+VzXKna5riPC1MHt8ZWhaPvzc94LIxOPrwhuleKYj9wQAqOwfrzbdDaaP9cfy9ITJiP015DtXBuaaQcacERjaNqYK0ytws9lakP1SjpVpuxgYCxeG1HM9S4QjT83HP44LzXPsRq6GX7pqpwnG00QJJQd0me6pAlVt+br9vtKGEy9nzeu5cwmipfAqPDZLbNW6p9gM/Od5NaQteIF+caMyh0ziiPy59OpWnA5B8ha+plW5uaImwuh524SVpR6U5gyiwZO89hql1b4aeRLXCQpPjiEWjOZoaUeSEwFWMTpOwDjSN5P7iOxmeWT5aBtUVnHDE/b24jTVpgo5p4wyBYXtx7iK6mTM= ceph-ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:52:11.006 INFO:teuthology.orchestra.run.smithi022.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T03:52:11.006 INFO:teuthology.orchestra.run.smithi022.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T03:52:11.011 INFO:teuthology.orchestra.run.smithi022.stdout:Adding host smithi022... 2024-09-21T03:52:11.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:11 smithi022 ceph-mon[31015]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:12 smithi022 ceph-mon[31015]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi022", "addr": "172.21.15.22", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:13.511 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:13 smithi022 ceph-mon[31015]: Deploying cephadm binary to smithi022 2024-09-21T03:52:15.988 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Added host 'smithi022' with addr '172.21.15.22' 2024-09-21T03:52:15.988 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mon service... 2024-09-21T03:52:16.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:16 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:16.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:16 smithi022 ceph-mon[31015]: Added host smithi022 2024-09-21T03:52:16.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:16 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:17.364 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T03:52:17.364 INFO:teuthology.orchestra.run.smithi022.stdout:Deploying unmanaged mgr service... 2024-09-21T03:52:17.977 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:17 smithi022 ceph-mon[31015]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:17.978 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:17 smithi022 ceph-mon[31015]: Saving service mon spec with placement count:5 2024-09-21T03:52:17.978 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:17 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:18.614 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T03:52:19.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:19 smithi022 ceph-mon[31015]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:19.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:19 smithi022 ceph-mon[31015]: Saving service mgr spec with placement count:2 2024-09-21T03:52:19.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:19 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:20.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:20 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:20.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:20 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:20.563 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:20 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1100270265' entity='client.admin' 2024-09-21T03:52:21.832 INFO:teuthology.orchestra.run.smithi022.stdout:Enabling the dashboard module... 2024-09-21T03:52:22.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:22 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3166780266' entity='client.admin' 2024-09-21T03:52:23.772 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:23 smithi022 ceph-mon[31015]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:52:23.772 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:23 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1726380160' entity='client.admin' cmd={"prefix": "mgr module enable", "module": "dashboard"} : dispatch 2024-09-21T03:52:23.773 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:23 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:23.773 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:23 smithi022 ceph-mon[31015]: from='mgr.14116 172.21.15.22:0/1519360396' entity='mgr.x' 2024-09-21T03:52:23.773 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:23 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: ignoring --setuser ceph since I am not root 2024-09-21T03:52:23.773 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:23 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: ignoring --setgroup ceph since I am not root 2024-09-21T03:52:24.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:24 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1726380160' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T03:52:24.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:24 smithi022 ceph-mon[31015]: mgrmap e9: x(active, since 21s) 2024-09-21T03:52:25.359 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:52:25.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T03:52:25.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T03:52:25.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-21T03:52:25.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T03:52:25.360 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:52:25.360 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for the mgr to restart... 2024-09-21T03:52:25.360 INFO:teuthology.orchestra.run.smithi022.stdout:Waiting for mgr epoch 9... 2024-09-21T03:52:25.540 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:25 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3912603454' entity='client.admin' cmd={"prefix": "mgr stat"} : dispatch 2024-09-21T03:52:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:28 smithi022 ceph-mon[31015]: Active manager daemon x restarted 2024-09-21T03:52:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:28 smithi022 ceph-mon[31015]: Activating manager daemon x 2024-09-21T03:52:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:28 smithi022 ceph-mon[31015]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T03:52:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:28 smithi022 ceph-mon[31015]: mgrmap e10: x(active, starting, since 0.00405764s) 2024-09-21T03:52:29.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:52:29.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "x", "id": "x"} : dispatch 2024-09-21T03:52:29.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata"} : dispatch 2024-09-21T03:52:29.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata"} : dispatch 2024-09-21T03:52:29.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata"} : dispatch 2024-09-21T03:52:29.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:28 smithi022 ceph-mon[31015]: Manager daemon x is now available 2024-09-21T03:52:30.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:30.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"} : dispatch 2024-09-21T03:52:30.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"} : dispatch 2024-09-21T03:52:30.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:29 smithi022 ceph-mon[31015]: mgrmap e11: x(active, since 1.0072s) 2024-09-21T03:52:31.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:30 smithi022 ceph-mon[31015]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T03:52:31.020 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:30 smithi022 ceph-mon[31015]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T03:52:31.023 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout { 2024-09-21T03:52:31.023 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T03:52:31.023 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T03:52:31.023 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout } 2024-09-21T03:52:31.023 INFO:teuthology.orchestra.run.smithi022.stdout:mgr epoch 9 is available 2024-09-21T03:52:31.024 INFO:teuthology.orchestra.run.smithi022.stdout:Using certmgr to generate dashboard self-signed certificate... 2024-09-21T03:52:31.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T03:52:31.265+0000 7fcbec3d1640 -1 log_channel(cephadm) log [ERR] : [21/Sep/2024:03:52:31] ENGINE Error in HTTPServer.serve 2024-09-21T03:52:31.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: Traceback (most recent call last): 2024-09-21T03:52:31.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:52:31.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: self._connections.run(self.expiration_interval) 2024-09-21T03:52:31.348 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: self._run(expiration_interval) 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: s = self.context.wrap_socket( 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: return self.sslsocket_class._create( 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: self.do_handshake() 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: self._sslobj.do_handshake() 2024-09-21T03:52:31.349 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:52:31.350 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T03:52:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-mon[31015]: mgrmap e12: x(active, since 2s) 2024-09-21T03:52:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-mon[31015]: [21/Sep/2024:03:52:31] ENGINE Bus STARTING 2024-09-21T03:52:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-mon[31015]: [21/Sep/2024:03:52:31] ENGINE Serving on http://172.21.15.22:8765 2024-09-21T03:52:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-mon[31015]: [21/Sep/2024:03:52:31] ENGINE Serving on https://172.21.15.22:7150 2024-09-21T03:52:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-mon[31015]: [21/Sep/2024:03:52:31] ENGINE Bus STARTED 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-mon[31015]: [21/Sep/2024:03:52:31] ENGINE Error in HTTPServer.serve 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: Traceback (most recent call last): 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._connections.run(self.expiration_interval) 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._run(expiration_interval) 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: s = self.context.wrap_socket( 2024-09-21T03:52:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T03:52:32.351 INFO:journalctl@ceph.mon.a.smithi022.stdout: return self.sslsocket_class._create( 2024-09-21T03:52:32.351 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T03:52:32.351 INFO:journalctl@ceph.mon.a.smithi022.stdout: self.do_handshake() 2024-09-21T03:52:32.351 INFO:journalctl@ceph.mon.a.smithi022.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T03:52:32.351 INFO:journalctl@ceph.mon.a.smithi022.stdout: self._sslobj.do_handshake() 2024-09-21T03:52:32.351 INFO:journalctl@ceph.mon.a.smithi022.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T03:52:32.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:33.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:33 smithi022 ceph-mon[31015]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch certmgr generate-certificates", "module_name": "dashboard", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:33.388 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:33.944 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout {"cert": "-----BEGIN CERTIFICATE-----\nMIIE+zCCAuOgAwIBAgIUFhtSGsogIV4azYuPpOWwmkf0MFIwDQYJKoZIhvcNAQEL\nBQAwFzEVMBMGA1UEAwwMY2VwaGFkbS1yb290MB4XDTI0MDkyMTAzNTIzM1oXDTM0\nMDkyMjAzNTIzM1owFzEVMBMGA1UEAwwMMTcyLjIxLjE1LjIyMIICIjANBgkqhkiG\n9w0BAQEFAAOCAg8AMIICCgKCAgEAmDp1qXZXLrvlzNqcm0CgmUic90okIeoek+Hx\nkTVcYTIYuD1TLQIPhcz3ZFE9aCMhPqp/PPesm+Fs5xTP1t6F5TRRJ/X10/FPWkxy\n0a0rUXdPterFvZzqM2GhhDquEuxglr8UXzt7rj6kPeTM0FDYie1rU6a45jUpN1uo\nfiRAxqzzED+Lq75OWG/xLITW8ITH2nPdDq/ftsQZ430oKXASs4u69TT+1UkQr2gt\n7fksBio/+OqP1igVtD8iTxlD52ZLr4NXmWFvI/n9xqVrsVn5AvurDowVWg5VmOQu\nJAiomTlqfwqeS7iNij8cQ4OHUAh6XZVuf9H91aPG72fETCfbIxvzIWio1WRiYDtj\n9aoTM2wtK/AGF91QsXpMjgDcli2079lDMz/rNPV0O3dBX1OcecWpHAECsBcaRYoP\ndu13c2Xk3DSGypkqiNjXgENOOrId/gI69fKY4Cwy16noovYIGCHB9y2yxJ0W5MUm\nCtxlHPt4FNYkc1vhwyYmckBIGf85N7cr5oQd2CkISWDjUdD3V7oJeRa4QIwZ0pz9\nbJjQhFeL0bSULMKqq4W2EjBj19YF7UotqngFZgBAe0wzLaS6+aG88APEDhXnfyHK\nBHnVtnRdvz9NCxE0MdHiPO3Su0BR/dBz6NTsH77tPu3XqkWokuSf8HdYk6fRVUFd\niO3GJy8CAwEAAaM/MD0wLQYDVR0RBCYwJIIJc21pdGhpMDIyghFkYXNoYm9hcmRf\nc2VydmVyc4cErBUPFjAMBgNVHRMBAf8EAjAAMA0GCSqGSIb3DQEBCwUAA4ICAQAF\nZwG3xCuW93PpfxP40+uMEPqT9w5kuWskNH+WVzvih95puQ8Rfu/e72dO+YsLCWpQ\nD5XSypY/PRB61MWcldkNsmUGzLBw2l7eIqUK2y2azAaTT9bm0oF1gL/b7YUDSm65\n2ZdpcIAr7hysqRTopf4ayip75G+I3Bsn9o7OkZtp7Jz2sSsK5XcQAOQR3lBQpLnm\nm+rTg3Y2laivJmktExGFrsaF8LM5X+0Tq/A3zMLE4jAgU2bZN/kQf+7mfWFMoff2\nFGG3HhEgsJzDrgmPq55yNzNQZMIB1IA6qG5shk02ZDW75jvhGMs+kYM0Tj8XDkNx\nxKGH6PAWvwRivghDLb3qTPl8VKC2Hxhax5ZT3tVd2USou9tbZSL/Zhl3hPMSNcNr\nlu7/YfHV1/Hkjjba8kDC8f+sI/TkImZfTkit3Y76G+fhRobGJAH713NYpUgRcnvV\nlY9mEVAcQK7Y2d5q0z4F2gDwlckuR55K48UFO9Y8f4kBX5S12xt6rhjokF73V13G\nlyixJN8xHUebMm2VpHlRAx7Fvl1xKSp6cs+H5T91IIS0sY3oWlMAtnH2LbuUipyv\nq4J102VKosFLosk3dwW9HoKjqO4YA/7Sx7mhHNqgRTaB5wvAL1uDmYcS0cA+nEVN\nDW0cBwzu3M7gHtJSHI/wlyFNhmyTi3QctaGX88JX5Q==\n-----END CERTIFICATE-----\n", "key": "-----BEGIN RSA PRIVATE KEY-----\nMIIJKAIBAAKCAgEAmDp1qXZXLrvlzNqcm0CgmUic90okIeoek+HxkTVcYTIYuD1T\nLQIPhcz3ZFE9aCMhPqp/PPesm+Fs5xTP1t6F5TRRJ/X10/FPWkxy0a0rUXdPterF\nvZzqM2GhhDquEuxglr8UXzt7rj6kPeTM0FDYie1rU6a45jUpN1uofiRAxqzzED+L\nq75OWG/xLITW8ITH2nPdDq/ftsQZ430oKXASs4u69TT+1UkQr2gt7fksBio/+OqP\n1igVtD8iTxlD52ZLr4NXmWFvI/n9xqVrsVn5AvurDowVWg5VmOQuJAiomTlqfwqe\nS7iNij8cQ4OHUAh6XZVuf9H91aPG72fETCfbIxvzIWio1WRiYDtj9aoTM2wtK/AG\nF91QsXpMjgDcli2079lDMz/rNPV0O3dBX1OcecWpHAECsBcaRYoPdu13c2Xk3DSG\nypkqiNjXgENOOrId/gI69fKY4Cwy16noovYIGCHB9y2yxJ0W5MUmCtxlHPt4FNYk\nc1vhwyYmckBIGf85N7cr5oQd2CkISWDjUdD3V7oJeRa4QIwZ0pz9bJjQhFeL0bSU\nLMKqq4W2EjBj19YF7UotqngFZgBAe0wzLaS6+aG88APEDhXnfyHKBHnVtnRdvz9N\nCxE0MdHiPO3Su0BR/dBz6NTsH77tPu3XqkWokuSf8HdYk6fRVUFdiO3GJy8CAwEA\nAQKCAgAEZht9mDHpvynRBWWcHXULKOM3tmr34DQeJABfFncnkLesAYtdivF8mfW6\nt7xDK5prr4O54qThmtUS24Qr/vzazVm33feTyKWLlmBgcAL0y+lSQX//KeX8n/gc\nFG0nch52+mlEOKcrEpwuhxyvu35VOyRQ49wY83VQFf1SYYmpXTQwmMszyu3xo5C/\n5l6CPS5OHIFt3CXmJ8YYBpBVwH2tSGN1JqD1qvvEhK4WhGpB5n3u5IVx898B1HTs\ntFvXLnYPktCLIy0kNhHpDIXz7jyUfrOsowLuFVb039uu5rzdoTKcZ56lPxQ3Z/nj\nUmi+yzx+i/GIIQgXF4uuBqGHJGmyRkLRgsD18xy/W6g/njWS5bfN8OTLXZVp6efV\nHFhIXsNereoCeJV4rDFdMOmgL3FSG5g3uN51j03ul9GieQ/sdLOhxFc8awm84Hqp\n/sBIRYhDs7gAGQZ/5fI3W32JgzgIZdPIcO2eqpM5jdDKwWYECwed491q0z0/pv8w\nNggTfWXoAm2HVS2k8wN0JAJ9hhtLAGny020dnZSxQSsjwMkMizu72h9JegtvBZnn\n/DtcRC8RMzc4xtIkOroRY5m8mrSQeFtaZ27KxJ48CBOQCDzeX8bdji0zphC4raL4\nW5FjmEnznbgJZwZBRzeS+/zAcfJtUZ3Trd+hihcL3RfxVp9ITQKCAQEAxkdavcQn\nOu9K66ZMhEhZadLgHL0+9GE85QSP+f+QuivKs4IYjXVZ6CdJGISFq2M4+JQtOIDo\ny0I+Jp9n2/Cr9YTtdkhd7aY3SlOJhOy4+Agbe3mViWaqmC23kIymD0H7L5h0nDE6\nstSGF+uhXWEAsWI4qTT1LGqgYt29OUZtJGBuIBKQSoIcwdcp3/yVXBuvVxAIbQ7z\nzFiqciRlCcbi2eYJAtVR0m59lipDVX4hNvByWQ+pffNdTobFAycToH0WZL18cklK\nl6fB7BB060rjJaHvDNaRABqAxF4aSZGhCrkJG8uxrGqSVLX8gN7nqE/45Tey4RQG\nuB69pcog/kVTtQKCAQEAxIs4F56hT16bjp0X+xQw6zW37CKkvNbEK4dA++ix4pxZ\nKaOpE4Hhgjm1h/aMeuFDnNiyWLVvp64FeL70S7S/Q1Q3AnhfImU1v4Mn/7jC/sBk\nIG0vVmShuBP5LZ8YHXURMdOJ3lPkta4AzI/uoZ+zIiDIIgWPL+jCOy4qJkftQHeY\nvF1V0guG8SU+vpVJSkqxUbAXp5fgGLV8depVWFYRku4BmtVNBfP8IJFglprBwg9Q\n+pSkyeZdRrDrXlwNNhwRtj0YrgE4YweF5iFdEMMS3srZuLf8KOZWxb65/RdqkYq3\njYMD416lHRZV4hUAoBEkkc49zSC4doll2kRfxwUl0wKCAQBfHfXS2Rl0tTx8pU9J\nmieCk429W6+qrkb3GmQzKr10AfQAfyVmHuidbNMs9s3k9PlsjjDPTU/fygxknM3G\n/cKQSk9cEcU1bypQ9pge8yycl88PQblRq7WkwTGxHze+VAm6wGkYUKl3Bmq5aOkF\nEbayYYsK6QPAZfpA01yl8DoFXFkX+6/KfnZrKtvEvrer8v//RQq1vpmH6vUBQqJR\nuV4z551lBY5141lNw0J/7bzjTR+dx9yoNioJtK8oHwPUVo16kEf1z2EANZLaut5L\nzaX/9Jnnz7rJkO06xmXX6wuVSEStV98I9iryhkb2T3hUDuE4nKqsPN4oT17s/HUt\nZXaNAoIBAQCRoVZ+qdt8o+0/TsdmEx/sKHGPVlwaUEgquJ0+Cr1D2/V1FP9CpQoj\nI/+OLvEIW8FthmMft9Bzvk3vmg4JynOtv8jC284h/jxFGzmYEZ7qhEOsgzqAGTB6\n5NHNLAUCTqve749IXYEp3TRaXovC1kI1F3UzQEtIhH7mut4gX0s8aWGSsNXWPRRP\nufkz3gngMlgQ3xmn5LD3ngIKnQd/3MZIyHIH9+SKdK5ss0uOTD0lPZQTF/DCaR7U\nMmM0F6DyZvn4vmx7Agx11C0yx6Xdta1Vx5hrdmgxJftFqnzFO4SLMu2uvVU0M/zE\nALjCPC2qbQlbwCWqyIPl0QjXIbKWFQphAoIBAGTN67hNvmzAg4ae1Xx1HIAZLytN\n72Eb2aRh8iuxW5Qc2onaOPV/N4rx/XG/nHaHhB0NAnWMHJlf2uLsg6Kzz1sXbM4A\nsZaYrE2Vh0rGsHgeKmcJ/Y3/EWYnw+2D2WYBuMm3XdHO3+0roj1an2c61G3wx8Sf\nIJsedR+NqbM9LWRRq6HLYRxj85mAciSBUT/XY2nYpdFxPfR+7kNNeWcJP1hc1PQm\nen4kcHVQkog7Dhqci5bhHvOpn7aqW59SgHgLwDpyZcs4jFHEIH9lB49wJfSvJh5S\nDyBJi2psAJvBtvdwpcLqdcSOETRKsfOovaf40yYRwFvxDtyE0wP8I6ssIw8=\n-----END RSA PRIVATE KEY-----\n"} 2024-09-21T03:52:35.092 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout SSL certificate updated 2024-09-21T03:52:35.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:35 smithi022 ceph-mon[31015]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:35.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:36.216 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout SSL certificate key updated 2024-09-21T03:52:36.216 INFO:teuthology.orchestra.run.smithi022.stdout:Creating initial admin user... 2024-09-21T03:52:37.085 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:36 smithi022 ceph-mon[31015]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard set-ssl-certificate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:37.085 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:36 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:37.580 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$tzcPtVGErNBiFux3qyjkGemf5ycenMObU9NlI.bwcIcFvkCOjQi7W", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726890757, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T03:52:37.580 INFO:teuthology.orchestra.run.smithi022.stdout:Fetching dashboard port number... 2024-09-21T03:52:38.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:38 smithi022 ceph-mon[31015]: from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:38.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:38 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:38.828 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T03:52:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T03:52:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout disabled 2024-09-21T03:52:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T03:52:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:systemctl: stdout inactive 2024-09-21T03:52:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:firewalld.service is not enabled 2024-09-21T03:52:38.845 INFO:teuthology.orchestra.run.smithi022.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T03:52:38.847 INFO:teuthology.orchestra.run.smithi022.stdout:Ceph Dashboard is now available at: 2024-09-21T03:52:38.847 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:38.847 INFO:teuthology.orchestra.run.smithi022.stdout: URL: https://smithi022.front.sepia.ceph.com:8443/ 2024-09-21T03:52:38.847 INFO:teuthology.orchestra.run.smithi022.stdout: User: admin 2024-09-21T03:52:38.847 INFO:teuthology.orchestra.run.smithi022.stdout: Password: 76el48xtk2 2024-09-21T03:52:38.847 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:38.848 INFO:teuthology.orchestra.run.smithi022.stdout:Saving cluster configuration to /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config directory 2024-09-21T03:52:39.236 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:39 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1782525349' entity='client.admin' cmd={"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} : dispatch 2024-09-21T03:52:40.110 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T03:52:40.110 INFO:teuthology.orchestra.run.smithi022.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T03:52:40.110 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:40.110 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout: ceph telemetry on 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout:For more information see: 2024-09-21T03:52:40.111 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:40.112 INFO:teuthology.orchestra.run.smithi022.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T03:52:40.112 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:40.112 INFO:teuthology.orchestra.run.smithi022.stdout:Bootstrap complete. 2024-09-21T03:52:40.149 INFO:tasks.cephadm:Fetching config... 2024-09-21T03:52:40.150 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:52:40.150 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T03:52:40.166 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T03:52:40.166 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:52:40.166 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T03:52:40.223 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T03:52:40.223 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:52:40.223 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/keyring of=/dev/stdout 2024-09-21T03:52:40.290 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T03:52:40.290 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:52:40.290 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T03:52:40.346 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T03:52:40.347 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIhbydFp3LGjt1H34clpHaUcWDOXJEJ+MCuaEKHvGOtCtq4Ds2xkvu8uGECvkZiR/Jd/dZC/cqgJICPX1wnht3Acj1odwpJWQtD4w/CZjYan2LLQK02kldGcqFHNZL14F2tbD73PlTLfJ0UYjQ4sKbyxSGZ2v5UG0bF+VzXKna5riPC1MHt8ZWhaPvzc94LIxOPrwhuleKYj9wQAqOwfrzbdDaaP9cfy9ITJiP015DtXBuaaQcacERjaNqYK0ytws9lakP1SjpVpuxgYCxeG1HM9S4QjT83HP44LzXPsRq6GX7pqpwnG00QJJQd0me6pAlVt+br9vtKGEy9nzeu5cwmipfAqPDZLbNW6p9gM/Od5NaQteIF+caMyh0ziiPy59OpWnA5B8ha+plW5uaImwuh524SVpR6U5gyiwZO89hql1b4aeRLXCQpPjiEWjOZoaUeSEwFWMTpOwDjSN5P7iOxmeWT5aBtUVnHDE/b24jTVpgo5p4wyBYXtx7iK6mTM= ceph-ae19ad46-77cc-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:52:40.421 INFO:teuthology.orchestra.run.smithi022.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIhbydFp3LGjt1H34clpHaUcWDOXJEJ+MCuaEKHvGOtCtq4Ds2xkvu8uGECvkZiR/Jd/dZC/cqgJICPX1wnht3Acj1odwpJWQtD4w/CZjYan2LLQK02kldGcqFHNZL14F2tbD73PlTLfJ0UYjQ4sKbyxSGZ2v5UG0bF+VzXKna5riPC1MHt8ZWhaPvzc94LIxOPrwhuleKYj9wQAqOwfrzbdDaaP9cfy9ITJiP015DtXBuaaQcacERjaNqYK0ytws9lakP1SjpVpuxgYCxeG1HM9S4QjT83HP44LzXPsRq6GX7pqpwnG00QJJQd0me6pAlVt+br9vtKGEy9nzeu5cwmipfAqPDZLbNW6p9gM/Od5NaQteIF+caMyh0ziiPy59OpWnA5B8ha+plW5uaImwuh524SVpR6U5gyiwZO89hql1b4aeRLXCQpPjiEWjOZoaUeSEwFWMTpOwDjSN5P7iOxmeWT5aBtUVnHDE/b24jTVpgo5p4wyBYXtx7iK6mTM= ceph-ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:52:40.433 DEBUG:teuthology.orchestra.run.smithi060:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIhbydFp3LGjt1H34clpHaUcWDOXJEJ+MCuaEKHvGOtCtq4Ds2xkvu8uGECvkZiR/Jd/dZC/cqgJICPX1wnht3Acj1odwpJWQtD4w/CZjYan2LLQK02kldGcqFHNZL14F2tbD73PlTLfJ0UYjQ4sKbyxSGZ2v5UG0bF+VzXKna5riPC1MHt8ZWhaPvzc94LIxOPrwhuleKYj9wQAqOwfrzbdDaaP9cfy9ITJiP015DtXBuaaQcacERjaNqYK0ytws9lakP1SjpVpuxgYCxeG1HM9S4QjT83HP44LzXPsRq6GX7pqpwnG00QJJQd0me6pAlVt+br9vtKGEy9nzeu5cwmipfAqPDZLbNW6p9gM/Od5NaQteIF+caMyh0ziiPy59OpWnA5B8ha+plW5uaImwuh524SVpR6U5gyiwZO89hql1b4aeRLXCQpPjiEWjOZoaUeSEwFWMTpOwDjSN5P7iOxmeWT5aBtUVnHDE/b24jTVpgo5p4wyBYXtx7iK6mTM= ceph-ae19ad46-77cc-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:52:40.489 INFO:teuthology.orchestra.run.smithi060.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIhbydFp3LGjt1H34clpHaUcWDOXJEJ+MCuaEKHvGOtCtq4Ds2xkvu8uGECvkZiR/Jd/dZC/cqgJICPX1wnht3Acj1odwpJWQtD4w/CZjYan2LLQK02kldGcqFHNZL14F2tbD73PlTLfJ0UYjQ4sKbyxSGZ2v5UG0bF+VzXKna5riPC1MHt8ZWhaPvzc94LIxOPrwhuleKYj9wQAqOwfrzbdDaaP9cfy9ITJiP015DtXBuaaQcacERjaNqYK0ytws9lakP1SjpVpuxgYCxeG1HM9S4QjT83HP44LzXPsRq6GX7pqpwnG00QJJQd0me6pAlVt+br9vtKGEy9nzeu5cwmipfAqPDZLbNW6p9gM/Od5NaQteIF+caMyh0ziiPy59OpWnA5B8ha+plW5uaImwuh524SVpR6U5gyiwZO89hql1b4aeRLXCQpPjiEWjOZoaUeSEwFWMTpOwDjSN5P7iOxmeWT5aBtUVnHDE/b24jTVpgo5p4wyBYXtx7iK6mTM= ceph-ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:52:40.502 DEBUG:teuthology.orchestra.run.smithi073:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIhbydFp3LGjt1H34clpHaUcWDOXJEJ+MCuaEKHvGOtCtq4Ds2xkvu8uGECvkZiR/Jd/dZC/cqgJICPX1wnht3Acj1odwpJWQtD4w/CZjYan2LLQK02kldGcqFHNZL14F2tbD73PlTLfJ0UYjQ4sKbyxSGZ2v5UG0bF+VzXKna5riPC1MHt8ZWhaPvzc94LIxOPrwhuleKYj9wQAqOwfrzbdDaaP9cfy9ITJiP015DtXBuaaQcacERjaNqYK0ytws9lakP1SjpVpuxgYCxeG1HM9S4QjT83HP44LzXPsRq6GX7pqpwnG00QJJQd0me6pAlVt+br9vtKGEy9nzeu5cwmipfAqPDZLbNW6p9gM/Od5NaQteIF+caMyh0ziiPy59OpWnA5B8ha+plW5uaImwuh524SVpR6U5gyiwZO89hql1b4aeRLXCQpPjiEWjOZoaUeSEwFWMTpOwDjSN5P7iOxmeWT5aBtUVnHDE/b24jTVpgo5p4wyBYXtx7iK6mTM= ceph-ae19ad46-77cc-11ef-baf5-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T03:52:40.565 INFO:teuthology.orchestra.run.smithi073.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIhbydFp3LGjt1H34clpHaUcWDOXJEJ+MCuaEKHvGOtCtq4Ds2xkvu8uGECvkZiR/Jd/dZC/cqgJICPX1wnht3Acj1odwpJWQtD4w/CZjYan2LLQK02kldGcqFHNZL14F2tbD73PlTLfJ0UYjQ4sKbyxSGZ2v5UG0bF+VzXKna5riPC1MHt8ZWhaPvzc94LIxOPrwhuleKYj9wQAqOwfrzbdDaaP9cfy9ITJiP015DtXBuaaQcacERjaNqYK0ytws9lakP1SjpVpuxgYCxeG1HM9S4QjT83HP44LzXPsRq6GX7pqpwnG00QJJQd0me6pAlVt+br9vtKGEy9nzeu5cwmipfAqPDZLbNW6p9gM/Od5NaQteIF+caMyh0ziiPy59OpWnA5B8ha+plW5uaImwuh524SVpR6U5gyiwZO89hql1b4aeRLXCQpPjiEWjOZoaUeSEwFWMTpOwDjSN5P7iOxmeWT5aBtUVnHDE/b24jTVpgo5p4wyBYXtx7iK6mTM= ceph-ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:52:40.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T03:52:40.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:40 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3939120465' entity='client.admin' 2024-09-21T03:52:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:42.543 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T03:52:42.544 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T03:52:42.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:42 smithi022 ceph-mon[31015]: mgrmap e13: x(active, since 12s) 2024-09-21T03:52:42.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:42 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3781258085' entity='client.admin' 2024-09-21T03:52:42.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:42.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:42.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi022", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:42.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:42.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:42.690 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:43.071 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:44.943 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi060 2024-09-21T03:52:44.943 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:52:44.943 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.conf 2024-09-21T03:52:44.963 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:52:44.963 DEBUG:teuthology.orchestra.run.smithi060:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:52:45.022 INFO:tasks.cephadm:Adding host smithi060 to orchestrator... 2024-09-21T03:52:45.022 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch host add smithi060 2024-09-21T03:52:45.046 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:45.046 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:45.046 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:45.046 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:45.047 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:45.047 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-21T03:52:45.047 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: Updating smithi022:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:52:45.047 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: Updating smithi022:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:52:45.047 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: Updating smithi022:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:52:45.047 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:45.047 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:45.047 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:45.275 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:47.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:46 smithi022 ceph-mon[31015]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi060", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:48.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:47 smithi022 ceph-mon[31015]: Deploying cephadm binary to smithi060 2024-09-21T03:52:49.709 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi060' with addr '172.21.15.60' 2024-09-21T03:52:50.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:49 smithi022 ceph-mon[31015]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:52:50.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:50.038 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:50.294 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T03:52:50.591 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:51.238 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:51.238 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}] 2024-09-21T03:52:51.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:50 smithi022 ceph-mon[31015]: Added host smithi060 2024-09-21T03:52:51.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:50 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:51.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:50 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:51.816 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi073 2024-09-21T03:52:51.816 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:52:51.816 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/etc/ceph/ceph.conf 2024-09-21T03:52:51.835 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:52:51.835 DEBUG:teuthology.orchestra.run.smithi073:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:52:51.893 INFO:tasks.cephadm:Adding host smithi073 to orchestrator... 2024-09-21T03:52:51.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch host add smithi073 2024-09-21T03:52:52.144 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:52.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:52 smithi022 ceph-mon[31015]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:52:52.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:52 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:52.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:52 smithi022 ceph-mon[31015]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:52:54.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:54 smithi022 ceph-mon[31015]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:52:54.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:54 smithi022 ceph-mon[31015]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:52:54.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:54.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:54.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:54.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:54.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"} : dispatch 2024-09-21T03:52:54.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:52:54.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:52:55.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:55 smithi022 ceph-mon[31015]: Deploying cephadm binary to smithi073 2024-09-21T03:52:55.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:55 smithi022 ceph-mon[31015]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T03:52:55.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:55 smithi022 ceph-mon[31015]: Updating smithi060:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:52:55.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:55 smithi022 ceph-mon[31015]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:52:55.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:55 smithi022 ceph-mon[31015]: Updating smithi060:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:52:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:56.590 INFO:teuthology.orchestra.run.smithi022.stdout:Added host 'smithi073' with addr '172.21.15.73' 2024-09-21T03:52:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:56 smithi022 ceph-mon[31015]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:52:57.198 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T03:52:57.452 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:57 smithi022 ceph-mon[31015]: Added host smithi073 2024-09-21T03:52:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:52:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:57 smithi022 ceph-mon[31015]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:52:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:58.069 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:52:58.069 INFO:teuthology.orchestra.run.smithi022.stdout:[{"addr": "172.21.15.22", "hostname": "smithi022", "labels": [], "status": ""}, {"addr": "172.21.15.60", "hostname": "smithi060", "labels": [], "status": ""}, {"addr": "172.21.15.73", "hostname": "smithi073", "labels": [], "status": ""}] 2024-09-21T03:52:58.690 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T03:52:58.691 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd crush tunables default 2024-09-21T03:52:58.943 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:52:59.058 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:58 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:52:59.059 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:58 smithi022 ceph-mon[31015]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:52:59.903 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2024-09-21T03:53:00.214 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:59 smithi022 ceph-mon[31015]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:00.215 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:52:59 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/605428271' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T03:53:00.535 INFO:tasks.cephadm:Adding mon.a on smithi022 2024-09-21T03:53:00.535 INFO:tasks.cephadm:Adding mon.b on smithi060 2024-09-21T03:53:00.535 INFO:tasks.cephadm:Adding mon.c on smithi073 2024-09-21T03:53:00.535 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch apply mon '3;smithi022:172.21.15.22=a;smithi060:172.21.15.60=b;smithi073:172.21.15.73=c' 2024-09-21T03:53:00.792 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T03:53:00.835 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:01.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:00 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/605428271' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T03:53:01.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:00 smithi022 ceph-mon[31015]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:53:01.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:00 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:01.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:00 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:01.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:00 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:01.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:00 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:01.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:00 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"} : dispatch 2024-09-21T03:53:01.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:00 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:01.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:00 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:01.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:00 smithi022 ceph-mon[31015]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-21T03:53:01.518 INFO:teuthology.orchestra.run.smithi073.stdout:Scheduled mon update... 2024-09-21T03:53:02.285 DEBUG:teuthology.orchestra.run.smithi060:mon.b> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.b.service 2024-09-21T03:53:02.288 DEBUG:teuthology.orchestra.run.smithi073:mon.c> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.c.service 2024-09-21T03:53:02.290 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:53:02.290 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:53:02.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: Updating smithi073:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:02.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:53:02.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:02.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: Updating smithi073:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:53:02.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi060:172.21.15.60=b;smithi073:172.21.15.73=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi060:172.21.15.60=b;smithi073:172.21.15.73=c;count:3 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:02.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:02 smithi022 ceph-mon[31015]: Deploying daemon mon.c on smithi073 2024-09-21T03:53:03.386 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:04.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:04 smithi022 ceph-mon[31015]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:05.004 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:53:05.004 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":1,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","modified":"2024-09-21T03:51:29.173395Z","created":"2024-09-21T03:51:29.173395Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T03:53:05.004 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 1 2024-09-21T03:53:05.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:05 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/228056693' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:53:06.172 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 podman[34424]: 2024-09-21 03:53:06.138505313 +0000 UTC m=+0.344168889 container start 1da834a6f621adfbda7ab3763de96c1842d32bb67d9ce5d6954b0b7b7512d4c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T03:53:06.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:06 smithi022 ceph-mon[31015]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T03:53:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev), process ceph-mon, pid 2 2024-09-21T03:53:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: pidfile_write: ignore empty --pid-file 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: load: jerasure load: lrc 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: RocksDB version: 7.9.2 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Git sha 0 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: DB SUMMARY 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: DB Session ID: S03K3HBIH7H6IOLS3MO2 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: CURRENT file: CURRENT 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-21T03:53:06.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.error_if_exists: 0 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.create_if_missing: 0 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.paranoid_checks: 1 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.env: 0x563d6153fd60 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.info_log: 0x563d664d9360 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.statistics: (nil) 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.use_fsync: 0 2024-09-21T03:53:06.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_log_file_size: 0 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.allow_fallocate: 1 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.use_direct_reads: 0 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.db_log_dir: 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.wal_dir: 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T03:53:06.608 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.write_buffer_manager: 0x563d664ddd60 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T03:53:06.609 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.unordered_write: 0 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.row_cache: None 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.wal_filter: None 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.two_write_queues: 0 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.wal_compression: 0 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.atomic_flush: 0 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T03:53:06.610 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T03:53:06.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T03:53:06.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.log_readahead_size: 0 2024-09-21T03:53:06.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T03:53:06.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T03:53:06.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T03:53:06.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T03:53:06.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T03:53:06.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T03:53:06.611 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T03:53:06.612 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_background_jobs: 2 2024-09-21T03:53:06.612 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_background_compactions: -1 2024-09-21T03:53:06.612 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_subcompactions: 1 2024-09-21T03:53:06.612 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_open_files: -1 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_background_flushes: -1 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Compression algorithms supported: 2024-09-21T03:53:06.613 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: kZSTD supported: 0 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: kXpressCompression supported: 0 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: kBZip2Compression supported: 0 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: kLZ4Compression supported: 1 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: kZlibCompression supported: 1 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: kSnappyCompression supported: 1 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.merge_operator: 2024-09-21T03:53:06.614 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_filter: None 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563d664d8fa0) 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout: cache_index_and_filter_blocks: 1 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout: pin_top_level_index_and_filter: 1 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout: index_type: 0 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout: data_block_index_type: 0 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout: index_shortening: 1 2024-09-21T03:53:06.615 INFO:journalctl@ceph.mon.c.smithi073.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: checksum: 4 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: no_block_cache: 0 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: block_cache: 0x563d6249d610 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: block_cache_name: BinnedLRUCache 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: block_cache_options: 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: capacity : 536870912 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: num_shard_bits : 4 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: strict_capacity_limit : 0 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: high_pri_pool_ratio: 0.000 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: block_cache_compressed: (nil) 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: persistent_cache: (nil) 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: block_size: 4096 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: block_size_deviation: 10 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: block_restart_interval: 16 2024-09-21T03:53:06.616 INFO:journalctl@ceph.mon.c.smithi073.stdout: index_block_restart_interval: 1 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: metadata_block_size: 4096 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: partition_filters: 0 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: use_delta_encoding: 1 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: filter_policy: bloomfilter 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: whole_key_filtering: 1 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: verify_compression: 0 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: read_amp_bytes_per_bit: 0 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: format_version: 5 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: enable_index_compression: 1 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: block_align: 0 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: max_auto_readahead_size: 262144 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: prepopulate_block_cache: 0 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: initial_auto_readahead_size: 8192 2024-09-21T03:53:06.617 INFO:journalctl@ceph.mon.c.smithi073.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compression: NoCompression 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.num_levels: 7 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T03:53:06.618 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T03:53:06.619 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T03:53:06.620 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T03:53:06.621 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.inplace_update_support: 0 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.bloom_locality: 0 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.max_successive_merges: 0 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T03:53:06.622 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.ttl: 2592000 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.enable_blob_files: false 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.min_blob_size: 0 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T03:53:06.623 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: f9ae2040-aefe-4c87-a41a-7135dafa699b 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890786175981, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890786176398, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726890786, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "f9ae2040-aefe-4c87-a41a-7135dafa699b", "db_session_id": "S03K3HBIH7H6IOLS3MO2", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890786176494, "job": 1, "event": "recovery_finished"} 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563d664fca80 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: DB pointer 0x563d672a2000 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout: ** DB Stats ** 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:53:06.624 INFO:journalctl@ceph.mon.c.smithi073.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: ** Compaction Stats [default] ** 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: ** Compaction Stats [default] ** 2024-09-21T03:53:06.625 INFO:journalctl@ceph.mon.c.smithi073.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.9 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: Interval compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T03:53:06.626 INFO:journalctl@ceph.mon.c.smithi073.stdout: Block cache BinnedLRUCache@0x563d6249d610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout: 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: using public_addr v2:172.21.15.73:0/0 -> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: starting mon.c rank -1 at public addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] at bind addrs [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(???) e0 preinit fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 bash[34424]: 1da834a6f621adfbda7ab3763de96c1842d32bb67d9ce5d6954b0b7b7512d4c2 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 systemd[1]: Started Ceph mon.c for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).mds e1 new map 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout: e1 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout: btime 2024-09-21T03:51:32:216802+0000 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:53:06.627 INFO:journalctl@ceph.mon.c.smithi073.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout: legacy client fscid: -1 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout: 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout: No filesystems configured 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:53:06.628 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"} : dispatch 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Deploying cephadm binary to smithi073 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Updating smithi060:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Updating smithi060:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.629 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Added host smithi073 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/605428271' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/605428271' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.630 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"} : dispatch 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Updating smithi073:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Updating smithi073:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi060:172.21.15.60=b;smithi073:172.21.15.73=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:06.631 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi060:172.21.15.60=b;smithi073:172.21.15.73=c;count:3 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: Deploying daemon mon.c on smithi073 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/228056693' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:06.632 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:06 smithi073 ceph-mon[34443]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T03:53:06.745 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:53:06.745 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:53:06.992 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:53:11.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: mon.a calling monitor election 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: mon.c calling monitor election 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T03:53:11.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: monmap epoch 2 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: last_changed 2024-09-21T03:53:06.203592+0000 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: created 2024-09-21T03:51:29.173395+0000 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: min_mon_release 19 (squid) 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: election_strategy: 1 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: fsmap 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: mgrmap e13: x(active, since 42s) 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: overall HEALTH_OK 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:11.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:11.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:11.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:53:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: mon.a calling monitor election 2024-09-21T03:53:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: mon.c calling monitor election 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: monmap epoch 2 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: last_changed 2024-09-21T03:53:06.203592+0000 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: created 2024-09-21T03:51:29.173395+0000 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: min_mon_release 19 (squid) 2024-09-21T03:53:11.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: election_strategy: 1 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: fsmap 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: mgrmap e13: x(active, since 42s) 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: overall HEALTH_OK 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:11.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:12.070 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:53:12.071 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","modified":"2024-09-21T03:53:06.203592Z","created":"2024-09-21T03:51:29.173395Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T03:53:12.071 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 2 2024-09-21T03:53:12.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:12 smithi073 ceph-mon[34443]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:12 smithi073 ceph-mon[34443]: Deploying daemon mon.b on smithi060 2024-09-21T03:53:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:12 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/2448835634' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:53:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:12 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:12.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:12 smithi022 ceph-mon[31015]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:12.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:12 smithi022 ceph-mon[31015]: Deploying daemon mon.b on smithi060 2024-09-21T03:53:12.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:12 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/2448835634' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:53:12.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:12 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:13.599 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 03:53:13 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T03:53:13.202+0000 7fcc25611640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-21T03:53:13.705 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:53:13.705 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:53:13.956 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:53:14.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:14 smithi073 ceph-mon[34443]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:14.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:14 smithi022 ceph-mon[31015]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:14.662 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:53:14.662 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":2,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","modified":"2024-09-21T03:53:06.203592Z","created":"2024-09-21T03:51:29.173395Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T03:53:14.662 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 2 2024-09-21T03:53:15.196 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: RocksDB version: 7.9.2 2024-09-21T03:53:15.196 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Git sha 0 2024-09-21T03:53:15.196 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Compile date 2024-09-20 22:29:49 2024-09-21T03:53:15.196 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: DB SUMMARY 2024-09-21T03:53:15.196 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: DB Session ID: XS8UW5UC48660U422X3Q 2024-09-21T03:53:15.196 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: CURRENT file: CURRENT 2024-09-21T03:53:15.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T03:53:15.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T03:53:15.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-21T03:53:15.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-21T03:53:15.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.error_if_exists: 0 2024-09-21T03:53:15.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.create_if_missing: 0 2024-09-21T03:53:15.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.paranoid_checks: 1 2024-09-21T03:53:15.197 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T03:53:15.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T03:53:15.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.env: 0x556beb5b7d60 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.info_log: 0x556bf00dd360 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.statistics: (nil) 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.use_fsync: 0 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_log_file_size: 0 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T03:53:15.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T03:53:15.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.allow_fallocate: 1 2024-09-21T03:53:15.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T03:53:15.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T03:53:15.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.use_direct_reads: 0 2024-09-21T03:53:15.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T03:53:15.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T03:53:15.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.db_log_dir: 2024-09-21T03:53:15.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.wal_dir: 2024-09-21T03:53:15.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T03:53:15.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.write_buffer_manager: 0x556bf00e1d60 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T03:53:15.455 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.unordered_write: 0 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.row_cache: None 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.wal_filter: None 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T03:53:15.456 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.two_write_queues: 0 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.wal_compression: 0 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.atomic_flush: 0 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.log_readahead_size: 0 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T03:53:15.457 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_background_jobs: 2 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_background_compactions: -1 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_subcompactions: 1 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_open_files: -1 2024-09-21T03:53:15.458 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T03:53:15.459 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T03:53:15.459 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T03:53:15.459 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T03:53:15.460 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_background_flushes: -1 2024-09-21T03:53:15.460 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Compression algorithms supported: 2024-09-21T03:53:15.460 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: kZSTD supported: 0 2024-09-21T03:53:15.460 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: kXpressCompression supported: 0 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: kBZip2Compression supported: 0 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: kLZ4Compression supported: 1 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: kZlibCompression supported: 1 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: kSnappyCompression supported: 1 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T03:53:15.461 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.merge_operator: 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_filter: None 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556bf00dcfa0) 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout: cache_index_and_filter_blocks: 1 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout: pin_top_level_index_and_filter: 1 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout: index_type: 0 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout: data_block_index_type: 0 2024-09-21T03:53:15.462 INFO:journalctl@ceph.mon.b.smithi060.stdout: index_shortening: 1 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: checksum: 4 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: no_block_cache: 0 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache: 0x556bec0a1610 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache_name: BinnedLRUCache 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache_options: 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: capacity : 536870912 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: num_shard_bits : 4 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: strict_capacity_limit : 0 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: high_pri_pool_ratio: 0.000 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_cache_compressed: (nil) 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: persistent_cache: (nil) 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_size: 4096 2024-09-21T03:53:15.463 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_size_deviation: 10 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_restart_interval: 16 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: index_block_restart_interval: 1 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: metadata_block_size: 4096 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: partition_filters: 0 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: use_delta_encoding: 1 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: filter_policy: bloomfilter 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: whole_key_filtering: 1 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: verify_compression: 0 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: read_amp_bytes_per_bit: 0 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: format_version: 5 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: enable_index_compression: 1 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: block_align: 0 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: max_auto_readahead_size: 262144 2024-09-21T03:53:15.464 INFO:journalctl@ceph.mon.b.smithi060.stdout: prepopulate_block_cache: 0 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout: initial_auto_readahead_size: 8192 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compression: NoCompression 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.num_levels: 7 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T03:53:15.465 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T03:53:15.466 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T03:53:15.467 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T03:53:15.468 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.inplace_update_support: 0 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.bloom_locality: 0 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.max_successive_merges: 0 2024-09-21T03:53:15.469 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.ttl: 2592000 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.enable_blob_files: false 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.min_blob_size: 0 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T03:53:15.470 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d8029553-1a42-49ac-8e6b-b01267a0e977 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890795195899, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890795196343, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726890795, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d8029553-1a42-49ac-8e6b-b01267a0e977", "db_session_id": "XS8UW5UC48660U422X3Q", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726890795196440, "job": 1, "event": "recovery_finished"} 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T03:53:15.471 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x556bf0100a80 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: DB pointer 0x556bf0ea6000 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** DB Stats ** 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-09-21T03:53:15.472 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** Compaction Stats [default] ** 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** Compaction Stats [default] ** 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 4.0 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-09-21T03:53:15.473 INFO:journalctl@ceph.mon.b.smithi060.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: Cumulative compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: Interval compaction: 0.00 GB write, 0.55 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: Block cache BinnedLRUCache@0x556bec0a1610#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T03:53:15.474 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: using public_addr v2:172.21.15.60:0/0 -> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: starting mon.b rank -1 at public addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] at bind addrs [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(???) e0 preinit fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).mds e1 new map 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout: e1 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout: btime 2024-09-21T03:51:32:216802+0000 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout: legacy client fscid: -1 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout: 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout: No filesystems configured 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T03:53:15.475 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi073", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.476 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi060", "name": "osd_memory_target"} : dispatch 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Deploying cephadm binary to smithi073 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Updating smithi060:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Updating smithi060:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Updating smithi060:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Added host smithi073 2024-09-21T03:53:15.477 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/605428271' entity='client.admin' cmd={"prefix": "osd crush tunables", "profile": "default"} : dispatch 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/605428271' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.478 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd/host:smithi073", "name": "osd_memory_target"} : dispatch 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Updating smithi073:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Updating smithi073:/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Updating smithi073:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi022:172.21.15.22=a;smithi060:172.21.15.60=b;smithi073:172.21.15.73=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:15.479 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Saving service mon spec with placement smithi022:172.21.15.22=a;smithi060:172.21.15.60=b;smithi073:172.21.15.73=c;count:3 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Deploying daemon mon.c on smithi073 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/228056693' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.a calling monitor election 2024-09-21T03:53:15.480 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.c calling monitor election 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: monmap epoch 2 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: last_changed 2024-09-21T03:53:06.203592+0000 2024-09-21T03:53:15.481 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: created 2024-09-21T03:51:29.173395+0000 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: min_mon_release 19 (squid) 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: election_strategy: 1 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: fsmap 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mgrmap e13: x(active, since 42s) 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: overall HEALTH_OK 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:15.482 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:15.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: Deploying daemon mon.b on smithi060 2024-09-21T03:53:15.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/2448835634' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:53:15.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:15.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:15.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 ceph-mon[33722]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-21T03:53:15.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 bash[33703]: 7f5455fe1e3f336b9fb107e33f631af5829496bf9c0f17570d5389d18a433af4 2024-09-21T03:53:15.483 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:15 smithi060 systemd[1]: Started Ceph mon.b for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:53:16.154 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-21T03:53:16.155 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph mon dump -f json 2024-09-21T03:53:16.403 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:53:20.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: mon.a calling monitor election 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: mon.c calling monitor election 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: mon.b calling monitor election 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: monmap epoch 3 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: last_changed 2024-09-21T03:53:15.224681+0000 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: created 2024-09-21T03:51:29.173395+0000 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: min_mon_release 19 (squid) 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: election_strategy: 1 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: fsmap 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: mgrmap e13: x(active, since 51s) 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: overall HEALTH_OK 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: mon.a calling monitor election 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: mon.c calling monitor election 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: mon.b calling monitor election 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: monmap epoch 3 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: last_changed 2024-09-21T03:53:15.224681+0000 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: created 2024-09-21T03:51:29.173395+0000 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: min_mon_release 19 (squid) 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: election_strategy: 1 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-09-21T03:53:20.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: fsmap 2024-09-21T03:53:20.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:53:20.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: mgrmap e13: x(active, since 51s) 2024-09-21T03:53:20.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: overall HEALTH_OK 2024-09-21T03:53:20.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.607 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:53:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: mon.a calling monitor election 2024-09-21T03:53:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: mon.c calling monitor election 2024-09-21T03:53:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:53:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: mon.b calling monitor election 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: monmap epoch 3 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: last_changed 2024-09-21T03:53:15.224681+0000 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: created 2024-09-21T03:51:29.173395+0000 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: min_mon_release 19 (squid) 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: election_strategy: 1 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: 0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: 1: [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] mon.c 2024-09-21T03:53:20.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: 2: [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] mon.b 2024-09-21T03:53:20.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: fsmap 2024-09-21T03:53:20.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T03:53:20.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: mgrmap e13: x(active, since 51s) 2024-09-21T03:53:20.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: overall HEALTH_OK 2024-09-21T03:53:20.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:20.718 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:53:20.718 INFO:teuthology.orchestra.run.smithi073.stdout:{"epoch":3,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","modified":"2024-09-21T03:53:15.224681Z","created":"2024-09-21T03:51:29.173395Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:3300","nonce":0},{"type":"v1","addr":"172.21.15.22:6789","nonce":0}]},"addr":"172.21.15.22:6789/0","public_addr":"172.21.15.22:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:3300","nonce":0},{"type":"v1","addr":"172.21.15.73:6789","nonce":0}]},"addr":"172.21.15.73:6789/0","public_addr":"172.21.15.73:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:3300","nonce":0},{"type":"v1","addr":"172.21.15.60:6789","nonce":0}]},"addr":"172.21.15.60:6789/0","public_addr":"172.21.15.60:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-09-21T03:53:20.718 INFO:teuthology.orchestra.run.smithi073.stderr:dumped monmap epoch 3 2024-09-21T03:53:21.511 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:21.511 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:21 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/479202414' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:53:21.511 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:21.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:21.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:21 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/479202414' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:53:21.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:21.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:21.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:21 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/479202414' entity='client.admin' cmd={"prefix": "mon dump", "format": "json"} : dispatch 2024-09-21T03:53:21.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:53:21.946 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T03:53:21.947 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T03:53:22.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:22.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:22.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:22.559 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.560 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:22.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:53:22.561 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:22.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:53:22.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:22.800 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: Updating smithi022:/etc/ceph/ceph.conf 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: Updating smithi060:/etc/ceph/ceph.conf 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: Updating smithi073:/etc/ceph/ceph.conf 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:53:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:23.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:23 smithi022 ceph-mon[31015]: Updating smithi073:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:23.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:23 smithi022 ceph-mon[31015]: Updating smithi060:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:23.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:23 smithi022 ceph-mon[31015]: Updating smithi022:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:23.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:23 smithi022 ceph-mon[31015]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:53:23.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:23 smithi022 ceph-mon[31015]: Reconfiguring daemon mon.a on smithi022 2024-09-21T03:53:23.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:23.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:23.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:23.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:53:23.485 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:23.688 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:23 smithi060 ceph-mon[33722]: Updating smithi073:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:23.688 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:23 smithi060 ceph-mon[33722]: Updating smithi060:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:23.688 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:23 smithi060 ceph-mon[33722]: Updating smithi022:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:23.688 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:23 smithi060 ceph-mon[33722]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:53:23.689 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:23 smithi060 ceph-mon[33722]: Reconfiguring daemon mon.a on smithi022 2024-09-21T03:53:23.689 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:23.689 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:23.689 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:23.689 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:53:23.689 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:23.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:23 smithi073 ceph-mon[34443]: Updating smithi073:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:23 smithi073 ceph-mon[34443]: Updating smithi060:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:23 smithi073 ceph-mon[34443]: Updating smithi022:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/config/ceph.conf 2024-09-21T03:53:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:23 smithi073 ceph-mon[34443]: Reconfiguring mon.a (unknown last config time)... 2024-09-21T03:53:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:23 smithi073 ceph-mon[34443]: Reconfiguring daemon mon.a on smithi022 2024-09-21T03:53:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:53:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:23.882 INFO:teuthology.orchestra.run.smithi022.stdout:# minimal ceph.conf for ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:23.882 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2024-09-21T03:53:23.882 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T03:53:23.882 INFO:teuthology.orchestra.run.smithi022.stdout: mon_host = [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] 2024-09-21T03:53:24.492 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T03:53:24.492 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:53:24.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:53:24.523 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:53:24.523 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:53:24.589 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:53:24.590 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:53:24.617 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:24 smithi060 ceph-mon[33722]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:24.618 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:24 smithi060 ceph-mon[33722]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:53:24.618 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:24 smithi060 ceph-mon[33722]: Reconfiguring daemon mon.b on smithi060 2024-09-21T03:53:24.618 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:24 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/902829074' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:24.618 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:24.620 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:53:24.620 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:53:24.687 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:53:24.687 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T03:53:24.709 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:24 smithi073 ceph-mon[34443]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:24.709 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:24 smithi073 ceph-mon[34443]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:53:24.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:24 smithi073 ceph-mon[34443]: Reconfiguring daemon mon.b on smithi060 2024-09-21T03:53:24.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:24 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/902829074' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:24.710 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:24.714 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:53:24.714 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T03:53:24.779 INFO:tasks.cephadm:Adding mgr.x on smithi022 2024-09-21T03:53:24.780 INFO:tasks.cephadm:Adding mgr.y on smithi060 2024-09-21T03:53:24.780 INFO:tasks.cephadm:Adding mgr.z on smithi073 2024-09-21T03:53:24.780 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch apply mgr '3;smithi022=x;smithi060=y;smithi073=z' 2024-09-21T03:53:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:24 smithi022 ceph-mon[31015]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:24 smithi022 ceph-mon[31015]: Reconfiguring mon.b (monmap changed)... 2024-09-21T03:53:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:24 smithi022 ceph-mon[31015]: Reconfiguring daemon mon.b on smithi060 2024-09-21T03:53:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:24 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/902829074' entity='client.admin' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:24.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:25.727 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:53:25.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:25.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:25.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:25 smithi073 ceph-mon[34443]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:53:25.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:25.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:53:25.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:25.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:25 smithi073 ceph-mon[34443]: Reconfiguring daemon mon.c on smithi073 2024-09-21T03:53:25.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:25.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:25.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:25 smithi022 ceph-mon[31015]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:53:25.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:25.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:53:25.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:25.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:25 smithi022 ceph-mon[31015]: Reconfiguring daemon mon.c on smithi073 2024-09-21T03:53:25.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:25.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:25.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:25 smithi060 ceph-mon[33722]: Reconfiguring mon.c (monmap changed)... 2024-09-21T03:53:25.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "mon."} : dispatch 2024-09-21T03:53:25.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config get", "who": "mon", "key": "public_network"} : dispatch 2024-09-21T03:53:25.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:25.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:25 smithi060 ceph-mon[33722]: Reconfiguring daemon mon.c on smithi073 2024-09-21T03:53:26.359 INFO:teuthology.orchestra.run.smithi073.stdout:Scheduled mgr update... 2024-09-21T03:53:26.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:26.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:26.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:53:26.827 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:26.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:26.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:53:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:26.945 DEBUG:teuthology.orchestra.run.smithi060:mgr.y> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.y.service 2024-09-21T03:53:26.947 DEBUG:teuthology.orchestra.run.smithi073:mgr.z> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.z.service 2024-09-21T03:53:26.950 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T03:53:26.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T03:53:26.951 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:26.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:26.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:53:26.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:53:26.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:53:26.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:26.953 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T03:53:26.953 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T03:53:26.996 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T03:53:26.996 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T03:53:27.039 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T03:53:27.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T03:53:27.082 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T03:53:27.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T03:53:27.125 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T03:53:27.126 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T03:53:27.168 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T03:53:27.169 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T03:53:27.212 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T03:53:27.213 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T03:53:27.251 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:27.253 INFO:tasks.cephadm:setting config [mds] mds_bal_fragment_size_max = 10000 2024-09-21T03:53:27.253 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_fragment_size_max 10000 2024-09-21T03:53:27.297 INFO:tasks.cephadm:setting config [mds] mds_bal_merge_size = 5 2024-09-21T03:53:27.297 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_merge_size 5 2024-09-21T03:53:27.322 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:27.325 INFO:tasks.cephadm:setting config [mds] mds_bal_split_bits = 3 2024-09-21T03:53:27.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_bits 3 2024-09-21T03:53:27.368 INFO:tasks.cephadm:setting config [mds] mds_bal_split_size = 100 2024-09-21T03:53:27.368 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds mds_bal_split_size 100 2024-09-21T03:53:27.411 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T03:53:27.411 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T03:53:27.468 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T03:53:27.469 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T03:53:27.513 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T03:53:27.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T03:53:27.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:27 smithi022 ceph-mon[31015]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi060=y;smithi073=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:27.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:27 smithi022 ceph-mon[31015]: Saving service mgr spec with placement smithi022=x;smithi060=y;smithi073=z;count:3 2024-09-21T03:53:27.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:27 smithi022 ceph-mon[31015]: Deploying daemon mgr.z on smithi073 2024-09-21T03:53:27.520 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T03:53:27.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T03:53:27.567 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T03:53:27.567 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T03:53:27.620 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T03:53:27.620 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T03:53:27.697 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T03:53:27.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T03:53:27.740 INFO:tasks.cephadm:setting config [mgr] client_mount_timeout = 30 2024-09-21T03:53:27.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mgr client_mount_timeout 30 2024-09-21T03:53:27.784 INFO:tasks.cephadm:setting config [mgr] debug_client = 20 2024-09-21T03:53:27.785 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mgr debug_client 20 2024-09-21T03:53:27.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:27 smithi073 ceph-mon[34443]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi060=y;smithi073=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:27.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:27 smithi073 ceph-mon[34443]: Saving service mgr spec with placement smithi022=x;smithi060=y;smithi073=z;count:3 2024-09-21T03:53:27.826 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:27 smithi073 ceph-mon[34443]: Deploying daemon mgr.z on smithi073 2024-09-21T03:53:27.827 INFO:tasks.cephadm:setting config [mgr] debug_mgr = 20 2024-09-21T03:53:27.827 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mgr debug_mgr 20 2024-09-21T03:53:27.879 INFO:tasks.cephadm:setting config [mgr] debug_ms = 1 2024-09-21T03:53:27.879 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mgr debug_ms 1 2024-09-21T03:53:27.925 INFO:tasks.cephadm:setting config [mgr] mon_warn_on_pool_no_app = False 2024-09-21T03:53:27.925 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mgr mon_warn_on_pool_no_app False 2024-09-21T03:53:27.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:27 smithi060 ceph-mon[33722]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi022=x;smithi060=y;smithi073=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:53:27.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:27 smithi060 ceph-mon[33722]: Saving service mgr spec with placement smithi022=x;smithi060=y;smithi073=z;count:3 2024-09-21T03:53:27.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:27 smithi060 ceph-mon[33722]: Deploying daemon mgr.z on smithi073 2024-09-21T03:53:27.968 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T03:53:27.968 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T03:53:28.014 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T03:53:28.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T03:53:28.134 DEBUG:tasks.cephadm:set 26 configs 2024-09-21T03:53:28.134 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi022') 2024-09-21T03:53:28.481 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:28 smithi073 ceph-mon[34443]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:28 smithi022 ceph-mon[31015]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:28.787 INFO:journalctl@ceph.mgr.z.smithi073.stdout:Sep 21 03:53:28 smithi073 ceph-mgr[35725]: -- 172.21.15.73:0/1270242863 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55707ae850e0 con 0x55707fc28000 2024-09-21T03:53:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:28 smithi060 ceph-mon[33722]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:29.104 INFO:journalctl@ceph.mgr.z.smithi073.stdout:Sep 21 03:53:28 smithi073 bash[35706]: 50dde4f04bd09d659aad17a3ed2092d01c81bc4ed980f8c99dbf951f48c1d847 2024-09-21T03:53:29.105 INFO:journalctl@ceph.mgr.z.smithi073.stdout:Sep 21 03:53:28 smithi073 systemd[1]: Started Ceph mgr.z for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:53:29.269 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi022') 2024-09-21T03:53:29.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:29 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/303947616' entity='client.admin' 2024-09-21T03:53:29.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:29 smithi060 ceph-mon[33722]: from='client.? ' entity='client.admin' 2024-09-21T03:53:29.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:29.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:29.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:29.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:53:29.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:53:29.595 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:53:29.595 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:29.824 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:29 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/303947616' entity='client.admin' 2024-09-21T03:53:29.825 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:29 smithi022 ceph-mon[31015]: from='client.? ' entity='client.admin' 2024-09-21T03:53:29.825 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:29.825 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:29.825 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:29.825 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:53:29.825 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:53:29.825 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:53:29.825 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:29.854 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi022') 2024-09-21T03:53:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:29 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/303947616' entity='client.admin' 2024-09-21T03:53:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:29 smithi073 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T03:53:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:53:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T03:53:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:53:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:30.075 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:30.196 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:30.196 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:30.196 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:30.688 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:30 smithi060 ceph-mon[33722]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:30.714 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:30 smithi060 ceph-mon[33722]: Deploying daemon mgr.y on smithi060 2024-09-21T03:53:30.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:30 smithi022 ceph-mon[31015]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:30.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:30 smithi022 ceph-mon[31015]: Deploying daemon mgr.y on smithi060 2024-09-21T03:53:30.827 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:30.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:30 smithi073 ceph-mon[34443]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:30.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:30 smithi073 ceph-mon[34443]: Deploying daemon mgr.y on smithi060 2024-09-21T03:53:30.941 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 21 03:53:30 smithi060 podman[34542]: 2024-09-21 03:53:30.939793051 +0000 UTC m=+0.154503512 container create ae3b2e9ed1d946d12293ea1b6012fc35f3a3757457dd23a4f9e312c339d2f9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T03:53:31.159 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.159 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.167 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.168 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.169 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.170 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.174 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.174 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.183 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.183 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.193 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 21 03:53:31 smithi060 podman[34542]: 2024-09-21 03:53:31.117268671 +0000 UTC m=+0.331979135 container init ae3b2e9ed1d946d12293ea1b6012fc35f3a3757457dd23a4f9e312c339d2f9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-21T03:53:31.193 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 21 03:53:31 smithi060 podman[34542]: 2024-09-21 03:53:31.120147451 +0000 UTC m=+0.334857920 container start ae3b2e9ed1d946d12293ea1b6012fc35f3a3757457dd23a4f9e312c339d2f9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-y, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T03:53:31.193 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 21 03:53:31 smithi060 ceph-mgr[34561]: -- 172.21.15.60:0/2823782227 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558d11b310e0 con 0x558d168d4480 2024-09-21T03:53:31.452 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 21 03:53:31 smithi060 bash[34542]: ae3b2e9ed1d946d12293ea1b6012fc35f3a3757457dd23a4f9e312c339d2f9cc 2024-09-21T03:53:31.452 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 21 03:53:31 smithi060 systemd[1]: Started Ceph mgr.y for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:53:31.505 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.505 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:31.505 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:32 smithi022 ceph-mon[31015]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:32.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:32 smithi022 ceph-mon[31015]: from='client.? ' entity='client.admin' 2024-09-21T03:53:32.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:32 smithi073 ceph-mon[34443]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:32 smithi073 ceph-mon[34443]: from='client.? ' entity='client.admin' 2024-09-21T03:53:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:32 smithi060 ceph-mon[33722]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:32 smithi060 ceph-mon[33722]: from='client.? ' entity='client.admin' 2024-09-21T03:53:33.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/391768781' entity='client.admin' 2024-09-21T03:53:33.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:33.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:33.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:53:33.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:53:33.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:53:33.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:33.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: Reconfiguring daemon mgr.x on smithi022 2024-09-21T03:53:33.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:33 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/395661430' entity='client.admin' 2024-09-21T03:53:33.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/391768781' entity='client.admin' 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: Reconfiguring daemon mgr.x on smithi022 2024-09-21T03:53:33.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:33 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/395661430' entity='client.admin' 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/391768781' entity='client.admin' 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: Reconfiguring mgr.x (unknown last config time)... 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]} : dispatch 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr services"} : dispatch 2024-09-21T03:53:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:33.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: Reconfiguring daemon mgr.x on smithi022 2024-09-21T03:53:33.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:33 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/395661430' entity='client.admin' 2024-09-21T03:53:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:34 smithi060 ceph-mon[33722]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:34 smithi060 ceph-mon[33722]: Standby manager daemon z started 2024-09-21T03:53:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:34 smithi060 ceph-mon[33722]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:53:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:34 smithi060 ceph-mon[33722]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:53:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:34 smithi060 ceph-mon[33722]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:53:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:34 smithi060 ceph-mon[33722]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:53:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:34 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3117664394' entity='client.admin' 2024-09-21T03:53:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:34 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2359510162' entity='client.admin' 2024-09-21T03:53:34.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:34 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:34.714 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:34 smithi022 ceph-mon[31015]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:34.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:34 smithi022 ceph-mon[31015]: Standby manager daemon z started 2024-09-21T03:53:34.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:34 smithi022 ceph-mon[31015]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:53:34.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:34 smithi022 ceph-mon[31015]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:53:34.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:34 smithi022 ceph-mon[31015]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:53:34.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:34 smithi022 ceph-mon[31015]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:53:34.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:34 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3117664394' entity='client.admin' 2024-09-21T03:53:34.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:34 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2359510162' entity='client.admin' 2024-09-21T03:53:34.715 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:34 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:34 smithi073 ceph-mon[34443]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:34 smithi073 ceph-mon[34443]: Standby manager daemon z started 2024-09-21T03:53:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:34 smithi073 ceph-mon[34443]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/crt"} : dispatch 2024-09-21T03:53:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:34 smithi073 ceph-mon[34443]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:53:34.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:34 smithi073 ceph-mon[34443]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/z/key"} : dispatch 2024-09-21T03:53:34.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:34 smithi073 ceph-mon[34443]: from='mgr.? 172.21.15.73:0/2592019711' entity='mgr.z' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:53:34.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:34 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3117664394' entity='client.admin' 2024-09-21T03:53:34.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:34 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2359510162' entity='client.admin' 2024-09-21T03:53:34.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:34 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:35.586 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:35 smithi022 ceph-mon[31015]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-21T03:53:35.587 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:53:35.587 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:35 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3047071101' entity='client.admin' 2024-09-21T03:53:35.587 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:35 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2583088150' entity='client.admin' 2024-09-21T03:53:35.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:35 smithi060 ceph-mon[33722]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-21T03:53:35.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:53:35.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:35 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3047071101' entity='client.admin' 2024-09-21T03:53:35.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:35 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2583088150' entity='client.admin' 2024-09-21T03:53:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:35 smithi073 ceph-mon[34443]: mgrmap e14: x(active, since 65s), standbys: z 2024-09-21T03:53:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "z", "id": "z"} : dispatch 2024-09-21T03:53:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:35 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3047071101' entity='client.admin' 2024-09-21T03:53:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:35 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2583088150' entity='client.admin' 2024-09-21T03:53:36.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:36 smithi022 ceph-mon[31015]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:36.516 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:36 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/498865237' entity='client.admin' 2024-09-21T03:53:36.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:36 smithi022 ceph-mon[31015]: Standby manager daemon y started 2024-09-21T03:53:36.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:36 smithi022 ceph-mon[31015]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:53:36.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:36 smithi022 ceph-mon[31015]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:53:36.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:36 smithi022 ceph-mon[31015]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:53:36.517 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:36 smithi022 ceph-mon[31015]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:53:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:36 smithi060 ceph-mon[33722]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:36 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/498865237' entity='client.admin' 2024-09-21T03:53:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:36 smithi060 ceph-mon[33722]: Standby manager daemon y started 2024-09-21T03:53:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:36 smithi060 ceph-mon[33722]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:53:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:36 smithi060 ceph-mon[33722]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:53:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:36 smithi060 ceph-mon[33722]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:53:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:36 smithi060 ceph-mon[33722]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:53:36.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:36 smithi073 ceph-mon[34443]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:36 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/498865237' entity='client.admin' 2024-09-21T03:53:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:36 smithi073 ceph-mon[34443]: Standby manager daemon y started 2024-09-21T03:53:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:36 smithi073 ceph-mon[34443]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/crt"} : dispatch 2024-09-21T03:53:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:36 smithi073 ceph-mon[34443]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/crt"} : dispatch 2024-09-21T03:53:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:36 smithi073 ceph-mon[34443]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/y/key"} : dispatch 2024-09-21T03:53:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:36 smithi073 ceph-mon[34443]: from='mgr.? 172.21.15.60:0/277637236' entity='mgr.y' cmd={"prefix": "config-key get", "key": "mgr/dashboard/key"} : dispatch 2024-09-21T03:53:37.944 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:37.945 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:37.945 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:38.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:38 smithi022 ceph-mon[31015]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:38.294 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:38 smithi022 ceph-mon[31015]: mgrmap e15: x(active, since 68s), standbys: y, z 2024-09-21T03:53:38.295 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:38 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:53:38.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:38 smithi060 ceph-mon[33722]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:38.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:38 smithi060 ceph-mon[33722]: mgrmap e15: x(active, since 68s), standbys: y, z 2024-09-21T03:53:38.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:38 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:53:38.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:38 smithi073 ceph-mon[34443]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:38.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:38 smithi073 ceph-mon[34443]: mgrmap e15: x(active, since 68s), standbys: y, z 2024-09-21T03:53:38.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:38 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mgr metadata", "who": "y", "id": "y"} : dispatch 2024-09-21T03:53:39.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:39 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3728336935' entity='client.admin' 2024-09-21T03:53:39.531 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:39 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3192362082' entity='client.admin' 2024-09-21T03:53:39.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:39 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3728336935' entity='client.admin' 2024-09-21T03:53:39.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:39 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3192362082' entity='client.admin' 2024-09-21T03:53:39.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:39 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3728336935' entity='client.admin' 2024-09-21T03:53:39.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:39 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3192362082' entity='client.admin' 2024-09-21T03:53:40.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:40 smithi022 ceph-mon[31015]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:40 smithi060 ceph-mon[33722]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:40.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:40 smithi073 ceph-mon[34443]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:41.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:41 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3174244713' entity='client.admin' 2024-09-21T03:53:41.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:41 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3798118396' entity='client.admin' 2024-09-21T03:53:41.756 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:41 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3174244713' entity='client.admin' 2024-09-21T03:53:41.756 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:41 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3798118396' entity='client.admin' 2024-09-21T03:53:41.844 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:41 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3174244713' entity='client.admin' 2024-09-21T03:53:41.844 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:41 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3798118396' entity='client.admin' 2024-09-21T03:53:42.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:42 smithi022 ceph-mon[31015]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:42.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:42 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2433570933' entity='client.admin' 2024-09-21T03:53:42.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:42 smithi073 ceph-mon[34443]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:42.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:42 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2433570933' entity='client.admin' 2024-09-21T03:53:42.880 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:42 smithi060 ceph-mon[33722]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:42.880 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:42 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2433570933' entity='client.admin' 2024-09-21T03:53:43.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.503+0000 7f0a458ea640 1 -- 172.21.15.22:0/957986240 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0a2c0b6480 msgr2=0x7f0a2c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.503+0000 7f0a458ea640 1 --2- 172.21.15.22:0/957986240 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0a2c0b6480 0x7f0a2c0b8990 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0a30009bd0 tx=0x7f0a30005f90 comp rx=0 tx=0).stop 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.503+0000 7f0a458ea640 1 -- 172.21.15.22:0/957986240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a40104070 msgr2=0x7f0a40199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.503+0000 7f0a458ea640 1 --2- 172.21.15.22:0/957986240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a40104070 0x7f0a40199f40 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0a38009fd0 tx=0x7f0a3800b260 comp rx=0 tx=0).stop 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.504+0000 7f0a458ea640 1 -- 172.21.15.22:0/957986240 shutdown_connections 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.504+0000 7f0a458ea640 1 --2- 172.21.15.22:0/957986240 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0a2c0b6480 0x7f0a2c0b8990 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.504+0000 7f0a458ea640 1 --2- 172.21.15.22:0/957986240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a40104070 0x7f0a40199f40 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.504+0000 7f0a458ea640 1 --2- 172.21.15.22:0/957986240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0a401036d0 0x7f0a401993a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.504+0000 7f0a458ea640 1 --2- 172.21.15.22:0/957986240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0a40102640 0x7f0a40198d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.504+0000 7f0a458ea640 1 -- 172.21.15.22:0/957986240 >> 172.21.15.22:0/957986240 conn(0x7f0a400fdfb0 msgr2=0x7f0a401069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.504+0000 7f0a458ea640 1 -- 172.21.15.22:0/957986240 shutdown_connections 2024-09-21T03:53:43.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:43.504+0000 7f0a458ea640 1 -- 172.21.15.22:0/957986240 wait complete. 2024-09-21T03:53:44.824 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:44 smithi022 ceph-mon[31015]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:44.824 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:44 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/957986240' entity='client.admin' 2024-09-21T03:53:44.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:44 smithi073 ceph-mon[34443]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:44.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:44 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/957986240' entity='client.admin' 2024-09-21T03:53:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:44 smithi060 ceph-mon[33722]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:44 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/957986240' entity='client.admin' 2024-09-21T03:53:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.690+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/4141332671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe18104810 msgr2=0x7fbe18104c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.690+0000 7fbe1cf8c640 1 --2- 172.21.15.22:0/4141332671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe18104810 0x7fbe18104c20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c009900 tx=0x7fbe0c02a480 comp rx=0 tx=0).stop 2024-09-21T03:53:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.690+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/4141332671 shutdown_connections 2024-09-21T03:53:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.690+0000 7fbe1cf8c640 1 --2- 172.21.15.22:0/4141332671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe181051b0 0x7fbe1810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.691+0000 7fbe1cf8c640 1 --2- 172.21.15.22:0/4141332671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe18104810 0x7fbe18104c20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.691+0000 7fbe1cf8c640 1 --2- 172.21.15.22:0/4141332671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18103780 0x7fbe18103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.691+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/4141332671 >> 172.21.15.22:0/4141332671 conn(0x7fbe180ff0f0 msgr2=0x7fbe181015a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.691+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/4141332671 shutdown_connections 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.691+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/4141332671 wait complete. 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe1cf8c640 1 Processor -- start 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe1cf8c640 1 -- start start 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe1cf8c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18103780 0x7fbe18199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe1cf8c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe18104810 0x7fbe1819a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe1cf8c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe181051b0 0x7fbe1819b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe1cf8c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1810f2b0 con 0x7fbe18104810 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe1cf8c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1810f130 con 0x7fbe181051b0 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe1cf8c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbe1810f430 con 0x7fbe18103780 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe15d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe18104810 0x7fbe1819a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe15d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe18104810 0x7fbe1819a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40528/0 (socket says 172.21.15.22:40528) 2024-09-21T03:53:45.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe15d9b640 1 -- 172.21.15.22:0/1015738891 learned_addr learned my addr 172.21.15.22:0/1015738891 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe1659c640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18103780 0x7fbe18199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.692+0000 7fbe16d9d640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe181051b0 0x7fbe1819b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe15d9b640 1 -- 172.21.15.22:0/1015738891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18103780 msgr2=0x7fbe18199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe15d9b640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18103780 0x7fbe18199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe15d9b640 1 -- 172.21.15.22:0/1015738891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe181051b0 msgr2=0x7fbe1819b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe15d9b640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe181051b0 0x7fbe1819b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe15d9b640 1 -- 172.21.15.22:0/1015738891 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe1819b930 con 0x7fbe18104810 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe15d9b640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe18104810 0x7fbe1819a570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c005760 tx=0x7fbe0c003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe077fe640 1 -- 172.21.15.22:0/1015738891 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c03f070 con 0x7fbe18104810 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/1015738891 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe1819bbc0 con 0x7fbe18104810 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/1015738891 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe181a2320 con 0x7fbe18104810 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe077fe640 1 -- 172.21.15.22:0/1015738891 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe0c031ba0 con 0x7fbe18104810 2024-09-21T03:53:45.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.693+0000 7fbe077fe640 1 -- 172.21.15.22:0/1015738891 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c035030 con 0x7fbe18104810 2024-09-21T03:53:45.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.695+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/1015738891 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdf80052c0 con 0x7fbe18104810 2024-09-21T03:53:45.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.696+0000 7fbe077fe640 1 -- 172.21.15.22:0/1015738891 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fbe0c042070 con 0x7fbe18104810 2024-09-21T03:53:45.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.698+0000 7fbe077fe640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbe000b6500 0x7fbe000b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:45.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.698+0000 7fbe1659c640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbe000b6500 0x7fbe000b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:45.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.698+0000 7fbe077fe640 1 -- 172.21.15.22:0/1015738891 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbe0c105d30 con 0x7fbe18104810 2024-09-21T03:53:45.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.698+0000 7fbe1659c640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbe000b6500 0x7fbe000b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009bd0 tx=0x7fbe08005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:45.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.702+0000 7fbe077fe640 1 -- 172.21.15.22:0/1015738891 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbe0c10a070 con 0x7fbe18104810 2024-09-21T03:53:45.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.905+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/1015738891 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fbdf80055b0 con 0x7fbe18104810 2024-09-21T03:53:45.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.910+0000 7fbe077fe640 1 -- 172.21.15.22:0/1015738891 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v27)=0 v27) ==== 122+0+0 (secure 0 0 0) 0x7fbe0c0d2670 con 0x7fbe18104810 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/1015738891 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbe000b6500 msgr2=0x7fbe000b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbe000b6500 0x7fbe000b8a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fbe08009bd0 tx=0x7fbe08005f90 comp rx=0 tx=0).stop 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/1015738891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe18104810 msgr2=0x7fbe1819a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe18104810 0x7fbe1819a570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c005760 tx=0x7fbe0c003c10 comp rx=0 tx=0).stop 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/1015738891 shutdown_connections 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbe000b6500 0x7fbe000b8a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbe181051b0 0x7fbe1819b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe18104810 0x7fbe1819a570 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 --2- 172.21.15.22:0/1015738891 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbe18103780 0x7fbe18199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/1015738891 >> 172.21.15.22:0/1015738891 conn(0x7fbe180ff0f0 msgr2=0x7fbe18107b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/1015738891 shutdown_connections 2024-09-21T03:53:45.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.912+0000 7fbe1cf8c640 1 -- 172.21.15.22:0/1015738891 wait complete. 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.605+0000 7f2bfaa12640 1 -- 172.21.15.22:0/4229846565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bf4104090 msgr2=0x7f2bf410aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.605+0000 7f2bfaa12640 1 --2- 172.21.15.22:0/4229846565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bf4104090 0x7f2bf410aa30 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f2bec009ca0 tx=0x7f2bec02a950 comp rx=0 tx=0).stop 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.605+0000 7f2bfaa12640 1 -- 172.21.15.22:0/4229846565 shutdown_connections 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.605+0000 7f2bfaa12640 1 --2- 172.21.15.22:0/4229846565 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bf4104090 0x7f2bf410aa30 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.605+0000 7f2bfaa12640 1 --2- 172.21.15.22:0/4229846565 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf41036f0 0x7f2bf4103b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.605+0000 7f2bfaa12640 1 --2- 172.21.15.22:0/4229846565 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf4102660 0x7f2bf4102ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.605+0000 7f2bfaa12640 1 -- 172.21.15.22:0/4229846565 >> 172.21.15.22:0/4229846565 conn(0x7f2bf40fdfd0 msgr2=0x7f2bf4100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.605+0000 7f2bfaa12640 1 -- 172.21.15.22:0/4229846565 shutdown_connections 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.605+0000 7f2bfaa12640 1 -- 172.21.15.22:0/4229846565 wait complete. 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.605+0000 7f2bfaa12640 1 Processor -- start 2024-09-21T03:53:45.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bfaa12640 1 -- start start 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bfaa12640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bf4102660 0x7f2bf4199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bfaa12640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf41036f0 0x7f2bf419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bfaa12640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4104090 0x7f2bf419b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bfaa12640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf410e190 con 0x7f2bf4102660 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bfaa12640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf410e010 con 0x7f2bf4104090 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bfaa12640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2bf410e310 con 0x7f2bf41036f0 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bf3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bf4102660 0x7f2bf4199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bf3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bf4102660 0x7f2bf4199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40510/0 (socket says 172.21.15.22:40510) 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bf3fff640 1 -- 172.21.15.22:0/3301835521 learned_addr learned my addr 172.21.15.22:0/3301835521 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bf37fe640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf41036f0 0x7f2bf419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.606+0000 7f2bf8faf640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4104090 0x7f2bf419b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bf3fff640 1 -- 172.21.15.22:0/3301835521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf41036f0 msgr2=0x7f2bf419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bf3fff640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf41036f0 0x7f2bf419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bf3fff640 1 -- 172.21.15.22:0/3301835521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4104090 msgr2=0x7f2bf419b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bf3fff640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4104090 0x7f2bf419b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bf3fff640 1 -- 172.21.15.22:0/3301835521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bf419b940 con 0x7f2bf4102660 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bf37fe640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf41036f0 0x7f2bf419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bf3fff640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bf4102660 0x7f2bf4199f10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2be400d950 tx=0x7f2be400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bf17fa640 1 -- 172.21.15.22:0/3301835521 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be4017070 con 0x7f2bf4102660 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bf17fa640 1 -- 172.21.15.22:0/3301835521 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2be4009c30 con 0x7f2bf4102660 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bfaa12640 1 -- 172.21.15.22:0/3301835521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bf419bc30 con 0x7f2bf4102660 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bf17fa640 1 -- 172.21.15.22:0/3301835521 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2be400f620 con 0x7f2bf4102660 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.607+0000 7f2bfaa12640 1 -- 172.21.15.22:0/3301835521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bf41a2330 con 0x7f2bf4102660 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.609+0000 7f2bfaa12640 1 -- 172.21.15.22:0/3301835521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bf41a2500 con 0x7f2bf4102660 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.610+0000 7f2bf17fa640 1 -- 172.21.15.22:0/3301835521 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f2be4010460 con 0x7f2bf4102660 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.611+0000 7f2bf17fa640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2bdc0b6480 0x7f2bdc0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.611+0000 7f2bf37fe640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2bdc0b6480 0x7f2bdc0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:45.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.611+0000 7f2bf17fa640 1 -- 172.21.15.22:0/3301835521 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f2be40e51d0 con 0x7f2bf4102660 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.612+0000 7f2bf37fe640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2bdc0b6480 0x7f2bdc0b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2be80058c0 tx=0x7f2be800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.616+0000 7f2bf17fa640 1 -- 172.21.15.22:0/3301835521 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2be4009de0 con 0x7f2bf4102660 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.810+0000 7f2bfaa12640 1 -- 172.21.15.22:0/3301835521 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f2bf41a26d0 con 0x7f2bf4102660 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.814+0000 7f2bf17fa640 1 -- 172.21.15.22:0/3301835521 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v26)=0 v26) ==== 108+0+0 (secure 0 0 0) 0x7f2be40b1b10 con 0x7f2bf4102660 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.816+0000 7f2bfaa12640 1 -- 172.21.15.22:0/3301835521 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2bdc0b6480 msgr2=0x7f2bdc0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.816+0000 7f2bfaa12640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2bdc0b6480 0x7f2bdc0b8990 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f2be80058c0 tx=0x7f2be800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.816+0000 7f2bfaa12640 1 -- 172.21.15.22:0/3301835521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bf4102660 msgr2=0x7f2bf4199f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.816+0000 7f2bfaa12640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bf4102660 0x7f2bf4199f10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f2be400d950 tx=0x7f2be400de10 comp rx=0 tx=0).stop 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.816+0000 7f2bfaa12640 1 -- 172.21.15.22:0/3301835521 shutdown_connections 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.816+0000 7f2bfaa12640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2bdc0b6480 0x7f2bdc0b8990 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.816+0000 7f2bfaa12640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bf41036f0 0x7f2bf419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.816+0000 7f2bfaa12640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bf4104090 0x7f2bf419b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.816+0000 7f2bfaa12640 1 --2- 172.21.15.22:0/3301835521 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bf4102660 0x7f2bf4199f10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:45.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.816+0000 7f2bfaa12640 1 -- 172.21.15.22:0/3301835521 >> 172.21.15.22:0/3301835521 conn(0x7f2bf40fdfd0 msgr2=0x7f2bf406b820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:45.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.817+0000 7f2bfaa12640 1 -- 172.21.15.22:0/3301835521 shutdown_connections 2024-09-21T03:53:45.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:45.817+0000 7f2bfaa12640 1 -- 172.21.15.22:0/3301835521 wait complete. 2024-09-21T03:53:46.823 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:46 smithi022 ceph-mon[31015]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:46.824 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:46 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3301835521' entity='client.admin' 2024-09-21T03:53:46.824 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:46 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1015738891' entity='client.admin' 2024-09-21T03:53:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:46 smithi073 ceph-mon[34443]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:46 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3301835521' entity='client.admin' 2024-09-21T03:53:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:46 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1015738891' entity='client.admin' 2024-09-21T03:53:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:46 smithi060 ceph-mon[33722]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:46 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3301835521' entity='client.admin' 2024-09-21T03:53:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:46 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1015738891' entity='client.admin' 2024-09-21T03:53:48.841 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:48 smithi022 ceph-mon[31015]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:48.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:48.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:48.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:48.842 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:48 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2209365000' entity='client.admin' 2024-09-21T03:53:48.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:48 smithi073 ceph-mon[34443]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:48 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2209365000' entity='client.admin' 2024-09-21T03:53:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:48 smithi060 ceph-mon[33722]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:48 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2209365000' entity='client.admin' 2024-09-21T03:53:49.129 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi022') 2024-09-21T03:53:49.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.728+0000 7fd2537b3640 1 -- 172.21.15.22:0/3282738830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd24c1083a0 msgr2=0x7fd24c10a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:49.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.728+0000 7fd2537b3640 1 --2- 172.21.15.22:0/3282738830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd24c1083a0 0x7fd24c10a8b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd244009ca0 tx=0x7fd24402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.728+0000 7fd2537b3640 1 -- 172.21.15.22:0/3282738830 shutdown_connections 2024-09-21T03:53:49.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.728+0000 7fd2537b3640 1 --2- 172.21.15.22:0/3282738830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd24c1083a0 0x7fd24c10a8b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.728+0000 7fd2537b3640 1 --2- 172.21.15.22:0/3282738830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c105780 0x7fd24c107c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.728+0000 7fd2537b3640 1 --2- 172.21.15.22:0/3282738830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd24c102d20 0x7fd24c105140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.728+0000 7fd2537b3640 1 -- 172.21.15.22:0/3282738830 >> 172.21.15.22:0/3282738830 conn(0x7fd24c0fd760 msgr2=0x7fd24c0ffc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:49.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.728+0000 7fd2537b3640 1 -- 172.21.15.22:0/3282738830 shutdown_connections 2024-09-21T03:53:49.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.728+0000 7fd2537b3640 1 -- 172.21.15.22:0/3282738830 wait complete. 2024-09-21T03:53:49.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd2537b3640 1 Processor -- start 2024-09-21T03:53:49.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd2537b3640 1 -- start start 2024-09-21T03:53:49.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd2537b3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd24c102d20 0x7fd24c1021c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:49.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd2537b3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c105780 0x7fd24c19ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:49.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd2537b3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd24c1083a0 0x7fd24c1a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:49.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd2537b3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c10e190 con 0x7fd24c102d20 2024-09-21T03:53:49.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd2537b3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c10e010 con 0x7fd24c105780 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd2537b3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd24c10e310 con 0x7fd24c1083a0 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd25154f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd24c102d20 0x7fd24c1021c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd25154f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd24c102d20 0x7fd24c1021c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40566/0 (socket says 172.21.15.22:40566) 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.729+0000 7fd25154f640 1 -- 172.21.15.22:0/3305454389 learned_addr learned my addr 172.21.15.22:0/3305454389 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd251d50640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd24c1083a0 0x7fd24c1a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd250d4e640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c105780 0x7fd24c19ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd25154f640 1 -- 172.21.15.22:0/3305454389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd24c1083a0 msgr2=0x7fd24c1a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd25154f640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd24c1083a0 0x7fd24c1a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd25154f640 1 -- 172.21.15.22:0/3305454389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c105780 msgr2=0x7fd24c19ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd25154f640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c105780 0x7fd24c19ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd25154f640 1 -- 172.21.15.22:0/3305454389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd24c1a18d0 con 0x7fd24c102d20 2024-09-21T03:53:49.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd251d50640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd24c1083a0 0x7fd24c1a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd25154f640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd24c102d20 0x7fd24c1021c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd24800c920 tx=0x7fd24800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd2427fc640 1 -- 172.21.15.22:0/3305454389 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248007c70 con 0x7fd24c102d20 2024-09-21T03:53:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd2427fc640 1 -- 172.21.15.22:0/3305454389 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd248007e10 con 0x7fd24c102d20 2024-09-21T03:53:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd2537b3640 1 -- 172.21.15.22:0/3305454389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd24c1a1bc0 con 0x7fd24c102d20 2024-09-21T03:53:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd2427fc640 1 -- 172.21.15.22:0/3305454389 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd248018710 con 0x7fd24c102d20 2024-09-21T03:53:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.730+0000 7fd2537b3640 1 -- 172.21.15.22:0/3305454389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd24c1a2100 con 0x7fd24c102d20 2024-09-21T03:53:49.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.731+0000 7fd2537b3640 1 -- 172.21.15.22:0/3305454389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd24c0ff280 con 0x7fd24c102d20 2024-09-21T03:53:49.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.733+0000 7fd2427fc640 1 -- 172.21.15.22:0/3305454389 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fd24800f450 con 0x7fd24c102d20 2024-09-21T03:53:49.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.734+0000 7fd2427fc640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2380b6500 0x7fd2380b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:49.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.734+0000 7fd250d4e640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2380b6500 0x7fd2380b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:49.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.734+0000 7fd2427fc640 1 -- 172.21.15.22:0/3305454389 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd2480e5bc0 con 0x7fd24c102d20 2024-09-21T03:53:49.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.734+0000 7fd250d4e640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2380b6500 0x7fd2380b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd23c005fd0 tx=0x7fd23c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:49.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.737+0000 7fd2427fc640 1 -- 172.21.15.22:0/3305454389 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd248014030 con 0x7fd24c102d20 2024-09-21T03:53:49.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.928+0000 7fd2537b3640 1 -- 172.21.15.22:0/3305454389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7fd24c02e640 con 0x7fd24c102d20 2024-09-21T03:53:49.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.932+0000 7fd2427fc640 1 -- 172.21.15.22:0/3305454389 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v29)=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7fd2480ae110 con 0x7fd24c102d20 2024-09-21T03:53:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 -- 172.21.15.22:0/3305454389 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2380b6500 msgr2=0x7fd2380b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2380b6500 0x7fd2380b8a10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd23c005fd0 tx=0x7fd23c005850 comp rx=0 tx=0).stop 2024-09-21T03:53:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 -- 172.21.15.22:0/3305454389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd24c102d20 msgr2=0x7fd24c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd24c102d20 0x7fd24c1021c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd24800c920 tx=0x7fd24800cde0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 -- 172.21.15.22:0/3305454389 shutdown_connections 2024-09-21T03:53:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2380b6500 0x7fd2380b8a10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd24c1083a0 0x7fd24c1a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd24c105780 0x7fd24c19ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 --2- 172.21.15.22:0/3305454389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd24c102d20 0x7fd24c1021c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 -- 172.21.15.22:0/3305454389 >> 172.21.15.22:0/3305454389 conn(0x7fd24c0fd760 msgr2=0x7fd24c103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 -- 172.21.15.22:0/3305454389 shutdown_connections 2024-09-21T03:53:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:49.935+0000 7fd2537b3640 1 -- 172.21.15.22:0/3305454389 wait complete. 2024-09-21T03:53:50.727 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi022') 2024-09-21T03:53:50.727 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi022') 2024-09-21T03:53:50.727 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi022') 2024-09-21T03:53:50.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:50 smithi022 ceph-mon[31015]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:50.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:50 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:50.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:50 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:50.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:50 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:50.803 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:50 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3305454389' entity='client.admin' 2024-09-21T03:53:50.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:50 smithi073 ceph-mon[34443]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:50.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:50 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:50.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:50 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:50.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:50 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:50.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:50 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3305454389' entity='client.admin' 2024-09-21T03:53:50.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.904+0000 7f15952d6640 1 -- 172.21.15.22:0/4061075785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15901094a0 msgr2=0x7f159010b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:50.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.904+0000 7f15952d6640 1 --2- 172.21.15.22:0/4061075785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15901094a0 0x7f159010b9b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1588009900 tx=0x7f158802a410 comp rx=0 tx=0).stop 2024-09-21T03:53:50.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.904+0000 7f15952d6640 1 -- 172.21.15.22:0/4061075785 shutdown_connections 2024-09-21T03:53:50.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.904+0000 7f15952d6640 1 --2- 172.21.15.22:0/4061075785 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1590106900 0x7f1590108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.904+0000 7f15952d6640 1 --2- 172.21.15.22:0/4061075785 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f15901094a0 0x7f159010b9b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.904+0000 7f15952d6640 1 --2- 172.21.15.22:0/4061075785 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f159006c660 0x7f15901063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.904+0000 7f15952d6640 1 -- 172.21.15.22:0/4061075785 >> 172.21.15.22:0/4061075785 conn(0x7f15900fdfe0 msgr2=0x7f1590100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.904+0000 7f15952d6640 1 -- 172.21.15.22:0/4061075785 shutdown_connections 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.904+0000 7f15952d6640 1 -- 172.21.15.22:0/4061075785 wait complete. 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.904+0000 7f15952d6640 1 Processor -- start 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f15952d6640 1 -- start start 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f15952d6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159006c660 0x7f1590199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f15952d6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1590106900 0x7f159019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f15952d6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15901094a0 0x7f159019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f15952d6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f159010f2c0 con 0x7f1590106900 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f15952d6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f159010f140 con 0x7f15901094a0 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f15952d6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f159010f440 con 0x7f159006c660 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f158e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1590106900 0x7f159019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:50.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f158e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1590106900 0x7f159019a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59640/0 (socket says 172.21.15.22:59640) 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f158e7fc640 1 -- 172.21.15.22:0/4089663416 learned_addr learned my addr 172.21.15.22:0/4089663416 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f158effd640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159006c660 0x7f1590199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f158f7fe640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15901094a0 0x7f159019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f158e7fc640 1 -- 172.21.15.22:0/4089663416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159006c660 msgr2=0x7f1590199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f158e7fc640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159006c660 0x7f1590199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f158e7fc640 1 -- 172.21.15.22:0/4089663416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15901094a0 msgr2=0x7f159019b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f158e7fc640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15901094a0 0x7f159019b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.905+0000 7f158e7fc640 1 -- 172.21.15.22:0/4089663416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159019b8c0 con 0x7f1590106900 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.906+0000 7f158e7fc640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1590106900 0x7f159019a500 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f157800e9f0 tx=0x7f157800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.906+0000 7f1587fff640 1 -- 172.21.15.22:0/4089663416 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157800cd80 con 0x7f1590106900 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.906+0000 7f1587fff640 1 -- 172.21.15.22:0/4089663416 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f15780054b0 con 0x7f1590106900 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.906+0000 7f15952d6640 1 -- 172.21.15.22:0/4089663416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f159019bbb0 con 0x7f1590106900 2024-09-21T03:53:50.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.906+0000 7f1587fff640 1 -- 172.21.15.22:0/4089663416 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578010430 con 0x7f1590106900 2024-09-21T03:53:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.906+0000 7f15952d6640 1 -- 172.21.15.22:0/4089663416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15901a22b0 con 0x7f1590106900 2024-09-21T03:53:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.907+0000 7f15952d6640 1 -- 172.21.15.22:0/4089663416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15900ffb00 con 0x7f1590106900 2024-09-21T03:53:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.908+0000 7f1587fff640 1 -- 172.21.15.22:0/4089663416 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f15780046c0 con 0x7f1590106900 2024-09-21T03:53:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.909+0000 7f1587fff640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f157c0b6500 0x7f157c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.909+0000 7f158effd640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f157c0b6500 0x7f157c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.909+0000 7f1587fff640 1 -- 172.21.15.22:0/4089663416 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f15780e5b00 con 0x7f1590106900 2024-09-21T03:53:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.910+0000 7f158effd640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f157c0b6500 0x7f157c0b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1580005fd0 tx=0x7f1580009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:50.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:50.912+0000 7f1587fff640 1 -- 172.21.15.22:0/4089663416 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f15780ae060 con 0x7f1590106900 2024-09-21T03:53:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:50 smithi060 ceph-mon[33722]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:50 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:50 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:50 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:50 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3305454389' entity='client.admin' 2024-09-21T03:53:51.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.103+0000 7f15952d6640 1 -- 172.21.15.22:0/4089663416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f159002e640 con 0x7f1590106900 2024-09-21T03:53:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.107+0000 7f1587fff640 1 -- 172.21.15.22:0/4089663416 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v30)=0 v30) ==== 111+0+0 (secure 0 0 0) 0x7f15780b2440 con 0x7f1590106900 2024-09-21T03:53:51.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 -- 172.21.15.22:0/4089663416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f157c0b6500 msgr2=0x7f157c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f157c0b6500 0x7f157c0b8a10 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1580005fd0 tx=0x7f1580009500 comp rx=0 tx=0).stop 2024-09-21T03:53:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 -- 172.21.15.22:0/4089663416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1590106900 msgr2=0x7f159019a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1590106900 0x7f159019a500 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f157800e9f0 tx=0x7f157800edf0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 -- 172.21.15.22:0/4089663416 shutdown_connections 2024-09-21T03:53:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f157c0b6500 0x7f157c0b8a10 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f15901094a0 0x7f159019b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1590106900 0x7f159019a500 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 --2- 172.21.15.22:0/4089663416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f159006c660 0x7f1590199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 -- 172.21.15.22:0/4089663416 >> 172.21.15.22:0/4089663416 conn(0x7f15900fdfe0 msgr2=0x7f1590104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 -- 172.21.15.22:0/4089663416 shutdown_connections 2024-09-21T03:53:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.110+0000 7f15952d6640 1 -- 172.21.15.22:0/4089663416 wait complete. 2024-09-21T03:53:51.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.748+0000 7fa5c458d640 1 -- 172.21.15.22:0/3274745700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5bc109480 msgr2=0x7fa5bc10b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.748+0000 7fa5c458d640 1 --2- 172.21.15.22:0/3274745700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5bc109480 0x7fa5bc10b990 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4009ca0 tx=0x7fa5b402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.749+0000 7fa5c458d640 1 -- 172.21.15.22:0/3274745700 shutdown_connections 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.749+0000 7fa5c458d640 1 --2- 172.21.15.22:0/3274745700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5bc1068e0 0x7fa5bc108d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.749+0000 7fa5c458d640 1 --2- 172.21.15.22:0/3274745700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5bc109480 0x7fa5bc10b990 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.749+0000 7fa5c458d640 1 --2- 172.21.15.22:0/3274745700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5bc06c660 0x7fa5bc1063a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.749+0000 7fa5c458d640 1 -- 172.21.15.22:0/3274745700 >> 172.21.15.22:0/3274745700 conn(0x7fa5bc0fdfe0 msgr2=0x7fa5bc100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.749+0000 7fa5c458d640 1 -- 172.21.15.22:0/3274745700 shutdown_connections 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.749+0000 7fa5c458d640 1 -- 172.21.15.22:0/3274745700 wait complete. 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.749+0000 7fa5c458d640 1 Processor -- start 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.749+0000 7fa5c458d640 1 -- start start 2024-09-21T03:53:51.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.749+0000 7fa5c458d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5bc06c660 0x7fa5bc199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:51.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c458d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5bc1068e0 0x7fa5bc19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:51.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c458d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5bc109480 0x7fa5bc19b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:51.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c458d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc10f280 con 0x7fa5bc1068e0 2024-09-21T03:53:51.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c458d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc10f100 con 0x7fa5bc06c660 2024-09-21T03:53:51.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c458d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc10f400 con 0x7fa5bc109480 2024-09-21T03:53:51.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c1b28640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5bc1068e0 0x7fa5bc19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:51.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c1b28640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5bc1068e0 0x7fa5bc19a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59670/0 (socket says 172.21.15.22:59670) 2024-09-21T03:53:51.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c1b28640 1 -- 172.21.15.22:0/3196494320 learned_addr learned my addr 172.21.15.22:0/3196494320 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c2b2a640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5bc109480 0x7fa5bc19b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c2329640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5bc06c660 0x7fa5bc199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c1b28640 1 -- 172.21.15.22:0/3196494320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5bc109480 msgr2=0x7fa5bc19b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c1b28640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5bc109480 0x7fa5bc19b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c1b28640 1 -- 172.21.15.22:0/3196494320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5bc06c660 msgr2=0x7fa5bc199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c1b28640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5bc06c660 0x7fa5bc199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c1b28640 1 -- 172.21.15.22:0/3196494320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc19b8a0 con 0x7fa5bc1068e0 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c2329640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5bc06c660 0x7fa5bc199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c1b28640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5bc1068e0 0x7fa5bc19a4e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00d950 tx=0x7fa5ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5b37fe640 1 -- 172.21.15.22:0/3196494320 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac017030 con 0x7fa5bc1068e0 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5b37fe640 1 -- 172.21.15.22:0/3196494320 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa5ac004020 con 0x7fa5bc1068e0 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5c458d640 1 -- 172.21.15.22:0/3196494320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5bc19bb90 con 0x7fa5bc1068e0 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.750+0000 7fa5b37fe640 1 -- 172.21.15.22:0/3196494320 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5ac0055d0 con 0x7fa5bc1068e0 2024-09-21T03:53:51.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.751+0000 7fa5c458d640 1 -- 172.21.15.22:0/3196494320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5bc1a2290 con 0x7fa5bc1068e0 2024-09-21T03:53:51.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.751+0000 7fa5c458d640 1 -- 172.21.15.22:0/3196494320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5bc0ffb00 con 0x7fa5bc1068e0 2024-09-21T03:53:51.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.755+0000 7fa5b37fe640 1 -- 172.21.15.22:0/3196494320 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fa5ac009a30 con 0x7fa5bc1068e0 2024-09-21T03:53:51.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.755+0000 7fa5b37fe640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa5a80b6500 0x7fa5a80b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:51.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.755+0000 7fa5c2329640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa5a80b6500 0x7fa5a80b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:51.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.756+0000 7fa5b37fe640 1 -- 172.21.15.22:0/3196494320 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa5ac0e55e0 con 0x7fa5bc1068e0 2024-09-21T03:53:51.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.756+0000 7fa5c2329640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa5a80b6500 0x7fa5a80b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80058c0 tx=0x7fa5b8005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:51.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.758+0000 7fa5b37fe640 1 -- 172.21.15.22:0/3196494320 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa5ac0adbc0 con 0x7fa5bc1068e0 2024-09-21T03:53:51.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.948+0000 7fa5c458d640 1 -- 172.21.15.22:0/3196494320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mds_bal_split_bits}] v 0) -- 0x7fa5bc02e640 con 0x7fa5bc1068e0 2024-09-21T03:53:51.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.952+0000 7fa5b37fe640 1 -- 172.21.15.22:0/3196494320 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_split_bits}]=0 v31)=0 v31) ==== 116+0+0 (secure 0 0 0) 0x7fa5ac0b1fa0 con 0x7fa5bc1068e0 2024-09-21T03:53:51.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.954+0000 7fa5c458d640 1 -- 172.21.15.22:0/3196494320 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa5a80b6500 msgr2=0x7fa5a80b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.954+0000 7fa5c458d640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa5a80b6500 0x7fa5a80b8a10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa5b80058c0 tx=0x7fa5b8005ec0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.954+0000 7fa5c458d640 1 -- 172.21.15.22:0/3196494320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5bc1068e0 msgr2=0x7fa5bc19a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.954+0000 7fa5c458d640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5bc1068e0 0x7fa5bc19a4e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa5ac00d950 tx=0x7fa5ac00de10 comp rx=0 tx=0).stop 2024-09-21T03:53:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.955+0000 7fa5c458d640 1 -- 172.21.15.22:0/3196494320 shutdown_connections 2024-09-21T03:53:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.955+0000 7fa5c458d640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa5a80b6500 0x7fa5a80b8a10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.955+0000 7fa5c458d640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa5bc109480 0x7fa5bc19b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.955+0000 7fa5c458d640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5bc1068e0 0x7fa5bc19a4e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.955+0000 7fa5c458d640 1 --2- 172.21.15.22:0/3196494320 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa5bc06c660 0x7fa5bc199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.955+0000 7fa5c458d640 1 -- 172.21.15.22:0/3196494320 >> 172.21.15.22:0/3196494320 conn(0x7fa5bc0fdfe0 msgr2=0x7fa5bc104df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.955+0000 7fa5c458d640 1 -- 172.21.15.22:0/3196494320 shutdown_connections 2024-09-21T03:53:51.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:51.955+0000 7fa5c458d640 1 -- 172.21.15.22:0/3196494320 wait complete. 2024-09-21T03:53:52.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:52 smithi022 ceph-mon[31015]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:52.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:52 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/4089663416' entity='client.admin' 2024-09-21T03:53:52.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:52 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:52.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:52 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:52.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:52 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:52.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:52 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:52.344 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:52 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3196494320' entity='client.admin' 2024-09-21T03:53:52.371 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi022') 2024-09-21T03:53:52.371 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_fragment_size_max', '10000'], check_status=True, hostname='smithi022') 2024-09-21T03:53:52.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:52 smithi060 ceph-mon[33722]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:52.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:52 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/4089663416' entity='client.admin' 2024-09-21T03:53:52.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:52 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:52.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:52 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:52.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:52 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:52.375 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:52 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:52.376 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:52 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3196494320' entity='client.admin' 2024-09-21T03:53:52.574 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:52.574 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:52.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:52 smithi073 ceph-mon[34443]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:52.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:52 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/4089663416' entity='client.admin' 2024-09-21T03:53:52.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:52 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:53:52.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:52 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:53:52.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:52 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:53:52.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:52 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:53:52.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:52 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3196494320' entity='client.admin' 2024-09-21T03:53:53.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.767+0000 7f6692aa9640 1 -- 172.21.15.22:0/2651690367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f668c103770 msgr2=0x7f668c103b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.767+0000 7f6692aa9640 1 --2- 172.21.15.22:0/2651690367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f668c103770 0x7f668c103b80 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f6678009900 tx=0x7f667802a480 comp rx=0 tx=0).stop 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.768+0000 7f6692aa9640 1 -- 172.21.15.22:0/2651690367 shutdown_connections 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.768+0000 7f6692aa9640 1 --2- 172.21.15.22:0/2651690367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f668c104110 0x7f668c10aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.768+0000 7f6692aa9640 1 --2- 172.21.15.22:0/2651690367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f668c103770 0x7f668c103b80 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.768+0000 7f6692aa9640 1 --2- 172.21.15.22:0/2651690367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f668c1026e0 0x7f668c102b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.768+0000 7f6692aa9640 1 -- 172.21.15.22:0/2651690367 >> 172.21.15.22:0/2651690367 conn(0x7f668c0fe050 msgr2=0x7f668c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.768+0000 7f6692aa9640 1 -- 172.21.15.22:0/2651690367 shutdown_connections 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.768+0000 7f6692aa9640 1 -- 172.21.15.22:0/2651690367 wait complete. 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.768+0000 7f6692aa9640 1 Processor -- start 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.768+0000 7f6692aa9640 1 -- start start 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6692aa9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f668c1026e0 0x7f668c199f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6692aa9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f668c103770 0x7f668c19a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6692aa9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f668c104110 0x7f668c19b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6692aa9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f668c10e170 con 0x7f668c1026e0 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6692aa9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f668c10dff0 con 0x7f668c104110 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6692aa9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f668c10e2f0 con 0x7f668c103770 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6690845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f668c1026e0 0x7f668c199f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6690845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f668c1026e0 0x7f668c199f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40548/0 (socket says 172.21.15.22:40548) 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6690845640 1 -- 172.21.15.22:0/2209365000 learned_addr learned my addr 172.21.15.22:0/2209365000 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f668bfff640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f668c103770 0x7f668c19a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6691046640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f668c104110 0x7f668c19b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6690845640 1 -- 172.21.15.22:0/2209365000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f668c103770 msgr2=0x7f668c19a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6690845640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f668c103770 0x7f668c19a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6690845640 1 -- 172.21.15.22:0/2209365000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f668c104110 msgr2=0x7f668c19b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6690845640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f668c104110 0x7f668c19b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6690845640 1 -- 172.21.15.22:0/2209365000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f668c19b950 con 0x7f668c1026e0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6691046640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f668c104110 0x7f668c19b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6690845640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f668c1026e0 0x7f668c199f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f668000d770 tx=0x7f668000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6689ffb640 1 -- 172.21.15.22:0/2209365000 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680017070 con 0x7f668c1026e0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6692aa9640 1 -- 172.21.15.22:0/2209365000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f668c19bc40 con 0x7f668c1026e0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.769+0000 7f6689ffb640 1 -- 172.21.15.22:0/2209365000 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66800054b0 con 0x7f668c1026e0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.770+0000 7f6689ffb640 1 -- 172.21.15.22:0/2209365000 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6680004c60 con 0x7f668c1026e0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.770+0000 7f6692aa9640 1 -- 172.21.15.22:0/2209365000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f668c1a2340 con 0x7f668c1026e0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.771+0000 7f6692aa9640 1 -- 172.21.15.22:0/2209365000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f668c1a2510 con 0x7f668c1026e0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.773+0000 7f6689ffb640 1 -- 172.21.15.22:0/2209365000 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f6680004e00 con 0x7f668c1026e0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.774+0000 7f6689ffb640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f667c0b6500 0x7f667c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.774+0000 7f6689ffb640 1 -- 172.21.15.22:0/2209365000 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f66800e5560 con 0x7f668c1026e0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.774+0000 7f668bfff640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f667c0b6500 0x7f667c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:53.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.775+0000 7f668bfff640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f667c0b6500 0x7f667c0b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f66780057c0 tx=0x7f6678000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.778+0000 7f6689ffb640 1 -- 172.21.15.22:0/2209365000 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f66800ada20 con 0x7f668c1026e0 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.969+0000 7f6692aa9640 1 -- 172.21.15.22:0/2209365000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f668c1a26e0 con 0x7f668c1026e0 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.973+0000 7f6689ffb640 1 -- 172.21.15.22:0/2209365000 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v28)=0 v28) ==== 121+0+0 (secure 0 0 0) 0x7f66800b1e00 con 0x7f668c1026e0 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 -- 172.21.15.22:0/2209365000 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f667c0b6500 msgr2=0x7f667c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f667c0b6500 0x7f667c0b8a10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f66780057c0 tx=0x7f6678000bc0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 -- 172.21.15.22:0/2209365000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f668c1026e0 msgr2=0x7f668c199f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f668c1026e0 0x7f668c199f20 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f668000d770 tx=0x7f668000dc30 comp rx=0 tx=0).stop 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 -- 172.21.15.22:0/2209365000 shutdown_connections 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f667c0b6500 0x7f667c0b8a10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f668c103770 0x7f668c19a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f668c104110 0x7f668c19b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 --2- 172.21.15.22:0/2209365000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f668c1026e0 0x7f668c199f20 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 -- 172.21.15.22:0/2209365000 >> 172.21.15.22:0/2209365000 conn(0x7f668c0fe050 msgr2=0x7f668c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:53.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 -- 172.21.15.22:0/2209365000 shutdown_connections 2024-09-21T03:53:53.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:47.976+0000 7f6692aa9640 1 -- 172.21.15.22:0/2209365000 wait complete. 2024-09-21T03:53:54.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:54 smithi073 ceph-mon[34443]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:54.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:54 smithi060 ceph-mon[33722]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:54.456 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:54 smithi022 ceph-mon[31015]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:54.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.980+0000 7fcd71322640 1 -- 172.21.15.22:0/3748430301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c1068d0 msgr2=0x7fcd6c108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:54.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.980+0000 7fcd71322640 1 --2- 172.21.15.22:0/3748430301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c1068d0 0x7fcd6c108d30 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd54009900 tx=0x7fcd5402a410 comp rx=0 tx=0).stop 2024-09-21T03:53:54.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.980+0000 7fcd71322640 1 -- 172.21.15.22:0/3748430301 shutdown_connections 2024-09-21T03:53:54.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.980+0000 7fcd71322640 1 --2- 172.21.15.22:0/3748430301 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd6c109470 0x7fcd6c10b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:54.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.980+0000 7fcd71322640 1 --2- 172.21.15.22:0/3748430301 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c1068d0 0x7fcd6c108d30 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:54.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.980+0000 7fcd71322640 1 --2- 172.21.15.22:0/3748430301 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd6c06b980 0x7fcd6c106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:54.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.980+0000 7fcd71322640 1 -- 172.21.15.22:0/3748430301 >> 172.21.15.22:0/3748430301 conn(0x7fcd6c0fdfb0 msgr2=0x7fcd6c100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:54.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.980+0000 7fcd71322640 1 -- 172.21.15.22:0/3748430301 shutdown_connections 2024-09-21T03:53:54.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.980+0000 7fcd71322640 1 -- 172.21.15.22:0/3748430301 wait complete. 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.981+0000 7fcd71322640 1 Processor -- start 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.981+0000 7fcd71322640 1 -- start start 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.981+0000 7fcd71322640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c06b980 0x7fcd6c199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.981+0000 7fcd71322640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd6c1068d0 0x7fcd6c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.981+0000 7fcd71322640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd6c109470 0x7fcd6c19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.981+0000 7fcd71322640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c10f210 con 0x7fcd6c06b980 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.981+0000 7fcd71322640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c10f090 con 0x7fcd6c1068d0 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.981+0000 7fcd71322640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcd6c10f390 con 0x7fcd6c109470 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c06b980 0x7fcd6c199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c06b980 0x7fcd6c199ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59696/0 (socket says 172.21.15.22:59696) 2024-09-21T03:53:54.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6affd640 1 -- 172.21.15.22:0/623434041 learned_addr learned my addr 172.21.15.22:0/623434041 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd63fff640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd6c1068d0 0x7fcd6c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6b7fe640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd6c109470 0x7fcd6c19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6affd640 1 -- 172.21.15.22:0/623434041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd6c109470 msgr2=0x7fcd6c19b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6affd640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd6c109470 0x7fcd6c19b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6affd640 1 -- 172.21.15.22:0/623434041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd6c1068d0 msgr2=0x7fcd6c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6affd640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd6c1068d0 0x7fcd6c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6affd640 1 -- 172.21.15.22:0/623434041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd6c19b8f0 con 0x7fcd6c06b980 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6b7fe640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd6c109470 0x7fcd6c19b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd6affd640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c06b980 0x7fcd6c199ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00d950 tx=0x7fcd5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd68ff9640 1 -- 172.21.15.22:0/623434041 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c017070 con 0x7fcd6c06b980 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd71322640 1 -- 172.21.15.22:0/623434041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd6c19bbe0 con 0x7fcd6c06b980 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd68ff9640 1 -- 172.21.15.22:0/623434041 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcd5c009c30 con 0x7fcd6c06b980 2024-09-21T03:53:54.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd68ff9640 1 -- 172.21.15.22:0/623434041 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd5c00f620 con 0x7fcd6c06b980 2024-09-21T03:53:54.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.982+0000 7fcd71322640 1 -- 172.21.15.22:0/623434041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd6c1a22e0 con 0x7fcd6c06b980 2024-09-21T03:53:54.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.983+0000 7fcd71322640 1 -- 172.21.15.22:0/623434041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd6c0ffad0 con 0x7fcd6c06b980 2024-09-21T03:53:54.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.985+0000 7fcd68ff9640 1 -- 172.21.15.22:0/623434041 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fcd5c010460 con 0x7fcd6c06b980 2024-09-21T03:53:54.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.986+0000 7fcd68ff9640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcd580b6480 0x7fcd580b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:54.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.987+0000 7fcd63fff640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcd580b6480 0x7fcd580b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:54.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.987+0000 7fcd68ff9640 1 -- 172.21.15.22:0/623434041 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fcd5c0e5220 con 0x7fcd6c06b980 2024-09-21T03:53:54.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.987+0000 7fcd63fff640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcd580b6480 0x7fcd580b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd540057c0 tx=0x7fcd54000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:54.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:54.989+0000 7fcd68ff9640 1 -- 172.21.15.22:0/623434041 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcd5c0ad780 con 0x7fcd6c06b980 2024-09-21T03:53:55.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.182+0000 7fcd71322640 1 -- 172.21.15.22:0/623434041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mds_bal_fragment_size_max}] v 0) -- 0x7fcd6c02e640 con 0x7fcd6c06b980 2024-09-21T03:53:55.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.187+0000 7fcd68ff9640 1 -- 172.21.15.22:0/623434041 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_fragment_size_max}]=0 v32)=0 v32) ==== 127+0+0 (secure 0 0 0) 0x7fcd5c009de0 con 0x7fcd6c06b980 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 -- 172.21.15.22:0/623434041 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcd580b6480 msgr2=0x7fcd580b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcd580b6480 0x7fcd580b8990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fcd540057c0 tx=0x7fcd54000bc0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 -- 172.21.15.22:0/623434041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c06b980 msgr2=0x7fcd6c199ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c06b980 0x7fcd6c199ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcd5c00d950 tx=0x7fcd5c00de10 comp rx=0 tx=0).stop 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 -- 172.21.15.22:0/623434041 shutdown_connections 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcd580b6480 0x7fcd580b8990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcd6c109470 0x7fcd6c19b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcd6c1068d0 0x7fcd6c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 --2- 172.21.15.22:0/623434041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcd6c06b980 0x7fcd6c199ec0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 -- 172.21.15.22:0/623434041 >> 172.21.15.22:0/623434041 conn(0x7fcd6c0fdfb0 msgr2=0x7fcd6c104de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 -- 172.21.15.22:0/623434041 shutdown_connections 2024-09-21T03:53:55.193 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7fcd71322640 1 -- 172.21.15.22:0/623434041 wait complete. 2024-09-21T03:53:55.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7f0fa7a02640 1 -- 172.21.15.22:0/1310348542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fa0105210 msgr2=0x7f0fa010bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7f0fa7a02640 1 --2- 172.21.15.22:0/1310348542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fa0105210 0x7f0fa010bbb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0f98009ca0 tx=0x7f0f9802a950 comp rx=0 tx=0).stop 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7f0fa7a02640 1 -- 172.21.15.22:0/1310348542 shutdown_connections 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7f0fa7a02640 1 --2- 172.21.15.22:0/1310348542 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fa0105210 0x7f0fa010bbb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7f0fa7a02640 1 --2- 172.21.15.22:0/1310348542 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0104870 0x7f0fa0104c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7f0fa7a02640 1 --2- 172.21.15.22:0/1310348542 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa01037e0 0x7f0fa0103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7f0fa7a02640 1 -- 172.21.15.22:0/1310348542 >> 172.21.15.22:0/1310348542 conn(0x7f0fa00ff150 msgr2=0x7f0fa0101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7f0fa7a02640 1 -- 172.21.15.22:0/1310348542 shutdown_connections 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.190+0000 7f0fa7a02640 1 -- 172.21.15.22:0/1310348542 wait complete. 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.191+0000 7f0fa7a02640 1 Processor -- start 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.191+0000 7f0fa7a02640 1 -- start start 2024-09-21T03:53:55.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.191+0000 7f0fa7a02640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa01037e0 0x7f0fa0199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.191+0000 7f0fa7a02640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fa0104870 0x7f0fa019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.191+0000 7f0fa7a02640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105210 0x7f0fa019b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa7a02640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa010f2c0 con 0x7f0fa0104870 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa7a02640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa010f140 con 0x7f0fa0105210 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa7a02640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0fa010f440 con 0x7f0fa01037e0 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa4f9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fa0104870 0x7f0fa019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa4f9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fa0104870 0x7f0fa019a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59714/0 (socket says 172.21.15.22:59714) 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa4f9d640 1 -- 172.21.15.22:0/2048792797 learned_addr learned my addr 172.21.15.22:0/2048792797 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa5f9f640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105210 0x7f0fa019b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa579e640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa01037e0 0x7f0fa0199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa4f9d640 1 -- 172.21.15.22:0/2048792797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa01037e0 msgr2=0x7f0fa0199ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa4f9d640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa01037e0 0x7f0fa0199ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa4f9d640 1 -- 172.21.15.22:0/2048792797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105210 msgr2=0x7f0fa019b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa4f9d640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105210 0x7f0fa019b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa4f9d640 1 -- 172.21.15.22:0/2048792797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fa019b900 con 0x7f0fa0104870 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa579e640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa01037e0 0x7f0fa0199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa4f9d640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fa0104870 0x7f0fa019a540 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000e9f0 tx=0x7f0f9000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0f967fc640 1 -- 172.21.15.22:0/2048792797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9000cd80 con 0x7f0fa0104870 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0f967fc640 1 -- 172.21.15.22:0/2048792797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f900108c0 con 0x7f0fa0104870 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.192+0000 7f0fa7a02640 1 -- 172.21.15.22:0/2048792797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fa019bbf0 con 0x7f0fa0104870 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.193+0000 7f0f967fc640 1 -- 172.21.15.22:0/2048792797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f900187c0 con 0x7f0fa0104870 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.193+0000 7f0fa7a02640 1 -- 172.21.15.22:0/2048792797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fa01a22f0 con 0x7f0fa0104870 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.194+0000 7f0fa7a02640 1 -- 172.21.15.22:0/2048792797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fa010a9c0 con 0x7f0fa0104870 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.196+0000 7f0f967fc640 1 -- 172.21.15.22:0/2048792797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f0f90010430 con 0x7f0fa0104870 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.197+0000 7f0f967fc640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0f8c0b6480 0x7f0f8c0b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.197+0000 7f0fa579e640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0f8c0b6480 0x7f0f8c0b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:55.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.197+0000 7f0f967fc640 1 -- 172.21.15.22:0/2048792797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0f900e5f10 con 0x7f0fa0104870 2024-09-21T03:53:55.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.198+0000 7f0fa579e640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0f8c0b6480 0x7f0f8c0b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009c20 tx=0x7f0f9c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:55.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.201+0000 7f0f967fc640 1 -- 172.21.15.22:0/2048792797 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0f900ae470 con 0x7f0fa0104870 2024-09-21T03:53:55.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.389+0000 7f0fa7a02640 1 -- 172.21.15.22:0/2048792797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mds_bal_merge_size}] v 0) -- 0x7f0fa002e640 con 0x7f0fa0104870 2024-09-21T03:53:55.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.393+0000 7f0f967fc640 1 -- 172.21.15.22:0/2048792797 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_bal_merge_size}]=0 v33)=0 v33) ==== 116+0+0 (secure 0 0 0) 0x7f0f900b2850 con 0x7f0fa0104870 2024-09-21T03:53:55.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 -- 172.21.15.22:0/2048792797 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0f8c0b6480 msgr2=0x7f0f8c0b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0f8c0b6480 0x7f0f8c0b8990 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f0f9c009c20 tx=0x7f0f9c005f90 comp rx=0 tx=0).stop 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 -- 172.21.15.22:0/2048792797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fa0104870 msgr2=0x7f0fa019a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fa0104870 0x7f0fa019a540 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0f9000e9f0 tx=0x7f0f9000eeb0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 -- 172.21.15.22:0/2048792797 shutdown_connections 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0f8c0b6480 0x7f0f8c0b8990 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0fa0105210 0x7f0fa019b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0fa0104870 0x7f0fa019a540 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 --2- 172.21.15.22:0/2048792797 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0fa01037e0 0x7f0fa0199ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 -- 172.21.15.22:0/2048792797 >> 172.21.15.22:0/2048792797 conn(0x7f0fa00ff150 msgr2=0x7f0fa0107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 -- 172.21.15.22:0/2048792797 shutdown_connections 2024-09-21T03:53:55.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:55.396+0000 7f0fa7a02640 1 -- 172.21.15.22:0/2048792797 wait complete. 2024-09-21T03:53:56.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:56 smithi022 ceph-mon[31015]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:56.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:56 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/623434041' entity='client.admin' 2024-09-21T03:53:56.327 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:56 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2048792797' entity='client.admin' 2024-09-21T03:53:56.360 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_merge_size', '5'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.360 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_bits', '3'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.360 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_bal_split_size', '100'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.360 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.360 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.360 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.360 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'client_mount_timeout', '30'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_client', '20'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_mgr', '20'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'debug_ms', '1'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mgr', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.361 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.362 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', 'ae19ad46-77cc-11ef-baf5-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi022') 2024-09-21T03:53:56.362 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config dump 2024-09-21T03:53:56.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:56 smithi060 ceph-mon[33722]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:56.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:56 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/623434041' entity='client.admin' 2024-09-21T03:53:56.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:56 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2048792797' entity='client.admin' 2024-09-21T03:53:56.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:56 smithi073 ceph-mon[34443]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:56.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:56 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/623434041' entity='client.admin' 2024-09-21T03:53:56.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:56 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2048792797' entity='client.admin' 2024-09-21T03:53:56.619 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:53:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 -- 172.21.15.22:0/621841518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f210c1040a0 msgr2=0x7f210c10aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 --2- 172.21.15.22:0/621841518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f210c1040a0 0x7f210c10aa40 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f2104009ca0 tx=0x7f210402a950 comp rx=0 tx=0).stop 2024-09-21T03:53:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 -- 172.21.15.22:0/621841518 shutdown_connections 2024-09-21T03:53:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 --2- 172.21.15.22:0/621841518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f210c1040a0 0x7f210c10aa40 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 --2- 172.21.15.22:0/621841518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210c103700 0x7f210c103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 --2- 172.21.15.22:0/621841518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c102670 0x7f210c102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 -- 172.21.15.22:0/621841518 >> 172.21.15.22:0/621841518 conn(0x7f210c0fdfe0 msgr2=0x7f210c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 -- 172.21.15.22:0/621841518 shutdown_connections 2024-09-21T03:53:57.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 -- 172.21.15.22:0/621841518 wait complete. 2024-09-21T03:53:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 Processor -- start 2024-09-21T03:53:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.070+0000 7f211430e640 1 -- start start 2024-09-21T03:53:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f211430e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f210c102670 0x7f210c06c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f211430e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210c103700 0x7f210c19ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f211430e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c1040a0 0x7f210c1a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f211430e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f210c10e150 con 0x7f210c102670 2024-09-21T03:53:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f211430e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f210c10dfd0 con 0x7f210c103700 2024-09-21T03:53:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f211430e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f210c10e2d0 con 0x7f210c1040a0 2024-09-21T03:53:57.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21120aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f210c102670 0x7f210c06c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21120aa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f210c102670 0x7f210c06c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59742/0 (socket says 172.21.15.22:59742) 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21120aa640 1 -- 172.21.15.22:0/2113476191 learned_addr learned my addr 172.21.15.22:0/2113476191 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21118a9640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210c103700 0x7f210c19ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21128ab640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c1040a0 0x7f210c1a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21120aa640 1 -- 172.21.15.22:0/2113476191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c1040a0 msgr2=0x7f210c1a1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21120aa640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c1040a0 0x7f210c1a1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21120aa640 1 -- 172.21.15.22:0/2113476191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210c103700 msgr2=0x7f210c19ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21120aa640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210c103700 0x7f210c19ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21120aa640 1 -- 172.21.15.22:0/2113476191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c1a1980 con 0x7f210c102670 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.071+0000 7f21120aa640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f210c102670 0x7f210c06c3e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f210800d950 tx=0x7f210800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.072+0000 7f21037fe640 1 -- 172.21.15.22:0/2113476191 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108017070 con 0x7f210c102670 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.072+0000 7f21037fe640 1 -- 172.21.15.22:0/2113476191 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2108009c30 con 0x7f210c102670 2024-09-21T03:53:57.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.072+0000 7f211430e640 1 -- 172.21.15.22:0/2113476191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210c1a1c70 con 0x7f210c102670 2024-09-21T03:53:57.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.072+0000 7f21037fe640 1 -- 172.21.15.22:0/2113476191 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f210800f620 con 0x7f210c102670 2024-09-21T03:53:57.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.072+0000 7f211430e640 1 -- 172.21.15.22:0/2113476191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210c1a21b0 con 0x7f210c102670 2024-09-21T03:53:57.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.073+0000 7f211430e640 1 -- 172.21.15.22:0/2113476191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210c109850 con 0x7f210c102670 2024-09-21T03:53:57.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.075+0000 7f21037fe640 1 -- 172.21.15.22:0/2113476191 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f2108010460 con 0x7f210c102670 2024-09-21T03:53:57.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.076+0000 7f21037fe640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20f80b6500 0x7f20f80b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:53:57.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.076+0000 7f21118a9640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20f80b6500 0x7f20f80b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:53:57.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.076+0000 7f21037fe640 1 -- 172.21.15.22:0/2113476191 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f21080e5190 con 0x7f210c102670 2024-09-21T03:53:57.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.077+0000 7f21118a9640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20f80b6500 0x7f20f80b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009bd0 tx=0x7f20fc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:53:57.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.079+0000 7f21037fe640 1 -- 172.21.15.22:0/2113476191 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2108009de0 con 0x7f210c102670 2024-09-21T03:53:57.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.272+0000 7f211430e640 1 -- 172.21.15.22:0/2113476191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f210c02e640 con 0x7f210c102670 2024-09-21T03:53:57.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.273+0000 7f21037fe640 1 -- 172.21.15.22:0/2113476191 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+21112 (secure 0 0 0) 0x7f21080b1ab0 con 0x7f210c102670 2024-09-21T03:53:57.275 INFO:teuthology.orchestra.run.smithi022.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-21T03:53:57.275 INFO:teuthology.orchestra.run.smithi022.stdout:global dev auth_debug true 2024-09-21T03:53:57.275 INFO:teuthology.orchestra.run.smithi022.stdout:global basic container_image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 * 2024-09-21T03:53:57.275 INFO:teuthology.orchestra.run.smithi022.stdout:global dev debug_asserts_on_shutdown true 2024-09-21T03:53:57.275 INFO:teuthology.orchestra.run.smithi022.stdout:global basic log_to_file true 2024-09-21T03:53:57.275 INFO:teuthology.orchestra.run.smithi022.stdout:global basic log_to_journald false 2024-09-21T03:53:57.275 INFO:teuthology.orchestra.run.smithi022.stdout:global basic log_to_stderr false 2024-09-21T03:53:57.275 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced mon_allow_pool_delete true 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced mon_clock_drift_allowed 1.000000 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced mon_cluster_log_to_file true 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced mon_max_pg_per_osd 10000 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced mon_pg_warn_max_object_skew 0.000000 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced mon_warn_on_crush_straw_calc_version_zero false 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced mon_warn_on_legacy_crush_tunables false 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced mon_warn_on_osd_down_out_interval_zero false 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global dev mon_warn_on_pool_pg_num_not_power_of_two false 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced mon_warn_on_too_few_osds false 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global dev ms_die_on_bug true 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global dev ms_die_on_old_message true 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced osd_pool_default_erasure_code_profile plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:global advanced osd_pool_default_pg_autoscale_mode off 2024-09-21T03:53:57.276 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced auth_allow_insecure_global_id_reclaim false 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced auth_mon_ticket_ttl 660.000000 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced auth_service_ticket_ttl 240.000000 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced debug_mon 20/20 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced debug_ms 1/1 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced debug_paxos 20/20 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced mon_data_avail_warn 5 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced mon_down_mkfs_grace 300 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced mon_mgr_mkfs_grace 240 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced mon_op_complaint_time 120 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon dev mon_osd_prime_pg_temp true 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced mon_osd_reporter_subtree_level osd 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T03:53:57.277 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim false 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced mon_warn_on_insecure_global_id_reclaim_allowed false 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mon advanced public_network 172.21.0.0/20 * 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced cephsqlite_lock_renewal_timeout 900000 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced client_mount_timeout 30 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced debug_client 20/20 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced debug_mgr 20/20 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced debug_ms 1/1 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced mgr/cephadm/allow_ptrace true * 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced mgr/cephadm/container_init True * 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced mgr/cephadm/migration_current 7 * 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced mgr/dashboard/ssl_server_port 8443 * 2024-09-21T03:53:57.278 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced mgr/orchestrator/orchestrator cephadm 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced mon_reweight_min_bytes_per_osd 10 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:mgr advanced mon_reweight_min_pgs_per_osd 4 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:mgr dev mon_warn_on_pool_no_app false 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd dev bdev_debug_aio true 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd dev bluestore_block_size 96636764160 * 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced bluestore_compression_mode aggressive 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd dev bluestore_fsck_on_mount true 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced debug_bluefs 20/20 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced debug_bluestore 20/20 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced debug_ms 1/1 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced debug_osd 20/20 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced debug_rocksdb 10/10 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd dev osd_debug_misdirected_ops true 2024-09-21T03:53:57.279 INFO:teuthology.orchestra.run.smithi022.stdout:osd dev osd_debug_op_order true 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd dev osd_debug_pg_log_writeout true 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd dev osd_debug_shutdown true 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd dev osd_debug_verify_cached_snaps true 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd dev osd_debug_verify_missing_on_start true 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd dev osd_debug_verify_stray_on_activate true 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_deep_scrub_update_digest_min_age 30 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_failsafe_full_ratio 0.950000 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_max_omap_entries_per_request 10000 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_mclock_profile high_recovery_ops 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_memory_target_autotune true 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_objectstore bluestore * 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_op_queue debug_random * 2024-09-21T03:53:57.280 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_op_queue_cut_off debug_random * 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_recover_clone_overlap true 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_recovery_max_chunk 1048576 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_scrub_load_threshold 5.000000 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_scrub_max_interval 600.000000 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:osd advanced osd_shutdown_pgref_assert true 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced debug_mds 20/20 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced debug_mds_balancer 20/20 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced debug_ms 2/2 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced mds_bal_fragment_size_max 10000 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced mds_bal_merge_size 5 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced mds_bal_replicate_threshold 1.000000 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced mds_bal_split_bits 3 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced mds_bal_split_size 100 2024-09-21T03:53:57.281 INFO:teuthology.orchestra.run.smithi022.stdout:mds dev mds_debug_frag true 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:mds dev mds_debug_scatterstat true 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:mds dev mds_verify_scatter true 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced rados_mon_op_timeout 900 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:mds advanced rados_osd_op_timeout 900 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:client advanced client_mount_timeout 600 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:client advanced debug_client 20/20 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:client advanced debug_ms 1/1 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:client advanced rados_mon_op_timeout 900 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:client advanced rados_osd_op_timeout 900 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:client.rgw advanced rgw_cache_enabled true 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:client.rgw advanced rgw_enable_ops_log true 2024-09-21T03:53:57.282 INFO:teuthology.orchestra.run.smithi022.stdout:client.rgw advanced rgw_enable_usage_log true 2024-09-21T03:53:57.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 -- 172.21.15.22:0/2113476191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20f80b6500 msgr2=0x7f20f80b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:57.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20f80b6500 0x7f20f80b8a10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009bd0 tx=0x7f20fc005f90 comp rx=0 tx=0).stop 2024-09-21T03:53:57.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 -- 172.21.15.22:0/2113476191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f210c102670 msgr2=0x7f210c06c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:53:57.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f210c102670 0x7f210c06c3e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f210800d950 tx=0x7f210800de10 comp rx=0 tx=0).stop 2024-09-21T03:53:57.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 -- 172.21.15.22:0/2113476191 shutdown_connections 2024-09-21T03:53:57.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20f80b6500 0x7f20f80b8a10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f210c1040a0 0x7f210c1a1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f210c103700 0x7f210c19ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 --2- 172.21.15.22:0/2113476191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f210c102670 0x7f210c06c3e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:53:57.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 -- 172.21.15.22:0/2113476191 >> 172.21.15.22:0/2113476191 conn(0x7f210c0fdfe0 msgr2=0x7f210c106a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:53:57.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 -- 172.21.15.22:0/2113476191 shutdown_connections 2024-09-21T03:53:57.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:53:57.275+0000 7f211430e640 1 -- 172.21.15.22:0/2113476191 wait complete. 2024-09-21T03:53:57.862 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T03:53:57.862 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T03:53:57.862 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:53:57.879 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:53:57.879 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-09-21T03:53:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:53:57.935 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:57.936 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T03:53:57.936 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:57.936 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:57.936 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-21 03:52:43.354200654 +0000 2024-09-21T03:53:57.936 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-21 03:48:10.310537149 +0000 2024-09-21T03:53:57.936 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-21 03:48:10.310537149 +0000 2024-09-21T03:53:57.936 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-21 03:48:10.310537149 +0000 2024-09-21T03:53:57.936 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:53:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-21T03:53:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-21T03:53:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 9.0068e-05 s, 5.7 MB/s 2024-09-21T03:53:58.003 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:53:58.059 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-09-21T03:53:58.114 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:53:58.115 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:58.115 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T03:53:58.115 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:58.115 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:58.115 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-21 03:52:43.387200213 +0000 2024-09-21T03:53:58.115 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-21 03:48:10.644532677 +0000 2024-09-21T03:53:58.115 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-21 03:48:10.644532677 +0000 2024-09-21T03:53:58.115 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-21 03:48:10.644532677 +0000 2024-09-21T03:53:58.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:53:58.178 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-21T03:53:58.178 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-21T03:53:58.178 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 9.5427e-05 s, 5.4 MB/s 2024-09-21T03:53:58.180 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:53:58.236 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-09-21T03:53:58.292 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:53:58.292 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:58.292 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-21T03:53:58.292 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:58.292 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:58.292 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-21 03:52:43.420199772 +0000 2024-09-21T03:53:58.292 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-21 03:48:10.971528299 +0000 2024-09-21T03:53:58.292 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-21 03:48:10.971528299 +0000 2024-09-21T03:53:58.293 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-21 03:48:10.971528299 +0000 2024-09-21T03:53:58.293 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:53:58.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:58 smithi022 ceph-mon[31015]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:58.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:53:58 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2113476191' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:53:58.356 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-21T03:53:58.356 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-21T03:53:58.356 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000107476 s, 4.8 MB/s 2024-09-21T03:53:58.357 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:53:58.414 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-09-21T03:53:58.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:58 smithi060 ceph-mon[33722]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:58.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:53:58 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2113476191' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:53:58.470 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:53:58.470 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:58.470 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T03:53:58.470 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:58.470 INFO:teuthology.orchestra.run.smithi022.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:58.470 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-09-21 03:52:43.453199331 +0000 2024-09-21T03:53:58.470 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-09-21 03:48:11.295523960 +0000 2024-09-21T03:53:58.471 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-09-21 03:48:11.295523960 +0000 2024-09-21T03:53:58.471 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: 2024-09-21 03:48:11.295523960 +0000 2024-09-21T03:53:58.471 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:53:58.534 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-09-21T03:53:58.535 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-09-21T03:53:58.535 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000108279 s, 4.7 MB/s 2024-09-21T03:53:58.536 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:53:58.593 DEBUG:teuthology.orchestra.run.smithi060:> set -ex 2024-09-21T03:53:58.593 DEBUG:teuthology.orchestra.run.smithi060:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:53:58.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:58 smithi073 ceph-mon[34443]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:53:58.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:53:58 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2113476191' entity='client.admin' cmd={"prefix": "config dump"} : dispatch 2024-09-21T03:53:58.613 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:53:58.614 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_1 2024-09-21T03:53:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:53:58.673 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:58.674 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-21T03:53:58.674 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:58.674 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:58.674 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 03:53:30.619545313 +0000 2024-09-21T03:53:58.674 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 03:48:14.972260557 +0000 2024-09-21T03:53:58.674 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 03:48:14.972260557 +0000 2024-09-21T03:53:58.674 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 03:48:14.972260557 +0000 2024-09-21T03:53:58.674 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:53:58.745 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T03:53:58.745 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T03:53:58.746 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000132359 s, 3.9 MB/s 2024-09-21T03:53:58.747 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:53:58.806 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_2 2024-09-21T03:53:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:53:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:58.865 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T03:53:58.865 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:58.865 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:58.865 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 03:53:30.620545303 +0000 2024-09-21T03:53:58.865 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 03:48:15.297257573 +0000 2024-09-21T03:53:58.865 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 03:48:15.297257573 +0000 2024-09-21T03:53:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 03:48:15.297257573 +0000 2024-09-21T03:53:58.865 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:53:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T03:53:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T03:53:58.932 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.0001175 s, 4.4 MB/s 2024-09-21T03:53:58.933 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:53:58.992 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_3 2024-09-21T03:53:59.050 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:53:59.050 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:59.050 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T03:53:59.050 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:59.050 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:59.050 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 03:53:30.620545303 +0000 2024-09-21T03:53:59.050 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 03:48:15.620254608 +0000 2024-09-21T03:53:59.051 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 03:48:15.620254608 +0000 2024-09-21T03:53:59.051 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 03:48:15.620254608 +0000 2024-09-21T03:53:59.051 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:53:59.117 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T03:53:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T03:53:59.118 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000103648 s, 4.9 MB/s 2024-09-21T03:53:59.119 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:53:59.177 DEBUG:teuthology.orchestra.run.smithi060:> stat /dev/vg_nvme/lv_4 2024-09-21T03:53:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:53:59.234 INFO:teuthology.orchestra.run.smithi060.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:59.234 INFO:teuthology.orchestra.run.smithi060.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T03:53:59.234 INFO:teuthology.orchestra.run.smithi060.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:59.235 INFO:teuthology.orchestra.run.smithi060.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:59.235 INFO:teuthology.orchestra.run.smithi060.stdout:Access: 2024-09-21 03:53:30.620545303 +0000 2024-09-21T03:53:59.235 INFO:teuthology.orchestra.run.smithi060.stdout:Modify: 2024-09-21 03:48:15.948251597 +0000 2024-09-21T03:53:59.235 INFO:teuthology.orchestra.run.smithi060.stdout:Change: 2024-09-21 03:48:15.948251597 +0000 2024-09-21T03:53:59.235 INFO:teuthology.orchestra.run.smithi060.stdout: Birth: 2024-09-21 03:48:15.948251597 +0000 2024-09-21T03:53:59.235 DEBUG:teuthology.orchestra.run.smithi060:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:53:59.301 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records in 2024-09-21T03:53:59.301 INFO:teuthology.orchestra.run.smithi060.stderr:1+0 records out 2024-09-21T03:53:59.301 INFO:teuthology.orchestra.run.smithi060.stderr:512 bytes copied, 0.000117489 s, 4.4 MB/s 2024-09-21T03:53:59.302 DEBUG:teuthology.orchestra.run.smithi060:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:53:59.360 DEBUG:teuthology.orchestra.run.smithi073:> set -ex 2024-09-21T03:53:59.360 DEBUG:teuthology.orchestra.run.smithi073:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T03:53:59.380 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T03:53:59.380 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_1 2024-09-21T03:53:59.439 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T03:53:59.439 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:59.439 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 667 Links: 1 2024-09-21T03:53:59.439 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:59.439 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:59.439 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-21 03:53:28.229137456 +0000 2024-09-21T03:53:59.439 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-21 03:48:07.079205515 +0000 2024-09-21T03:53:59.439 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-21 03:48:07.079205515 +0000 2024-09-21T03:53:59.440 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-21 03:48:07.079205515 +0000 2024-09-21T03:53:59.440 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T03:53:59.509 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-21T03:53:59.509 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-21T03:53:59.509 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000223593 s, 2.3 MB/s 2024-09-21T03:53:59.510 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T03:53:59.570 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_2 2024-09-21T03:53:59.627 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T03:53:59.627 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:59.627 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-21T03:53:59.627 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:59.627 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:59.627 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-21 03:53:28.229137456 +0000 2024-09-21T03:53:59.628 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-21 03:48:07.403198023 +0000 2024-09-21T03:53:59.628 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-21 03:48:07.403198023 +0000 2024-09-21T03:53:59.628 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-21 03:48:07.403198023 +0000 2024-09-21T03:53:59.628 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T03:53:59.693 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-21T03:53:59.694 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-21T03:53:59.694 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000203317 s, 2.5 MB/s 2024-09-21T03:53:59.695 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T03:53:59.753 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_3 2024-09-21T03:53:59.809 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T03:53:59.810 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:59.810 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-21T03:53:59.810 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:59.810 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:59.810 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-21 03:53:28.230137433 +0000 2024-09-21T03:53:59.810 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-21 03:48:07.718190739 +0000 2024-09-21T03:53:59.810 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-21 03:48:07.718190739 +0000 2024-09-21T03:53:59.810 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-21 03:48:07.718190739 +0000 2024-09-21T03:53:59.811 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T03:53:59.875 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-21T03:53:59.875 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-21T03:53:59.875 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000229276 s, 2.2 MB/s 2024-09-21T03:53:59.876 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T03:53:59.934 DEBUG:teuthology.orchestra.run.smithi073:> stat /dev/vg_nvme/lv_4 2024-09-21T03:53:59.990 INFO:teuthology.orchestra.run.smithi073.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T03:53:59.990 INFO:teuthology.orchestra.run.smithi073.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T03:53:59.990 INFO:teuthology.orchestra.run.smithi073.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T03:53:59.990 INFO:teuthology.orchestra.run.smithi073.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T03:53:59.990 INFO:teuthology.orchestra.run.smithi073.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T03:53:59.990 INFO:teuthology.orchestra.run.smithi073.stdout:Access: 2024-09-21 03:53:28.230137433 +0000 2024-09-21T03:53:59.990 INFO:teuthology.orchestra.run.smithi073.stdout:Modify: 2024-09-21 03:48:08.050183062 +0000 2024-09-21T03:53:59.991 INFO:teuthology.orchestra.run.smithi073.stdout:Change: 2024-09-21 03:48:08.050183062 +0000 2024-09-21T03:53:59.991 INFO:teuthology.orchestra.run.smithi073.stdout: Birth: 2024-09-21 03:48:08.050183062 +0000 2024-09-21T03:53:59.991 DEBUG:teuthology.orchestra.run.smithi073:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T03:54:00.054 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records in 2024-09-21T03:54:00.054 INFO:teuthology.orchestra.run.smithi073.stderr:1+0 records out 2024-09-21T03:54:00.055 INFO:teuthology.orchestra.run.smithi073.stderr:512 bytes copied, 0.000221052 s, 2.3 MB/s 2024-09-21T03:54:00.056 DEBUG:teuthology.orchestra.run.smithi073:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T03:54:00.112 INFO:tasks.cephadm:Deploying osd.0 on smithi022 with /dev/vg_nvme/lv_4... 2024-09-21T03:54:00.113 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:54:00.377 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:00.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:00 smithi060 ceph-mon[33722]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:00.499 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:00 smithi022 ceph-mon[31015]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:00.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:00 smithi073 ceph-mon[34443]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:02.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:02 smithi022 ceph-mon[31015]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:02.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:02 smithi060 ceph-mon[33722]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:02.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:02 smithi073 ceph-mon[34443]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:02.699 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:54:02.725 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi022:vg_nvme/lv_4 2024-09-21T03:54:02.977 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:54:03.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.427+0000 7f843a085640 1 -- 172.21.15.22:0/692755744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84341040a0 msgr2=0x7f843410aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.427+0000 7f843a085640 1 --2- 172.21.15.22:0/692755744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84341040a0 0x7f843410aa40 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f842c009ca0 tx=0x7f842c02a950 comp rx=0 tx=0).stop 2024-09-21T03:54:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.427+0000 7f843a085640 1 -- 172.21.15.22:0/692755744 shutdown_connections 2024-09-21T03:54:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.427+0000 7f843a085640 1 --2- 172.21.15.22:0/692755744 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8434103700 0x7f8434103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.427+0000 7f843a085640 1 --2- 172.21.15.22:0/692755744 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f84341040a0 0x7f843410aa40 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.427+0000 7f843a085640 1 --2- 172.21.15.22:0/692755744 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8434102670 0x7f8434102ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.427+0000 7f843a085640 1 -- 172.21.15.22:0/692755744 >> 172.21.15.22:0/692755744 conn(0x7f84340fdfe0 msgr2=0x7f8434100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.427+0000 7f843a085640 1 -- 172.21.15.22:0/692755744 shutdown_connections 2024-09-21T03:54:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.427+0000 7f843a085640 1 -- 172.21.15.22:0/692755744 wait complete. 2024-09-21T03:54:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.428+0000 7f843a085640 1 Processor -- start 2024-09-21T03:54:03.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.428+0000 7f843a085640 1 -- start start 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.428+0000 7f843a085640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8434102670 0x7f8434198dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.428+0000 7f843a085640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103700 0x7f8434199430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.428+0000 7f843a085640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84341040a0 0x7f8434199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.428+0000 7f843a085640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f843410e170 con 0x7f8434103700 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.428+0000 7f843a085640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f843410dff0 con 0x7f84341040a0 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f843a085640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f843410e2f0 con 0x7f8434102670 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8432ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103700 0x7f8434199430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8432ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103700 0x7f8434199430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50916/0 (socket says 172.21.15.22:50916) 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8432ffd640 1 -- 172.21.15.22:0/3369628296 learned_addr learned my addr 172.21.15.22:0/3369628296 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f84337fe640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8434102670 0x7f8434198dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8433fff640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84341040a0 0x7f8434199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8432ffd640 1 -- 172.21.15.22:0/3369628296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8434102670 msgr2=0x7f8434198dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8432ffd640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8434102670 0x7f8434198dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8432ffd640 1 -- 172.21.15.22:0/3369628296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84341040a0 msgr2=0x7f8434199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8432ffd640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84341040a0 0x7f8434199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8432ffd640 1 -- 172.21.15.22:0/3369628296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843419a760 con 0x7f8434103700 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8432ffd640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103700 0x7f8434199430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f842800e9f0 tx=0x7f842800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8430ff9640 1 -- 172.21.15.22:0/3369628296 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842800ccc0 con 0x7f8434103700 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f843a085640 1 -- 172.21.15.22:0/3369628296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843419aa50 con 0x7f8434103700 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8430ff9640 1 -- 172.21.15.22:0/3369628296 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f842800ce60 con 0x7f8434103700 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f8430ff9640 1 -- 172.21.15.22:0/3369628296 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8428010430 con 0x7f8434103700 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.429+0000 7f843a085640 1 -- 172.21.15.22:0/3369628296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84341a11e0 con 0x7f8434103700 2024-09-21T03:54:03.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.430+0000 7f843a085640 1 -- 172.21.15.22:0/3369628296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8434109830 con 0x7f8434103700 2024-09-21T03:54:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.432+0000 7f8430ff9640 1 -- 172.21.15.22:0/3369628296 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f84280046c0 con 0x7f8434103700 2024-09-21T03:54:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.433+0000 7f8430ff9640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f841c0b6500 0x7f841c0b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.433+0000 7f84337fe640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f841c0b6500 0x7f841c0b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.433+0000 7f8430ff9640 1 -- 172.21.15.22:0/3369628296 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f84280e5d40 con 0x7f8434103700 2024-09-21T03:54:03.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.433+0000 7f84337fe640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f841c0b6500 0x7f841c0b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f842400abe0 tx=0x7f842400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:03.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.436+0000 7f8430ff9640 1 -- 172.21.15.22:0/3369628296 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8428056710 con 0x7f8434103700 2024-09-21T03:54:03.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:03.634+0000 7f843a085640 1 -- 172.21.15.22:0/3369628296 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8434063800 con 0x7f841c0b6500 2024-09-21T03:54:04.302 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:04 smithi022 ceph-mon[31015]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:04.302 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:54:04.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:54:04.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:04.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:04 smithi060 ceph-mon[33722]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:04.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:54:04.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:54:04.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:04.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:04 smithi073 ceph-mon[34443]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:04.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:54:04.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:54:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:05.548 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:05 smithi022 ceph-mon[31015]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:05.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:05 smithi073 ceph-mon[34443]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:05.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:05 smithi060 ceph-mon[33722]: from='client.14385 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:06.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:06 smithi022 ceph-mon[31015]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:06.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:06 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3685452082' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83062b79-0279-4099-afb7-f1a51046ca56"} : dispatch 2024-09-21T03:54:06.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:06 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3685452082' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83062b79-0279-4099-afb7-f1a51046ca56"}]': finished 2024-09-21T03:54:06.507 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:06 smithi022 ceph-mon[31015]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T03:54:06.508 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:06 smithi073 ceph-mon[34443]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3685452082' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83062b79-0279-4099-afb7-f1a51046ca56"} : dispatch 2024-09-21T03:54:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3685452082' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83062b79-0279-4099-afb7-f1a51046ca56"}]': finished 2024-09-21T03:54:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:06 smithi073 ceph-mon[34443]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T03:54:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:06 smithi060 ceph-mon[33722]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:06 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3685452082' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "83062b79-0279-4099-afb7-f1a51046ca56"} : dispatch 2024-09-21T03:54:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:06 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3685452082' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "83062b79-0279-4099-afb7-f1a51046ca56"}]': finished 2024-09-21T03:54:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:06 smithi060 ceph-mon[33722]: osdmap e5: 1 total, 0 up, 1 in 2024-09-21T03:54:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:07.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:07 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1395614531' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:54:07.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:07 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1395614531' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:54:07.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:07 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1395614531' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:54:08.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:08 smithi022 ceph-mon[31015]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:08.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:08 smithi073 ceph-mon[34443]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:08 smithi060 ceph-mon[33722]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:10.538 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:10 smithi022 ceph-mon[31015]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:10.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:10 smithi073 ceph-mon[34443]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:10.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:10 smithi060 ceph-mon[33722]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:12.300 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:12 smithi022 ceph-mon[31015]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:12.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:12 smithi060 ceph-mon[33722]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:12.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:12 smithi073 ceph-mon[34443]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:14.582 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:14 smithi022 ceph-mon[31015]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:14.582 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:54:14.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:14.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:14 smithi073 ceph-mon[34443]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:14.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:54:14.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:14 smithi060 ceph-mon[33722]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T03:54:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:15.557 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:15 smithi022 ceph-mon[31015]: Deploying daemon osd.0 on smithi022 2024-09-21T03:54:15.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:15 smithi073 ceph-mon[34443]: Deploying daemon osd.0 on smithi022 2024-09-21T03:54:15.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:15 smithi060 ceph-mon[33722]: Deploying daemon osd.0 on smithi022 2024-09-21T03:54:16.529 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:16 smithi022 ceph-mon[31015]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:16.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:16 smithi073 ceph-mon[34443]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:16.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:16 smithi060 ceph-mon[33722]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:18.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:18 smithi022 ceph-mon[31015]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:18.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:18 smithi073 ceph-mon[34443]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:18 smithi060 ceph-mon[33722]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:20.384 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:20 smithi022 ceph-mon[31015]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:20.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:20 smithi073 ceph-mon[34443]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:20 smithi060 ceph-mon[33722]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:21.266 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:21.266 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:21.266 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:21.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:21.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:21.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:21.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:21.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:21.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:22.501 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:22 smithi022 ceph-mon[31015]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:22.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:22 smithi073 ceph-mon[34443]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:22 smithi060 ceph-mon[33722]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:24.544 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:24 smithi022 ceph-mon[31015]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:24.545 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:24.545 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:24.545 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:24.545 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:24.545 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:24.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:24 smithi073 ceph-mon[34443]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:24 smithi060 ceph-mon[33722]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:25.013 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 0 on host 'smithi022' 2024-09-21T03:54:25.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.010+0000 7f8430ff9640 1 -- 172.21.15.22:0/3369628296 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8434063800 con 0x7f841c0b6500 2024-09-21T03:54:25.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.012+0000 7f843a085640 1 -- 172.21.15.22:0/3369628296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f841c0b6500 msgr2=0x7f841c0b8a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:25.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.012+0000 7f843a085640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f841c0b6500 0x7f841c0b8a10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f842400abe0 tx=0x7f842400a2d0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.012+0000 7f843a085640 1 -- 172.21.15.22:0/3369628296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103700 msgr2=0x7f8434199430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:25.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.012+0000 7f843a085640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103700 0x7f8434199430 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f842800e9f0 tx=0x7f842800edf0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.012+0000 7f843a085640 1 -- 172.21.15.22:0/3369628296 shutdown_connections 2024-09-21T03:54:25.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.012+0000 7f843a085640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f841c0b6500 0x7f841c0b8a10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.012+0000 7f843a085640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f84341040a0 0x7f8434199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.012+0000 7f843a085640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8434103700 0x7f8434199430 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.012+0000 7f843a085640 1 --2- 172.21.15.22:0/3369628296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8434102670 0x7f8434198dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:25.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.012+0000 7f843a085640 1 -- 172.21.15.22:0/3369628296 >> 172.21.15.22:0/3369628296 conn(0x7f84340fdfe0 msgr2=0x7f8434106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:25.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.013+0000 7f843a085640 1 -- 172.21.15.22:0/3369628296 shutdown_connections 2024-09-21T03:54:25.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:54:25.013+0000 7f843a085640 1 -- 172.21.15.22:0/3369628296 wait complete. 2024-09-21T03:54:25.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:25.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:25.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:25.594 DEBUG:teuthology.orchestra.run.smithi022:osd.0> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.0.service 2024-09-21T03:54:25.596 INFO:tasks.cephadm:Deploying osd.1 on smithi060 with /dev/vg_nvme/lv_4... 2024-09-21T03:54:25.596 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:54:25.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:25.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:25.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:25.623 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:25.623 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:25.623 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:25.860 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:54:26.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:26 smithi022 ceph-mon[31015]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:26.599 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:54:26 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0[46878]: 2024-09-21T03:54:26.463+0000 7f7e65a51640 -1 osd.0 0 log_to_monitors true 2024-09-21T03:54:26.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:26 smithi073 ceph-mon[34443]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:26.701 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:26 smithi060 ceph-mon[33722]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:27.588 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:27 smithi060 ceph-mon[33722]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:54:27.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:27 smithi022 ceph-mon[31015]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:54:27.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:27 smithi073 ceph-mon[34443]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T03:54:28.412 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:54:28.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:28 smithi060 ceph-mon[33722]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:28.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:28 smithi060 ceph-mon[33722]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:54:28.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:28 smithi060 ceph-mon[33722]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:54:28.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:28 smithi060 ceph-mon[33722]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:54:28.438 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:28.439 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_4 2024-09-21T03:54:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:28 smithi022 ceph-mon[31015]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:28 smithi022 ceph-mon[31015]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:54:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:28 smithi022 ceph-mon[31015]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:54:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:28 smithi022 ceph-mon[31015]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:54:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:28.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:28 smithi073 ceph-mon[34443]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:28.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:28 smithi073 ceph-mon[34443]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T03:54:28.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:28 smithi073 ceph-mon[34443]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T03:54:28.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:28 smithi073 ceph-mon[34443]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:54:28.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:28.738 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:54:29.099 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:54:28 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0[46878]: 2024-09-21T03:54:28.736+0000 7f7e619d3640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T03:54:29.099 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:54:28 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0[46878]: 2024-09-21T03:54:28.739+0000 7f7e597c9640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:54:29.176 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.173+0000 7fab1293a640 1 -- 172.21.15.60:0/1734338614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab0c1051a0 msgr2=0x7fab0c10bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.173+0000 7fab1293a640 1 --2- 172.21.15.60:0/1734338614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab0c1051a0 0x7fab0c10bb40 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fab04009ca0 tx=0x7fab0402a950 comp rx=0 tx=0).stop 2024-09-21T03:54:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.173+0000 7fab1293a640 1 -- 172.21.15.60:0/1734338614 shutdown_connections 2024-09-21T03:54:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.173+0000 7fab1293a640 1 --2- 172.21.15.60:0/1734338614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab0c104800 0x7fab0c104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.173+0000 7fab1293a640 1 --2- 172.21.15.60:0/1734338614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab0c1051a0 0x7fab0c10bb40 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.173+0000 7fab1293a640 1 --2- 172.21.15.60:0/1734338614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab0c103770 0x7fab0c103be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.173+0000 7fab1293a640 1 -- 172.21.15.60:0/1734338614 >> 172.21.15.60:0/1734338614 conn(0x7fab0c0ff0e0 msgr2=0x7fab0c101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.173+0000 7fab1293a640 1 -- 172.21.15.60:0/1734338614 shutdown_connections 2024-09-21T03:54:29.177 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.173+0000 7fab1293a640 1 -- 172.21.15.60:0/1734338614 wait complete. 2024-09-21T03:54:29.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.174+0000 7fab1293a640 1 Processor -- start 2024-09-21T03:54:29.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.174+0000 7fab1293a640 1 -- start start 2024-09-21T03:54:29.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.174+0000 7fab1293a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab0c103770 0x7fab0c199ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.174+0000 7fab1293a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab0c104800 0x7fab0c19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.179 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.174+0000 7fab1293a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab0c1051a0 0x7fab0c19b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.174+0000 7fab1293a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10f270 con 0x7fab0c104800 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.174+0000 7fab1293a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10f0f0 con 0x7fab0c1051a0 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.174+0000 7fab1293a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fab0c10f3f0 con 0x7fab0c103770 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.174+0000 7fab10ed7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab0c1051a0 0x7fab0c19b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab10ed7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab0c1051a0 0x7fab0c19b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41746/0 (socket says 172.21.15.60:41746) 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab10ed7640 1 -- 172.21.15.60:0/4064494057 learned_addr learned my addr 172.21.15.60:0/4064494057 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab0bfff640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab0c103770 0x7fab0c199ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab03fff640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab0c104800 0x7fab0c19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab10ed7640 1 -- 172.21.15.60:0/4064494057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab0c103770 msgr2=0x7fab0c199ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab10ed7640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab0c103770 0x7fab0c199ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab10ed7640 1 -- 172.21.15.60:0/4064494057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab0c104800 msgr2=0x7fab0c19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab10ed7640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab0c104800 0x7fab0c19a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab10ed7640 1 -- 172.21.15.60:0/4064494057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab0c19b8f0 con 0x7fab0c1051a0 2024-09-21T03:54:29.180 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab10ed7640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab0c1051a0 0x7fab0c19b0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab0402f800 tx=0x7fab04003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab09ffb640 1 -- 172.21.15.60:0/4064494057 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04034040 con 0x7fab0c1051a0 2024-09-21T03:54:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab09ffb640 1 -- 172.21.15.60:0/4064494057 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab04030850 con 0x7fab0c1051a0 2024-09-21T03:54:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab1293a640 1 -- 172.21.15.60:0/4064494057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab0c19bb80 con 0x7fab0c1051a0 2024-09-21T03:54:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab09ffb640 1 -- 172.21.15.60:0/4064494057 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab04039430 con 0x7fab0c1051a0 2024-09-21T03:54:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.175+0000 7fab1293a640 1 -- 172.21.15.60:0/4064494057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab0c0755f0 con 0x7fab0c1051a0 2024-09-21T03:54:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.177+0000 7fab1293a640 1 -- 172.21.15.60:0/4064494057 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab0c10a930 con 0x7fab0c1051a0 2024-09-21T03:54:29.181 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.178+0000 7fab09ffb640 1 -- 172.21.15.60:0/4064494057 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7fab04037020 con 0x7fab0c1051a0 2024-09-21T03:54:29.182 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.179+0000 7fab09ffb640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faaf80b6480 0x7faaf80b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.180+0000 7fab09ffb640 1 -- 172.21.15.60:0/4064494057 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7fab04106790 con 0x7fab0c1051a0 2024-09-21T03:54:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.180+0000 7fab0bfff640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faaf80b6480 0x7faaf80b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:29.183 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.180+0000 7fab0bfff640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faaf80b6480 0x7faaf80b8990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faafc00bbe0 tx=0x7faafc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:29.186 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.183+0000 7fab09ffb640 1 -- 172.21.15.60:0/4064494057 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fab040cec20 con 0x7fab0c1051a0 2024-09-21T03:54:29.384 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:29.381+0000 7fab1293a640 1 -- 172.21.15.60:0/4064494057 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fab0c063800 con 0x7faaf80b6480 2024-09-21T03:54:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:54:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:54:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi022 2024-09-21T03:54:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:54:29.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-21T03:54:29.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:29.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:29.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:29 smithi060 ceph-mon[33722]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' 2024-09-21T03:54:29.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi022 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:29.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:29 smithi022 ceph-mon[31015]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi022 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi022 to 17092M 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:29.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:29.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:29 smithi073 ceph-mon[34443]: from='osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726]' entity='osd.0' 2024-09-21T03:54:30.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:54:30.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:54:30.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:30.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:30.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:30.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:54:30.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:54:30.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:30.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] boot 2024-09-21T03:54:30.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T03:54:30.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:30.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:54:30.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:54:30.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:54:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:54:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] boot 2024-09-21T03:54:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T03:54:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:30.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:54:30.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:54:30.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T03:54:30.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:30.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:30.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:54:30.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:54:30.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:30.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: osd.0 [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] boot 2024-09-21T03:54:30.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: osdmap e8: 1 total, 1 up, 1 in 2024-09-21T03:54:30.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T03:54:32.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:32 smithi022 ceph-mon[31015]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:32.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:32 smithi022 ceph-mon[31015]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:54:32.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:32 smithi022 ceph-mon[31015]: from='client.? 172.21.15.60:0/3587722909' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "08151432-cfef-4b3d-88eb-5cd78d8eab0b"} : dispatch 2024-09-21T03:54:32.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:32 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "08151432-cfef-4b3d-88eb-5cd78d8eab0b"} : dispatch 2024-09-21T03:54:32.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:32 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08151432-cfef-4b3d-88eb-5cd78d8eab0b"}]': finished 2024-09-21T03:54:32.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:32 smithi022 ceph-mon[31015]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T03:54:32.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:32.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:32 smithi022 ceph-mon[31015]: from='client.? 172.21.15.60:0/1738193267' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:54:32.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:32 smithi073 ceph-mon[34443]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:32 smithi073 ceph-mon[34443]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:54:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:32 smithi073 ceph-mon[34443]: from='client.? 172.21.15.60:0/3587722909' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "08151432-cfef-4b3d-88eb-5cd78d8eab0b"} : dispatch 2024-09-21T03:54:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:32 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "08151432-cfef-4b3d-88eb-5cd78d8eab0b"} : dispatch 2024-09-21T03:54:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:32 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08151432-cfef-4b3d-88eb-5cd78d8eab0b"}]': finished 2024-09-21T03:54:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:32 smithi073 ceph-mon[34443]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T03:54:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:32 smithi073 ceph-mon[34443]: from='client.? 172.21.15.60:0/1738193267' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:54:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:32 smithi060 ceph-mon[33722]: pgmap v59: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:32 smithi060 ceph-mon[33722]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T03:54:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:32 smithi060 ceph-mon[33722]: from='client.? 172.21.15.60:0/3587722909' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "08151432-cfef-4b3d-88eb-5cd78d8eab0b"} : dispatch 2024-09-21T03:54:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:32 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "08151432-cfef-4b3d-88eb-5cd78d8eab0b"} : dispatch 2024-09-21T03:54:32.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:32 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "08151432-cfef-4b3d-88eb-5cd78d8eab0b"}]': finished 2024-09-21T03:54:32.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:32 smithi060 ceph-mon[33722]: osdmap e10: 2 total, 1 up, 2 in 2024-09-21T03:54:32.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:32.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:32 smithi060 ceph-mon[33722]: from='client.? 172.21.15.60:0/1738193267' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:54:34.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:34 smithi022 ceph-mon[31015]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:34.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:34 smithi073 ceph-mon[34443]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:34.701 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:34 smithi060 ceph-mon[33722]: pgmap v62: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:36.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:36 smithi022 ceph-mon[31015]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:36.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:36 smithi073 ceph-mon[34443]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:36.634 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:36 smithi060 ceph-mon[33722]: pgmap v63: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:38.498 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:38 smithi060 ceph-mon[33722]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:38.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:38 smithi022 ceph-mon[31015]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:38.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:38 smithi073 ceph-mon[34443]: pgmap v64: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:40.391 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:40 smithi060 ceph-mon[33722]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:40.391 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:54:40.392 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:40.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:40 smithi022 ceph-mon[31015]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:40.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:54:40.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:40.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:40 smithi073 ceph-mon[34443]: pgmap v65: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:40.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T03:54:40.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:41.564 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:41 smithi060 ceph-mon[33722]: Deploying daemon osd.1 on smithi060 2024-09-21T03:54:41.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:41 smithi022 ceph-mon[31015]: Deploying daemon osd.1 on smithi060 2024-09-21T03:54:41.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:41 smithi073 ceph-mon[34443]: Deploying daemon osd.1 on smithi060 2024-09-21T03:54:42.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:42 smithi060 ceph-mon[33722]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:42 smithi022 ceph-mon[31015]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:42.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:42 smithi073 ceph-mon[34443]: pgmap v66: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:44 smithi022 ceph-mon[31015]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:44.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:44 smithi073 ceph-mon[34443]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:44.651 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:44 smithi060 ceph-mon[33722]: pgmap v67: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:46.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:46 smithi060 ceph-mon[33722]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:46.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:46 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:46.594 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:46 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:46.595 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:46 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:46.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:46 smithi022 ceph-mon[31015]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:46.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:46 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:46.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:46 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:46.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:46 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:46.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:46 smithi073 ceph-mon[34443]: pgmap v68: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:46.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:46 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:46.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:46 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:46.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:46 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:48.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:48 smithi022 ceph-mon[31015]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:48.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:48 smithi073 ceph-mon[34443]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:48 smithi060 ceph-mon[33722]: pgmap v69: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:49.761 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:49.761 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:49.761 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:49.761 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:49.762 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:49.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:49.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:49.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:49.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:49.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:49.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:49.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:49.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:49.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:49.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:50.071 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.068+0000 7fab09ffb640 1 -- 172.21.15.60:0/4064494057 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fab0c063800 con 0x7faaf80b6480 2024-09-21T03:54:50.071 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 1 on host 'smithi060' 2024-09-21T03:54:50.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 -- 172.21.15.60:0/4064494057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faaf80b6480 msgr2=0x7faaf80b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:50.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faaf80b6480 0x7faaf80b8990 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7faafc00bbe0 tx=0x7faafc00b390 comp rx=0 tx=0).stop 2024-09-21T03:54:50.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 -- 172.21.15.60:0/4064494057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab0c1051a0 msgr2=0x7fab0c19b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:50.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab0c1051a0 0x7fab0c19b0d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fab0402f800 tx=0x7fab04003f90 comp rx=0 tx=0).stop 2024-09-21T03:54:50.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 -- 172.21.15.60:0/4064494057 shutdown_connections 2024-09-21T03:54:50.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faaf80b6480 0x7faaf80b8990 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fab0c1051a0 0x7fab0c19b0d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab0c104800 0x7fab0c19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.073 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 --2- 172.21.15.60:0/4064494057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fab0c103770 0x7fab0c199ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:50.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 -- 172.21.15.60:0/4064494057 >> 172.21.15.60:0/4064494057 conn(0x7fab0c0ff0e0 msgr2=0x7fab0c107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:50.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 -- 172.21.15.60:0/4064494057 shutdown_connections 2024-09-21T03:54:50.074 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:54:50.070+0000 7fab1293a640 1 -- 172.21.15.60:0/4064494057 wait complete. 2024-09-21T03:54:50.649 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:50 smithi060 ceph-mon[33722]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:50.649 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:50 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:50.649 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:50 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:50.649 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:50 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:50.676 DEBUG:teuthology.orchestra.run.smithi060:osd.1> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.1.service 2024-09-21T03:54:50.678 INFO:tasks.cephadm:Deploying osd.2 on smithi073 with /dev/vg_nvme/lv_4... 2024-09-21T03:54:50.678 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T03:54:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:50 smithi022 ceph-mon[31015]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:50 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:50 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:50.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:50 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:50 smithi073 ceph-mon[34443]: pgmap v70: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:50 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:54:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:50 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:50 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:50.936 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:54:52.107 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:54:51 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1[37657]: 2024-09-21T03:54:51.911+0000 7f3ea2dfd640 -1 osd.1 0 log_to_monitors true 2024-09-21T03:54:52.537 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:52 smithi073 ceph-mon[34443]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:52.537 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:52 smithi073 ceph-mon[34443]: from='osd.1 [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:54:52.537 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:52 smithi073 ceph-mon[34443]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:54:52.809 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:52 smithi060 ceph-mon[33722]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:52.809 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:52 smithi060 ceph-mon[33722]: from='osd.1 [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:54:52.809 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:52 smithi060 ceph-mon[33722]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:54:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:52 smithi022 ceph-mon[31015]: pgmap v71: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:52 smithi022 ceph-mon[31015]: from='osd.1 [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:54:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:52 smithi022 ceph-mon[31015]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T03:54:53.077 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:54:53.103 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi073:vg_nvme/lv_4 2024-09-21T03:54:53.352 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:54:53.639 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:54:53.639 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:54:53.639 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: from='osd.1 [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:54:53.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:53.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:54:53.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:53.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:53.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:54:53.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:53.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:53.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:54:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:54:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: from='osd.1 [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:54:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:54:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:54:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:53.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.812+0000 7f1e16fd6640 1 -- 172.21.15.73:0/2858576698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10103780 msgr2=0x7f1e10103b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:53.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.812+0000 7f1e16fd6640 1 --2- 172.21.15.73:0/2858576698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10103780 0x7f1e10103b90 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc009860 tx=0x7f1dfc02a3d0 comp rx=0 tx=0).stop 2024-09-21T03:54:53.815 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.812+0000 7f1e16fd6640 1 -- 172.21.15.73:0/2858576698 shutdown_connections 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.812+0000 7f1e16fd6640 1 --2- 172.21.15.73:0/2858576698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e10104120 0x7f1e1010aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.812+0000 7f1e16fd6640 1 --2- 172.21.15.73:0/2858576698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10103780 0x7f1e10103b90 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.812+0000 7f1e16fd6640 1 --2- 172.21.15.73:0/2858576698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e101026f0 0x7f1e10102b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.812+0000 7f1e16fd6640 1 -- 172.21.15.73:0/2858576698 >> 172.21.15.73:0/2858576698 conn(0x7f1e100fe080 msgr2=0x7f1e10100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.812+0000 7f1e16fd6640 1 -- 172.21.15.73:0/2858576698 shutdown_connections 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.812+0000 7f1e16fd6640 1 -- 172.21.15.73:0/2858576698 wait complete. 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e16fd6640 1 Processor -- start 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e16fd6640 1 -- start start 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e16fd6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e101026f0 0x7f1e101062c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e16fd6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e10103780 0x7f1e10104b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e16fd6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10104120 0x7f1e101050d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:53.816 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e16fd6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1010e160 con 0x7f1e10104120 2024-09-21T03:54:53.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e16fd6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1010dfe0 con 0x7f1e101026f0 2024-09-21T03:54:53.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e16fd6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1e1010e2e0 con 0x7f1e10103780 2024-09-21T03:54:53.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e0ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e10103780 0x7f1e10104b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:53.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e14d72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e101026f0 0x7f1e101062c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:53.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e0ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e10103780 0x7f1e10104b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:57676/0 (socket says 172.21.15.73:57676) 2024-09-21T03:54:53.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e15573640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10104120 0x7f1e101050d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:53.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e0ffff640 1 -- 172.21.15.73:0/3007107502 learned_addr learned my addr 172.21.15.73:0/3007107502 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-21T03:54:53.817 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e14d72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e101026f0 0x7f1e101062c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.73:60964/0 (socket says 172.21.15.73:60964) 2024-09-21T03:54:53.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e15573640 1 -- 172.21.15.73:0/3007107502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e10103780 msgr2=0x7f1e10104b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:53.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e15573640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e10103780 0x7f1e10104b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:53.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e15573640 1 -- 172.21.15.73:0/3007107502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e101026f0 msgr2=0x7f1e101062c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:54:53.818 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e15573640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e101026f0 0x7f1e101062c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:54:53.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e15573640 1 -- 172.21.15.73:0/3007107502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e101057d0 con 0x7f1e10104120 2024-09-21T03:54:53.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.813+0000 7f1e0ffff640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e10103780 0x7f1e10104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:54:53.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.814+0000 7f1e15573640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10104120 0x7f1e101050d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800ef00 tx=0x7f1e0800c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:53.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.814+0000 7f1e0dffb640 1 -- 172.21.15.73:0/3007107502 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e08004b20 con 0x7f1e10104120 2024-09-21T03:54:53.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.814+0000 7f1e0dffb640 1 -- 172.21.15.73:0/3007107502 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e08003e00 con 0x7f1e10104120 2024-09-21T03:54:53.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.814+0000 7f1e16fd6640 1 -- 172.21.15.73:0/3007107502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e101a3f90 con 0x7f1e10104120 2024-09-21T03:54:53.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.814+0000 7f1e0dffb640 1 -- 172.21.15.73:0/3007107502 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e08004820 con 0x7f1e10104120 2024-09-21T03:54:53.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.814+0000 7f1e16fd6640 1 -- 172.21.15.73:0/3007107502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e101a4330 con 0x7f1e10104120 2024-09-21T03:54:53.819 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.815+0000 7f1e16fd6640 1 -- 172.21.15.73:0/3007107502 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e10102b60 con 0x7f1e10104120 2024-09-21T03:54:53.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.818+0000 7f1e0dffb640 1 -- 172.21.15.73:0/3007107502 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f1e0801d020 con 0x7f1e10104120 2024-09-21T03:54:53.820 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.818+0000 7f1e0dffb640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e000b6480 0x7f1e000b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:54:53.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.819+0000 7f1e0dffb640 1 -- 172.21.15.73:0/3007107502 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7f1e080e6290 con 0x7f1e10104120 2024-09-21T03:54:53.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.819+0000 7f1e14d72640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e000b6480 0x7f1e000b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:54:53.821 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.819+0000 7f1e14d72640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e000b6480 0x7f1e000b8990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009bd0 tx=0x7f1e04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:54:53.827 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:53.825+0000 7f1e0dffb640 1 -- 172.21.15.73:0/3007107502 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e08024030 con 0x7f1e10104120 2024-09-21T03:54:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T03:54:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T03:54:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: from='osd.1 [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:54:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: from='osd.1 ' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:54:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:53.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:53.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:54:53.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:53.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:53.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:54:54.022 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:54:54.020+0000 7f1e16fd6640 1 -- 172.21.15.73:0/3007107502 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f1e101000d0 con 0x7f1e000b6480 2024-09-21T03:54:54.202 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1[37657]: 2024-09-21T03:54:53.937+0000 7f3e9f594640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T03:54:54.202 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:54:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1[37657]: 2024-09-21T03:54:53.940+0000 7f3e96b75640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:54:54.639 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:54.639 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi060 2024-09-21T03:54:54.639 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-21T03:54:54.639 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:54.639 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:54:54.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T03:54:54.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:54.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:54.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: from='osd.1 ' entity='osd.1' 2024-09-21T03:54:54.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:54:54.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:54:54.640 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi060 2024-09-21T03:54:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-21T03:54:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:54:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T03:54:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:54.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:54.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: from='osd.1 ' entity='osd.1' 2024-09-21T03:54:54.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:54:54.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:54:54.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: pgmap v73: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi060 2024-09-21T03:54:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi060 to 17092M 2024-09-21T03:54:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:54:54.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:54:54.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T03:54:54.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:54.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:54.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: from='osd.1 ' entity='osd.1' 2024-09-21T03:54:54.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:54:54.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:54:54.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:54:55.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:55 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:54:55.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:55 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:54:55.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:55 smithi073 ceph-mon[34443]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:55.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:55.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:55 smithi073 ceph-mon[34443]: osd.1 [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] boot 2024-09-21T03:54:55.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:55 smithi073 ceph-mon[34443]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T03:54:55.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:55.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:55 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:54:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:55 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:54:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:55 smithi022 ceph-mon[31015]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:55 smithi022 ceph-mon[31015]: osd.1 [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] boot 2024-09-21T03:54:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:55 smithi022 ceph-mon[31015]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T03:54:55.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:55.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:55 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:54:55.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:55 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:54:55.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:55 smithi060 ceph-mon[33722]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:54:55.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:55.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:55 smithi060 ceph-mon[33722]: osd.1 [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] boot 2024-09-21T03:54:55.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:55 smithi060 ceph-mon[33722]: osdmap e13: 2 total, 2 up, 2 in 2024-09-21T03:54:55.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T03:54:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:56 smithi022 ceph-mon[31015]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:56 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/3293309834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c6ac00d8-4358-45b9-85d2-c14921cdd053"} : dispatch 2024-09-21T03:54:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:56 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c6ac00d8-4358-45b9-85d2-c14921cdd053"} : dispatch 2024-09-21T03:54:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:56 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6ac00d8-4358-45b9-85d2-c14921cdd053"}]': finished 2024-09-21T03:54:56.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:56 smithi022 ceph-mon[31015]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T03:54:56.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:56 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:54:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:56 smithi073 ceph-mon[34443]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:56 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/3293309834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c6ac00d8-4358-45b9-85d2-c14921cdd053"} : dispatch 2024-09-21T03:54:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:56 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c6ac00d8-4358-45b9-85d2-c14921cdd053"} : dispatch 2024-09-21T03:54:56.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:56 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6ac00d8-4358-45b9-85d2-c14921cdd053"}]': finished 2024-09-21T03:54:56.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:56 smithi073 ceph-mon[34443]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T03:54:56.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:56 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:54:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:56 smithi060 ceph-mon[33722]: pgmap v75: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-21T03:54:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:56 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/3293309834' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c6ac00d8-4358-45b9-85d2-c14921cdd053"} : dispatch 2024-09-21T03:54:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:56 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c6ac00d8-4358-45b9-85d2-c14921cdd053"} : dispatch 2024-09-21T03:54:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:56 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c6ac00d8-4358-45b9-85d2-c14921cdd053"}]': finished 2024-09-21T03:54:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:56 smithi060 ceph-mon[33722]: osdmap e14: 3 total, 2 up, 3 in 2024-09-21T03:54:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:56 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:54:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:57 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/127554632' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:54:57.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:57 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/127554632' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:54:57.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:57 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/127554632' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:54:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:54:58 smithi022 ceph-mon[31015]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:54:58.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:54:58 smithi073 ceph-mon[34443]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:54:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:54:58 smithi060 ceph-mon[33722]: pgmap v78: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:00 smithi022 ceph-mon[31015]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:00.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:00 smithi073 ceph-mon[34443]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:00 smithi060 ceph-mon[33722]: pgmap v79: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:02.796 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:02 smithi073 ceph-mon[34443]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:02 smithi022 ceph-mon[31015]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:02 smithi060 ceph-mon[33722]: pgmap v80: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:04 smithi022 ceph-mon[31015]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:04.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:04 smithi073 ceph-mon[34443]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:04 smithi060 ceph-mon[33722]: pgmap v81: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:05.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:55:05.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:05.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:05 smithi022 ceph-mon[31015]: Deploying daemon osd.2 on smithi073 2024-09-21T03:55:05.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:55:05.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:05.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:05 smithi073 ceph-mon[34443]: Deploying daemon osd.2 on smithi073 2024-09-21T03:55:05.951 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T03:55:05.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:05.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:05 smithi060 ceph-mon[33722]: Deploying daemon osd.2 on smithi073 2024-09-21T03:55:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:06 smithi022 ceph-mon[31015]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:06.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:06 smithi073 ceph-mon[34443]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:06 smithi060 ceph-mon[33722]: pgmap v82: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:08 smithi022 ceph-mon[31015]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:08.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:08 smithi073 ceph-mon[34443]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:08 smithi060 ceph-mon[33722]: pgmap v83: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:10.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:10 smithi022 ceph-mon[31015]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:10.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:10 smithi073 ceph-mon[34443]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:10 smithi060 ceph-mon[33722]: pgmap v84: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:11.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:11.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:11.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:11.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:11.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:11.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:11.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:11.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:11.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:12.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:12 smithi022 ceph-mon[31015]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:12.853 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:12 smithi060 ceph-mon[33722]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:12.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:12 smithi073 ceph-mon[34443]: pgmap v85: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:14.039 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:13 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:14.039 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:13 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:14.039 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:13 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:14.039 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:13 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:14.039 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:13 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:14.040 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:13 smithi073 ceph-mon[34443]: pgmap v86: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:14.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:13 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:14.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:13 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:14.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:13 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:14.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:13 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:14.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:13 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:14.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:13 smithi022 ceph-mon[31015]: pgmap v86: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:14.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:13 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:14.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:13 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:14.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:13 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:14.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:13 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:14.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:13 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:14.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:13 smithi060 ceph-mon[33722]: pgmap v86: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:14.613 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 2 on host 'smithi073' 2024-09-21T03:55:14.614 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.610+0000 7f1e0dffb640 1 -- 172.21.15.73:0/3007107502 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1e101000d0 con 0x7f1e000b6480 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.613+0000 7f1e16fd6640 1 -- 172.21.15.73:0/3007107502 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e000b6480 msgr2=0x7f1e000b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.613+0000 7f1e16fd6640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e000b6480 0x7f1e000b8990 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1e04009bd0 tx=0x7f1e04005f90 comp rx=0 tx=0).stop 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.613+0000 7f1e16fd6640 1 -- 172.21.15.73:0/3007107502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10104120 msgr2=0x7f1e101050d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.613+0000 7f1e16fd6640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10104120 0x7f1e101050d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1e0800ef00 tx=0x7f1e0800c740 comp rx=0 tx=0).stop 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.614+0000 7f1e16fd6640 1 -- 172.21.15.73:0/3007107502 shutdown_connections 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.614+0000 7f1e16fd6640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e000b6480 0x7f1e000b8990 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.614+0000 7f1e16fd6640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e10103780 0x7f1e10104b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.614+0000 7f1e16fd6640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e10104120 0x7f1e101050d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.614+0000 7f1e16fd6640 1 --2- 172.21.15.73:0/3007107502 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e101026f0 0x7f1e101062c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.614+0000 7f1e16fd6640 1 -- 172.21.15.73:0/3007107502 >> 172.21.15.73:0/3007107502 conn(0x7f1e100fe080 msgr2=0x7f1e100ff9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.614+0000 7f1e16fd6640 1 -- 172.21.15.73:0/3007107502 shutdown_connections 2024-09-21T03:55:14.616 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:55:14.614+0000 7f1e16fd6640 1 -- 172.21.15.73:0/3007107502 wait complete. 2024-09-21T03:55:14.920 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:14.920 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:14.920 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:15.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:15.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:15.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:15.201 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:15.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:15.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:15.248 DEBUG:teuthology.orchestra.run.smithi073:osd.2> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.2.service 2024-09-21T03:55:15.250 INFO:tasks.cephadm:Deploying osd.3 on smithi022 with /dev/vg_nvme/lv_3... 2024-09-21T03:55:15.250 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:55:15.518 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:15.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:15 smithi073 ceph-mon[34443]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:15.908 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:15 smithi022 ceph-mon[31015]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:16.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:15 smithi060 ceph-mon[33722]: pgmap v87: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:16.597 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:16 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2[38837]: 2024-09-21T03:55:16.445+0000 7ff4b1138640 -1 osd.2 0 log_to_monitors true 2024-09-21T03:55:16.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:16 smithi073 ceph-mon[34443]: from='osd.2 [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:55:16.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:16 smithi073 ceph-mon[34443]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:55:17.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:16 smithi022 ceph-mon[31015]: from='osd.2 [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:55:17.064 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:16 smithi022 ceph-mon[31015]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:55:17.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:16 smithi060 ceph-mon[33722]: from='osd.2 [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:55:17.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:16 smithi060 ceph-mon[33722]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T03:55:17.926 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:17 smithi073 ceph-mon[34443]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:55:17.926 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:17 smithi073 ceph-mon[34443]: from='osd.2 [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:55:17.927 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:17 smithi073 ceph-mon[34443]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T03:55:17.927 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:17 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:17.927 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:17 smithi073 ceph-mon[34443]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:55:17.927 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:17 smithi073 ceph-mon[34443]: pgmap v89: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:18.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:17 smithi022 ceph-mon[31015]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:55:18.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:17 smithi022 ceph-mon[31015]: from='osd.2 [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:55:18.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:17 smithi022 ceph-mon[31015]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T03:55:18.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:17 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:18.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:17 smithi022 ceph-mon[31015]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:55:18.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:17 smithi022 ceph-mon[31015]: pgmap v89: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:18.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:17 smithi060 ceph-mon[33722]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T03:55:18.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:17 smithi060 ceph-mon[33722]: from='osd.2 [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:55:18.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:17 smithi060 ceph-mon[33722]: osdmap e15: 3 total, 2 up, 3 in 2024-09-21T03:55:18.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:17 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:18.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:17 smithi060 ceph-mon[33722]: from='osd.2 ' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:55:18.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:17 smithi060 ceph-mon[33722]: pgmap v89: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:18.223 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:55:18.250 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi022:vg_nvme/lv_3 2024-09-21T03:55:18.513 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:55:18.604 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2[38837]: 2024-09-21T03:55:18.267+0000 7ff4ad0ba640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T03:55:18.605 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2[38837]: 2024-09-21T03:55:18.272+0000 7ff4a4eb0640 -1 osd.2 16 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:55:18.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.967+0000 7f16fb76b640 1 -- 172.21.15.22:0/4025815358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f41094a0 msgr2=0x7f16f410b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.967+0000 7f16fb76b640 1 --2- 172.21.15.22:0/4025815358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f41094a0 0x7f16f410b9b0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f16ec009ca0 tx=0x7f16ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:55:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.967+0000 7f16fb76b640 1 -- 172.21.15.22:0/4025815358 shutdown_connections 2024-09-21T03:55:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.967+0000 7f16fb76b640 1 --2- 172.21.15.22:0/4025815358 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f41094a0 0x7f16f410b9b0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.967+0000 7f16fb76b640 1 --2- 172.21.15.22:0/4025815358 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16f4106960 0x7f16f4108d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.967+0000 7f16fb76b640 1 --2- 172.21.15.22:0/4025815358 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16f406c2e0 0x7f16f4106420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.967+0000 7f16fb76b640 1 -- 172.21.15.22:0/4025815358 >> 172.21.15.22:0/4025815358 conn(0x7f16f40fdfe0 msgr2=0x7f16f4100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.967+0000 7f16fb76b640 1 -- 172.21.15.22:0/4025815358 shutdown_connections 2024-09-21T03:55:18.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.967+0000 7f16fb76b640 1 -- 172.21.15.22:0/4025815358 wait complete. 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.968+0000 7f16fb76b640 1 Processor -- start 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.968+0000 7f16fb76b640 1 -- start start 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.968+0000 7f16fb76b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f406c2e0 0x7f16f4199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.968+0000 7f16fb76b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16f4106960 0x7f16f419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.968+0000 7f16fb76b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16f41094a0 0x7f16f419b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.968+0000 7f16fb76b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f16f410f2b0 con 0x7f16f406c2e0 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.968+0000 7f16fb76b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f16f410f130 con 0x7f16f41094a0 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.968+0000 7f16fb76b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f16f410f430 con 0x7f16f4106960 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9507640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f406c2e0 0x7f16f4199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9507640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f406c2e0 0x7f16f4199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51068/0 (socket says 172.21.15.22:51068) 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9507640 1 -- 172.21.15.22:0/1266194763 learned_addr learned my addr 172.21.15.22:0/1266194763 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:55:18.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f8d06640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16f4106960 0x7f16f419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:18.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9d08640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16f41094a0 0x7f16f419b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:18.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9507640 1 -- 172.21.15.22:0/1266194763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16f4106960 msgr2=0x7f16f419a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:18.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9507640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16f4106960 0x7f16f419a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:18.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9507640 1 -- 172.21.15.22:0/1266194763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16f41094a0 msgr2=0x7f16f419b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:18.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9507640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16f41094a0 0x7f16f419b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:18.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9507640 1 -- 172.21.15.22:0/1266194763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16f419b810 con 0x7f16f406c2e0 2024-09-21T03:55:18.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9d08640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16f41094a0 0x7f16f419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:55:18.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16f9507640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f406c2e0 0x7f16f4199e70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f16f000d770 tx=0x7f16f000db70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:18.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16ea7fc640 1 -- 172.21.15.22:0/1266194763 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0017070 con 0x7f16f406c2e0 2024-09-21T03:55:18.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16fb76b640 1 -- 172.21.15.22:0/1266194763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16f419bb00 con 0x7f16f406c2e0 2024-09-21T03:55:18.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16ea7fc640 1 -- 172.21.15.22:0/1266194763 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16f0009820 con 0x7f16f406c2e0 2024-09-21T03:55:18.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16ea7fc640 1 -- 172.21.15.22:0/1266194763 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16f0004b20 con 0x7f16f406c2e0 2024-09-21T03:55:18.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.969+0000 7f16fb76b640 1 -- 172.21.15.22:0/1266194763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16f41a2290 con 0x7f16f406c2e0 2024-09-21T03:55:18.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.971+0000 7f16fb76b640 1 -- 172.21.15.22:0/1266194763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16f4106d70 con 0x7f16f406c2e0 2024-09-21T03:55:18.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.972+0000 7f16ea7fc640 1 -- 172.21.15.22:0/1266194763 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 15) ==== 154456+0+0 (secure 0 0 0) 0x7f16f00099d0 con 0x7f16f406c2e0 2024-09-21T03:55:18.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.973+0000 7f16ea7fc640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f16e00b6480 0x7f16e00b8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:18.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.973+0000 7f16f8d06640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f16e00b6480 0x7f16e00b8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:18.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.973+0000 7f16ea7fc640 1 -- 172.21.15.22:0/1266194763 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2571+0+0 (secure 0 0 0) 0x7f16f00e5a80 con 0x7f16f406c2e0 2024-09-21T03:55:18.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.974+0000 7f16f8d06640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f16e00b6480 0x7f16e00b8990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16e400abe0 tx=0x7f16e400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:18.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:18.976+0000 7f16ea7fc640 1 -- 172.21.15.22:0/1266194763 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f16f00ad9c0 con 0x7f16f406c2e0 2024-09-21T03:55:19.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:55:19.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi073 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi073 to 17088M 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:18 smithi022 ceph-mon[31015]: from='osd.2 ' entity='osd.2' 2024-09-21T03:55:19.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:55:19.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:55:19.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:19.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:19.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi073 2024-09-21T03:55:19.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:55:19.108 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi073 to 17088M 2024-09-21T03:55:19.108 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.108 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:19.108 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:19.108 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.108 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:18 smithi073 ceph-mon[34443]: from='osd.2 ' entity='osd.2' 2024-09-21T03:55:19.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:19.177+0000 7f16fb76b640 1 -- 172.21.15.22:0/1266194763 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f16f402e9d0 con 0x7f16e00b6480 2024-09-21T03:55:19.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi073 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi073 to 17088M 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:19.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:19.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:18 smithi060 ceph-mon[33722]: from='osd.2 ' entity='osd.2' 2024-09-21T03:55:19.830 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:55:19.830 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:55:19.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:19.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: pgmap v91: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:19.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:19.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:55:19.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:55:19.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:19.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: osd.2 [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] boot 2024-09-21T03:55:19.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T03:55:19.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:19.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:55:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:55:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:55:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: pgmap v91: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:55:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:55:20.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:20.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: osd.2 [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] boot 2024-09-21T03:55:20.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T03:55:20.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:20.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:55:20.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:55:20.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:55:20.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:20.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: pgmap v91: 0 pgs: ; 0 B data, 69 MiB used, 179 GiB / 179 GiB avail 2024-09-21T03:55:20.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:20.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:55:20.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:55:20.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:20.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: osd.2 [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] boot 2024-09-21T03:55:20.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: osdmap e17: 3 total, 3 up, 3 in 2024-09-21T03:55:20.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T03:55:20.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:55:21.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:55:21.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 ceph-mon[31015]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T03:55:21.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:55:21.568 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51161]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:55:21.568 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51161]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:21.568 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:21.568 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51161]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:21.568 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51166]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:55:21.569 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51166]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:21.569 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:21.569 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51166]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:21.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:55:21.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 ceph-mon[34443]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T03:55:21.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:55:21.605 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42308]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:55:21.605 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42308]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:21.605 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:21.605 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42308]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:21.605 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42311]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:55:21.605 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42311]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:21.605 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:21.605 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42311]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:21.649 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T03:55:21.650 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 ceph-mon[33722]: osdmap e18: 3 total, 3 up, 3 in 2024-09-21T03:55:21.650 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true} : dispatch 2024-09-21T03:55:21.650 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41236]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:55:21.650 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41236]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:21.650 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:21.650 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41236]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:21.650 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41239]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:55:21.650 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41239]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:21.650 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:21.651 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41239]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51196]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:55:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51196]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51196]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51199]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:55:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51199]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:21 smithi022 sudo[51199]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41242]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:55:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41242]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41242]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41245]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:55:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41245]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:21 smithi060 sudo[41245]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:22.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42314]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T03:55:22.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42314]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:22.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:22.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42314]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:22.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42317]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T03:55:22.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42317]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T03:55:22.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T03:55:22.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:21 smithi073 sudo[42317]: pam_unix(sudo:session): session closed for user root 2024-09-21T03:55:22.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:55:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1393887881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5b81662-58c9-4931-9377-b9bd9f18c6e4"} : dispatch 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1393887881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5b81662-58c9-4931-9377-b9bd9f18c6e4"}]': finished 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T03:55:22.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:55:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1393887881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5b81662-58c9-4931-9377-b9bd9f18c6e4"} : dispatch 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1393887881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5b81662-58c9-4931-9377-b9bd9f18c6e4"}]': finished 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T03:55:22.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: pgmap v94: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T03:55:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T03:55:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "a"} : dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "b"} : dispatch 2024-09-21T03:55:22.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mon metadata", "id": "c"} : dispatch 2024-09-21T03:55:22.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T03:55:22.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1393887881' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "c5b81662-58c9-4931-9377-b9bd9f18c6e4"} : dispatch 2024-09-21T03:55:22.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1393887881' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c5b81662-58c9-4931-9377-b9bd9f18c6e4"}]': finished 2024-09-21T03:55:22.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: osdmap e20: 4 total, 3 up, 4 in 2024-09-21T03:55:22.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:23.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:23.296+0000 7f16ea7fc640 1 -- 172.21.15.22:0/1266194763 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f16f0009cf0 con 0x7f16f406c2e0 2024-09-21T03:55:23.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:23 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2574216927' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:55:23.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:23 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2574216927' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:55:23.633 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:23 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2574216927' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:55:24.597 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:24 smithi073 ceph-mon[34443]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:24.597 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:24 smithi073 ceph-mon[34443]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-09-21T03:55:24.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:24 smithi022 ceph-mon[31015]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:24.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:24 smithi022 ceph-mon[31015]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-09-21T03:55:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:24 smithi060 ceph-mon[33722]: pgmap v97: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:24 smithi060 ceph-mon[33722]: mgrmap e16: x(active, since 2m), standbys: y, z 2024-09-21T03:55:26.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:26 smithi022 ceph-mon[31015]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:26.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:26 smithi073 ceph-mon[34443]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:26 smithi060 ceph-mon[33722]: pgmap v98: 1 pgs: 1 creating+peering; 0 B data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:28 smithi022 ceph-mon[31015]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:28.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:28 smithi073 ceph-mon[34443]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:28.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:28 smithi060 ceph-mon[33722]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:30.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:30 smithi022 ceph-mon[31015]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:30.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:55:30.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:30.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:30 smithi073 ceph-mon[34443]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:30.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:55:30.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:30 smithi060 ceph-mon[33722]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T03:55:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:31.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:31 smithi022 ceph-mon[31015]: Deploying daemon osd.3 on smithi022 2024-09-21T03:55:31.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:31 smithi073 ceph-mon[34443]: Deploying daemon osd.3 on smithi022 2024-09-21T03:55:31.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:31 smithi060 ceph-mon[33722]: Deploying daemon osd.3 on smithi022 2024-09-21T03:55:32.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:32 smithi022 ceph-mon[31015]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:32.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:32 smithi073 ceph-mon[34443]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:32 smithi060 ceph-mon[33722]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:34.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:34 smithi022 ceph-mon[31015]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:34.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:34 smithi073 ceph-mon[34443]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:34 smithi060 ceph-mon[33722]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:36.482 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:36 smithi022 ceph-mon[31015]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:36.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:36 smithi073 ceph-mon[34443]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:36 smithi060 ceph-mon[33722]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:37.478 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:37.478 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:37.478 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:37.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:37.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:37.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:37.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:37.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:37.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:38.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:38 smithi022 ceph-mon[31015]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:38.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:38 smithi073 ceph-mon[34443]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:38.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:38 smithi060 ceph-mon[33722]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:40 smithi060 ceph-mon[33722]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:40.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:40 smithi022 ceph-mon[31015]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:40.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:40.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:40.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:40.791 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:40.792 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:40.832 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 3 on host 'smithi022' 2024-09-21T03:55:40.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.830+0000 7f16ea7fc640 1 -- 172.21.15.22:0/1266194763 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f16f402e9d0 con 0x7f16e00b6480 2024-09-21T03:55:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 -- 172.21.15.22:0/1266194763 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f16e00b6480 msgr2=0x7f16e00b8990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f16e00b6480 0x7f16e00b8990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f16e400abe0 tx=0x7f16e400a2d0 comp rx=0 tx=0).stop 2024-09-21T03:55:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 -- 172.21.15.22:0/1266194763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f406c2e0 msgr2=0x7f16f4199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f406c2e0 0x7f16f4199e70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f16f000d770 tx=0x7f16f000db70 comp rx=0 tx=0).stop 2024-09-21T03:55:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 -- 172.21.15.22:0/1266194763 shutdown_connections 2024-09-21T03:55:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f16e00b6480 0x7f16e00b8990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f16f4106960 0x7f16f419a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f16f41094a0 0x7f16f419b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 --2- 172.21.15.22:0/1266194763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f16f406c2e0 0x7f16f4199e70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 -- 172.21.15.22:0/1266194763 >> 172.21.15.22:0/1266194763 conn(0x7f16f40fdfe0 msgr2=0x7f16f4104e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 -- 172.21.15.22:0/1266194763 shutdown_connections 2024-09-21T03:55:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:55:40.833+0000 7f16fb76b640 1 -- 172.21.15.22:0/1266194763 wait complete. 2024-09-21T03:55:40.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:40 smithi073 ceph-mon[34443]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:40.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:40.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:40.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:40.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:40.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:41.469 DEBUG:teuthology.orchestra.run.smithi022:osd.3> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.3.service 2024-09-21T03:55:41.472 INFO:tasks.cephadm:Deploying osd.4 on smithi060 with /dev/vg_nvme/lv_3... 2024-09-21T03:55:41.472 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:55:41.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:41 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:41.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:41 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:41.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:41 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:41.738 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:55:41.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:41 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:41.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:41 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:41.748 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:41 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:41.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:41 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:55:41.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:41 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:41.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:41 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:42 smithi022 ceph-mon[31015]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:42 smithi060 ceph-mon[33722]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:42.756 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:42 smithi073 ceph-mon[34443]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:42.980 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 03:55:42 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3[53180]: 2024-09-21T03:55:42.826+0000 7fdbc223c640 -1 osd.3 0 log_to_monitors true 2024-09-21T03:55:43.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:43 smithi060 ceph-mon[33722]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:55:43.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:43 smithi022 ceph-mon[31015]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:55:43.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:43 smithi073 ceph-mon[34443]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T03:55:44.264 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:55:44.294 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_3 2024-09-21T03:55:44.565 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:44.583 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:55:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:55:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:55:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:44.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:44.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:55:44.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:55:44.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:44.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:44.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:44.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:44.858 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:45.016 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T03:55:45.016 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: osdmap e21: 4 total, 3 up, 4 in 2024-09-21T03:55:45.016 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:55:45.016 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:45.016 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:45.016 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:45.016 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:55:45.016 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:55:45.016 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:45.017 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:45.017 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:55:45.017 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:55:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.043+0000 7f43730cc640 1 -- 172.21.15.60:0/2184092228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f436c1094a0 msgr2=0x7f436c10b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:45.049 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.043+0000 7f43730cc640 1 --2- 172.21.15.60:0/2184092228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f436c1094a0 0x7f436c10b9b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4364009ca0 tx=0x7f436402a8c0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.043+0000 7f43730cc640 1 -- 172.21.15.60:0/2184092228 shutdown_connections 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.043+0000 7f43730cc640 1 --2- 172.21.15.60:0/2184092228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436c106900 0x7f436c108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.043+0000 7f43730cc640 1 --2- 172.21.15.60:0/2184092228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f436c1094a0 0x7f436c10b9b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.043+0000 7f43730cc640 1 --2- 172.21.15.60:0/2184092228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f436c06c340 0x7f436c1063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.043+0000 7f43730cc640 1 -- 172.21.15.60:0/2184092228 >> 172.21.15.60:0/2184092228 conn(0x7f436c0fdfe0 msgr2=0x7f436c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.043+0000 7f43730cc640 1 -- 172.21.15.60:0/2184092228 shutdown_connections 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.043+0000 7f43730cc640 1 -- 172.21.15.60:0/2184092228 wait complete. 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.044+0000 7f43730cc640 1 Processor -- start 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.044+0000 7f43730cc640 1 -- start start 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.044+0000 7f43730cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f436c06c340 0x7f436c199e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.044+0000 7f43730cc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436c106900 0x7f436c19a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.044+0000 7f43730cc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f436c1094a0 0x7f436c19b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:45.050 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.044+0000 7f43730cc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f436c10f2c0 con 0x7f436c06c340 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.044+0000 7f43730cc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f436c10f140 con 0x7f436c1094a0 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.044+0000 7f43730cc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f436c10f440 con 0x7f436c106900 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.044+0000 7f4371669640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f436c1094a0 0x7f436c19b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.044+0000 7f4370e68640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f436c06c340 0x7f436c199e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4371669640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f436c1094a0 0x7f436c19b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:41308/0 (socket says 172.21.15.60:41308) 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4371669640 1 -- 172.21.15.60:0/2331211076 learned_addr learned my addr 172.21.15.60:0/2331211076 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f436bfff640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436c106900 0x7f436c19a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4370e68640 1 -- 172.21.15.60:0/2331211076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436c106900 msgr2=0x7f436c19a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4370e68640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436c106900 0x7f436c19a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4370e68640 1 -- 172.21.15.60:0/2331211076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f436c1094a0 msgr2=0x7f436c19b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4370e68640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f436c1094a0 0x7f436c19b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:55:45.051 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4370e68640 1 -- 172.21.15.60:0/2331211076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f436c19b8b0 con 0x7f436c06c340 2024-09-21T03:55:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4371669640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f436c1094a0 0x7f436c19b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f436bfff640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436c106900 0x7f436c19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:55:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4370e68640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f436c06c340 0x7f436c199e80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f436000e9f0 tx=0x7f436000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4369ffb640 1 -- 172.21.15.60:0/2331211076 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f436000ccc0 con 0x7f436c06c340 2024-09-21T03:55:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4369ffb640 1 -- 172.21.15.60:0/2331211076 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43600108c0 con 0x7f436c06c340 2024-09-21T03:55:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f43730cc640 1 -- 172.21.15.60:0/2331211076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f436c19bba0 con 0x7f436c06c340 2024-09-21T03:55:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.045+0000 7f4369ffb640 1 -- 172.21.15.60:0/2331211076 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43600187e0 con 0x7f436c06c340 2024-09-21T03:55:45.052 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.046+0000 7f43730cc640 1 -- 172.21.15.60:0/2331211076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f436c1a22a0 con 0x7f436c06c340 2024-09-21T03:55:45.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.047+0000 7f43730cc640 1 -- 172.21.15.60:0/2331211076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f436c0ffb00 con 0x7f436c06c340 2024-09-21T03:55:45.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.048+0000 7f4369ffb640 1 -- 172.21.15.60:0/2331211076 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4360010430 con 0x7f436c06c340 2024-09-21T03:55:45.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.049+0000 7f4369ffb640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f435c0b6590 0x7f435c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:55:45.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.049+0000 7f4369ffb640 1 -- 172.21.15.60:0/2331211076 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3389+0+0 (secure 0 0 0) 0x7f43600e62a0 con 0x7f436c06c340 2024-09-21T03:55:45.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.049+0000 7f436bfff640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f435c0b6590 0x7f435c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:55:45.053 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.050+0000 7f436bfff640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f435c0b6590 0x7f435c0b8aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4358009fc0 tx=0x7f4358005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:55:45.055 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.053+0000 7f4369ffb640 1 -- 172.21.15.60:0/2331211076 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f43600b21b0 con 0x7f436c06c340 2024-09-21T03:55:45.255 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:55:45.252+0000 7f43730cc640 1 -- 172.21.15.60:0/2331211076 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f436c063800 con 0x7f435c0b6590 2024-09-21T03:55:45.349 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3[53180]: 2024-09-21T03:55:44.879+0000 7fdbbe9d3640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T03:55:45.349 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 03:55:44 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3[53180]: 2024-09-21T03:55:44.884+0000 7fdbb5fb4640 -1 osd.3 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:55:45.612 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:45 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi022 2024-09-21T03:55:45.612 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:45 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-21T03:55:45.612 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:45 smithi060 ceph-mon[33722]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:55:45.613 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:45 smithi060 ceph-mon[33722]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:55:45.613 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:45.613 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:45.613 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:45 smithi060 ceph-mon[33722]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' 2024-09-21T03:55:45.613 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:55:45.613 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:55:45.613 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:45 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi022 2024-09-21T03:55:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:45 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-21T03:55:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:45 smithi022 ceph-mon[31015]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:55:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:45 smithi022 ceph-mon[31015]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:55:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:45 smithi022 ceph-mon[31015]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' 2024-09-21T03:55:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:55:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:55:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:45.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:45 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi022 2024-09-21T03:55:45.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:45 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi022 to 8546M 2024-09-21T03:55:45.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:45 smithi073 ceph-mon[34443]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:55:45.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:45 smithi073 ceph-mon[34443]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T03:55:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:45 smithi073 ceph-mon[34443]: from='osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547]' entity='osd.3' 2024-09-21T03:55:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:55:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:55:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:46 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:55:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:46 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:55:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:46 smithi060 ceph-mon[33722]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:46 smithi060 ceph-mon[33722]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:46 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:46 smithi060 ceph-mon[33722]: osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] boot 2024-09-21T03:55:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:46 smithi060 ceph-mon[33722]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T03:55:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:46 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:46 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:55:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:46 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:55:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:46 smithi022 ceph-mon[31015]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:46 smithi022 ceph-mon[31015]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:46 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:46.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:46 smithi022 ceph-mon[31015]: osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] boot 2024-09-21T03:55:46.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:46 smithi022 ceph-mon[31015]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T03:55:46.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:46 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:46 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:55:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:46 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:55:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:46 smithi073 ceph-mon[34443]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 100 MiB used, 268 GiB / 268 GiB avail 2024-09-21T03:55:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:46 smithi073 ceph-mon[34443]: from='client.14490 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:55:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:46 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:46 smithi073 ceph-mon[34443]: osd.3 [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] boot 2024-09-21T03:55:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:46 smithi073 ceph-mon[34443]: osdmap e23: 4 total, 4 up, 4 in 2024-09-21T03:55:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:46 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T03:55:47.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:47 smithi060 ceph-mon[33722]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T03:55:47.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:47 smithi022 ceph-mon[31015]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T03:55:47.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:47 smithi073 ceph-mon[34443]: osdmap e24: 4 total, 4 up, 4 in 2024-09-21T03:55:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:48 smithi060 ceph-mon[33722]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:55:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:48 smithi060 ceph-mon[33722]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T03:55:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:48 smithi060 ceph-mon[33722]: from='client.? 172.21.15.60:0/2587341146' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa0cec75-47d4-4449-b928-fae79f9196e5"} : dispatch 2024-09-21T03:55:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:48 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa0cec75-47d4-4449-b928-fae79f9196e5"} : dispatch 2024-09-21T03:55:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:48 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa0cec75-47d4-4449-b928-fae79f9196e5"}]': finished 2024-09-21T03:55:48.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:48 smithi060 ceph-mon[33722]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T03:55:48.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:55:48.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:48 smithi060 ceph-mon[33722]: from='client.? 172.21.15.60:0/3931652990' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:55:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:48 smithi022 ceph-mon[31015]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:55:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:48 smithi022 ceph-mon[31015]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T03:55:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:48 smithi022 ceph-mon[31015]: from='client.? 172.21.15.60:0/2587341146' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa0cec75-47d4-4449-b928-fae79f9196e5"} : dispatch 2024-09-21T03:55:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:48 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa0cec75-47d4-4449-b928-fae79f9196e5"} : dispatch 2024-09-21T03:55:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:48 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa0cec75-47d4-4449-b928-fae79f9196e5"}]': finished 2024-09-21T03:55:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:48 smithi022 ceph-mon[31015]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T03:55:48.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:55:48.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:48 smithi022 ceph-mon[31015]: from='client.? 172.21.15.60:0/3931652990' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:55:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:48 smithi073 ceph-mon[34443]: pgmap v113: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:55:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:48 smithi073 ceph-mon[34443]: osdmap e25: 4 total, 4 up, 4 in 2024-09-21T03:55:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:48 smithi073 ceph-mon[34443]: from='client.? 172.21.15.60:0/2587341146' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa0cec75-47d4-4449-b928-fae79f9196e5"} : dispatch 2024-09-21T03:55:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:48 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "aa0cec75-47d4-4449-b928-fae79f9196e5"} : dispatch 2024-09-21T03:55:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:48 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aa0cec75-47d4-4449-b928-fae79f9196e5"}]': finished 2024-09-21T03:55:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:48 smithi073 ceph-mon[34443]: osdmap e26: 5 total, 4 up, 5 in 2024-09-21T03:55:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:55:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:48 smithi073 ceph-mon[34443]: from='client.? 172.21.15.60:0/3931652990' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:55:50.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:50 smithi060 ceph-mon[33722]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:55:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:50 smithi022 ceph-mon[31015]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:55:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:50 smithi073 ceph-mon[34443]: pgmap v116: 1 pgs: 1 remapped+peering; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:55:52.682 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:52 smithi060 ceph-mon[33722]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T03:55:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:52 smithi022 ceph-mon[31015]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T03:55:52.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:52 smithi073 ceph-mon[34443]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 106 KiB/s, 0 objects/s recovering 2024-09-21T03:55:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:54 smithi060 ceph-mon[33722]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T03:55:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:54 smithi022 ceph-mon[31015]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T03:55:54.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:54 smithi073 ceph-mon[34443]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-09-21T03:55:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:56 smithi060 ceph-mon[33722]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:55:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:56 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:55:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:56 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:56 smithi022 ceph-mon[31015]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:55:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:56 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:55:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:56 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:56 smithi073 ceph-mon[34443]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:55:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:56 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T03:55:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:56 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:55:57.701 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:57 smithi060 ceph-mon[33722]: Deploying daemon osd.4 on smithi060 2024-09-21T03:55:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:57 smithi022 ceph-mon[31015]: Deploying daemon osd.4 on smithi060 2024-09-21T03:55:57.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:57 smithi073 ceph-mon[34443]: Deploying daemon osd.4 on smithi060 2024-09-21T03:55:58.543 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:55:58 smithi060 ceph-mon[33722]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T03:55:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:55:58 smithi022 ceph-mon[31015]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T03:55:58.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:55:58 smithi073 ceph-mon[34443]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-09-21T03:56:00.826 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:00 smithi060 ceph-mon[33722]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T03:56:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:00 smithi022 ceph-mon[31015]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T03:56:00.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:00 smithi073 ceph-mon[34443]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-09-21T03:56:02.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:02 smithi060 ceph-mon[33722]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:56:02.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:02.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:02.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:02 smithi022 ceph-mon[31015]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:56:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:02.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:02 smithi073 ceph-mon[34443]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:56:02.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:02.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:02.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:04 smithi060 ceph-mon[33722]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:04 smithi022 ceph-mon[31015]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:04.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:04 smithi073 ceph-mon[34443]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:06.338 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:05 smithi060 ceph-mon[33722]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:06.338 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:06.339 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:06.339 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:06.339 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:06.339 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:06.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:05 smithi022 ceph-mon[31015]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:06.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:06.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:06.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:06.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:06.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:06.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:05 smithi073 ceph-mon[34443]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:06.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:06.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:06.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:06.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:06.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:06.667 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.664+0000 7f4369ffb640 1 -- 172.21.15.60:0/2331211076 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f436c063800 con 0x7f435c0b6590 2024-09-21T03:56:06.667 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 4 on host 'smithi060' 2024-09-21T03:56:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 -- 172.21.15.60:0/2331211076 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f435c0b6590 msgr2=0x7f435c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f435c0b6590 0x7f435c0b8aa0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4358009fc0 tx=0x7f4358005f90 comp rx=0 tx=0).stop 2024-09-21T03:56:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 -- 172.21.15.60:0/2331211076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f436c06c340 msgr2=0x7f436c199e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f436c06c340 0x7f436c199e80 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f436000e9f0 tx=0x7f436000eeb0 comp rx=0 tx=0).stop 2024-09-21T03:56:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 -- 172.21.15.60:0/2331211076 shutdown_connections 2024-09-21T03:56:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f435c0b6590 0x7f435c0b8aa0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:06.669 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f436c106900 0x7f436c19a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f436c1094a0 0x7f436c19b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 --2- 172.21.15.60:0/2331211076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f436c06c340 0x7f436c199e80 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 -- 172.21.15.60:0/2331211076 >> 172.21.15.60:0/2331211076 conn(0x7f436c0fdfe0 msgr2=0x7f436c104db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 -- 172.21.15.60:0/2331211076 shutdown_connections 2024-09-21T03:56:06.670 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:56:06.667+0000 7f43730cc640 1 -- 172.21.15.60:0/2331211076 wait complete. 2024-09-21T03:56:07.318 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:07.319 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:07.319 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:07.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:07.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:07.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:07.352 DEBUG:teuthology.orchestra.run.smithi060:osd.4> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.4.service 2024-09-21T03:56:07.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:07.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:07.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:07.355 INFO:tasks.cephadm:Deploying osd.5 on smithi073 with /dev/vg_nvme/lv_3... 2024-09-21T03:56:07.355 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T03:56:07.610 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:56:08.051 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:07 smithi073 ceph-mon[34443]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:08.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:07 smithi060 ceph-mon[33722]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:08.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:07 smithi022 ceph-mon[31015]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:08.876 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 03:56:08 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4[43774]: 2024-09-21T03:56:08.533+0000 7fa3cc3f9640 -1 osd.4 0 log_to_monitors true 2024-09-21T03:56:09.067 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:08 smithi073 ceph-mon[34443]: from='osd.4 [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:56:09.067 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:08 smithi073 ceph-mon[34443]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:56:09.129 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:08 smithi060 ceph-mon[33722]: from='osd.4 [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:56:09.129 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:08 smithi060 ceph-mon[33722]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:56:09.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:08 smithi022 ceph-mon[31015]: from='osd.4 [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:56:09.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:08 smithi022 ceph-mon[31015]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T03:56:10.099 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:56:10.125 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi073:vg_nvme/lv_3 2024-09-21T03:56:10.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:09 smithi022 ceph-mon[31015]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:10.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:09 smithi022 ceph-mon[31015]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:56:10.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:09 smithi022 ceph-mon[31015]: from='osd.4 [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:56:10.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:09 smithi022 ceph-mon[31015]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T03:56:10.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:09 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:10.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:09 smithi022 ceph-mon[31015]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:56:10.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:09 smithi073 ceph-mon[34443]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:10.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:09 smithi073 ceph-mon[34443]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:56:10.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:09 smithi073 ceph-mon[34443]: from='osd.4 [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:56:10.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:09 smithi073 ceph-mon[34443]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T03:56:10.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:09 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:10.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:09 smithi073 ceph-mon[34443]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:56:10.376 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 03:56:09 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4[43774]: 2024-09-21T03:56:09.976+0000 7fa3c837b640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T03:56:10.376 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 03:56:09 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4[43774]: 2024-09-21T03:56:09.983+0000 7fa3c4179640 -1 osd.4 28 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:56:10.376 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:09 smithi060 ceph-mon[33722]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:10.376 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:09 smithi060 ceph-mon[33722]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T03:56:10.377 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:09 smithi060 ceph-mon[33722]: from='osd.4 [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:56:10.377 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:09 smithi060 ceph-mon[33722]: osdmap e27: 5 total, 4 up, 5 in 2024-09-21T03:56:10.377 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:09 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:10.377 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:09 smithi060 ceph-mon[33722]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:56:10.381 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:56:10.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.857+0000 7f6658277640 1 -- 172.21.15.73:0/888288092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6650103830 msgr2=0x7f665010a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:10.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.857+0000 7f6658277640 1 --2- 172.21.15.73:0/888288092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6650103830 0x7f665010a1d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6648009ca0 tx=0x7f664802a950 comp rx=0 tx=0).stop 2024-09-21T03:56:10.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.857+0000 7f6658277640 1 -- 172.21.15.73:0/888288092 shutdown_connections 2024-09-21T03:56:10.861 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.857+0000 7f6658277640 1 --2- 172.21.15.73:0/888288092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6650103830 0x7f665010a1d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.857+0000 7f6658277640 1 --2- 172.21.15.73:0/888288092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6650102e90 0x7f66501032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.857+0000 7f6658277640 1 --2- 172.21.15.73:0/888288092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650101e00 0x7f6650102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.857+0000 7f6658277640 1 -- 172.21.15.73:0/888288092 >> 172.21.15.73:0/888288092 conn(0x7f66500fd770 msgr2=0x7f66500ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.857+0000 7f6658277640 1 -- 172.21.15.73:0/888288092 shutdown_connections 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.857+0000 7f6658277640 1 -- 172.21.15.73:0/888288092 wait complete. 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6658277640 1 Processor -- start 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6658277640 1 -- start start 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6658277640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650101e00 0x7f665010b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6658277640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6650102e90 0x7f665019ec40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6658277640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6650103830 0x7f66501a1190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6658277640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f665010e190 con 0x7f6650103830 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6658277640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f665010e010 con 0x7f6650101e00 2024-09-21T03:56:10.862 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6658277640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f665010e310 con 0x7f6650102e90 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6655812640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6650102e90 0x7f665019ec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6655812640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6650102e90 0x7f665019ec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:55354/0 (socket says 172.21.15.73:55354) 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6655812640 1 -- 172.21.15.73:0/2961802595 learned_addr learned my addr 172.21.15.73:0/2961802595 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6656013640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650101e00 0x7f665010b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6656814640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6650103830 0x7f66501a1190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6655812640 1 -- 172.21.15.73:0/2961802595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650101e00 msgr2=0x7f665010b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6655812640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650101e00 0x7f665010b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6655812640 1 -- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6650103830 msgr2=0x7f66501a1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6655812640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6650103830 0x7f66501a1190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6655812640 1 -- 172.21.15.73:0/2961802595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66501a1900 con 0x7f6650102e90 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.858+0000 7f6656814640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6650103830 0x7f66501a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.859+0000 7f6655812640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6650102e90 0x7f665019ec40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f664400c920 tx=0x7f664400cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:10.863 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.859+0000 7f664f7fe640 1 -- 172.21.15.73:0/2961802595 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644007c70 con 0x7f6650102e90 2024-09-21T03:56:10.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.859+0000 7f6658277640 1 -- 172.21.15.73:0/2961802595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66501a1bf0 con 0x7f6650102e90 2024-09-21T03:56:10.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.859+0000 7f664f7fe640 1 -- 172.21.15.73:0/2961802595 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6644007e10 con 0x7f6650102e90 2024-09-21T03:56:10.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.859+0000 7f664f7fe640 1 -- 172.21.15.73:0/2961802595 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66440186f0 con 0x7f6650102e90 2024-09-21T03:56:10.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.859+0000 7f6658277640 1 -- 172.21.15.73:0/2961802595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66501a2130 con 0x7f6650102e90 2024-09-21T03:56:10.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.860+0000 7f6658277640 1 -- 172.21.15.73:0/2961802595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6650108fe0 con 0x7f6650102e90 2024-09-21T03:56:10.864 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.862+0000 7f664f7fe640 1 -- 172.21.15.73:0/2961802595 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f664400f450 con 0x7f6650102e90 2024-09-21T03:56:10.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.863+0000 7f664f7fe640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66380b6510 0x7f66380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:10.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.863+0000 7f664f7fe640 1 -- 172.21.15.73:0/2961802595 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 3821+0+0 (secure 0 0 0) 0x7f66440e6670 con 0x7f6650102e90 2024-09-21T03:56:10.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.863+0000 7f6656013640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66380b6510 0x7f66380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:10.865 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.864+0000 7f6656013640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66380b6510 0x7f66380b8a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6640005fd0 tx=0x7f6640005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:10.868 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:10.866+0000 7f664f7fe640 1 -- 172.21.15.73:0/2961802595 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6644014030 con 0x7f6650102e90 2024-09-21T03:56:11.057 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:11.055+0000 7f6658277640 1 -- 172.21.15.73:0/2961802595 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6650063800 con 0x7f66380b6510 2024-09-21T03:56:11.057 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:56:11.057 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi060 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:11.058 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:56:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T03:56:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi060 2024-09-21T03:56:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-21T03:56:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:56:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: osdmap e28: 5 total, 4 up, 5 in 2024-09-21T03:56:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi060 2024-09-21T03:56:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:11.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi060 to 8546M 2024-09-21T03:56:11.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:11.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:11.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:11.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:11 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:56:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:11 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:56:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:11 smithi022 ceph-mon[31015]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:11 smithi022 ceph-mon[31015]: osd.4 [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] boot 2024-09-21T03:56:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:11 smithi022 ceph-mon[31015]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T03:56:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:12.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:11 smithi022 ceph-mon[31015]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:12.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:56:12.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:56:12.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:12.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:11 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:56:12.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:11 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:56:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:11 smithi073 ceph-mon[34443]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:11 smithi073 ceph-mon[34443]: osd.4 [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] boot 2024-09-21T03:56:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:11 smithi073 ceph-mon[34443]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T03:56:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:11 smithi073 ceph-mon[34443]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:56:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:56:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:12.355 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:11 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:56:12.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:11 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:56:12.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:11 smithi060 ceph-mon[33722]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 135 MiB used, 357 GiB / 358 GiB avail 2024-09-21T03:56:12.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:11 smithi060 ceph-mon[33722]: osd.4 [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] boot 2024-09-21T03:56:12.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:11 smithi060 ceph-mon[33722]: osdmap e29: 5 total, 5 up, 5 in 2024-09-21T03:56:12.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T03:56:12.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:11 smithi060 ceph-mon[33722]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:12.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:56:12.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:56:12.356 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:13.646 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:13 smithi060 ceph-mon[33722]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T03:56:13.646 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:13 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/2541425957' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a273207d-bf1d-4931-913d-e23491b84857"} : dispatch 2024-09-21T03:56:13.646 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:13 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a273207d-bf1d-4931-913d-e23491b84857"} : dispatch 2024-09-21T03:56:13.646 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:13 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a273207d-bf1d-4931-913d-e23491b84857"}]': finished 2024-09-21T03:56:13.709 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:13 smithi073 ceph-mon[34443]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T03:56:13.709 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:13 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/2541425957' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a273207d-bf1d-4931-913d-e23491b84857"} : dispatch 2024-09-21T03:56:13.709 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:13 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a273207d-bf1d-4931-913d-e23491b84857"} : dispatch 2024-09-21T03:56:13.709 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:13 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a273207d-bf1d-4931-913d-e23491b84857"}]': finished 2024-09-21T03:56:13.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:13 smithi022 ceph-mon[31015]: osdmap e30: 5 total, 5 up, 5 in 2024-09-21T03:56:13.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:13 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/2541425957' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a273207d-bf1d-4931-913d-e23491b84857"} : dispatch 2024-09-21T03:56:13.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:13 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "a273207d-bf1d-4931-913d-e23491b84857"} : dispatch 2024-09-21T03:56:13.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:13 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a273207d-bf1d-4931-913d-e23491b84857"}]': finished 2024-09-21T03:56:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:14 smithi060 ceph-mon[33722]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:14 smithi060 ceph-mon[33722]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T03:56:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:14 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/883781735' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:56:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:14 smithi022 ceph-mon[31015]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:14 smithi022 ceph-mon[31015]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T03:56:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:14 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/883781735' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:56:14.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:14 smithi073 ceph-mon[34443]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:14.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:14 smithi073 ceph-mon[34443]: osdmap e31: 6 total, 5 up, 6 in 2024-09-21T03:56:14.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:14 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/883781735' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:56:16.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:16 smithi060 ceph-mon[33722]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:16.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:16 smithi022 ceph-mon[31015]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:16.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:16 smithi073 ceph-mon[34443]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:18 smithi060 ceph-mon[33722]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:18.714 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:18 smithi073 ceph-mon[34443]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:18.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:18 smithi022 ceph-mon[31015]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:20.686 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:20 smithi073 ceph-mon[34443]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:20 smithi060 ceph-mon[33722]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:20 smithi022 ceph-mon[31015]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:22.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:22 smithi022 ceph-mon[31015]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:22.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:56:22.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:22.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:22 smithi073 ceph-mon[34443]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:22.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:56:22.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:22.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:22 smithi060 ceph-mon[33722]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:22.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T03:56:22.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:23.685 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:23 smithi073 ceph-mon[34443]: Deploying daemon osd.5 on smithi073 2024-09-21T03:56:23.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:23 smithi022 ceph-mon[31015]: Deploying daemon osd.5 on smithi073 2024-09-21T03:56:23.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:23 smithi060 ceph-mon[33722]: Deploying daemon osd.5 on smithi073 2024-09-21T03:56:24.717 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:24 smithi060 ceph-mon[33722]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:24.782 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:24 smithi073 ceph-mon[34443]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:24 smithi022 ceph-mon[31015]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:26.783 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:26 smithi073 ceph-mon[34443]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:26.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:26 smithi022 ceph-mon[31015]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:26 smithi060 ceph-mon[33722]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:28.748 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:28 smithi073 ceph-mon[34443]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:28.749 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:28.749 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:28.749 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:28 smithi022 ceph-mon[31015]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:28 smithi060 ceph-mon[33722]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:30.492 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:30 smithi073 ceph-mon[34443]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:30.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:30 smithi022 ceph-mon[31015]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:30.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:30 smithi060 ceph-mon[33722]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:31.703 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:31.704 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:31.704 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:31.704 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:31.704 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:31.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:31.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:31.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:31.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:31.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:31.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:31.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:31.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:31.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:31.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:32.014 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.012+0000 7f664f7fe640 1 -- 172.21.15.73:0/2961802595 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6650063800 con 0x7f66380b6510 2024-09-21T03:56:32.015 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 5 on host 'smithi073' 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.015+0000 7f6658277640 1 -- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66380b6510 msgr2=0x7f66380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.015+0000 7f6658277640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66380b6510 0x7f66380b8a20 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f6640005fd0 tx=0x7f6640005850 comp rx=0 tx=0).stop 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.015+0000 7f6658277640 1 -- 172.21.15.73:0/2961802595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6650102e90 msgr2=0x7f665019ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.015+0000 7f6658277640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6650102e90 0x7f665019ec40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f664400c920 tx=0x7f664400cde0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.015+0000 7f6658277640 1 -- 172.21.15.73:0/2961802595 shutdown_connections 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.015+0000 7f6658277640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66380b6510 0x7f66380b8a20 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.015+0000 7f6658277640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6650102e90 0x7f665019ec40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.015+0000 7f6658277640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6650103830 0x7f66501a1190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.015+0000 7f6658277640 1 --2- 172.21.15.73:0/2961802595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6650101e00 0x7f665010b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.016+0000 7f6658277640 1 -- 172.21.15.73:0/2961802595 >> 172.21.15.73:0/2961802595 conn(0x7f66500fd770 msgr2=0x7f66501061b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.016+0000 7f6658277640 1 -- 172.21.15.73:0/2961802595 shutdown_connections 2024-09-21T03:56:32.018 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:56:32.016+0000 7f6658277640 1 -- 172.21.15.73:0/2961802595 wait complete. 2024-09-21T03:56:32.692 DEBUG:teuthology.orchestra.run.smithi073:osd.5> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.5.service 2024-09-21T03:56:32.694 INFO:tasks.cephadm:Deploying osd.6 on smithi022 with /dev/vg_nvme/lv_2... 2024-09-21T03:56:32.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:56:32.823 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:32 smithi073 ceph-mon[34443]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:32.823 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:32.823 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:32.823 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:32 smithi022 ceph-mon[31015]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:32.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:32.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:32 smithi060 ceph-mon[33722]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:32.965 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:56:34.202 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 03:56:34 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T03:56:34.102+0000 7f7b49f9e640 -1 osd.5 0 log_to_monitors true 2024-09-21T03:56:34.811 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:34 smithi073 ceph-mon[34443]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:34.812 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:34 smithi073 ceph-mon[34443]: from='osd.5 [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:56:34.812 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:34 smithi073 ceph-mon[34443]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:56:34.834 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:34 smithi022 ceph-mon[31015]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:34.834 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:34 smithi022 ceph-mon[31015]: from='osd.5 [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:56:34.834 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:34 smithi022 ceph-mon[31015]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:56:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:34 smithi060 ceph-mon[33722]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:34 smithi060 ceph-mon[33722]: from='osd.5 [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:56:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:34 smithi060 ceph-mon[33722]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T03:56:35.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:56:35.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T03:56:35.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:35.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='osd.5 [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:56:35.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:56:35.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:35.847 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:35.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:35.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:35.848 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.850 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:56:35.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:56:35.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='osd.5 [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.883 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi022:vg_nvme/lv_2 2024-09-21T03:56:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T03:56:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: osdmap e32: 6 total, 5 up, 6 in 2024-09-21T03:56:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='osd.5 [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:56:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:56:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:35.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:56:35.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:35.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:35.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:35.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:36.141 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:56:36.354 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 03:56:36 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T03:56:36.000+0000 7f7b46735640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T03:56:36.354 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 03:56:36 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T03:56:36.006+0000 7f7b3dd16640 -1 osd.5 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:56:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.654+0000 7f9dee8b5640 1 -- 172.21.15.22:0/518489006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8102640 msgr2=0x7f9de8102ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.654+0000 7f9dee8b5640 1 --2- 172.21.15.22:0/518489006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8102640 0x7f9de8102ab0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009900 tx=0x7f9dd802a480 comp rx=0 tx=0).stop 2024-09-21T03:56:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.654+0000 7f9dee8b5640 1 -- 172.21.15.22:0/518489006 shutdown_connections 2024-09-21T03:56:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.654+0000 7f9dee8b5640 1 --2- 172.21.15.22:0/518489006 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de8104070 0x7f9de810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:36.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.654+0000 7f9dee8b5640 1 --2- 172.21.15.22:0/518489006 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de81036d0 0x7f9de8103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.654+0000 7f9dee8b5640 1 --2- 172.21.15.22:0/518489006 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8102640 0x7f9de8102ab0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.654+0000 7f9dee8b5640 1 -- 172.21.15.22:0/518489006 >> 172.21.15.22:0/518489006 conn(0x7f9de80fdfb0 msgr2=0x7f9de8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.654+0000 7f9dee8b5640 1 -- 172.21.15.22:0/518489006 shutdown_connections 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.654+0000 7f9dee8b5640 1 -- 172.21.15.22:0/518489006 wait complete. 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9dee8b5640 1 Processor -- start 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9dee8b5640 1 -- start start 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9dee8b5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8102640 0x7f9de806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9dee8b5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de81036d0 0x7f9de819ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9dee8b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de8104070 0x7f9de81a1210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9dee8b5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9de810e190 con 0x7f9de8102640 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9dee8b5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9de810e010 con 0x7f9de81036d0 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9dee8b5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9de810e310 con 0x7f9de8104070 2024-09-21T03:56:36.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9de7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8102640 0x7f9de806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9de7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8102640 0x7f9de806b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41920/0 (socket says 172.21.15.22:41920) 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9de7fff640 1 -- 172.21.15.22:0/4031168899 learned_addr learned my addr 172.21.15.22:0/4031168899 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9de77fe640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de81036d0 0x7f9de819ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9de7fff640 1 -- 172.21.15.22:0/4031168899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de8104070 msgr2=0x7f9de81a1210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9dece52640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de8104070 0x7f9de81a1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9de7fff640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de8104070 0x7f9de81a1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9de7fff640 1 -- 172.21.15.22:0/4031168899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de81036d0 msgr2=0x7f9de819ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9de7fff640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de81036d0 0x7f9de819ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.655+0000 7f9de7fff640 1 -- 172.21.15.22:0/4031168899 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9de81a1a10 con 0x7f9de8102640 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.656+0000 7f9de7fff640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8102640 0x7f9de806b6a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009230 tx=0x7f9dd80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.656+0000 7f9de57fa640 1 -- 172.21.15.22:0/4031168899 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd803f030 con 0x7f9de8102640 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.656+0000 7f9de57fa640 1 -- 172.21.15.22:0/4031168899 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9dd8003c90 con 0x7f9de8102640 2024-09-21T03:56:36.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.656+0000 7f9dee8b5640 1 -- 172.21.15.22:0/4031168899 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9de81a1ca0 con 0x7f9de8102640 2024-09-21T03:56:36.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.656+0000 7f9de57fa640 1 -- 172.21.15.22:0/4031168899 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dd8035070 con 0x7f9de8102640 2024-09-21T03:56:36.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.656+0000 7f9dee8b5640 1 -- 172.21.15.22:0/4031168899 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9de81a2180 con 0x7f9de8102640 2024-09-21T03:56:36.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.657+0000 7f9dee8b5640 1 -- 172.21.15.22:0/4031168899 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9de8109820 con 0x7f9de8102640 2024-09-21T03:56:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.659+0000 7f9de57fa640 1 -- 172.21.15.22:0/4031168899 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f9dd8042030 con 0x7f9de8102640 2024-09-21T03:56:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.659+0000 7f9de57fa640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9dd00b6510 0x7f9dd00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:56:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.660+0000 7f9de77fe640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9dd00b6510 0x7f9dd00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:56:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.660+0000 7f9de57fa640 1 -- 172.21.15.22:0/4031168899 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4566+0+0 (secure 0 0 0) 0x7f9dd8106f40 con 0x7f9de8102640 2024-09-21T03:56:36.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.660+0000 7f9de77fe640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9dd00b6510 0x7f9dd00b8a20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009890 tx=0x7f9ddc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:56:36.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.663+0000 7f9de57fa640 1 -- 172.21.15.22:0/4031168899 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9dd80ce670 con 0x7f9de8102640 2024-09-21T03:56:36.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:36 smithi022 ceph-mon[31015]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:36.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:36 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi073 2024-09-21T03:56:36.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:36 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi073 to 8544M 2024-09-21T03:56:36.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:36 smithi022 ceph-mon[31015]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:56:36.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:36 smithi022 ceph-mon[31015]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T03:56:36.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:36 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:36.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:36 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:36.856 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:36 smithi022 ceph-mon[31015]: from='osd.5 ' entity='osd.5' 2024-09-21T03:56:36.860 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:36 smithi073 ceph-mon[34443]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:36.860 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:36 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi073 2024-09-21T03:56:36.860 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:36 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi073 to 8544M 2024-09-21T03:56:36.860 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:36 smithi073 ceph-mon[34443]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:56:36.861 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:36 smithi073 ceph-mon[34443]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T03:56:36.861 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:36 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:36.861 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:36 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:36.861 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:36 smithi073 ceph-mon[34443]: from='osd.5 ' entity='osd.5' 2024-09-21T03:56:36.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:36.863+0000 7f9dee8b5640 1 -- 172.21.15.22:0/4031168899 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f9de8063800 con 0x7f9dd00b6510 2024-09-21T03:56:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:36 smithi060 ceph-mon[33722]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:36 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi073 2024-09-21T03:56:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:36 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi073 to 8544M 2024-09-21T03:56:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:36 smithi060 ceph-mon[33722]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:56:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:36 smithi060 ceph-mon[33722]: osdmap e33: 6 total, 5 up, 6 in 2024-09-21T03:56:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:36 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:36 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:36 smithi060 ceph-mon[33722]: from='osd.5 ' entity='osd.5' 2024-09-21T03:56:37.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:37 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:56:37.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:37 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:56:37.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:37 smithi022 ceph-mon[31015]: osd.5 [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] boot 2024-09-21T03:56:37.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:37 smithi022 ceph-mon[31015]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T03:56:37.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:37.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:56:37.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:56:37.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:37.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:37 smithi022 ceph-mon[31015]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T03:56:37.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:37 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:56:37.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:37 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:56:37.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:37 smithi073 ceph-mon[34443]: osd.5 [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] boot 2024-09-21T03:56:37.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:37 smithi073 ceph-mon[34443]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T03:56:37.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:37.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:56:37.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:56:37.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:37.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:37 smithi073 ceph-mon[34443]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T03:56:37.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:37 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:56:37.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:37 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:56:37.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:37 smithi060 ceph-mon[33722]: osd.5 [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] boot 2024-09-21T03:56:37.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:37 smithi060 ceph-mon[33722]: osdmap e34: 6 total, 6 up, 6 in 2024-09-21T03:56:37.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T03:56:37.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:56:37.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:56:37.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:37.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:37 smithi060 ceph-mon[33722]: osdmap e35: 6 total, 6 up, 6 in 2024-09-21T03:56:38.809 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:38 smithi022 ceph-mon[31015]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:38.810 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:38 smithi022 ceph-mon[31015]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:38.810 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:38 smithi022 ceph-mon[31015]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T03:56:38.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:38 smithi073 ceph-mon[34443]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:38.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:38 smithi073 ceph-mon[34443]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:38.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:38 smithi073 ceph-mon[34443]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T03:56:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:38 smithi060 ceph-mon[33722]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 162 MiB used, 447 GiB / 447 GiB avail 2024-09-21T03:56:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:38 smithi060 ceph-mon[33722]: from='client.14517 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:56:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:38 smithi060 ceph-mon[33722]: osdmap e36: 6 total, 6 up, 6 in 2024-09-21T03:56:39.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:39 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1481645534' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d5061cbb-19ed-4027-9249-9c46cac4cf5b"} : dispatch 2024-09-21T03:56:39.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:39 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1481645534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5061cbb-19ed-4027-9249-9c46cac4cf5b"}]': finished 2024-09-21T03:56:39.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:39 smithi022 ceph-mon[31015]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T03:56:39.843 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:39 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:56:39.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:39 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1481645534' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d5061cbb-19ed-4027-9249-9c46cac4cf5b"} : dispatch 2024-09-21T03:56:39.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:39 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1481645534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5061cbb-19ed-4027-9249-9c46cac4cf5b"}]': finished 2024-09-21T03:56:39.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:39 smithi073 ceph-mon[34443]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T03:56:39.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:39 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:56:39.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:39 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1481645534' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "d5061cbb-19ed-4027-9249-9c46cac4cf5b"} : dispatch 2024-09-21T03:56:39.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:39 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1481645534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d5061cbb-19ed-4027-9249-9c46cac4cf5b"}]': finished 2024-09-21T03:56:39.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:39 smithi060 ceph-mon[33722]: osdmap e37: 7 total, 6 up, 7 in 2024-09-21T03:56:39.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:39 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:56:40.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:40 smithi022 ceph-mon[31015]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:40.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:40 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1122920839' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:56:40.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:40 smithi073 ceph-mon[34443]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:40.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:40 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1122920839' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:56:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:40 smithi060 ceph-mon[33722]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:40 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1122920839' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:56:42.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:42 smithi022 ceph-mon[31015]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-21T03:56:42.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:42 smithi073 ceph-mon[34443]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-21T03:56:42.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:42 smithi060 ceph-mon[33722]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 135 KiB/s, 0 objects/s recovering 2024-09-21T03:56:44.834 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:44 smithi022 ceph-mon[31015]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:56:44.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:44 smithi073 ceph-mon[34443]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:56:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:44 smithi060 ceph-mon[33722]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:56:46.782 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:46 smithi022 ceph-mon[31015]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T03:56:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:46 smithi073 ceph-mon[34443]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T03:56:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:46 smithi060 ceph-mon[33722]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T03:56:47.907 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:47 smithi022 ceph-mon[31015]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T03:56:47.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:47 smithi060 ceph-mon[33722]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T03:56:48.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:47 smithi073 ceph-mon[34443]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T03:56:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:56:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:48 smithi060 ceph-mon[33722]: Deploying daemon osd.6 on smithi022 2024-09-21T03:56:49.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:56:49.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:49.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:48 smithi022 ceph-mon[31015]: Deploying daemon osd.6 on smithi022 2024-09-21T03:56:49.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.6"} : dispatch 2024-09-21T03:56:49.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:49.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:48 smithi073 ceph-mon[34443]: Deploying daemon osd.6 on smithi022 2024-09-21T03:56:49.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:49 smithi060 ceph-mon[33722]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:56:49.958 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:49 smithi022 ceph-mon[31015]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:56:50.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:49 smithi073 ceph-mon[34443]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:56:52.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:51 smithi022 ceph-mon[31015]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:56:52.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:51 smithi060 ceph-mon[33722]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:56:52.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:51 smithi073 ceph-mon[34443]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:56:54.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:53 smithi022 ceph-mon[31015]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:54.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:53 smithi060 ceph-mon[33722]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:54.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:53 smithi073 ceph-mon[34443]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:55.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:55.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:55.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:55.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:55.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:55.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:55.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:55.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:55.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:56.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:56 smithi022 ceph-mon[31015]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:56 smithi060 ceph-mon[33722]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:56 smithi073 ceph-mon[34443]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:58.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:58 smithi022 ceph-mon[31015]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:58.362 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:58 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:58.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:58 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:58.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:58 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:58.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:58 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:58.364 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:58 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:58.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.473+0000 7f9de57fa640 1 -- 172.21.15.22:0/4031168899 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9de8063800 con 0x7f9dd00b6510 2024-09-21T03:56:58.475 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 6 on host 'smithi022' 2024-09-21T03:56:58.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.476+0000 7f9dee8b5640 1 -- 172.21.15.22:0/4031168899 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9dd00b6510 msgr2=0x7f9dd00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:58.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.476+0000 7f9dee8b5640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9dd00b6510 0x7f9dd00b8a20 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc009890 tx=0x7f9ddc008040 comp rx=0 tx=0).stop 2024-09-21T03:56:58.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.476+0000 7f9dee8b5640 1 -- 172.21.15.22:0/4031168899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8102640 msgr2=0x7f9de806b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:56:58.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.476+0000 7f9dee8b5640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8102640 0x7f9de806b6a0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9dd8009230 tx=0x7f9dd80042f0 comp rx=0 tx=0).stop 2024-09-21T03:56:58.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.477+0000 7f9dee8b5640 1 -- 172.21.15.22:0/4031168899 shutdown_connections 2024-09-21T03:56:58.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.477+0000 7f9dee8b5640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9dd00b6510 0x7f9dd00b8a20 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:58.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.477+0000 7f9dee8b5640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9de8104070 0x7f9de81a1210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:58.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.477+0000 7f9dee8b5640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9de81036d0 0x7f9de819ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:58.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.477+0000 7f9dee8b5640 1 --2- 172.21.15.22:0/4031168899 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9de8102640 0x7f9de806b6a0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:56:58.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.477+0000 7f9dee8b5640 1 -- 172.21.15.22:0/4031168899 >> 172.21.15.22:0/4031168899 conn(0x7f9de80fdfb0 msgr2=0x7f9de81069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:56:58.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.477+0000 7f9dee8b5640 1 -- 172.21.15.22:0/4031168899 shutdown_connections 2024-09-21T03:56:58.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:56:58.477+0000 7f9dee8b5640 1 -- 172.21.15.22:0/4031168899 wait complete. 2024-09-21T03:56:58.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:58 smithi073 ceph-mon[34443]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:58.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:58 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:58.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:58 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:58.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:58 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:58.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:58 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:58.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:58 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:58.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:58 smithi060 ceph-mon[33722]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:56:58.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:58 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:58.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:58 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:58.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:58 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:56:58.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:58 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:56:58.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:58 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:59.457 DEBUG:teuthology.orchestra.run.smithi022:osd.6> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.6.service 2024-09-21T03:56:59.460 INFO:tasks.cephadm:Deploying osd.7 on smithi060 with /dev/vg_nvme/lv_2... 2024-09-21T03:56:59.460 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:56:59.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:59 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:59.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:59 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:59.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:56:59 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:59.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:59 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:59.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:59 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:59.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:56:59 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:59.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:59 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:56:59.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:59 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:59.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:56:59 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:56:59.726 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:57:00.765 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:00 smithi022 ceph-mon[31015]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:57:00.766 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 03:57:00 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T03:57:00.482+0000 7f0001bf8640 -1 osd.6 0 log_to_monitors true 2024-09-21T03:57:00.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:00 smithi073 ceph-mon[34443]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:57:00.873 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:00 smithi060 ceph-mon[33722]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:57:01.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:01 smithi022 ceph-mon[31015]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:57:01.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:01 smithi073 ceph-mon[34443]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:57:01.947 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:01 smithi060 ceph-mon[33722]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]} : dispatch 2024-09-21T03:57:02.243 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:57:02.270 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_2 2024-09-21T03:57:02.534 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:57:02.560 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:02 smithi060 ceph-mon[33722]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:57:02.561 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:02 smithi060 ceph-mon[33722]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:57:02.561 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:02 smithi060 ceph-mon[33722]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T03:57:02.561 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:02 smithi060 ceph-mon[33722]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:57:02.561 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:02 smithi022 ceph-mon[31015]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:57:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:02 smithi022 ceph-mon[31015]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:57:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:02 smithi022 ceph-mon[31015]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T03:57:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:02 smithi022 ceph-mon[31015]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:57:02.716 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:02.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:02 smithi073 ceph-mon[34443]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:57:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:02 smithi073 ceph-mon[34443]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-21T03:57:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:02 smithi073 ceph-mon[34443]: osdmap e38: 7 total, 6 up, 7 in 2024-09-21T03:57:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:02 smithi073 ceph-mon[34443]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd={"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:57:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:02.969 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 03:57:02 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T03:57:02.958+0000 7efffe38f640 -1 osd.6 0 waiting for initial osdmap 2024-09-21T03:57:02.970 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 03:57:02 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T03:57:02.967+0000 7efff5970640 -1 osd.6 39 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:57:03.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.998+0000 7f2bbe62d640 1 -- 172.21.15.60:0/26993412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bb81036d0 msgr2=0x7f2bb8103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:03.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.998+0000 7f2bbe62d640 1 --2- 172.21.15.60:0/26993412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bb81036d0 0x7f2bb8103ae0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f2bac009900 tx=0x7f2bac02a480 comp rx=0 tx=0).stop 2024-09-21T03:57:03.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.998+0000 7f2bbe62d640 1 -- 172.21.15.60:0/26993412 shutdown_connections 2024-09-21T03:57:03.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.998+0000 7f2bbe62d640 1 --2- 172.21.15.60:0/26993412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8104070 0x7f2bb810aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:03.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.998+0000 7f2bbe62d640 1 --2- 172.21.15.60:0/26993412 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bb81036d0 0x7f2bb8103ae0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:03.001 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.998+0000 7f2bbe62d640 1 --2- 172.21.15.60:0/26993412 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb8102640 0x7f2bb8102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:03.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.998+0000 7f2bbe62d640 1 -- 172.21.15.60:0/26993412 >> 172.21.15.60:0/26993412 conn(0x7f2bb80fdfb0 msgr2=0x7f2bb8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:03.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.998+0000 7f2bbe62d640 1 -- 172.21.15.60:0/26993412 shutdown_connections 2024-09-21T03:57:03.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.998+0000 7f2bbe62d640 1 -- 172.21.15.60:0/26993412 wait complete. 2024-09-21T03:57:03.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.999+0000 7f2bbe62d640 1 Processor -- start 2024-09-21T03:57:03.002 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.999+0000 7f2bbe62d640 1 -- start start 2024-09-21T03:57:03.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.999+0000 7f2bbe62d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb8102640 0x7f2bb806b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:03.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.999+0000 7f2bbe62d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bb81036d0 0x7f2bb819ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:03.004 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.999+0000 7f2bbe62d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8104070 0x7f2bb81a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.999+0000 7f2bbe62d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb810e120 con 0x7f2bb8104070 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.999+0000 7f2bbe62d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb810dfa0 con 0x7f2bb81036d0 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:02.999+0000 7f2bbe62d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb810e2a0 con 0x7f2bb8102640 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bb77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bb81036d0 0x7f2bb819ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bb77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bb81036d0 0x7f2bb819ec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:33994/0 (socket says 172.21.15.60:33994) 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bb77fe640 1 -- 172.21.15.60:0/2036961453 learned_addr learned my addr 172.21.15.60:0/2036961453 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bbcbca640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8104070 0x7f2bb81a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bb7fff640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb8102640 0x7f2bb806b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bbcbca640 1 -- 172.21.15.60:0/2036961453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb8102640 msgr2=0x7f2bb806b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bbcbca640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb8102640 0x7f2bb806b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:03.005 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bbcbca640 1 -- 172.21.15.60:0/2036961453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bb81036d0 msgr2=0x7f2bb819ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bbcbca640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bb81036d0 0x7f2bb819ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bbcbca640 1 -- 172.21.15.60:0/2036961453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb81989f0 con 0x7f2bb8104070 2024-09-21T03:57:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bb77fe640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bb81036d0 0x7f2bb819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:57:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bbcbca640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8104070 0x7f2bb81a1170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009fd0 tx=0x7f2bb000ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.000+0000 7f2bb57fa640 1 -- 172.21.15.60:0/2036961453 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb000ce20 con 0x7f2bb8104070 2024-09-21T03:57:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.001+0000 7f2bbe62d640 1 -- 172.21.15.60:0/2036961453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb8198ce0 con 0x7f2bb8104070 2024-09-21T03:57:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.001+0000 7f2bb57fa640 1 -- 172.21.15.60:0/2036961453 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2bb0005020 con 0x7f2bb8104070 2024-09-21T03:57:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.001+0000 7f2bb57fa640 1 -- 172.21.15.60:0/2036961453 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb0010690 con 0x7f2bb8104070 2024-09-21T03:57:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.001+0000 7f2bbe62d640 1 -- 172.21.15.60:0/2036961453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb8199220 con 0x7f2bb8104070 2024-09-21T03:57:03.006 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.002+0000 7f2bbe62d640 1 -- 172.21.15.60:0/2036961453 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb802e640 con 0x7f2bb8104070 2024-09-21T03:57:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.003+0000 7f2bb57fa640 1 -- 172.21.15.60:0/2036961453 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2bb0004a40 con 0x7f2bb8104070 2024-09-21T03:57:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.004+0000 7f2bb57fa640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2ba00b6510 0x7f2ba00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.004+0000 7f2bb57fa640 1 -- 172.21.15.60:0/2036961453 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4685+0+0 (secure 0 0 0) 0x7f2bb00e6c20 con 0x7f2bb8104070 2024-09-21T03:57:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.004+0000 7f2bb7fff640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2ba00b6510 0x7f2ba00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:03.007 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.004+0000 7f2bb7fff640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2ba00b6510 0x7f2ba00b8a20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80058c0 tx=0x7f2ba800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:03.009 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.007+0000 7f2bb57fa640 1 -- 172.21.15.60:0/2036961453 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2bb00ae240 con 0x7f2bb8104070 2024-09-21T03:57:03.209 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:03.207+0000 7f2bbe62d640 1 -- 172.21.15.60:0/2036961453 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2bb8109420 con 0x7f2ba00b6510 2024-09-21T03:57:03.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:57:03.757 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:03.758 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:03.759 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.759 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' 2024-09-21T03:57:03.759 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:57:03.759 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:57:03.759 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:03 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:03.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:57:03.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:57:03.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:57:03.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T03:57:03.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:03.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:03.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:03.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:03.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:03.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:03.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:03.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' 2024-09-21T03:57:03.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:57:03.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:57:03.806 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:03 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: osdmap e39: 7 total, 6 up, 7 in 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:03.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:03.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:03.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:03.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094]' entity='osd.6' 2024-09-21T03:57:03.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:57:03.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:57:03.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:03 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:04.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:04 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi022 2024-09-21T03:57:04.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:04 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-21T03:57:04.660 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:04 smithi060 ceph-mon[33722]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:57:04.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:04 smithi060 ceph-mon[33722]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:04.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:04.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:04 smithi060 ceph-mon[33722]: osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] boot 2024-09-21T03:57:04.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:04 smithi060 ceph-mon[33722]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T03:57:04.661 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:04 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi022 2024-09-21T03:57:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:04 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-21T03:57:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:04 smithi022 ceph-mon[31015]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:57:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:04 smithi022 ceph-mon[31015]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:04.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:04.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:04 smithi022 ceph-mon[31015]: osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] boot 2024-09-21T03:57:04.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:04 smithi022 ceph-mon[31015]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T03:57:04.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:04.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:04 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi022 2024-09-21T03:57:04.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:04 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi022 to 5697M 2024-09-21T03:57:04.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:04 smithi073 ceph-mon[34443]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 193 MiB used, 536 GiB / 536 GiB avail 2024-09-21T03:57:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:04 smithi073 ceph-mon[34443]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:04 smithi073 ceph-mon[34443]: osd.6 [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] boot 2024-09-21T03:57:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:04 smithi073 ceph-mon[34443]: osdmap e40: 7 total, 7 up, 7 in 2024-09-21T03:57:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 6} : dispatch 2024-09-21T03:57:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:06 smithi060 ceph-mon[33722]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:06 smithi060 ceph-mon[33722]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T03:57:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:06 smithi060 ceph-mon[33722]: from='client.? 172.21.15.60:0/2213624491' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3e922938-5d07-46fe-aa70-a2d9d34844d5"} : dispatch 2024-09-21T03:57:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:06 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3e922938-5d07-46fe-aa70-a2d9d34844d5"} : dispatch 2024-09-21T03:57:06.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:06 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e922938-5d07-46fe-aa70-a2d9d34844d5"}]': finished 2024-09-21T03:57:06.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:06 smithi060 ceph-mon[33722]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T03:57:06.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:06.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:06 smithi060 ceph-mon[33722]: from='client.? 172.21.15.60:0/2262484040' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:57:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:06 smithi022 ceph-mon[31015]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:06 smithi022 ceph-mon[31015]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T03:57:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:06 smithi022 ceph-mon[31015]: from='client.? 172.21.15.60:0/2213624491' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3e922938-5d07-46fe-aa70-a2d9d34844d5"} : dispatch 2024-09-21T03:57:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:06 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3e922938-5d07-46fe-aa70-a2d9d34844d5"} : dispatch 2024-09-21T03:57:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:06 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e922938-5d07-46fe-aa70-a2d9d34844d5"}]': finished 2024-09-21T03:57:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:06 smithi022 ceph-mon[31015]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T03:57:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:06 smithi022 ceph-mon[31015]: from='client.? 172.21.15.60:0/2262484040' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:57:06.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:06 smithi073 ceph-mon[34443]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:06.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:06 smithi073 ceph-mon[34443]: osdmap e41: 7 total, 7 up, 7 in 2024-09-21T03:57:06.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.60:0/2213624491' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3e922938-5d07-46fe-aa70-a2d9d34844d5"} : dispatch 2024-09-21T03:57:06.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:06 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "3e922938-5d07-46fe-aa70-a2d9d34844d5"} : dispatch 2024-09-21T03:57:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:06 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3e922938-5d07-46fe-aa70-a2d9d34844d5"}]': finished 2024-09-21T03:57:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:06 smithi073 ceph-mon[34443]: osdmap e42: 8 total, 7 up, 8 in 2024-09-21T03:57:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.60:0/2262484040' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:57:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:08 smithi022 ceph-mon[31015]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:08.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:08 smithi073 ceph-mon[34443]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:08 smithi060 ceph-mon[33722]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:10.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:10 smithi022 ceph-mon[31015]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:10.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:10 smithi073 ceph-mon[34443]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:10.948 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:10 smithi060 ceph-mon[33722]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:12.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:12 smithi060 ceph-mon[33722]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:12.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:12 smithi022 ceph-mon[31015]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:12.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:12 smithi073 ceph-mon[34443]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:14.650 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:14 smithi060 ceph-mon[33722]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:14.650 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:57:14.650 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:14 smithi022 ceph-mon[31015]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:57:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:14.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:14 smithi073 ceph-mon[34443]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:14.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.7"} : dispatch 2024-09-21T03:57:14.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:15.835 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:15 smithi060 ceph-mon[33722]: Deploying daemon osd.7 on smithi060 2024-09-21T03:57:15.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:15 smithi022 ceph-mon[31015]: Deploying daemon osd.7 on smithi060 2024-09-21T03:57:15.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:15 smithi073 ceph-mon[34443]: Deploying daemon osd.7 on smithi060 2024-09-21T03:57:16.833 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:16 smithi060 ceph-mon[33722]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:16.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:16 smithi022 ceph-mon[31015]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:16.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:16 smithi073 ceph-mon[34443]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:18.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:18 smithi022 ceph-mon[31015]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:18.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:18 smithi073 ceph-mon[34443]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:18.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:18 smithi060 ceph-mon[33722]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:20 smithi022 ceph-mon[31015]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:20.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:20 smithi073 ceph-mon[34443]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:20.951 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:20 smithi060 ceph-mon[33722]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:21.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:21.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:21.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:21.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:22.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:22 smithi022 ceph-mon[31015]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:22.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:22 smithi073 ceph-mon[34443]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:22.941 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:22 smithi060 ceph-mon[33722]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:24.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:24 smithi060 ceph-mon[33722]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:24.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:24.559 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:24.560 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:24.560 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:24.560 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:24.604 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.602+0000 7f2bb57fa640 1 -- 172.21.15.60:0/2036961453 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2bb8109420 con 0x7f2ba00b6510 2024-09-21T03:57:24.605 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 7 on host 'smithi060' 2024-09-21T03:57:24.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 -- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2ba00b6510 msgr2=0x7f2ba00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:24.607 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2ba00b6510 0x7f2ba00b8a20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ba80058c0 tx=0x7f2ba800a2d0 comp rx=0 tx=0).stop 2024-09-21T03:57:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 -- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8104070 msgr2=0x7f2bb81a1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8104070 0x7f2bb81a1170 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f2bb0009fd0 tx=0x7f2bb000ef10 comp rx=0 tx=0).stop 2024-09-21T03:57:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 -- 172.21.15.60:0/2036961453 shutdown_connections 2024-09-21T03:57:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2ba00b6510 0x7f2ba00b8a20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8104070 0x7f2bb81a1170 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2bb81036d0 0x7f2bb819ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 --2- 172.21.15.60:0/2036961453 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2bb8102640 0x7f2bb806b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 -- 172.21.15.60:0/2036961453 >> 172.21.15.60:0/2036961453 conn(0x7f2bb80fdfb0 msgr2=0x7f2bb81069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 -- 172.21.15.60:0/2036961453 shutdown_connections 2024-09-21T03:57:24.608 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:57:24.605+0000 7f2bbe62d640 1 -- 172.21.15.60:0/2036961453 wait complete. 2024-09-21T03:57:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:24 smithi022 ceph-mon[31015]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:24.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:24.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:24 smithi073 ceph-mon[34443]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:24.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:24.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:24.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:24.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:24.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:25.266 DEBUG:teuthology.orchestra.run.smithi060:osd.7> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.7.service 2024-09-21T03:57:25.269 INFO:tasks.cephadm:Deploying osd.8 on smithi073 with /dev/vg_nvme/lv_2... 2024-09-21T03:57:25.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T03:57:25.522 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:57:25.567 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:25.567 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:25.567 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:25.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:25.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:25.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:25.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:25.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:25.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:26 smithi060 ceph-mon[33722]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:26 smithi060 ceph-mon[33722]: from='osd.7 [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:57:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:26 smithi060 ceph-mon[33722]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:57:26.702 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 03:57:26 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T03:57:26.567+0000 7f5ef6d49640 -1 osd.7 0 log_to_monitors true 2024-09-21T03:57:26.886 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:26 smithi073 ceph-mon[34443]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:26.887 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:26 smithi073 ceph-mon[34443]: from='osd.7 [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:57:26.887 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:26 smithi073 ceph-mon[34443]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:57:27.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:26 smithi022 ceph-mon[31015]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:27.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:26 smithi022 ceph-mon[31015]: from='osd.7 [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372]' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:57:27.256 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:26 smithi022 ceph-mon[31015]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]} : dispatch 2024-09-21T03:57:27.888 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 03:57:27 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T03:57:27.611+0000 7f5ef2ccb640 -1 osd.7 0 waiting for initial osdmap 2024-09-21T03:57:27.889 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 03:57:27 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T03:57:27.619+0000 7f5eeeac9640 -1 osd.7 44 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:57:27.889 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:27 smithi060 ceph-mon[33722]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:57:27.889 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:27 smithi060 ceph-mon[33722]: from='osd.7 [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:57:27.889 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:27 smithi060 ceph-mon[33722]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T03:57:27.889 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:27.889 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:27 smithi060 ceph-mon[33722]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:57:27.889 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:27 smithi060 ceph-mon[33722]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:57:27.961 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:27 smithi073 ceph-mon[34443]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:57:27.962 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:27 smithi073 ceph-mon[34443]: from='osd.7 [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:57:27.962 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:27 smithi073 ceph-mon[34443]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T03:57:27.962 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:27.962 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:27 smithi073 ceph-mon[34443]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:57:27.962 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:27 smithi073 ceph-mon[34443]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:57:27.964 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:57:27.990 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi073:vg_nvme/lv_2 2024-09-21T03:57:28.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:27 smithi022 ceph-mon[31015]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-21T03:57:28.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:27 smithi022 ceph-mon[31015]: from='osd.7 [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372]' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:57:28.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:27 smithi022 ceph-mon[31015]: osdmap e43: 8 total, 7 up, 8 in 2024-09-21T03:57:28.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:28.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:27 smithi022 ceph-mon[31015]: from='osd.7 ' entity='osd.7' cmd={"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:57:28.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:27 smithi022 ceph-mon[31015]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:57:28.239 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:57:28.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.716+0000 7febb561e640 1 -- 172.21.15.73:0/3777459961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febb0101b40 msgr2=0x7febb0101f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:28.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.716+0000 7febb561e640 1 --2- 172.21.15.73:0/3777459961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febb0101b40 0x7febb0101f50 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7feba0009ca0 tx=0x7feba002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:57:28.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.716+0000 7febb561e640 1 -- 172.21.15.73:0/3777459961 shutdown_connections 2024-09-21T03:57:28.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.716+0000 7febb561e640 1 --2- 172.21.15.73:0/3777459961 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febb01094b0 0x7febb010b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:28.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.716+0000 7febb561e640 1 --2- 172.21.15.73:0/3777459961 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb0102570 0x7febb0108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:28.730 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.716+0000 7febb561e640 1 --2- 172.21.15.73:0/3777459961 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febb0101b40 0x7febb0101f50 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.716+0000 7febb561e640 1 -- 172.21.15.73:0/3777459961 >> 172.21.15.73:0/3777459961 conn(0x7febb00fd770 msgr2=0x7febb00ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.716+0000 7febb561e640 1 -- 172.21.15.73:0/3777459961 shutdown_connections 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.716+0000 7febb561e640 1 -- 172.21.15.73:0/3777459961 wait complete. 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febb561e640 1 Processor -- start 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febb561e640 1 -- start start 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febb561e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febb0101b40 0x7febb0199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febb561e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb0102570 0x7febb019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febb561e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febb01094b0 0x7febb019b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febb561e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7febb010f310 con 0x7febb0102570 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febb561e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7febb010f190 con 0x7febb01094b0 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febb561e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7febb010f490 con 0x7febb0101b40 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febaeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febb0101b40 0x7febb0199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:28.731 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febaeffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febb0101b40 0x7febb0199f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:35534/0 (socket says 172.21.15.73:35534) 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febaeffd640 1 -- 172.21.15.73:0/555658764 learned_addr learned my addr 172.21.15.73:0/555658764 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febae7fc640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb0102570 0x7febb019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.717+0000 7febaf7fe640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febb01094b0 0x7febb019b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7febaeffd640 1 -- 172.21.15.73:0/555658764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febb01094b0 msgr2=0x7febb019b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7febaeffd640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febb01094b0 0x7febb019b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7febaeffd640 1 -- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb0102570 msgr2=0x7febb019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7febaeffd640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb0102570 0x7febb019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7febaeffd640 1 -- 172.21.15.73:0/555658764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febb019b940 con 0x7febb0101b40 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7febaf7fe640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febb01094b0 0x7febb019b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7febae7fc640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb0102570 0x7febb019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7febaeffd640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febb0101b40 0x7febb0199f10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feba0009dc0 tx=0x7feba0003a70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:28.732 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7feba7fff640 1 -- 172.21.15.73:0/555658764 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0004040 con 0x7febb0101b40 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7feba7fff640 1 -- 172.21.15.73:0/555658764 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feba0004670 con 0x7febb0101b40 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7febb561e640 1 -- 172.21.15.73:0/555658764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febb019bbd0 con 0x7febb0101b40 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7feba7fff640 1 -- 172.21.15.73:0/555658764 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba0030de0 con 0x7febb0101b40 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.718+0000 7febb561e640 1 -- 172.21.15.73:0/555658764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febb01a2330 con 0x7febb0101b40 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.719+0000 7febb561e640 1 -- 172.21.15.73:0/555658764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febb0101f50 con 0x7febb0101b40 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.720+0000 7feba7fff640 1 -- 172.21.15.73:0/555658764 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7feba00305c0 con 0x7febb0101b40 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.721+0000 7feba7fff640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7feb9c0b6510 0x7feb9c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.721+0000 7feba7fff640 1 -- 172.21.15.73:0/555658764 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5430+0+0 (secure 0 0 0) 0x7feba0107df0 con 0x7febb0101b40 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.721+0000 7febae7fc640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7feb9c0b6510 0x7feb9c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.722+0000 7febae7fc640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7feb9c0b6510 0x7feb9c0b8a20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feb980058c0 tx=0x7feb98005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:28.733 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.725+0000 7feba7fff640 1 -- 172.21.15.73:0/555658764 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7feba0004820 con 0x7febb0101b40 2024-09-21T03:57:28.915 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:28.912+0000 7febb561e640 1 -- 172.21.15.73:0/555658764 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7febb0063800 con 0x7feb9c0b6510 2024-09-21T03:57:28.915 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:28.915 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T03:57:28.915 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:28.915 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:28.915 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi060 2024-09-21T03:57:28.915 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:28.915 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:28.915 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:28.916 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:28.916 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:28.916 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-21T03:57:28.916 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:28.916 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:28.916 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:28.916 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:28.916 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: osd.7 [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] boot 2024-09-21T03:57:28.916 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T03:57:28.916 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T03:57:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi060 2024-09-21T03:57:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: osd.7 [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] boot 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T03:57:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:29.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 228 MiB used, 626 GiB / 626 GiB avail 2024-09-21T03:57:29.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: osdmap e44: 8 total, 7 up, 8 in 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi060 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi060 to 5697M 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:29.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: osd.7 [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] boot 2024-09-21T03:57:29.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: osdmap e45: 8 total, 8 up, 8 in 2024-09-21T03:57:29.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 7} : dispatch 2024-09-21T03:57:29.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:29 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:57:29.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:29 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:57:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:29 smithi073 ceph-mon[34443]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:29 smithi073 ceph-mon[34443]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:57:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:57:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:29.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:29 smithi073 ceph-mon[34443]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T03:57:29.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:29 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:57:29.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:29 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:57:29.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:29 smithi060 ceph-mon[33722]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:29.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:29 smithi060 ceph-mon[33722]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:29.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:57:29.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:57:29.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:29.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:29 smithi060 ceph-mon[33722]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T03:57:30.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:29 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:57:30.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:29 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:57:30.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:29 smithi022 ceph-mon[31015]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:30.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:29 smithi022 ceph-mon[31015]: from='client.24433 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:30.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:57:30.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:57:30.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:30.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:29 smithi022 ceph-mon[31015]: osdmap e46: 8 total, 8 up, 8 in 2024-09-21T03:57:31.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:31 smithi073 ceph-mon[34443]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T03:57:31.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:31 smithi073 ceph-mon[34443]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:31.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:31 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/4045489878' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ec0cee7-24d3-4022-802c-506565544114"} : dispatch 2024-09-21T03:57:31.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:31 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ec0cee7-24d3-4022-802c-506565544114"} : dispatch 2024-09-21T03:57:31.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:31 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ec0cee7-24d3-4022-802c-506565544114"}]': finished 2024-09-21T03:57:31.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:31 smithi073 ceph-mon[34443]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T03:57:31.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:31.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:31 smithi060 ceph-mon[33722]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T03:57:31.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:31 smithi060 ceph-mon[33722]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:31.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:31 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/4045489878' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ec0cee7-24d3-4022-802c-506565544114"} : dispatch 2024-09-21T03:57:31.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:31 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ec0cee7-24d3-4022-802c-506565544114"} : dispatch 2024-09-21T03:57:31.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:31 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ec0cee7-24d3-4022-802c-506565544114"}]': finished 2024-09-21T03:57:31.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:31 smithi060 ceph-mon[33722]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T03:57:31.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:32.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:31 smithi022 ceph-mon[31015]: osdmap e47: 8 total, 8 up, 8 in 2024-09-21T03:57:32.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:31 smithi022 ceph-mon[31015]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:32.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:31 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/4045489878' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ec0cee7-24d3-4022-802c-506565544114"} : dispatch 2024-09-21T03:57:32.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:31 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "0ec0cee7-24d3-4022-802c-506565544114"} : dispatch 2024-09-21T03:57:32.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:31 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "0ec0cee7-24d3-4022-802c-506565544114"}]': finished 2024-09-21T03:57:32.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:31 smithi022 ceph-mon[31015]: osdmap e48: 9 total, 8 up, 9 in 2024-09-21T03:57:32.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:32 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/3586081071' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:57:33.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:32 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/3586081071' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:57:33.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:32 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/3586081071' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:57:33.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:33 smithi022 ceph-mon[31015]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:33.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:33 smithi060 ceph-mon[33722]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:34.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:33 smithi073 ceph-mon[34443]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 255 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:36.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:35 smithi060 ceph-mon[33722]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:57:36.216 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:35 smithi073 ceph-mon[34443]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:57:36.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:35 smithi022 ceph-mon[31015]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:57:38.078 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:37 smithi073 ceph-mon[34443]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T03:57:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:37 smithi060 ceph-mon[33722]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T03:57:38.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:37 smithi022 ceph-mon[31015]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-21T03:57:40.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:39 smithi060 ceph-mon[33722]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T03:57:40.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:39 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:57:40.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:39 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:40.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:39 smithi060 ceph-mon[33722]: Deploying daemon osd.8 on smithi073 2024-09-21T03:57:40.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:39 smithi073 ceph-mon[34443]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T03:57:40.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:39 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:57:40.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:39 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:40.222 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:39 smithi073 ceph-mon[34443]: Deploying daemon osd.8 on smithi073 2024-09-21T03:57:40.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:39 smithi022 ceph-mon[31015]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-21T03:57:40.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:39 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.8"} : dispatch 2024-09-21T03:57:40.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:39 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:40.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:39 smithi022 ceph-mon[31015]: Deploying daemon osd.8 on smithi073 2024-09-21T03:57:42.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:41 smithi060 ceph-mon[33722]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:57:42.259 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:41 smithi073 ceph-mon[34443]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:57:42.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:41 smithi022 ceph-mon[31015]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-21T03:57:44.194 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:43 smithi073 ceph-mon[34443]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T03:57:44.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:43 smithi060 ceph-mon[33722]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T03:57:44.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:43 smithi022 ceph-mon[31015]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-21T03:57:46.201 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:45 smithi060 ceph-mon[33722]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:57:46.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:46.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:46.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:46.256 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:45 smithi073 ceph-mon[34443]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:57:46.256 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:46.256 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:46.256 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:46.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:45 smithi022 ceph-mon[31015]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:57:46.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:46.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:46.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:47.994 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:47 smithi073 ceph-mon[34443]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:48.201 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:47 smithi060 ceph-mon[33722]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:48.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:47 smithi022 ceph-mon[31015]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:49.129 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.126+0000 7feba7fff640 1 -- 172.21.15.73:0/555658764 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7febb0063800 con 0x7feb9c0b6510 2024-09-21T03:57:49.129 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 8 on host 'smithi073' 2024-09-21T03:57:49.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 -- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7feb9c0b6510 msgr2=0x7feb9c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:49.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7feb9c0b6510 0x7feb9c0b8a20 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7feb980058c0 tx=0x7feb98005850 comp rx=0 tx=0).stop 2024-09-21T03:57:49.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 -- 172.21.15.73:0/555658764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febb0101b40 msgr2=0x7febb0199f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:49.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febb0101b40 0x7febb0199f10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7feba0009dc0 tx=0x7feba0003a70 comp rx=0 tx=0).stop 2024-09-21T03:57:49.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 -- 172.21.15.73:0/555658764 shutdown_connections 2024-09-21T03:57:49.131 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7feb9c0b6510 0x7feb9c0b8a20 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7febb01094b0 0x7febb019b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febb0102570 0x7febb019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 --2- 172.21.15.73:0/555658764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7febb0101b40 0x7febb0199f10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 -- 172.21.15.73:0/555658764 >> 172.21.15.73:0/555658764 conn(0x7febb00fd770 msgr2=0x7febb0107710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 -- 172.21.15.73:0/555658764 shutdown_connections 2024-09-21T03:57:49.132 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:57:49.129+0000 7febb561e640 1 -- 172.21.15.73:0/555658764 wait complete. 2024-09-21T03:57:49.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:49.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:49.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:49.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:49 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.745 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.746 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.746 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:49.746 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:49.746 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.746 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:49.746 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.746 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:49 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.771 DEBUG:teuthology.orchestra.run.smithi073:osd.8> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.8.service 2024-09-21T03:57:49.774 INFO:tasks.cephadm:Deploying osd.9 on smithi022 with /dev/vg_nvme/lv_1... 2024-09-21T03:57:49.774 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:57:49.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:49.804 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:49.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:57:49.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:49.805 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:49 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:50.047 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:50.444 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:50 smithi022 ceph-mon[31015]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:50.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:50 smithi060 ceph-mon[33722]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:50 smithi073 ceph-mon[34443]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:52.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 03:57:51 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T03:57:51.772+0000 7f92a9537640 -1 osd.8 0 log_to_monitors true 2024-09-21T03:57:52.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:52 smithi060 ceph-mon[33722]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:52.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:52 smithi060 ceph-mon[33722]: from='osd.8 [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:57:52.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:52 smithi060 ceph-mon[33722]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:57:52.819 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:52 smithi073 ceph-mon[34443]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:52.819 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:52 smithi073 ceph-mon[34443]: from='osd.8 [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:57:52.819 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:52 smithi073 ceph-mon[34443]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:57:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:52 smithi022 ceph-mon[31015]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:52 smithi022 ceph-mon[31015]: from='osd.8 [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718]' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:57:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:52 smithi022 ceph-mon[31015]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]} : dispatch 2024-09-21T03:57:52.915 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:57:52.944 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi022:vg_nvme/lv_1 2024-09-21T03:57:53.243 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:57:53.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:57:53.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T03:57:53.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:53.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='osd.8 [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:57:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:57:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:53.652 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:57:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T03:57:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='osd.8 [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:57:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:57:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:53.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 -- 172.21.15.22:0/3045486530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec109490 msgr2=0x7f47ec10b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:53.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 --2- 172.21.15.22:0/3045486530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec109490 0x7f47ec10b9a0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f47e4009900 tx=0x7f47e402a410 comp rx=0 tx=0).stop 2024-09-21T03:57:53.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 -- 172.21.15.22:0/3045486530 shutdown_connections 2024-09-21T03:57:53.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 --2- 172.21.15.22:0/3045486530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ec1068f0 0x7f47ec108d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:53.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 --2- 172.21.15.22:0/3045486530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec109490 0x7f47ec10b9a0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:53.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 --2- 172.21.15.22:0/3045486530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec06c6a0 0x7f47ec1063b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 -- 172.21.15.22:0/3045486530 >> 172.21.15.22:0/3045486530 conn(0x7f47ec0fdfd0 msgr2=0x7f47ec100480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 -- 172.21.15.22:0/3045486530 shutdown_connections 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 -- 172.21.15.22:0/3045486530 wait complete. 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 Processor -- start 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.745+0000 7f47f3a32640 1 -- start start 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f3a32640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec06c6a0 0x7f47ec1039e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f3a32640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ec1068f0 0x7f47ec1022b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f3a32640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec109490 0x7f47ec1027f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f3a32640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec10f240 con 0x7f47ec109490 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f3a32640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec10f0c0 con 0x7f47ec06c6a0 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f3a32640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f47ec10f3c0 con 0x7f47ec1068f0 2024-09-21T03:57:53.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f1fcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec109490 0x7f47ec1027f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f1fcf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec109490 0x7f47ec1027f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37028/0 (socket says 172.21.15.22:37028) 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f1fcf640 1 -- 172.21.15.22:0/874463703 learned_addr learned my addr 172.21.15.22:0/874463703 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f17ce640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec06c6a0 0x7f47ec1039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f0fcd640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ec1068f0 0x7f47ec1022b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f1fcf640 1 -- 172.21.15.22:0/874463703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ec1068f0 msgr2=0x7f47ec1022b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f1fcf640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ec1068f0 0x7f47ec1022b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f1fcf640 1 -- 172.21.15.22:0/874463703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec06c6a0 msgr2=0x7f47ec1039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f1fcf640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec06c6a0 0x7f47ec1039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f1fcf640 1 -- 172.21.15.22:0/874463703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47ec102ef0 con 0x7f47ec109490 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f17ce640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec06c6a0 0x7f47ec1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.746+0000 7f47f1fcf640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec109490 0x7f47ec1027f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47e4031460 tx=0x7f47e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.747+0000 7f47e27fc640 1 -- 172.21.15.22:0/874463703 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e403f030 con 0x7f47ec109490 2024-09-21T03:57:53.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.747+0000 7f47e27fc640 1 -- 172.21.15.22:0/874463703 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47e4003c90 con 0x7f47ec109490 2024-09-21T03:57:53.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.747+0000 7f47e27fc640 1 -- 172.21.15.22:0/874463703 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47e4035070 con 0x7f47ec109490 2024-09-21T03:57:53.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.747+0000 7f47f3a32640 1 -- 172.21.15.22:0/874463703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47ec1a3f80 con 0x7f47ec109490 2024-09-21T03:57:53.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.747+0000 7f47f3a32640 1 -- 172.21.15.22:0/874463703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47ec1a4320 con 0x7f47ec109490 2024-09-21T03:57:53.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.748+0000 7f47f3a32640 1 -- 172.21.15.22:0/874463703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47ec0ffaf0 con 0x7f47ec109490 2024-09-21T03:57:53.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.749+0000 7f47e27fc640 1 -- 172.21.15.22:0/874463703 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f47e4042030 con 0x7f47ec109490 2024-09-21T03:57:53.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.750+0000 7f47e27fc640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47d80b6510 0x7f47d80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:57:53.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.750+0000 7f47f17ce640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47d80b6510 0x7f47d80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:57:53.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.750+0000 7f47e27fc640 1 -- 172.21.15.22:0/874463703 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5549+0+0 (secure 0 0 0) 0x7f47e4107210 con 0x7f47ec109490 2024-09-21T03:57:53.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.751+0000 7f47f17ce640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47d80b6510 0x7f47d80b8a20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f47e8005fd0 tx=0x7f47e8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:57:53.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.754+0000 7f47e27fc640 1 -- 172.21.15.22:0/874463703 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47e40d2950 con 0x7f47ec109490 2024-09-21T03:57:53.807 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T03:57:53.430+0000 7f92a54b9640 -1 osd.8 0 waiting for initial osdmap 2024-09-21T03:57:53.807 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T03:57:53.440+0000 7f92a12b7640 -1 osd.8 50 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:57:53.807 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-21T03:57:53.807 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: osdmap e49: 9 total, 8 up, 9 in 2024-09-21T03:57:53.807 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:53.807 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='osd.8 [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718]' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:57:53.808 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='osd.8 ' entity='osd.8' cmd={"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:57:53.808 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.808 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.808 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:53.808 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:53.808 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:57:53.808 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.808 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:53.808 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:57:53.808 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:57:53.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:57:53.953+0000 7f47f3a32640 1 -- 172.21.15.22:0/874463703 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f47ec063800 con 0x7f47d80b6510 2024-09-21T03:57:54.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:54 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi073 2024-09-21T03:57:54.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:54 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi073 to 5696M 2024-09-21T03:57:54.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:54 smithi022 ceph-mon[31015]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:54.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:54 smithi022 ceph-mon[31015]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:57:54.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:54 smithi022 ceph-mon[31015]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T03:57:54.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:54.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:54.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:57:54.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:57:54.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:54 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi073 2024-09-21T03:57:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:54 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi073 to 5696M 2024-09-21T03:57:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:54 smithi060 ceph-mon[33722]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:54 smithi060 ceph-mon[33722]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:57:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:54 smithi060 ceph-mon[33722]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T03:57:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:57:54.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:57:54.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:54 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi073 2024-09-21T03:57:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:54 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi073 to 5696M 2024-09-21T03:57:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:54 smithi073 ceph-mon[34443]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 256 MiB used, 715 GiB / 715 GiB avail 2024-09-21T03:57:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:54 smithi073 ceph-mon[34443]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:57:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:54 smithi073 ceph-mon[34443]: osdmap e50: 9 total, 8 up, 9 in 2024-09-21T03:57:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:57:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:57:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:57:55.672 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:55 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:57:55.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:55 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:57:55.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:55 smithi022 ceph-mon[31015]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:55.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:55 smithi022 ceph-mon[31015]: osd.8 [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] boot 2024-09-21T03:57:55.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:55 smithi022 ceph-mon[31015]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T03:57:55.673 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:55.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:55 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:57:55.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:55 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:57:55.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:55 smithi060 ceph-mon[33722]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:55.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:55 smithi060 ceph-mon[33722]: osd.8 [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] boot 2024-09-21T03:57:55.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:55 smithi060 ceph-mon[33722]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T03:57:55.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:55.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:55 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:57:55.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:55 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:57:55.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:55 smithi073 ceph-mon[34443]: from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi022:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:57:55.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:55 smithi073 ceph-mon[34443]: osd.8 [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] boot 2024-09-21T03:57:55.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:55 smithi073 ceph-mon[34443]: osdmap e51: 9 total, 9 up, 9 in 2024-09-21T03:57:55.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 8} : dispatch 2024-09-21T03:57:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:56 smithi060 ceph-mon[33722]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:57:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:56 smithi060 ceph-mon[33722]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T03:57:56.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:56 smithi022 ceph-mon[31015]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:57:56.727 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:56 smithi022 ceph-mon[31015]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T03:57:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:56 smithi073 ceph-mon[34443]: pgmap v204: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:57:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:56 smithi073 ceph-mon[34443]: osdmap e52: 9 total, 9 up, 9 in 2024-09-21T03:57:57.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:57 smithi060 ceph-mon[33722]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T03:57:57.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:57 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1976739010' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "968b9387-432d-43fc-a2e7-76257b93cc83"} : dispatch 2024-09-21T03:57:57.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:57 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1976739010' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "968b9387-432d-43fc-a2e7-76257b93cc83"}]': finished 2024-09-21T03:57:57.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:57 smithi060 ceph-mon[33722]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T03:57:57.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:57:57.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:57 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2928994694' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:57:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:57 smithi022 ceph-mon[31015]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T03:57:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:57 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1976739010' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "968b9387-432d-43fc-a2e7-76257b93cc83"} : dispatch 2024-09-21T03:57:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:57 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1976739010' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "968b9387-432d-43fc-a2e7-76257b93cc83"}]': finished 2024-09-21T03:57:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:57 smithi022 ceph-mon[31015]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T03:57:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:57:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:57 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2928994694' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:57:57.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:57 smithi073 ceph-mon[34443]: osdmap e53: 9 total, 9 up, 9 in 2024-09-21T03:57:57.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:57 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1976739010' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "968b9387-432d-43fc-a2e7-76257b93cc83"} : dispatch 2024-09-21T03:57:57.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:57 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1976739010' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "968b9387-432d-43fc-a2e7-76257b93cc83"}]': finished 2024-09-21T03:57:57.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:57 smithi073 ceph-mon[34443]: osdmap e54: 10 total, 9 up, 10 in 2024-09-21T03:57:57.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:57:57.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:57 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2928994694' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:57:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:57:58 smithi022 ceph-mon[31015]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:57:58.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:57:58 smithi073 ceph-mon[34443]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:57:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:57:58 smithi060 ceph-mon[33722]: pgmap v208: 1 pgs: 1 peering; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:00 smithi022 ceph-mon[31015]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-21T03:58:00.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:00 smithi073 ceph-mon[34443]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-21T03:58:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:00 smithi060 ceph-mon[33722]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-09-21T03:58:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:02 smithi022 ceph-mon[31015]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:58:02.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:02 smithi073 ceph-mon[34443]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:58:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:02 smithi060 ceph-mon[33722]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T03:58:04.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:04 smithi022 ceph-mon[31015]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T03:58:04.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:04 smithi073 ceph-mon[34443]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T03:58:04.951 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:04 smithi060 ceph-mon[33722]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-21T03:58:05.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:58:05.828 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:05.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:58:05.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:05.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.9"} : dispatch 2024-09-21T03:58:05.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:06.844 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:06 smithi022 ceph-mon[31015]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T03:58:06.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:06 smithi022 ceph-mon[31015]: Deploying daemon osd.9 on smithi022 2024-09-21T03:58:06.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:06 smithi073 ceph-mon[34443]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T03:58:06.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:06 smithi073 ceph-mon[34443]: Deploying daemon osd.9 on smithi022 2024-09-21T03:58:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:06 smithi060 ceph-mon[33722]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-21T03:58:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:06 smithi060 ceph-mon[33722]: Deploying daemon osd.9 on smithi022 2024-09-21T03:58:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:08 smithi022 ceph-mon[31015]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T03:58:08.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:08 smithi073 ceph-mon[34443]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T03:58:08.951 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:08 smithi060 ceph-mon[33722]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T03:58:10.745 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:10 smithi022 ceph-mon[31015]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:58:10.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:10 smithi073 ceph-mon[34443]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:58:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:10 smithi060 ceph-mon[33722]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T03:58:12.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:12 smithi022 ceph-mon[31015]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:12.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:12 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:12.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:12 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:12.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:12 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:12.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:12 smithi060 ceph-mon[33722]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:12.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:12 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:12 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:12.755 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:12 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:12.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:12 smithi073 ceph-mon[34443]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:12.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:12 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:12.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:12 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:12.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:12 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:14 smithi022 ceph-mon[31015]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:14.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:14 smithi073 ceph-mon[34443]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:14.951 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:14 smithi060 ceph-mon[33722]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:15.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.309+0000 7f47e27fc640 1 -- 172.21.15.22:0/874463703 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f47ec063800 con 0x7f47d80b6510 2024-09-21T03:58:15.312 INFO:teuthology.orchestra.run.smithi022.stdout:Created osd(s) 9 on host 'smithi022' 2024-09-21T03:58:15.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 -- 172.21.15.22:0/874463703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47d80b6510 msgr2=0x7f47d80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:15.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47d80b6510 0x7f47d80b8a20 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f47e8005fd0 tx=0x7f47e8009500 comp rx=0 tx=0).stop 2024-09-21T03:58:15.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 -- 172.21.15.22:0/874463703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec109490 msgr2=0x7f47ec1027f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:15.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec109490 0x7f47ec1027f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f47e4031460 tx=0x7f47e40042f0 comp rx=0 tx=0).stop 2024-09-21T03:58:15.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 -- 172.21.15.22:0/874463703 shutdown_connections 2024-09-21T03:58:15.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47d80b6510 0x7f47d80b8a20 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:15.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47ec1068f0 0x7f47ec1022b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:15.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47ec109490 0x7f47ec1027f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:15.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 --2- 172.21.15.22:0/874463703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47ec06c6a0 0x7f47ec1039e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:15.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 -- 172.21.15.22:0/874463703 >> 172.21.15.22:0/874463703 conn(0x7f47ec0fdfd0 msgr2=0x7f47ec104ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:15.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 -- 172.21.15.22:0/874463703 shutdown_connections 2024-09-21T03:58:15.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:58:15.311+0000 7f47f3a32640 1 -- 172.21.15.22:0/874463703 wait complete. 2024-09-21T03:58:15.942 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:15 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:15.942 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:15 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:15.942 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:15 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:15.942 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:15 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:15.942 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:15 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:15.943 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:15 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:15.943 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:15 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:15.943 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:15 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:15.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:15.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:15.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:15.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:15.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:15.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:15.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:15.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:15 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:15.969 DEBUG:teuthology.orchestra.run.smithi022:osd.9> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.9.service 2024-09-21T03:58:15.971 INFO:tasks.cephadm:Deploying osd.10 on smithi060 with /dev/vg_nvme/lv_1... 2024-09-21T03:58:15.972 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:58:16.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:15 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:16.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:15 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:16.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:15 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:16.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:15 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:16.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:15 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:16.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:15 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:16.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:15 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:16.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:15 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:16.239 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:58:16.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:16 smithi060 ceph-mon[33722]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:17.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:16 smithi022 ceph-mon[31015]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:17.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:16 smithi073 ceph-mon[34443]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:17.850 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 03:58:17 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T03:58:17.684+0000 7f38755f4640 -1 osd.9 0 log_to_monitors true 2024-09-21T03:58:18.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:18 smithi022 ceph-mon[31015]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:18.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:18 smithi022 ceph-mon[31015]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:58:18.924 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:18 smithi060 ceph-mon[33722]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:18.924 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:18 smithi060 ceph-mon[33722]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:58:18.927 INFO:teuthology.orchestra.run.smithi060.stdout: 2024-09-21T03:58:18.956 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi060:vg_nvme/lv_1 2024-09-21T03:58:19.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:18 smithi073 ceph-mon[34443]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:19.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:18 smithi073 ceph-mon[34443]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]} : dispatch 2024-09-21T03:58:19.209 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T03:58:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.673+0000 7f9a37945640 1 -- 172.21.15.60:0/1199967754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a30102650 msgr2=0x7f9a30102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.673+0000 7f9a37945640 1 --2- 172.21.15.60:0/1199967754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a30102650 0x7f9a30102ac0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009900 tx=0x7f9a2c02a480 comp rx=0 tx=0).stop 2024-09-21T03:58:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.673+0000 7f9a37945640 1 -- 172.21.15.60:0/1199967754 shutdown_connections 2024-09-21T03:58:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.673+0000 7f9a37945640 1 --2- 172.21.15.60:0/1199967754 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a30104080 0x7f9a3010aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.673+0000 7f9a37945640 1 --2- 172.21.15.60:0/1199967754 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a301036e0 0x7f9a30103af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.673+0000 7f9a37945640 1 --2- 172.21.15.60:0/1199967754 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a30102650 0x7f9a30102ac0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:19.677 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.673+0000 7f9a37945640 1 -- 172.21.15.60:0/1199967754 >> 172.21.15.60:0/1199967754 conn(0x7f9a300fdfe0 msgr2=0x7f9a30100470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.673+0000 7f9a37945640 1 -- 172.21.15.60:0/1199967754 shutdown_connections 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.673+0000 7f9a37945640 1 -- 172.21.15.60:0/1199967754 wait complete. 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a37945640 1 Processor -- start 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a37945640 1 -- start start 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a37945640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a30102650 0x7f9a3010cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a37945640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a301036e0 0x7f9a3010b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a37945640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a30104080 0x7f9a3010bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a37945640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3010f270 con 0x7f9a301036e0 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a37945640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3010f0f0 con 0x7f9a30102650 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a37945640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3010f3f0 con 0x7f9a30104080 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a356e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a30102650 0x7f9a3010cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a356e1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a30102650 0x7f9a3010cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.60:50892/0 (socket says 172.21.15.60:50892) 2024-09-21T03:58:19.678 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a356e1640 1 -- 172.21.15.60:0/2352746841 learned_addr learned my addr 172.21.15.60:0/2352746841 (peer_addr_for_me v2:172.21.15.60:0/0) 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a34ee0640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a301036e0 0x7f9a3010b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a35ee2640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a30104080 0x7f9a3010bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a356e1640 1 -- 172.21.15.60:0/2352746841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a30104080 msgr2=0x7f9a3010bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a356e1640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a30104080 0x7f9a3010bba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a356e1640 1 -- 172.21.15.60:0/2352746841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a301036e0 msgr2=0x7f9a3010b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a356e1640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a301036e0 0x7f9a3010b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.674+0000 7f9a356e1640 1 -- 172.21.15.60:0/2352746841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3010c2a0 con 0x7f9a30102650 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.675+0000 7f9a356e1640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a30102650 0x7f9a3010cd90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009230 tx=0x7f9a2c005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.675+0000 7f9a267fc640 1 -- 172.21.15.60:0/2352746841 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c03f030 con 0x7f9a30102650 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.675+0000 7f9a267fc640 1 -- 172.21.15.60:0/2352746841 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a2c0043d0 con 0x7f9a30102650 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.675+0000 7f9a37945640 1 -- 172.21.15.60:0/2352746841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a301a3f70 con 0x7f9a30102650 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.675+0000 7f9a267fc640 1 -- 172.21.15.60:0/2352746841 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a2c035070 con 0x7f9a30102650 2024-09-21T03:58:19.679 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.675+0000 7f9a37945640 1 -- 172.21.15.60:0/2352746841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a301a4310 con 0x7f9a30102650 2024-09-21T03:58:19.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.676+0000 7f9a37945640 1 -- 172.21.15.60:0/2352746841 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a30109830 con 0x7f9a30102650 2024-09-21T03:58:19.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.677+0000 7f9a267fc640 1 -- 172.21.15.60:0/2352746841 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f9a2c042030 con 0x7f9a30102650 2024-09-21T03:58:19.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.678+0000 7f9a267fc640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a1c0b6510 0x7f9a1c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:19.680 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.678+0000 7f9a267fc640 1 -- 172.21.15.60:0/2352746841 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5981+0+0 (secure 0 0 0) 0x7f9a2c107390 con 0x7f9a30102650 2024-09-21T03:58:19.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.678+0000 7f9a34ee0640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a1c0b6510 0x7f9a1c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:19.681 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.679+0000 7f9a34ee0640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a1c0b6510 0x7f9a1c0b8a20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009bd0 tx=0x7f9a20005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:19.683 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.681+0000 7f9a267fc640 1 -- 172.21.15.60:0/2352746841 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a2c0ce4a0 con 0x7f9a30102650 2024-09-21T03:58:19.882 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:19.879+0000 7f9a37945640 1 -- 172.21.15.60:0/2352746841 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9a30063800 con 0x7f9a1c0b6510 2024-09-21T03:58:19.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:58:19.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T03:58:19.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:58:19.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:19.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:19.882 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi022 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:19.883 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:20.099 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T03:58:19.632+0000 7f3871576640 -1 osd.9 0 waiting for initial osdmap 2024-09-21T03:58:20.099 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T03:58:19.645+0000 7f386d374640 -1 osd.9 56 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:58:20.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:58:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T03:58:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:58:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi022 2024-09-21T03:58:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:20.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:20.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:20.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-21T03:58:20.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:20.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:20.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:20.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:20.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-21T03:58:20.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: osdmap e55: 10 total, 9 up, 10 in 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd={"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]} : dispatch 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 283 MiB used, 804 GiB / 805 GiB avail 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi022 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi022 to 4273M 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:20.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:20.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:20 smithi060 ceph-mon[33722]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:58:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:20 smithi060 ceph-mon[33722]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T03:58:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:20 smithi060 ceph-mon[33722]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:58:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:58:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:21.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:20 smithi022 ceph-mon[31015]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:58:21.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:20 smithi022 ceph-mon[31015]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T03:58:21.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:21.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:21.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:20 smithi022 ceph-mon[31015]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:21.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:58:21.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:58:21.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:21.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:20 smithi073 ceph-mon[34443]: from='osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi022", "root=default"]}]': finished 2024-09-21T03:58:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:20 smithi073 ceph-mon[34443]: osdmap e56: 10 total, 9 up, 10 in 2024-09-21T03:58:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:20 smithi073 ceph-mon[34443]: from='client.24485 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi060:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:58:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:58:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:21.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:21 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:58:21.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:21 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:58:21.798 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:21 smithi060 ceph-mon[33722]: osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] boot 2024-09-21T03:58:21.799 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:21 smithi060 ceph-mon[33722]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T03:58:21.799 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:21.799 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:21 smithi060 ceph-mon[33722]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:22.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:21 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:58:22.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:21 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:58:22.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:21 smithi022 ceph-mon[31015]: osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] boot 2024-09-21T03:58:22.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:21 smithi022 ceph-mon[31015]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T03:58:22.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:22.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:21 smithi022 ceph-mon[31015]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:22.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:21 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:58:22.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:21 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:58:22.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:21 smithi073 ceph-mon[34443]: osd.9 [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] boot 2024-09-21T03:58:22.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:21 smithi073 ceph-mon[34443]: osdmap e57: 10 total, 10 up, 10 in 2024-09-21T03:58:22.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 9} : dispatch 2024-09-21T03:58:22.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:21 smithi073 ceph-mon[34443]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:22.943 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:22 smithi060 ceph-mon[33722]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T03:58:22.943 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:22 smithi060 ceph-mon[33722]: from='client.? 172.21.15.60:0/564314748' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7c321ad-f83a-4d51-a4dc-65dfe62b59e2"} : dispatch 2024-09-21T03:58:22.943 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:22 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7c321ad-f83a-4d51-a4dc-65dfe62b59e2"} : dispatch 2024-09-21T03:58:22.943 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:22 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7c321ad-f83a-4d51-a4dc-65dfe62b59e2"}]': finished 2024-09-21T03:58:22.943 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:22 smithi060 ceph-mon[33722]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T03:58:22.943 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:23.000 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:22 smithi022 ceph-mon[31015]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T03:58:23.001 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:22 smithi022 ceph-mon[31015]: from='client.? 172.21.15.60:0/564314748' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7c321ad-f83a-4d51-a4dc-65dfe62b59e2"} : dispatch 2024-09-21T03:58:23.001 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:22 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7c321ad-f83a-4d51-a4dc-65dfe62b59e2"} : dispatch 2024-09-21T03:58:23.001 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:22 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7c321ad-f83a-4d51-a4dc-65dfe62b59e2"}]': finished 2024-09-21T03:58:23.001 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:22 smithi022 ceph-mon[31015]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T03:58:23.001 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:23.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:22 smithi073 ceph-mon[34443]: osdmap e58: 10 total, 10 up, 10 in 2024-09-21T03:58:23.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:22 smithi073 ceph-mon[34443]: from='client.? 172.21.15.60:0/564314748' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7c321ad-f83a-4d51-a4dc-65dfe62b59e2"} : dispatch 2024-09-21T03:58:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:22 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "b7c321ad-f83a-4d51-a4dc-65dfe62b59e2"} : dispatch 2024-09-21T03:58:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:22 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b7c321ad-f83a-4d51-a4dc-65dfe62b59e2"}]': finished 2024-09-21T03:58:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:22 smithi073 ceph-mon[34443]: osdmap e59: 11 total, 10 up, 11 in 2024-09-21T03:58:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:23.946 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:23 smithi073 ceph-mon[34443]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:23.946 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:23 smithi073 ceph-mon[34443]: from='client.? 172.21.15.60:0/916202653' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:58:23.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:23 smithi060 ceph-mon[33722]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:23.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:23 smithi060 ceph-mon[33722]: from='client.? 172.21.15.60:0/916202653' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:58:24.013 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:23 smithi022 ceph-mon[31015]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:24.013 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:23 smithi022 ceph-mon[31015]: from='client.? 172.21.15.60:0/916202653' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:58:26.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:25 smithi060 ceph-mon[33722]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:26.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:25 smithi022 ceph-mon[31015]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:26.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:25 smithi073 ceph-mon[34443]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 310 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:28.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:27 smithi060 ceph-mon[33722]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:28.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:27 smithi022 ceph-mon[31015]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:28.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:27 smithi073 ceph-mon[34443]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:30.146 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:29 smithi060 ceph-mon[33722]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:30.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:29 smithi022 ceph-mon[31015]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:30.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:29 smithi073 ceph-mon[34443]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:32.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:31 smithi060 ceph-mon[33722]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:32.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:58:32.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:32.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:31 smithi060 ceph-mon[33722]: Deploying daemon osd.10 on smithi060 2024-09-21T03:58:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:31 smithi022 ceph-mon[31015]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:58:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:31 smithi022 ceph-mon[31015]: Deploying daemon osd.10 on smithi060 2024-09-21T03:58:32.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:31 smithi073 ceph-mon[34443]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:32.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.10"} : dispatch 2024-09-21T03:58:32.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:32.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:31 smithi073 ceph-mon[34443]: Deploying daemon osd.10 on smithi060 2024-09-21T03:58:34.187 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:33 smithi060 ceph-mon[33722]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:34.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:33 smithi022 ceph-mon[31015]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:34.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:33 smithi073 ceph-mon[34443]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:36.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:35 smithi060 ceph-mon[33722]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:36.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:35 smithi022 ceph-mon[31015]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:36.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:35 smithi073 ceph-mon[34443]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:37 smithi060 ceph-mon[33722]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:38.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:37 smithi022 ceph-mon[31015]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:38.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:38.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:38.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:38.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:37 smithi073 ceph-mon[34443]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:38.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:38.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:38.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:40.064 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:39 smithi060 ceph-mon[33722]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:40.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:39 smithi022 ceph-mon[31015]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:40.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:39 smithi073 ceph-mon[34443]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:40.513 INFO:teuthology.orchestra.run.smithi060.stdout:Created osd(s) 10 on host 'smithi060' 2024-09-21T03:58:40.514 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.511+0000 7f9a267fc640 1 -- 172.21.15.60:0/2352746841 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9a30063800 con 0x7f9a1c0b6510 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.513+0000 7f9a37945640 1 -- 172.21.15.60:0/2352746841 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a1c0b6510 msgr2=0x7f9a1c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.513+0000 7f9a37945640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a1c0b6510 0x7f9a1c0b8a20 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9a20009bd0 tx=0x7f9a20005f90 comp rx=0 tx=0).stop 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.513+0000 7f9a37945640 1 -- 172.21.15.60:0/2352746841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a30102650 msgr2=0x7f9a3010cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.513+0000 7f9a37945640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a30102650 0x7f9a3010cd90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9a2c009230 tx=0x7f9a2c005e80 comp rx=0 tx=0).stop 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.514+0000 7f9a37945640 1 -- 172.21.15.60:0/2352746841 shutdown_connections 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.514+0000 7f9a37945640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a1c0b6510 0x7f9a1c0b8a20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.514+0000 7f9a37945640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a30104080 0x7f9a3010bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.514+0000 7f9a37945640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a301036e0 0x7f9a3010b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.514+0000 7f9a37945640 1 --2- 172.21.15.60:0/2352746841 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a30102650 0x7f9a3010cd90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.514+0000 7f9a37945640 1 -- 172.21.15.60:0/2352746841 >> 172.21.15.60:0/2352746841 conn(0x7f9a300fdfe0 msgr2=0x7f9a30106a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:40.516 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.514+0000 7f9a37945640 1 -- 172.21.15.60:0/2352746841 shutdown_connections 2024-09-21T03:58:40.517 INFO:teuthology.orchestra.run.smithi060.stderr:2024-09-21T03:58:40.514+0000 7f9a37945640 1 -- 172.21.15.60:0/2352746841 wait complete. 2024-09-21T03:58:41.173 DEBUG:teuthology.orchestra.run.smithi060:osd.10> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.10.service 2024-09-21T03:58:41.175 INFO:tasks.cephadm:Deploying osd.11 on smithi073 with /dev/vg_nvme/lv_1... 2024-09-21T03:58:41.176 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- lvm zap /dev/vg_nvme/lv_1 2024-09-21T03:58:41.435 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:58:41.760 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:41 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.760 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:41 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.760 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:41 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.760 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:41 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.762 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:41 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.762 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:41 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.762 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:41 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.762 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:41 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:41 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:41 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:41 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:41.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:41 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:42.735 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:42 smithi073 ceph-mon[34443]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:42.765 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:42 smithi060 ceph-mon[33722]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:42.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:42 smithi022 ceph-mon[31015]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:43.452 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 03:58:43 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T03:58:43.152+0000 7fb1567da640 -1 osd.10 0 log_to_monitors true 2024-09-21T03:58:43.813 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:43 smithi073 ceph-mon[34443]: from='osd.10 [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:58:43.813 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:43 smithi073 ceph-mon[34443]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:58:43.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:43 smithi022 ceph-mon[31015]: from='osd.10 [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:58:43.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:43 smithi022 ceph-mon[31015]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:58:43.855 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:43 smithi060 ceph-mon[33722]: from='osd.10 [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274]' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:58:43.855 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:43 smithi060 ceph-mon[33722]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]} : dispatch 2024-09-21T03:58:44.205 INFO:teuthology.orchestra.run.smithi073.stdout: 2024-09-21T03:58:44.230 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch daemon add osd smithi073:vg_nvme/lv_1 2024-09-21T03:58:44.479 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:58:44.784 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T03:58:44.534+0000 7fb15275c640 -1 osd.10 0 waiting for initial osdmap 2024-09-21T03:58:44.784 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T03:58:44.554+0000 7fb14e55a640 -1 osd.10 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:58:44.784 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: from='osd.10 [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.785 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:44 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.798 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:44.798 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:58:44.798 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T03:58:44.798 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:44.799 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: from='osd.10 [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:58:44.799 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:58:44.799 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:44.799 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:44.799 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.799 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.799 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.799 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:44 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:44.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-21T03:58:44.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: osdmap e60: 11 total, 10 up, 11 in 2024-09-21T03:58:44.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:44.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: from='osd.10 [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274]' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:58:44.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: from='osd.10 ' entity='osd.10' cmd={"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]} : dispatch 2024-09-21T03:58:44.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:44.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:44.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:44 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T03:58:44.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 -- 172.21.15.73:0/1016038073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f959410b6f0 msgr2=0x7f959410db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:44.981 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 --2- 172.21.15.73:0/1016038073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f959410b6f0 0x7f959410db90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f958c009ca0 tx=0x7f958c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:58:44.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 -- 172.21.15.73:0/1016038073 shutdown_connections 2024-09-21T03:58:44.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 --2- 172.21.15.73:0/1016038073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f959410b6f0 0x7f959410db90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:44.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 --2- 172.21.15.73:0/1016038073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9594075cf0 0x7f9594076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:44.982 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 --2- 172.21.15.73:0/1016038073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f95940770e0 0x7f95940757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 -- 172.21.15.73:0/1016038073 >> 172.21.15.73:0/1016038073 conn(0x7f95940ff0c0 msgr2=0x7f9594101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 -- 172.21.15.73:0/1016038073 shutdown_connections 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 -- 172.21.15.73:0/1016038073 wait complete. 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 Processor -- start 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.972+0000 7f95988f7640 1 -- start start 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f95988f7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9594075cf0 0x7f959419c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f95988f7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940770e0 0x7f959419c700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f95988f7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f959410b6f0 0x7f959419d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f95988f7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9594111470 con 0x7f9594075cf0 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f95988f7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f95941112f0 con 0x7f959410b6f0 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f95988f7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f95941115f0 con 0x7f95940770e0 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940770e0 0x7f959419c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:44.983 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940770e0 0x7f959419c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:46596/0 (socket says 172.21.15.73:46596) 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958bfff640 1 -- 172.21.15.73:0/3626491075 learned_addr learned my addr 172.21.15.73:0/3626491075 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f9592d9d640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f959410b6f0 0x7f959419d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f959259c640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9594075cf0 0x7f959419c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958bfff640 1 -- 172.21.15.73:0/3626491075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f959410b6f0 msgr2=0x7f959419d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958bfff640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f959410b6f0 0x7f959419d2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958bfff640 1 -- 172.21.15.73:0/3626491075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9594075cf0 msgr2=0x7f959419c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958bfff640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9594075cf0 0x7f959419c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958bfff640 1 -- 172.21.15.73:0/3626491075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f959419dac0 con 0x7f95940770e0 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958bfff640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940770e0 0x7f959419c700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f957c00d950 tx=0x7f957c00de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958b7fe640 1 -- 172.21.15.73:0/3626491075 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c017030 con 0x7f95940770e0 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f95988f7640 1 -- 172.21.15.73:0/3626491075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f959419ddb0 con 0x7f95940770e0 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958b7fe640 1 -- 172.21.15.73:0/3626491075 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f957c004020 con 0x7f95940770e0 2024-09-21T03:58:44.984 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.973+0000 7f958b7fe640 1 -- 172.21.15.73:0/3626491075 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c0055d0 con 0x7f95940770e0 2024-09-21T03:58:44.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.974+0000 7f95988f7640 1 -- 172.21.15.73:0/3626491075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95941a44b0 con 0x7f95940770e0 2024-09-21T03:58:44.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.974+0000 7f95988f7640 1 -- 172.21.15.73:0/3626491075 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95941a4680 con 0x7f95940770e0 2024-09-21T03:58:44.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.976+0000 7f958b7fe640 1 -- 172.21.15.73:0/3626491075 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f957c009a30 con 0x7f95940770e0 2024-09-21T03:58:44.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.977+0000 7f958b7fe640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f95800b6510 0x7f95800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:58:44.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.977+0000 7f958b7fe640 1 -- 172.21.15.73:0/3626491075 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 6414+0+0 (secure 0 0 0) 0x7f957c0e6b90 con 0x7f95940770e0 2024-09-21T03:58:44.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.977+0000 7f959259c640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f95800b6510 0x7f95800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:58:44.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.978+0000 7f959259c640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f95800b6510 0x7f95800b8a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9584009b50 tx=0x7f9584005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:58:44.985 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:44.981+0000 7f958b7fe640 1 -- 172.21.15.73:0/3626491075 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f957c0adb90 con 0x7f95940770e0 2024-09-21T03:58:45.172 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:58:45.169+0000 7f95988f7640 1 -- 172.21.15.73:0/3626491075 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f95940ffc50 con 0x7f95800b6510 2024-09-21T03:58:45.788 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi060 2024-09-21T03:58:45.788 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-21T03:58:45.788 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:45.788 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:58:45.788 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T03:58:45.788 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:45.788 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:45.789 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:45.789 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:45.789 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:45.789 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:45.789 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:45.789 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:45.789 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:45.789 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:58:45.789 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:58:45.789 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:45.793 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi060 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:45.794 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:45.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:58:45.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:58:45.795 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi060 2024-09-21T03:58:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi060 to 4273M 2024-09-21T03:58:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi060", "root=default"]}]': finished 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: osdmap e61: 11 total, 10 up, 11 in 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:58:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd tree", "states": ["destroyed"], "format": "json"} : dispatch 2024-09-21T03:58:45.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.bootstrap-osd"} : dispatch 2024-09-21T03:58:45.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:46 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:58:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:46 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:58:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:46 smithi022 ceph-mon[31015]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:46 smithi022 ceph-mon[31015]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:46 smithi022 ceph-mon[31015]: osd.10 [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] boot 2024-09-21T03:58:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:46 smithi022 ceph-mon[31015]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T03:58:46.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:46 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:46 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:58:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:46 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:58:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:46 smithi073 ceph-mon[34443]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:46 smithi073 ceph-mon[34443]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:46 smithi073 ceph-mon[34443]: osd.10 [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] boot 2024-09-21T03:58:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:46 smithi073 ceph-mon[34443]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T03:58:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:46 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:46 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:58:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:46 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:58:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:46 smithi060 ceph-mon[33722]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 311 MiB used, 894 GiB / 894 GiB avail 2024-09-21T03:58:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:46 smithi060 ceph-mon[33722]: from='client.24505 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi073:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:58:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:46 smithi060 ceph-mon[33722]: osd.10 [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] boot 2024-09-21T03:58:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:46 smithi060 ceph-mon[33722]: osdmap e62: 11 total, 11 up, 11 in 2024-09-21T03:58:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:46 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 10} : dispatch 2024-09-21T03:58:47.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:47 smithi022 ceph-mon[31015]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T03:58:47.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:47 smithi073 ceph-mon[34443]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T03:58:47.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:47 smithi060 ceph-mon[33722]: osdmap e63: 11 total, 11 up, 11 in 2024-09-21T03:58:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:48 smithi022 ceph-mon[31015]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:58:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:48 smithi022 ceph-mon[31015]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T03:58:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:48 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/1081033819' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c83d7da-b854-47cb-8768-48f57bd3ef85"} : dispatch 2024-09-21T03:58:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:48 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c83d7da-b854-47cb-8768-48f57bd3ef85"} : dispatch 2024-09-21T03:58:48.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:48 smithi022 ceph-mon[31015]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c83d7da-b854-47cb-8768-48f57bd3ef85"}]': finished 2024-09-21T03:58:48.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:48 smithi022 ceph-mon[31015]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T03:58:48.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:58:48.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:48 smithi022 ceph-mon[31015]: from='client.? 172.21.15.73:0/3725697539' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:58:48.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:48 smithi073 ceph-mon[34443]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:58:48.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:48 smithi073 ceph-mon[34443]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T03:58:48.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:48 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/1081033819' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c83d7da-b854-47cb-8768-48f57bd3ef85"} : dispatch 2024-09-21T03:58:48.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:48 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c83d7da-b854-47cb-8768-48f57bd3ef85"} : dispatch 2024-09-21T03:58:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:48 smithi073 ceph-mon[34443]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c83d7da-b854-47cb-8768-48f57bd3ef85"}]': finished 2024-09-21T03:58:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:48 smithi073 ceph-mon[34443]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T03:58:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:58:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:48 smithi073 ceph-mon[34443]: from='client.? 172.21.15.73:0/3725697539' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:58:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:48 smithi060 ceph-mon[33722]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:58:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:48 smithi060 ceph-mon[33722]: osdmap e64: 11 total, 11 up, 11 in 2024-09-21T03:58:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:48 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/1081033819' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c83d7da-b854-47cb-8768-48f57bd3ef85"} : dispatch 2024-09-21T03:58:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:48 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd={"prefix": "osd new", "uuid": "2c83d7da-b854-47cb-8768-48f57bd3ef85"} : dispatch 2024-09-21T03:58:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:48 smithi060 ceph-mon[33722]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2c83d7da-b854-47cb-8768-48f57bd3ef85"}]': finished 2024-09-21T03:58:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:48 smithi060 ceph-mon[33722]: osdmap e65: 12 total, 11 up, 12 in 2024-09-21T03:58:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:58:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:48 smithi060 ceph-mon[33722]: from='client.? 172.21.15.73:0/3725697539' entity='client.bootstrap-osd' cmd={"prefix": "mon getmap"} : dispatch 2024-09-21T03:58:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:50 smithi022 ceph-mon[31015]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T03:58:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:50 smithi073 ceph-mon[34443]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T03:58:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:50 smithi060 ceph-mon[33722]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-09-21T03:58:52.834 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:52 smithi073 ceph-mon[34443]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T03:58:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:52 smithi022 ceph-mon[31015]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T03:58:52.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:52 smithi060 ceph-mon[33722]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 108 KiB/s, 0 objects/s recovering 2024-09-21T03:58:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:54 smithi022 ceph-mon[31015]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T03:58:54.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:54 smithi073 ceph-mon[34443]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T03:58:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:54 smithi060 ceph-mon[33722]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 91 KiB/s, 0 objects/s recovering 2024-09-21T03:58:56.815 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:56 smithi073 ceph-mon[34443]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:58:56.815 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:56 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:58:56.815 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:56 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:56 smithi022 ceph-mon[31015]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:58:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:56 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:58:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:56 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:56 smithi060 ceph-mon[33722]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-21T03:58:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:56 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "osd.11"} : dispatch 2024-09-21T03:58:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:56 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:58:57.715 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:57 smithi073 ceph-mon[34443]: Deploying daemon osd.11 on smithi073 2024-09-21T03:58:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:57 smithi022 ceph-mon[31015]: Deploying daemon osd.11 on smithi073 2024-09-21T03:58:57.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:57 smithi060 ceph-mon[33722]: Deploying daemon osd.11 on smithi073 2024-09-21T03:58:58.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:58:58 smithi073 ceph-mon[34443]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T03:58:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:58:58 smithi022 ceph-mon[31015]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T03:58:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:58:58 smithi060 ceph-mon[33722]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-21T03:59:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:00 smithi022 ceph-mon[31015]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:59:00.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:00 smithi073 ceph-mon[34443]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:59:00.951 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:00 smithi060 ceph-mon[33722]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-21T03:59:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:02 smithi022 ceph-mon[31015]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:02.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:02.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:02.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:02.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:02 smithi073 ceph-mon[34443]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:02 smithi060 ceph-mon[33722]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:04 smithi022 ceph-mon[31015]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:04.852 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:04 smithi073 ceph-mon[34443]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:04 smithi060 ceph-mon[33722]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:05.936 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.934+0000 7f958b7fe640 1 -- 172.21.15.73:0/3626491075 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f95940ffc50 con 0x7f95800b6510 2024-09-21T03:59:05.936 INFO:teuthology.orchestra.run.smithi073.stdout:Created osd(s) 11 on host 'smithi073' 2024-09-21T03:59:05.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 -- 172.21.15.73:0/3626491075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f95800b6510 msgr2=0x7f95800b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:05.938 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f95800b6510 0x7f95800b8a20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f9584009b50 tx=0x7f9584005f90 comp rx=0 tx=0).stop 2024-09-21T03:59:05.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 -- 172.21.15.73:0/3626491075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940770e0 msgr2=0x7f959419c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:05.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940770e0 0x7f959419c700 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f957c00d950 tx=0x7f957c00de10 comp rx=0 tx=0).stop 2024-09-21T03:59:05.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 -- 172.21.15.73:0/3626491075 shutdown_connections 2024-09-21T03:59:05.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f95800b6510 0x7f95800b8a20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:05.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f95940770e0 0x7f959419c700 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:05.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f959410b6f0 0x7f959419d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:05.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 --2- 172.21.15.73:0/3626491075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9594075cf0 0x7f959419c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:05.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 -- 172.21.15.73:0/3626491075 >> 172.21.15.73:0/3626491075 conn(0x7f95940ff0c0 msgr2=0x7f95940ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:05.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.936+0000 7f95988f7640 1 -- 172.21.15.73:0/3626491075 shutdown_connections 2024-09-21T03:59:05.939 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:05.937+0000 7f95988f7640 1 -- 172.21.15.73:0/3626491075 wait complete. 2024-09-21T03:59:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:06 smithi060 ceph-mon[33722]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.569 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:06 smithi073 ceph-mon[34443]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:06.570 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.570 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.570 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:06.570 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:06.570 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.570 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:06.570 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.570 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.597 DEBUG:teuthology.orchestra.run.smithi073:osd.11> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.11.service 2024-09-21T03:59:06.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:06 smithi022 ceph-mon[31015]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:06.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:06.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:06.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:06.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:06.603 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-21T03:59:06.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:59:06.871 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:07.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.370+0000 7f4edcd36640 1 -- 172.21.15.22:0/1454800996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ed81068d0 msgr2=0x7f4ed8108d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:07.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.370+0000 7f4edcd36640 1 --2- 172.21.15.22:0/1454800996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ed81068d0 0x7f4ed8108d30 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009900 tx=0x7f4ecc02a410 comp rx=0 tx=0).stop 2024-09-21T03:59:07.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.370+0000 7f4edcd36640 1 -- 172.21.15.22:0/1454800996 shutdown_connections 2024-09-21T03:59:07.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.370+0000 7f4edcd36640 1 --2- 172.21.15.22:0/1454800996 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed8109470 0x7f4ed810b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:07.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.370+0000 7f4edcd36640 1 --2- 172.21.15.22:0/1454800996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ed81068d0 0x7f4ed8108d30 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:07.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.370+0000 7f4edcd36640 1 --2- 172.21.15.22:0/1454800996 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ed806b980 0x7f4ed8106390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:07.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.370+0000 7f4edcd36640 1 -- 172.21.15.22:0/1454800996 >> 172.21.15.22:0/1454800996 conn(0x7f4ed80fdfb0 msgr2=0x7f4ed8100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:07.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.370+0000 7f4edcd36640 1 -- 172.21.15.22:0/1454800996 shutdown_connections 2024-09-21T03:59:07.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.370+0000 7f4edcd36640 1 -- 172.21.15.22:0/1454800996 wait complete. 2024-09-21T03:59:07.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4edcd36640 1 Processor -- start 2024-09-21T03:59:07.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4edcd36640 1 -- start start 2024-09-21T03:59:07.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4edcd36640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ed806b980 0x7f4ed8199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:07.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4edcd36640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ed81068d0 0x7f4ed819a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:07.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4edcd36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed8109470 0x7f4ed819b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:07.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4edcd36640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed810f230 con 0x7f4ed81068d0 2024-09-21T03:59:07.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4edcd36640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed810f0b0 con 0x7f4ed8109470 2024-09-21T03:59:07.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4edcd36640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4ed810f3b0 con 0x7f4ed806b980 2024-09-21T03:59:07.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4ed5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ed81068d0 0x7f4ed819a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:07.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4ed5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ed81068d0 0x7f4ed819a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37334/0 (socket says 172.21.15.22:37334) 2024-09-21T03:59:07.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4ed5d9b640 1 -- 172.21.15.22:0/3771372188 learned_addr learned my addr 172.21.15.22:0/3771372188 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:07.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4ed659c640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ed806b980 0x7f4ed8199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:07.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.371+0000 7f4ed6d9d640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed8109470 0x7f4ed819b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:07.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4ed5d9b640 1 -- 172.21.15.22:0/3771372188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ed806b980 msgr2=0x7f4ed8199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:07.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4ed5d9b640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ed806b980 0x7f4ed8199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:07.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4ed5d9b640 1 -- 172.21.15.22:0/3771372188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed8109470 msgr2=0x7f4ed819b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:07.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4ed5d9b640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed8109470 0x7f4ed819b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:07.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4ed5d9b640 1 -- 172.21.15.22:0/3771372188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ed819b980 con 0x7f4ed81068d0 2024-09-21T03:59:07.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4ed6d9d640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed8109470 0x7f4ed819b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:59:07.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4ed5d9b640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ed81068d0 0x7f4ed819a5c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009230 tx=0x7f4ecc005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:07.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4ec77fe640 1 -- 172.21.15.22:0/3771372188 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc03f030 con 0x7f4ed81068d0 2024-09-21T03:59:07.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4ec77fe640 1 -- 172.21.15.22:0/3771372188 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ecc0043d0 con 0x7f4ed81068d0 2024-09-21T03:59:07.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4edcd36640 1 -- 172.21.15.22:0/3771372188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ed819bc10 con 0x7f4ed81068d0 2024-09-21T03:59:07.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4ec77fe640 1 -- 172.21.15.22:0/3771372188 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ecc035070 con 0x7f4ed81068d0 2024-09-21T03:59:07.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.372+0000 7f4edcd36640 1 -- 172.21.15.22:0/3771372188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ed81a21a0 con 0x7f4ed81068d0 2024-09-21T03:59:07.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.373+0000 7f4edcd36640 1 -- 172.21.15.22:0/3771372188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ed80ffad0 con 0x7f4ed81068d0 2024-09-21T03:59:07.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.376+0000 7f4ec77fe640 1 -- 172.21.15.22:0/3771372188 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4ecc042030 con 0x7f4ed81068d0 2024-09-21T03:59:07.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.376+0000 7f4ec77fe640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4ec00b6510 0x7f4ec00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:07.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.377+0000 7f4ed659c640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4ec00b6510 0x7f4ec00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:07.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.377+0000 7f4ec77fe640 1 -- 172.21.15.22:0/3771372188 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 6809+0+0 (secure 0 0 0) 0x7f4ecc107580 con 0x7f4ed81068d0 2024-09-21T03:59:07.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.377+0000 7f4ed659c640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4ec00b6510 0x7f4ec00b8a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8005fd0 tx=0x7f4ec8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:07.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.379+0000 7f4ec77fe640 1 -- 172.21.15.22:0/3771372188 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ecc0d27d0 con 0x7f4ed81068d0 2024-09-21T03:59:07.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.569+0000 7f4edcd36640 1 -- 172.21.15.22:0/3771372188 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f4ed802e810 con 0x7f4ed81068d0 2024-09-21T03:59:07.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.569+0000 7f4ec77fe640 1 -- 172.21.15.22:0/3771372188 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v65) ==== 74+0+133 (secure 0 0 0) 0x7f4ecc0d7710 con 0x7f4ed81068d0 2024-09-21T03:59:07.572 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:07.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 -- 172.21.15.22:0/3771372188 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4ec00b6510 msgr2=0x7f4ec00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:07.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4ec00b6510 0x7f4ec00b8a20 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ec8005fd0 tx=0x7f4ec8009500 comp rx=0 tx=0).stop 2024-09-21T03:59:07.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 -- 172.21.15.22:0/3771372188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ed81068d0 msgr2=0x7f4ed819a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:07.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ed81068d0 0x7f4ed819a5c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f4ecc009230 tx=0x7f4ecc005e80 comp rx=0 tx=0).stop 2024-09-21T03:59:07.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 -- 172.21.15.22:0/3771372188 shutdown_connections 2024-09-21T03:59:07.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4ec00b6510 0x7f4ec00b8a20 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:07.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4ed8109470 0x7f4ed819b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:07.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4ed81068d0 0x7f4ed819a5c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:07.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 --2- 172.21.15.22:0/3771372188 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4ed806b980 0x7f4ed8199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:07.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 -- 172.21.15.22:0/3771372188 >> 172.21.15.22:0/3771372188 conn(0x7f4ed80fdfb0 msgr2=0x7f4ed8104f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:07.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 -- 172.21.15.22:0/3771372188 shutdown_connections 2024-09-21T03:59:07.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:07.572+0000 7f4edcd36640 1 -- 172.21.15.22:0/3771372188 wait complete. 2024-09-21T03:59:08.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:08 smithi022 ceph-mon[31015]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:08.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:08 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3771372188' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:59:08.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:08 smithi022 ceph-mon[31015]: from='osd.11 [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:59:08.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:08 smithi022 ceph-mon[31015]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:59:08.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:08 smithi073 ceph-mon[34443]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:08.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:08 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3771372188' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:59:08.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:08 smithi073 ceph-mon[34443]: from='osd.11 [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:59:08.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:08 smithi073 ceph-mon[34443]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:59:08.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 03:59:08 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T03:59:08.097+0000 7f7f9a2cd640 -1 osd.11 0 log_to_monitors true 2024-09-21T03:59:08.370 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":65,"num_osds":12,"num_up_osds":11,"osd_up_since":1726891125,"num_in_osds":12,"osd_in_since":1726891127,"num_remapped_pgs":0} 2024-09-21T03:59:08.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:08 smithi060 ceph-mon[33722]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:08.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:08 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3771372188' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:59:08.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:08 smithi060 ceph-mon[33722]: from='osd.11 [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038]' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:59:08.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:08 smithi060 ceph-mon[33722]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]} : dispatch 2024-09-21T03:59:09.370 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:59:09.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:09 smithi060 ceph-mon[33722]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:59:09.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:09 smithi060 ceph-mon[33722]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T03:59:09.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:09 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:09.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:09 smithi060 ceph-mon[33722]: from='osd.11 [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:59:09.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:09 smithi060 ceph-mon[33722]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:59:09.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:09 smithi022 ceph-mon[31015]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:59:09.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:09 smithi022 ceph-mon[31015]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T03:59:09.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:09 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:09.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:09 smithi022 ceph-mon[31015]: from='osd.11 [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:59:09.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:09 smithi022 ceph-mon[31015]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:59:09.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:09 smithi073 ceph-mon[34443]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-21T03:59:09.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:09 smithi073 ceph-mon[34443]: osdmap e66: 12 total, 11 up, 12 in 2024-09-21T03:59:09.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:09 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:09.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:09 smithi073 ceph-mon[34443]: from='osd.11 [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038]' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:59:09.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:09 smithi073 ceph-mon[34443]: from='osd.11 ' entity='osd.11' cmd={"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]} : dispatch 2024-09-21T03:59:09.644 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:10.104 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 03:59:09 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T03:59:09.647+0000 7f7f9624f640 -1 osd.11 0 waiting for initial osdmap 2024-09-21T03:59:10.104 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 03:59:09 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T03:59:09.659+0000 7f7f8e045640 -1 osd.11 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T03:59:10.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.144+0000 7fd64e0f9640 1 -- 172.21.15.22:0/2361159765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd648104070 msgr2=0x7fd64810aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:10.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.144+0000 7fd64e0f9640 1 --2- 172.21.15.22:0/2361159765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd648104070 0x7fd64810aa10 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd640009ca0 tx=0x7fd64002a950 comp rx=0 tx=0).stop 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.144+0000 7fd64e0f9640 1 -- 172.21.15.22:0/2361159765 shutdown_connections 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.144+0000 7fd64e0f9640 1 --2- 172.21.15.22:0/2361159765 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6481036d0 0x7fd648103ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.144+0000 7fd64e0f9640 1 --2- 172.21.15.22:0/2361159765 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd648104070 0x7fd64810aa10 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.144+0000 7fd64e0f9640 1 --2- 172.21.15.22:0/2361159765 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648102640 0x7fd648102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.144+0000 7fd64e0f9640 1 -- 172.21.15.22:0/2361159765 >> 172.21.15.22:0/2361159765 conn(0x7fd6480fdfb0 msgr2=0x7fd648100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.144+0000 7fd64e0f9640 1 -- 172.21.15.22:0/2361159765 shutdown_connections 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.144+0000 7fd64e0f9640 1 -- 172.21.15.22:0/2361159765 wait complete. 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd64e0f9640 1 Processor -- start 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd64e0f9640 1 -- start start 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd64e0f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648102640 0x7fd648199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd64e0f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6481036d0 0x7fd64819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd64e0f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd648104070 0x7fd64819b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:10.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd64e0f9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd64810e120 con 0x7fd648104070 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd64e0f9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd64810dfa0 con 0x7fd648102640 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd64e0f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd64810e2a0 con 0x7fd6481036d0 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd647fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd648104070 0x7fd64819b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd647fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd648104070 0x7fd64819b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37352/0 (socket says 172.21.15.22:37352) 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd647fff640 1 -- 172.21.15.22:0/3120598704 learned_addr learned my addr 172.21.15.22:0/3120598704 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd646ffd640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6481036d0 0x7fd64819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.145+0000 7fd6477fe640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648102640 0x7fd648199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd647fff640 1 -- 172.21.15.22:0/3120598704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6481036d0 msgr2=0x7fd64819a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd647fff640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6481036d0 0x7fd64819a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd647fff640 1 -- 172.21.15.22:0/3120598704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648102640 msgr2=0x7fd648199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd647fff640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648102640 0x7fd648199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd647fff640 1 -- 172.21.15.22:0/3120598704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64819b8a0 con 0x7fd648104070 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd646ffd640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6481036d0 0x7fd64819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd647fff640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd648104070 0x7fd64819b080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd64002ae70 tx=0x7fd640003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd644ff9640 1 -- 172.21.15.22:0/3120598704 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd640034040 con 0x7fd648104070 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd644ff9640 1 -- 172.21.15.22:0/3120598704 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd640030850 con 0x7fd648104070 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd64e0f9640 1 -- 172.21.15.22:0/3120598704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd64819bb30 con 0x7fd648104070 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd644ff9640 1 -- 172.21.15.22:0/3120598704 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6400046f0 con 0x7fd648104070 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.146+0000 7fd64e0f9640 1 -- 172.21.15.22:0/3120598704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6481a2290 con 0x7fd648104070 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.147+0000 7fd64e0f9640 1 -- 172.21.15.22:0/3120598704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd648102ab0 con 0x7fd648104070 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.149+0000 7fd644ff9640 1 -- 172.21.15.22:0/3120598704 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd640037020 con 0x7fd648104070 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.150+0000 7fd644ff9640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6300b6590 0x7fd6300b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.150+0000 7fd6477fe640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6300b6590 0x7fd6300b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:10.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.150+0000 7fd644ff9640 1 -- 172.21.15.22:0/3120598704 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 6847+0+0 (secure 0 0 0) 0x7fd640107d40 con 0x7fd648104070 2024-09-21T03:59:10.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.150+0000 7fd6477fe640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6300b6590 0x7fd6300b8aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd638005d00 tx=0x7fd63800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:10.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.154+0000 7fd644ff9640 1 -- 172.21.15.22:0/3120598704 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd640083710 con 0x7fd648104070 2024-09-21T03:59:10.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.342+0000 7fd64e0f9640 1 -- 172.21.15.22:0/3120598704 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd6481a2970 con 0x7fd648104070 2024-09-21T03:59:10.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:10.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='osd.11 ' entity='osd.11' 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:10.346 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:10.347 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.343+0000 7fd644ff9640 1 -- 172.21.15.22:0/3120598704 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v67) ==== 74+0+133 (secure 0 0 0) 0x7fd6400ceb90 con 0x7fd648104070 2024-09-21T03:59:10.347 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:10.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.346+0000 7fd64e0f9640 1 -- 172.21.15.22:0/3120598704 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6300b6590 msgr2=0x7fd6300b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:10.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.346+0000 7fd64e0f9640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6300b6590 0x7fd6300b8aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd638005d00 tx=0x7fd63800b410 comp rx=0 tx=0).stop 2024-09-21T03:59:10.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.346+0000 7fd64e0f9640 1 -- 172.21.15.22:0/3120598704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd648104070 msgr2=0x7fd64819b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:10.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.346+0000 7fd64e0f9640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd648104070 0x7fd64819b080 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd64002ae70 tx=0x7fd640003d60 comp rx=0 tx=0).stop 2024-09-21T03:59:10.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.346+0000 7fd64e0f9640 1 -- 172.21.15.22:0/3120598704 shutdown_connections 2024-09-21T03:59:10.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.346+0000 7fd64e0f9640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6300b6590 0x7fd6300b8aa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.346+0000 7fd64e0f9640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6481036d0 0x7fd64819a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.346+0000 7fd64e0f9640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd648104070 0x7fd64819b080 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.346+0000 7fd64e0f9640 1 --2- 172.21.15.22:0/3120598704 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd648102640 0x7fd648199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:10.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.347+0000 7fd64e0f9640 1 -- 172.21.15.22:0/3120598704 >> 172.21.15.22:0/3120598704 conn(0x7fd6480fdfb0 msgr2=0x7fd6480ff900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:10.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.347+0000 7fd64e0f9640 1 -- 172.21.15.22:0/3120598704 shutdown_connections 2024-09-21T03:59:10.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:10.347+0000 7fd64e0f9640 1 -- 172.21.15.22:0/3120598704 wait complete. 2024-09-21T03:59:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:59:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T03:59:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='osd.11 ' entity='osd.11' 2024-09-21T03:59:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:10.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:10.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 338 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi073", "root=default"]}]': finished 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: osdmap e67: 12 total, 11 up, 12 in 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='osd.11 ' entity='osd.11' 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T03:59:10.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:10.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:10.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:10.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:11.064 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":67,"num_osds":12,"num_up_osds":11,"osd_up_since":1726891125,"num_in_osds":12,"osd_in_since":1726891127,"num_remapped_pgs":0} 2024-09-21T03:59:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:11 smithi022 ceph-mon[31015]: purged_snaps scrub starts 2024-09-21T03:59:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:11 smithi022 ceph-mon[31015]: purged_snaps scrub ok 2024-09-21T03:59:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:11 smithi022 ceph-mon[31015]: Detected new or changed devices on smithi073 2024-09-21T03:59:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:11 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi073 to 4272M 2024-09-21T03:59:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:11 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3120598704' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:59:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:11 smithi022 ceph-mon[31015]: osd.11 [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] boot 2024-09-21T03:59:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:11 smithi022 ceph-mon[31015]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T03:59:11.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:11 smithi060 ceph-mon[33722]: purged_snaps scrub starts 2024-09-21T03:59:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:11 smithi060 ceph-mon[33722]: purged_snaps scrub ok 2024-09-21T03:59:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:11 smithi060 ceph-mon[33722]: Detected new or changed devices on smithi073 2024-09-21T03:59:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:11 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi073 to 4272M 2024-09-21T03:59:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:11 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3120598704' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:59:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:11 smithi060 ceph-mon[33722]: osd.11 [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] boot 2024-09-21T03:59:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:11 smithi060 ceph-mon[33722]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T03:59:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:11.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:11 smithi073 ceph-mon[34443]: purged_snaps scrub starts 2024-09-21T03:59:11.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:11 smithi073 ceph-mon[34443]: purged_snaps scrub ok 2024-09-21T03:59:11.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:11 smithi073 ceph-mon[34443]: Detected new or changed devices on smithi073 2024-09-21T03:59:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:11 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi073 to 4272M 2024-09-21T03:59:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:11 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3120598704' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:59:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:11 smithi073 ceph-mon[34443]: osd.11 [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] boot 2024-09-21T03:59:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:11 smithi073 ceph-mon[34443]: osdmap e68: 12 total, 12 up, 12 in 2024-09-21T03:59:11.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd metadata", "id": 11} : dispatch 2024-09-21T03:59:12.065 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd stat -f json 2024-09-21T03:59:12.336 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:12 smithi022 ceph-mon[31015]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:12.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:12 smithi060 ceph-mon[33722]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:12.506 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:12 smithi073 ceph-mon[34443]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 339 MiB used, 983 GiB / 983 GiB avail 2024-09-21T03:59:12.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.819+0000 7f88d4563640 1 -- 172.21.15.22:0/3419305391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc103770 msgr2=0x7f88cc103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.819+0000 7f88d4563640 1 --2- 172.21.15.22:0/3419305391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc103770 0x7f88cc103be0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009900 tx=0x7f88c802a480 comp rx=0 tx=0).stop 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.819+0000 7f88d4563640 1 -- 172.21.15.22:0/3419305391 shutdown_connections 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.819+0000 7f88d4563640 1 --2- 172.21.15.22:0/3419305391 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88cc104800 0x7f88cc104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.819+0000 7f88d4563640 1 --2- 172.21.15.22:0/3419305391 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88cc1051a0 0x7f88cc10bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.819+0000 7f88d4563640 1 --2- 172.21.15.22:0/3419305391 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc103770 0x7f88cc103be0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.819+0000 7f88d4563640 1 -- 172.21.15.22:0/3419305391 >> 172.21.15.22:0/3419305391 conn(0x7f88cc0ff0c0 msgr2=0x7f88cc101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.819+0000 7f88d4563640 1 -- 172.21.15.22:0/3419305391 shutdown_connections 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.819+0000 7f88d4563640 1 -- 172.21.15.22:0/3419305391 wait complete. 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d4563640 1 Processor -- start 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d4563640 1 -- start start 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d4563640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc103770 0x7f88cc19c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d4563640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88cc104800 0x7f88cc19c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d4563640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88cc1051a0 0x7f88cc19d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d4563640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc10f260 con 0x7f88cc103770 2024-09-21T03:59:12.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d4563640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc10f0e0 con 0x7f88cc104800 2024-09-21T03:59:12.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d4563640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f88cc10f3e0 con 0x7f88cc1051a0 2024-09-21T03:59:12.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d22ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc103770 0x7f88cc19c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d22ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc103770 0x7f88cc19c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49390/0 (socket says 172.21.15.22:49390) 2024-09-21T03:59:12.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d22ff640 1 -- 172.21.15.22:0/1299069746 learned_addr learned my addr 172.21.15.22:0/1299069746 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:12.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d2b00640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88cc1051a0 0x7f88cc19d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.820+0000 7f88d1afe640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88cc104800 0x7f88cc19c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88d22ff640 1 -- 172.21.15.22:0/1299069746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88cc1051a0 msgr2=0x7f88cc19d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88d22ff640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88cc1051a0 0x7f88cc19d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88d22ff640 1 -- 172.21.15.22:0/1299069746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88cc104800 msgr2=0x7f88cc19c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88d22ff640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88cc104800 0x7f88cc19c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88d22ff640 1 -- 172.21.15.22:0/1299069746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88cc19dae0 con 0x7f88cc103770 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88d22ff640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc103770 0x7f88cc19c140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009230 tx=0x7f88c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88c37fe640 1 -- 172.21.15.22:0/1299069746 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c803f030 con 0x7f88cc103770 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88c37fe640 1 -- 172.21.15.22:0/1299069746 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88c8003c90 con 0x7f88cc103770 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88d4563640 1 -- 172.21.15.22:0/1299069746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88cc19dd70 con 0x7f88cc103770 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88c37fe640 1 -- 172.21.15.22:0/1299069746 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88c8035070 con 0x7f88cc103770 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.821+0000 7f88d4563640 1 -- 172.21.15.22:0/1299069746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88cc1a4390 con 0x7f88cc103770 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.822+0000 7f88d4563640 1 -- 172.21.15.22:0/1299069746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88cc1a45c0 con 0x7f88cc103770 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.824+0000 7f88c37fe640 1 -- 172.21.15.22:0/1299069746 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f88c8042030 con 0x7f88cc103770 2024-09-21T03:59:12.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.824+0000 7f88c37fe640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f88b80b6590 0x7f88b80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:12.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.824+0000 7f88d1afe640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f88b80b6590 0x7f88b80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:12.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.824+0000 7f88c37fe640 1 -- 172.21.15.22:0/1299069746 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f88c8107780 con 0x7f88cc103770 2024-09-21T03:59:12.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.825+0000 7f88d1afe640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f88b80b6590 0x7f88b80b8aa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f88bc005fd0 tx=0x7f88bc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:12.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:12.828+0000 7f88c37fe640 1 -- 172.21.15.22:0/1299069746 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f88c80d2890 con 0x7f88cc103770 2024-09-21T03:59:13.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.018+0000 7f88d4563640 1 -- 172.21.15.22:0/1299069746 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f88cc1a4790 con 0x7f88cc103770 2024-09-21T03:59:13.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.019+0000 7f88c37fe640 1 -- 172.21.15.22:0/1299069746 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v69) ==== 74+0+133 (secure 0 0 0) 0x7f88c80d77d0 con 0x7f88cc103770 2024-09-21T03:59:13.020 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:13.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 -- 172.21.15.22:0/1299069746 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f88b80b6590 msgr2=0x7f88b80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:13.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f88b80b6590 0x7f88b80b8aa0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f88bc005fd0 tx=0x7f88bc00b390 comp rx=0 tx=0).stop 2024-09-21T03:59:13.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 -- 172.21.15.22:0/1299069746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc103770 msgr2=0x7f88cc19c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:13.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc103770 0x7f88cc19c140 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f88c8009230 tx=0x7f88c80042f0 comp rx=0 tx=0).stop 2024-09-21T03:59:13.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 -- 172.21.15.22:0/1299069746 shutdown_connections 2024-09-21T03:59:13.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f88b80b6590 0x7f88b80b8aa0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:13.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f88cc1051a0 0x7f88cc19d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:13.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f88cc104800 0x7f88cc19c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:13.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 --2- 172.21.15.22:0/1299069746 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88cc103770 0x7f88cc19c140 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:13.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 -- 172.21.15.22:0/1299069746 >> 172.21.15.22:0/1299069746 conn(0x7f88cc0ff0c0 msgr2=0x7f88cc0755f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:13.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 -- 172.21.15.22:0/1299069746 shutdown_connections 2024-09-21T03:59:13.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:13.021+0000 7f88d4563640 1 -- 172.21.15.22:0/1299069746 wait complete. 2024-09-21T03:59:13.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:13 smithi022 ceph-mon[31015]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T03:59:13.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:13 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1299069746' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:59:13.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:13 smithi060 ceph-mon[33722]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T03:59:13.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:13 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1299069746' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:59:13.526 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:13 smithi073 ceph-mon[34443]: osdmap e69: 12 total, 12 up, 12 in 2024-09-21T03:59:13.526 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:13 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1299069746' entity='client.admin' cmd={"prefix": "osd stat", "format": "json"} : dispatch 2024-09-21T03:59:13.870 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":69,"num_osds":12,"num_up_osds":12,"osd_up_since":1726891150,"num_in_osds":12,"osd_in_since":1726891127,"num_remapped_pgs":0} 2024-09-21T03:59:13.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T03:59:14.133 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:14.451 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:14 smithi060 ceph-mon[33722]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:14.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:14 smithi022 ceph-mon[31015]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:14.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:14 smithi073 ceph-mon[34443]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:14.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.622+0000 7f26fca65640 1 -- 172.21.15.22:0/3234047108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f81094f0 msgr2=0x7f26f8109900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.622+0000 7f26fca65640 1 --2- 172.21.15.22:0/3234047108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f81094f0 0x7f26f8109900 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f26e0009900 tx=0x7f26e002a410 comp rx=0 tx=0).stop 2024-09-21T03:59:14.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.622+0000 7f26fca65640 1 -- 172.21.15.22:0/3234047108 shutdown_connections 2024-09-21T03:59:14.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.622+0000 7f26fca65640 1 --2- 172.21.15.22:0/3234047108 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f8109e40 0x7f26f8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.622+0000 7f26fca65640 1 --2- 172.21.15.22:0/3234047108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f81094f0 0x7f26f8109900 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.622+0000 7f26fca65640 1 --2- 172.21.15.22:0/3234047108 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f8103bb0 0x7f26f8103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.622+0000 7f26fca65640 1 -- 172.21.15.22:0/3234047108 >> 172.21.15.22:0/3234047108 conn(0x7f26f80ff600 msgr2=0x7f26f8101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:14.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.622+0000 7f26fca65640 1 -- 172.21.15.22:0/3234047108 shutdown_connections 2024-09-21T03:59:14.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.622+0000 7f26fca65640 1 -- 172.21.15.22:0/3234047108 wait complete. 2024-09-21T03:59:14.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26fca65640 1 Processor -- start 2024-09-21T03:59:14.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26fca65640 1 -- start start 2024-09-21T03:59:14.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26fca65640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f8103bb0 0x7f26f819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26fca65640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f81094f0 0x7f26f819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26fca65640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f8109e40 0x7f26f819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26fca65640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81139b0 con 0x7f26f8109e40 2024-09-21T03:59:14.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26fca65640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8113830 con 0x7f26f81094f0 2024-09-21T03:59:14.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26fca65640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8113b30 con 0x7f26f8103bb0 2024-09-21T03:59:14.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26f659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f8103bb0 0x7f26f819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26f6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f8109e40 0x7f26f819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26f5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f81094f0 0x7f26f819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26f659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f8103bb0 0x7f26f819a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:36414/0 (socket says 172.21.15.22:36414) 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26f6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f8109e40 0x7f26f819fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49412/0 (socket says 172.21.15.22:49412) 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26f5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f81094f0 0x7f26f819a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:35952/0 (socket says 172.21.15.22:35952) 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.623+0000 7f26f659c640 1 -- 172.21.15.22:0/1503615629 learned_addr learned my addr 172.21.15.22:0/1503615629 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26f5d9b640 1 -- 172.21.15.22:0/1503615629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f8103bb0 msgr2=0x7f26f819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26f5d9b640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f8103bb0 0x7f26f819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26f5d9b640 1 -- 172.21.15.22:0/1503615629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f8109e40 msgr2=0x7f26f819fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26f5d9b640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f8109e40 0x7f26f819fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26f5d9b640 1 -- 172.21.15.22:0/1503615629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f81a0350 con 0x7f26f81094f0 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26f659c640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f8103bb0 0x7f26f819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26f6d9d640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f8109e40 0x7f26f819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26f5d9b640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f81094f0 0x7f26f819a980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26e002a930 tx=0x7f26e0005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:14.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26ef7fe640 1 -- 172.21.15.22:0/1503615629 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e003f070 con 0x7f26f81094f0 2024-09-21T03:59:14.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26fca65640 1 -- 172.21.15.22:0/1503615629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f81a05e0 con 0x7f26f81094f0 2024-09-21T03:59:14.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26ef7fe640 1 -- 172.21.15.22:0/1503615629 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26e0003a80 con 0x7f26f81094f0 2024-09-21T03:59:14.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26ef7fe640 1 -- 172.21.15.22:0/1503615629 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e0035070 con 0x7f26f81094f0 2024-09-21T03:59:14.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.624+0000 7f26fca65640 1 -- 172.21.15.22:0/1503615629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f81a6da0 con 0x7f26f81094f0 2024-09-21T03:59:14.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.625+0000 7f26fca65640 1 -- 172.21.15.22:0/1503615629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f8104e30 con 0x7f26f81094f0 2024-09-21T03:59:14.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.627+0000 7f26ef7fe640 1 -- 172.21.15.22:0/1503615629 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f26e00035f0 con 0x7f26f81094f0 2024-09-21T03:59:14.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.628+0000 7f26ef7fe640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e40b6510 0x7f26e40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:14.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.628+0000 7f26f659c640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e40b6510 0x7f26e40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:14.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.628+0000 7f26ef7fe640 1 -- 172.21.15.22:0/1503615629 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f26e0107620 con 0x7f26f81094f0 2024-09-21T03:59:14.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.628+0000 7f26f659c640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e40b6510 0x7f26e40b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f26e800f7d0 tx=0x7f26e8009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:14.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.631+0000 7f26ef7fe640 1 -- 172.21.15.22:0/1503615629 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26e00d2690 con 0x7f26f81094f0 2024-09-21T03:59:14.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.820+0000 7f26fca65640 1 -- 172.21.15.22:0/1503615629 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26f810bc30 con 0x7f26f81094f0 2024-09-21T03:59:14.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.821+0000 7f26ef7fe640 1 -- 172.21.15.22:0/1503615629 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+18382 (secure 0 0 0) 0x7f26e00d75d0 con 0x7f26f81094f0 2024-09-21T03:59:14.823 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:14.823 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":69,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T03:59:12.176938+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":35,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 -- 172.21.15.22:0/1503615629 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e40b6510 msgr2=0x7f26e40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e40b6510 0x7f26e40b8a20 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f26e800f7d0 tx=0x7f26e8009500 comp rx=0 tx=0).stop 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 -- 172.21.15.22:0/1503615629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f81094f0 msgr2=0x7f26f819a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f81094f0 0x7f26f819a980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f26e002a930 tx=0x7f26e0005e10 comp rx=0 tx=0).stop 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 -- 172.21.15.22:0/1503615629 shutdown_connections 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e40b6510 0x7f26e40b8a20 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f8109e40 0x7f26f819fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f81094f0 0x7f26f819a980 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 --2- 172.21.15.22:0/1503615629 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f8103bb0 0x7f26f819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 -- 172.21.15.22:0/1503615629 >> 172.21.15.22:0/1503615629 conn(0x7f26f80ff600 msgr2=0x7f26f8101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 -- 172.21.15.22:0/1503615629 shutdown_connections 2024-09-21T03:59:14.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:14.823+0000 7f26fca65640 1 -- 172.21.15.22:0/1503615629 wait complete. 2024-09-21T03:59:15.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:15 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1503615629' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:59:15.562 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:15 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1503615629' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:59:15.599 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:55:19.289173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T03:59:15.599 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T03:59:15.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:15 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1503615629' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T03:59:15.861 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:16.248 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:16 smithi022 ceph-mon[31015]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.342+0000 7f47c50e8640 1 -- 172.21.15.22:0/3141254009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c01083a0 msgr2=0x7f47c01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.342+0000 7f47c50e8640 1 --2- 172.21.15.22:0/3141254009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c01083a0 0x7f47c01087b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f47b4009900 tx=0x7f47b402a410 comp rx=0 tx=0).stop 2024-09-21T03:59:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.342+0000 7f47c50e8640 1 -- 172.21.15.22:0/3141254009 shutdown_connections 2024-09-21T03:59:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.342+0000 7f47c50e8640 1 --2- 172.21.15.22:0/3141254009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c0108cf0 0x7f47c010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.342+0000 7f47c50e8640 1 --2- 172.21.15.22:0/3141254009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c01083a0 0x7f47c01087b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.342+0000 7f47c50e8640 1 --2- 172.21.15.22:0/3141254009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102a60 0x7f47c0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.342+0000 7f47c50e8640 1 -- 172.21.15.22:0/3141254009 >> 172.21.15.22:0/3141254009 conn(0x7f47c0079730 msgr2=0x7f47c0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.342+0000 7f47c50e8640 1 -- 172.21.15.22:0/3141254009 shutdown_connections 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.342+0000 7f47c50e8640 1 -- 172.21.15.22:0/3141254009 wait complete. 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.343+0000 7f47c50e8640 1 Processor -- start 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47c50e8640 1 -- start start 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47c50e8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102a60 0x7f47c019b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47c50e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c01083a0 0x7f47c019b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47c50e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c0108cf0 0x7f47c019bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47c50e8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f47c0112860 con 0x7f47c01083a0 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47c50e8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f47c01126e0 con 0x7f47c0108cf0 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47c50e8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f47c01129e0 con 0x7f47c0102a60 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47be59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c01083a0 0x7f47c019b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47be59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c01083a0 0x7f47c019b6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49432/0 (socket says 172.21.15.22:49432) 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47be59c640 1 -- 172.21.15.22:0/2647428528 learned_addr learned my addr 172.21.15.22:0/2647428528 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47bf59e640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c0108cf0 0x7f47c019bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47bed9d640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102a60 0x7f47c019b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47be59c640 1 -- 172.21.15.22:0/2647428528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102a60 msgr2=0x7f47c019b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47be59c640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102a60 0x7f47c019b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47be59c640 1 -- 172.21.15.22:0/2647428528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c0108cf0 msgr2=0x7f47c019bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47be59c640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c0108cf0 0x7f47c019bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.344+0000 7f47be59c640 1 -- 172.21.15.22:0/2647428528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47c01a6440 con 0x7f47c01083a0 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.345+0000 7f47be59c640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c01083a0 0x7f47c019b6f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f47b402a930 tx=0x7f47b4003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.345+0000 7f47a7fff640 1 -- 172.21.15.22:0/2647428528 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b403f070 con 0x7f47c01083a0 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.345+0000 7f47a7fff640 1 -- 172.21.15.22:0/2647428528 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47b403baf0 con 0x7f47c01083a0 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.345+0000 7f47c50e8640 1 -- 172.21.15.22:0/2647428528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47c01a66d0 con 0x7f47c01083a0 2024-09-21T03:59:16.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.345+0000 7f47a7fff640 1 -- 172.21.15.22:0/2647428528 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b4035030 con 0x7f47c01083a0 2024-09-21T03:59:16.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.345+0000 7f47c50e8640 1 -- 172.21.15.22:0/2647428528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47c01a6bb0 con 0x7f47c01083a0 2024-09-21T03:59:16.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.346+0000 7f47c50e8640 1 -- 172.21.15.22:0/2647428528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c0103ce0 con 0x7f47c01083a0 2024-09-21T03:59:16.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.347+0000 7f47a7fff640 1 -- 172.21.15.22:0/2647428528 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f47b4042070 con 0x7f47c01083a0 2024-09-21T03:59:16.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.348+0000 7f47a7fff640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47a80b6540 0x7f47a80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:16.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.348+0000 7f47bed9d640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47a80b6540 0x7f47a80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:16.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.348+0000 7f47a7fff640 1 -- 172.21.15.22:0/2647428528 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f47b4107990 con 0x7f47c01083a0 2024-09-21T03:59:16.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.349+0000 7f47bed9d640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47a80b6540 0x7f47a80b8a50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47b0005fd0 tx=0x7f47b0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:16.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.351+0000 7f47a7fff640 1 -- 172.21.15.22:0/2647428528 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47b40ce6c0 con 0x7f47c01083a0 2024-09-21T03:59:16.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:16 smithi060 ceph-mon[33722]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:16.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.538+0000 7f47c50e8640 1 -- 172.21.15.22:0/2647428528 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f47c002e640 con 0x7f47c01083a0 2024-09-21T03:59:16.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.539+0000 7f47a7fff640 1 -- 172.21.15.22:0/2647428528 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) ==== 93+0+10 (secure 0 0 0) 0x7f47b40d5e20 con 0x7f47c01083a0 2024-09-21T03:59:16.540 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-09-21T03:59:16.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 -- 172.21.15.22:0/2647428528 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47a80b6540 msgr2=0x7f47a80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47a80b6540 0x7f47a80b8a50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f47b0005fd0 tx=0x7f47b0005850 comp rx=0 tx=0).stop 2024-09-21T03:59:16.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 -- 172.21.15.22:0/2647428528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c01083a0 msgr2=0x7f47c019b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:16.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c01083a0 0x7f47c019b6f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f47b402a930 tx=0x7f47b4003b90 comp rx=0 tx=0).stop 2024-09-21T03:59:16.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 -- 172.21.15.22:0/2647428528 shutdown_connections 2024-09-21T03:59:16.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47a80b6540 0x7f47a80b8a50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f47c0108cf0 0x7f47c019bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f47c01083a0 0x7f47c019b6f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 --2- 172.21.15.22:0/2647428528 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f47c0102a60 0x7f47c019b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:16.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 -- 172.21.15.22:0/2647428528 >> 172.21.15.22:0/2647428528 conn(0x7f47c0079730 msgr2=0x7f47c0104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:16.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 -- 172.21.15.22:0/2647428528 shutdown_connections 2024-09-21T03:59:16.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:16.541+0000 7f47c50e8640 1 -- 172.21.15.22:0/2647428528 wait complete. 2024-09-21T03:59:16.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:16 smithi073 ceph-mon[34443]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:17.258 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:17 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2647428528' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:59:17.259 INFO:tasks.cephadm:Adding mds.a on smithi022 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.d on smithi022 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.g on smithi022 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.j on smithi022 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.b on smithi060 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.e on smithi060 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.h on smithi060 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.k on smithi060 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.c on smithi073 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.f on smithi073 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.i on smithi073 2024-09-21T03:59:17.260 INFO:tasks.cephadm:Adding mds.l on smithi073 2024-09-21T03:59:17.261 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph orch apply mds all '12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l' 2024-09-21T03:59:17.523 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T03:59:17.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:17 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2647428528' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:59:17.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:17 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2647428528' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T03:59:17.998 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 -- 172.21.15.73:0/1054970581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2034103770 msgr2=0x7f2034103be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 --2- 172.21.15.73:0/1054970581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2034103770 0x7f2034103be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f2024009900 tx=0x7f202402a480 comp rx=0 tx=0).stop 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 -- 172.21.15.73:0/1054970581 shutdown_connections 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 --2- 172.21.15.73:0/1054970581 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20341051a0 0x7f203410bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 --2- 172.21.15.73:0/1054970581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2034104800 0x7f2034104c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 --2- 172.21.15.73:0/1054970581 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2034103770 0x7f2034103be0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 -- 172.21.15.73:0/1054970581 >> 172.21.15.73:0/1054970581 conn(0x7f20340ff0c0 msgr2=0x7f2034101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 -- 172.21.15.73:0/1054970581 shutdown_connections 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 -- 172.21.15.73:0/1054970581 wait complete. 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 Processor -- start 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.989+0000 7f203a791640 1 -- start start 2024-09-21T03:59:17.999 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f203a791640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2034103770 0x7f2034076e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f203a791640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2034104800 0x7f2034075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f203a791640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20341051a0 0x7f2034075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f203a791640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f203410f2c0 con 0x7f2034104800 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f203a791640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f203410f140 con 0x7f20341051a0 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f203a791640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f203410f440 con 0x7f2034103770 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f2033fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2034103770 0x7f2034076e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f2033fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2034103770 0x7f2034076e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.73:56298/0 (socket says 172.21.15.73:56298) 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f2033fff640 1 -- 172.21.15.73:0/492105469 learned_addr learned my addr 172.21.15.73:0/492105469 (peer_addr_for_me v2:172.21.15.73:0/0) 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f20337fe640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2034104800 0x7f2034075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f2038d2e640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20341051a0 0x7f2034075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f2033fff640 1 -- 172.21.15.73:0/492105469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20341051a0 msgr2=0x7f2034075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:18.000 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f2033fff640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20341051a0 0x7f2034075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f2033fff640 1 -- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2034104800 msgr2=0x7f2034075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f2033fff640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2034104800 0x7f2034075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f2033fff640 1 -- 172.21.15.73:0/492105469 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20340762c0 con 0x7f2034103770 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f20337fe640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2034104800 0x7f2034075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.990+0000 7f2033fff640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2034103770 0x7f2034076e40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2024009230 tx=0x7f20240042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.991+0000 7f20317fa640 1 -- 172.21.15.73:0/492105469 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202403f030 con 0x7f2034103770 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.991+0000 7f203a791640 1 -- 172.21.15.73:0/492105469 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2034076550 con 0x7f2034103770 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.991+0000 7f20317fa640 1 -- 172.21.15.73:0/492105469 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2024003c90 con 0x7f2034103770 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.991+0000 7f20317fa640 1 -- 172.21.15.73:0/492105469 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024035070 con 0x7f2034103770 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.991+0000 7f203a791640 1 -- 172.21.15.73:0/492105469 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20341a42e0 con 0x7f2034103770 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.992+0000 7f203a791640 1 -- 172.21.15.73:0/492105469 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2034103be0 con 0x7f2034103770 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.993+0000 7f20317fa640 1 -- 172.21.15.73:0/492105469 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2024042030 con 0x7f2034103770 2024-09-21T03:59:18.001 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.994+0000 7f20317fa640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f201c0b6510 0x7f201c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.994+0000 7f20317fa640 1 -- 172.21.15.73:0/492105469 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f2024107a30 con 0x7f2034103770 2024-09-21T03:59:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.994+0000 7f20337fe640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f201c0b6510 0x7f201c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.995+0000 7f20337fe640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f201c0b6510 0x7f201c0b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f202800abe0 tx=0x7f202800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:18.002 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:17.997+0000 7f20317fa640 1 -- 172.21.15.73:0/492105469 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f20240ce760 con 0x7f2034103770 2024-09-21T03:59:18.187 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.184+0000 7f203a791640 1 -- 172.21.15.73:0/492105469 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l", "target": ["mon-mgr", ""]}) -- 0x7f2034063ac0 con 0x7f201c0b6510 2024-09-21T03:59:18.195 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.193+0000 7f20317fa640 1 -- 172.21.15.73:0/492105469 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f2034063ac0 con 0x7f201c0b6510 2024-09-21T03:59:18.196 INFO:teuthology.orchestra.run.smithi073.stdout:Scheduled mds.all update... 2024-09-21T03:59:18.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 -- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f201c0b6510 msgr2=0x7f201c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:18.198 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f201c0b6510 0x7f201c0b8a20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f202800abe0 tx=0x7f202800a5c0 comp rx=0 tx=0).stop 2024-09-21T03:59:18.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 -- 172.21.15.73:0/492105469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2034103770 msgr2=0x7f2034076e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:18.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2034103770 0x7f2034076e40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f2024009230 tx=0x7f20240042f0 comp rx=0 tx=0).stop 2024-09-21T03:59:18.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 -- 172.21.15.73:0/492105469 shutdown_connections 2024-09-21T03:59:18.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f201c0b6510 0x7f201c0b8a20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:18.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f20341051a0 0x7f2034075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:18.199 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2034104800 0x7f2034075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:18.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 --2- 172.21.15.73:0/492105469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2034103770 0x7f2034076e40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:18.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 -- 172.21.15.73:0/492105469 >> 172.21.15.73:0/492105469 conn(0x7f20340ff0c0 msgr2=0x7f2034107b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:18.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 -- 172.21.15.73:0/492105469 shutdown_connections 2024-09-21T03:59:18.200 INFO:teuthology.orchestra.run.smithi073.stderr:2024-09-21T03:59:18.196+0000 7f203a791640 1 -- 172.21.15.73:0/492105469 wait complete. 2024-09-21T03:59:18.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:18 smithi022 ceph-mon[31015]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:18.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:18.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:18.577 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:18 smithi073 ceph-mon[34443]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:18.577 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:18.577 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:18 smithi060 ceph-mon[33722]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:19.004 DEBUG:teuthology.orchestra.run.smithi022:mds.a> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.a.service 2024-09-21T03:59:19.007 DEBUG:teuthology.orchestra.run.smithi022:mds.d> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.d.service 2024-09-21T03:59:19.050 DEBUG:teuthology.orchestra.run.smithi022:mds.g> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.g.service 2024-09-21T03:59:19.094 DEBUG:teuthology.orchestra.run.smithi022:mds.j> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.j.service 2024-09-21T03:59:19.137 DEBUG:teuthology.orchestra.run.smithi060:mds.b> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.b.service 2024-09-21T03:59:19.141 DEBUG:teuthology.orchestra.run.smithi060:mds.e> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.e.service 2024-09-21T03:59:19.184 DEBUG:teuthology.orchestra.run.smithi060:mds.h> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.h.service 2024-09-21T03:59:19.227 DEBUG:teuthology.orchestra.run.smithi060:mds.k> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.k.service 2024-09-21T03:59:19.257 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:19 smithi073 ceph-mon[34443]: from='client.24562 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:19.257 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:19 smithi073 ceph-mon[34443]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l;count:12 2024-09-21T03:59:19.258 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:19.258 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:19.258 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:19.258 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:19.258 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:19.258 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:19.258 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:19 smithi073 ceph-mon[34443]: Deploying daemon mds.l on smithi073 2024-09-21T03:59:19.270 DEBUG:teuthology.orchestra.run.smithi073:mds.c> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.c.service 2024-09-21T03:59:19.272 DEBUG:teuthology.orchestra.run.smithi073:mds.f> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.f.service 2024-09-21T03:59:19.315 DEBUG:teuthology.orchestra.run.smithi073:mds.i> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.i.service 2024-09-21T03:59:19.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:19 smithi022 ceph-mon[31015]: from='client.24562 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:19.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:19 smithi022 ceph-mon[31015]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l;count:12 2024-09-21T03:59:19.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:19.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:19.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:19.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:19.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:19.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:19.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:19 smithi022 ceph-mon[31015]: Deploying daemon mds.l on smithi073 2024-09-21T03:59:19.357 DEBUG:teuthology.orchestra.run.smithi073:mds.l> sudo journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.l.service 2024-09-21T03:59:19.401 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-21T03:59:19.401 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:19.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:19 smithi060 ceph-mon[33722]: from='client.24562 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T03:59:19.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:19 smithi060 ceph-mon[33722]: Saving service mds.all spec with placement smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l;count:12 2024-09-21T03:59:19.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:19.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:19.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:19.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:19.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:19.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:19.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:19 smithi060 ceph-mon[33722]: Deploying daemon mds.l on smithi073 2024-09-21T03:59:19.660 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:20.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.139+0000 7f408a8a8640 1 -- 172.21.15.22:0/610811771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4084102a60 msgr2=0x7f4084102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:20.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.139+0000 7f408a8a8640 1 --2- 172.21.15.22:0/610811771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4084102a60 0x7f4084102e70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f4074009900 tx=0x7f407402a410 comp rx=0 tx=0).stop 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.139+0000 7f408a8a8640 1 -- 172.21.15.22:0/610811771 shutdown_connections 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.139+0000 7f408a8a8640 1 --2- 172.21.15.22:0/610811771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4084108cf0 0x7f408410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.139+0000 7f408a8a8640 1 --2- 172.21.15.22:0/610811771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f40841083a0 0x7f40841087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.139+0000 7f408a8a8640 1 --2- 172.21.15.22:0/610811771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4084102a60 0x7f4084102e70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.139+0000 7f408a8a8640 1 -- 172.21.15.22:0/610811771 >> 172.21.15.22:0/610811771 conn(0x7f4084079730 msgr2=0x7f4084079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.139+0000 7f408a8a8640 1 -- 172.21.15.22:0/610811771 shutdown_connections 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.139+0000 7f408a8a8640 1 -- 172.21.15.22:0/610811771 wait complete. 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.140+0000 7f408a8a8640 1 Processor -- start 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.140+0000 7f408a8a8640 1 -- start start 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f408a8a8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4084102a60 0x7f408419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f408a8a8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40841083a0 0x7f408419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:20.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f408a8a8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4084108cf0 0x7f408419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f408a8a8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4084112810 con 0x7f4084108cf0 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f408a8a8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4084112690 con 0x7f4084102a60 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f408a8a8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4084112990 con 0x7f40841083a0 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f4088e45640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4084108cf0 0x7f408419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f4088e45640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4084108cf0 0x7f408419fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49454/0 (socket says 172.21.15.22:49454) 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f4088e45640 1 -- 172.21.15.22:0/1632426640 learned_addr learned my addr 172.21.15.22:0/1632426640 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f4083fff640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4084102a60 0x7f408419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f407bfff640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40841083a0 0x7f408419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f4088e45640 1 -- 172.21.15.22:0/1632426640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40841083a0 msgr2=0x7f408419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f4088e45640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40841083a0 0x7f408419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f4088e45640 1 -- 172.21.15.22:0/1632426640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4084102a60 msgr2=0x7f408419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f4088e45640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4084102a60 0x7f408419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f4088e45640 1 -- 172.21.15.22:0/1632426640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40841a02e0 con 0x7f4084108cf0 2024-09-21T03:59:20.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.141+0000 7f4088e45640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4084108cf0 0x7f408419fbb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f407c00cad0 tx=0x7f407c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.142+0000 7f4081ffb640 1 -- 172.21.15.22:0/1632426640 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c00ae20 con 0x7f4084108cf0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.142+0000 7f4081ffb640 1 -- 172.21.15.22:0/1632426640 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f407c005020 con 0x7f4084108cf0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.142+0000 7f408a8a8640 1 -- 172.21.15.22:0/1632426640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40841a05d0 con 0x7f4084108cf0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.142+0000 7f4081ffb640 1 -- 172.21.15.22:0/1632426640 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c00f6b0 con 0x7f4084108cf0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.142+0000 7f408a8a8640 1 -- 172.21.15.22:0/1632426640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40841a6d30 con 0x7f4084108cf0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.143+0000 7f408a8a8640 1 -- 172.21.15.22:0/1632426640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4084102e70 con 0x7f4084108cf0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.144+0000 7f4081ffb640 1 -- 172.21.15.22:0/1632426640 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f407c0051d0 con 0x7f4084108cf0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.145+0000 7f4081ffb640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f40700b6510 0x7f40700b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.145+0000 7f4083fff640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f40700b6510 0x7f40700b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.145+0000 7f4081ffb640 1 -- 172.21.15.22:0/1632426640 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f407c0e7060 con 0x7f4084108cf0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.145+0000 7f4083fff640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f40700b6510 0x7f40700b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40740057c0 tx=0x7f40740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:20.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.148+0000 7f4081ffb640 1 -- 172.21.15.22:0/1632426640 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f407c014030 con 0x7f4084108cf0 2024-09-21T03:59:20.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.375+0000 7f408a8a8640 1 -- 172.21.15.22:0/1632426640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f408419b4a0 con 0x7f4084108cf0 2024-09-21T03:59:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.376+0000 7f4081ffb640 1 -- 172.21.15.22:0/1632426640 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f408419b4a0 con 0x7f4084108cf0 2024-09-21T03:59:20.378 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:20.378 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":1,"btime":"2024-09-21T03:51:32:216802+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-21T03:59:20.378 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 1 2024-09-21T03:59:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 -- 172.21.15.22:0/1632426640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f40700b6510 msgr2=0x7f40700b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f40700b6510 0x7f40700b8a20 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f40740057c0 tx=0x7f40740058d0 comp rx=0 tx=0).stop 2024-09-21T03:59:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 -- 172.21.15.22:0/1632426640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4084108cf0 msgr2=0x7f408419fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4084108cf0 0x7f408419fbb0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f407c00cad0 tx=0x7f407c00cf90 comp rx=0 tx=0).stop 2024-09-21T03:59:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 -- 172.21.15.22:0/1632426640 shutdown_connections 2024-09-21T03:59:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f40700b6510 0x7f40700b8a20 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:20.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f40841083a0 0x7f408419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4084108cf0 0x7f408419fbb0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 --2- 172.21.15.22:0/1632426640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4084102a60 0x7f408419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 -- 172.21.15.22:0/1632426640 >> 172.21.15.22:0/1632426640 conn(0x7f4084079730 msgr2=0x7f4084101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 -- 172.21.15.22:0/1632426640 shutdown_connections 2024-09-21T03:59:20.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:20.378+0000 7f408a8a8640 1 -- 172.21.15.22:0/1632426640 wait complete. 2024-09-21T03:59:20.644 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:20 smithi073 ceph-mon[34443]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:20.644 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:20 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1632426640' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:20.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:20 smithi022 ceph-mon[31015]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:20.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:20 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1632426640' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:20.951 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:20 smithi060 ceph-mon[33722]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:20 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1632426640' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:21.036 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 03:59:20 smithi073 systemd[1]: Starting Ceph mds.l for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:59:21.293 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 03:59:21 smithi073 podman[62251]: 2024-09-21 03:59:20.936814741 +0000 UTC m=+0.016095008 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:59:21.293 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 03:59:21 smithi073 podman[62251]: 2024-09-21 03:59:21.063167046 +0000 UTC m=+0.142447299 container create 50b7701970fa614254bf4836f6693f89f690db4f51853318eeade1d3dd596938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:59:21.293 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 03:59:21 smithi073 podman[62251]: 2024-09-21 03:59:21.29136972 +0000 UTC m=+0.370649985 container init 50b7701970fa614254bf4836f6693f89f690db4f51853318eeade1d3dd596938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:59:21.604 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 03:59:21 smithi073 podman[62251]: 2024-09-21 03:59:21.2941513 +0000 UTC m=+0.373431555 container start 50b7701970fa614254bf4836f6693f89f690db4f51853318eeade1d3dd596938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T03:59:21.605 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 03:59:21 smithi073 ceph-mds[62270]: -- 172.21.15.73:0/42352509 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55919d491860 con 0x5591a1639180 2024-09-21T03:59:21.605 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 03:59:21 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l[62266]: starting mds.l at 2024-09-21T03:59:21.605 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 03:59:21 smithi073 bash[62251]: 50b7701970fa614254bf4836f6693f89f690db4f51853318eeade1d3dd596938 2024-09-21T03:59:21.605 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 03:59:21 smithi073 systemd[1]: Started Ceph mds.l for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:22.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:22.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6832/1353426950,v1:172.21.15.73:6833/1353426950] up:boot 2024-09-21T03:59:22.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: fsmap 1 up:standby 2024-09-21T03:59:22.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:59:22.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:22.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:22.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:22.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:22.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:22.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:22.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:22 smithi060 ceph-mon[33722]: Deploying daemon mds.k on smithi060 2024-09-21T03:59:22.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:22.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6832/1353426950,v1:172.21.15.73:6833/1353426950] up:boot 2024-09-21T03:59:22.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: fsmap 1 up:standby 2024-09-21T03:59:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:59:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:22 smithi022 ceph-mon[31015]: Deploying daemon mds.k on smithi060 2024-09-21T03:59:22.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6832/1353426950,v1:172.21.15.73:6833/1353426950] up:boot 2024-09-21T03:59:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: fsmap 1 up:standby 2024-09-21T03:59:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T03:59:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:22 smithi073 ceph-mon[34443]: Deploying daemon mds.k on smithi060 2024-09-21T03:59:23.324 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:23.601 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:23.702 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 03:59:23 smithi060 systemd[1]: Starting Ceph mds.k for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:59:24.004 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 03:59:23 smithi060 podman[60973]: 2024-09-21 03:59:23.622984437 +0000 UTC m=+0.016553083 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:59:24.004 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 03:59:23 smithi060 podman[60973]: 2024-09-21 03:59:23.737532829 +0000 UTC m=+0.131101507 container create 49f75a4572c0b76973ae5b8aaa21e189df0e795a3aa0541a27a4e091ecc56521 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T03:59:24.005 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 03:59:23 smithi060 podman[60973]: 2024-09-21 03:59:23.965326569 +0000 UTC m=+0.358895208 container init 49f75a4572c0b76973ae5b8aaa21e189df0e795a3aa0541a27a4e091ecc56521 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:59:24.005 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 03:59:23 smithi060 podman[60973]: 2024-09-21 03:59:23.96817286 +0000 UTC m=+0.361741497 container start 49f75a4572c0b76973ae5b8aaa21e189df0e795a3aa0541a27a4e091ecc56521 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T03:59:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.187+0000 7f6c34410640 1 -- 172.21.15.22:0/1755949651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c2c1094c0 msgr2=0x7f6c2c1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.187+0000 7f6c34410640 1 --2- 172.21.15.22:0/1755949651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c2c1094c0 0x7f6c2c1098d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c009900 tx=0x7f6c1c02a410 comp rx=0 tx=0).stop 2024-09-21T03:59:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.187+0000 7f6c34410640 1 -- 172.21.15.22:0/1755949651 shutdown_connections 2024-09-21T03:59:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.187+0000 7f6c34410640 1 --2- 172.21.15.22:0/1755949651 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c2c109e10 0x7f6c2c110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.187+0000 7f6c34410640 1 --2- 172.21.15.22:0/1755949651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c2c1094c0 0x7f6c2c1098d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:24.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.187+0000 7f6c34410640 1 --2- 172.21.15.22:0/1755949651 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c103b80 0x7f6c2c103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.187+0000 7f6c34410640 1 -- 172.21.15.22:0/1755949651 >> 172.21.15.22:0/1755949651 conn(0x7f6c2c0ff610 msgr2=0x7f6c2c101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.187+0000 7f6c34410640 1 -- 172.21.15.22:0/1755949651 shutdown_connections 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.187+0000 7f6c34410640 1 -- 172.21.15.22:0/1755949651 wait complete. 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.188+0000 7f6c34410640 1 Processor -- start 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.188+0000 7f6c34410640 1 -- start start 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c34410640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c103b80 0x7f6c2c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c34410640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c2c1094c0 0x7f6c2c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c34410640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c2c109e10 0x7f6c2c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c34410640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c113980 con 0x7f6c2c1094c0 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c34410640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c113800 con 0x7f6c2c109e10 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c34410640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6c2c113b00 con 0x7f6c2c103b80 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c319ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c2c1094c0 0x7f6c2c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c319ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c2c1094c0 0x7f6c2c19a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44828/0 (socket says 172.21.15.22:44828) 2024-09-21T03:59:24.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c319ab640 1 -- 172.21.15.22:0/2675889036 learned_addr learned my addr 172.21.15.22:0/2675889036 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c321ac640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c103b80 0x7f6c2c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c329ad640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c2c109e10 0x7f6c2c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c319ab640 1 -- 172.21.15.22:0/2675889036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c103b80 msgr2=0x7f6c2c19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c319ab640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c103b80 0x7f6c2c19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c319ab640 1 -- 172.21.15.22:0/2675889036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c2c109e10 msgr2=0x7f6c2c19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c319ab640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c2c109e10 0x7f6c2c19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c319ab640 1 -- 172.21.15.22:0/2675889036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c1a0340 con 0x7f6c2c1094c0 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c329ad640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c2c109e10 0x7f6c2c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.189+0000 7f6c321ac640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c103b80 0x7f6c2c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.190+0000 7f6c319ab640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c2c1094c0 0x7f6c2c19a970 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c004770 tx=0x7f6c1c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.190+0000 7f6c237fe640 1 -- 172.21.15.22:0/2675889036 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c03f030 con 0x7f6c2c1094c0 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.190+0000 7f6c34410640 1 -- 172.21.15.22:0/2675889036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c1a05d0 con 0x7f6c2c1094c0 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.190+0000 7f6c237fe640 1 -- 172.21.15.22:0/2675889036 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c1c004440 con 0x7f6c2c1094c0 2024-09-21T03:59:24.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.190+0000 7f6c237fe640 1 -- 172.21.15.22:0/2675889036 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c1c035070 con 0x7f6c2c1094c0 2024-09-21T03:59:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.190+0000 7f6c34410640 1 -- 172.21.15.22:0/2675889036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c2c1a6d90 con 0x7f6c2c1094c0 2024-09-21T03:59:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.191+0000 7f6c34410640 1 -- 172.21.15.22:0/2675889036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c2c103f90 con 0x7f6c2c1094c0 2024-09-21T03:59:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.193+0000 7f6c237fe640 1 -- 172.21.15.22:0/2675889036 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f6c1c042030 con 0x7f6c2c1094c0 2024-09-21T03:59:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.194+0000 7f6c237fe640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6c180b6510 0x7f6c180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.194+0000 7f6c321ac640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6c180b6510 0x7f6c180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.194+0000 7f6c237fe640 1 -- 172.21.15.22:0/2675889036 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f6c1c1076e0 con 0x7f6c2c1094c0 2024-09-21T03:59:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.194+0000 7f6c321ac640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6c180b6510 0x7f6c180b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c28005fd0 tx=0x7f6c2800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:24.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.201+0000 7f6c237fe640 1 -- 172.21.15.22:0/2675889036 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6c1c0ce370 con 0x7f6c2c1094c0 2024-09-21T03:59:24.346 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 03:59:24 smithi060 ceph-mds[60993]: -- 172.21.15.60:0/3685907691 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5631e73fd860 con 0x5631eb5a5a80 2024-09-21T03:59:24.346 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 03:59:24 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k[60989]: starting mds.k at 2024-09-21T03:59:24.346 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 03:59:24 smithi060 bash[60973]: 49f75a4572c0b76973ae5b8aaa21e189df0e795a3aa0541a27a4e091ecc56521 2024-09-21T03:59:24.346 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 03:59:24 smithi060 systemd[1]: Started Ceph mds.k for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:24.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:24 smithi022 ceph-mon[31015]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:24.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:24.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:24.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:24.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:24.479 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:24.480 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:24 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:24.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.477+0000 7f6c34410640 1 -- 172.21.15.22:0/2675889036 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c2c19b500 con 0x7f6c2c1094c0 2024-09-21T03:59:24.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.477+0000 7f6c237fe640 1 -- 172.21.15.22:0/2675889036 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2260 (secure 0 0 0) 0x7f6c1c0d2750 con 0x7f6c2c1094c0 2024-09-21T03:59:24.480 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:24.480 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":3,"btime":"2024-09-21T03:59:24:336789+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:59:24.481 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 3 2024-09-21T03:59:24.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 -- 172.21.15.22:0/2675889036 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6c180b6510 msgr2=0x7f6c180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:24.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6c180b6510 0x7f6c180b8a20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6c28005fd0 tx=0x7f6c2800b390 comp rx=0 tx=0).stop 2024-09-21T03:59:24.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 -- 172.21.15.22:0/2675889036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c2c1094c0 msgr2=0x7f6c2c19a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:24.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c2c1094c0 0x7f6c2c19a970 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6c1c004770 tx=0x7f6c1c004040 comp rx=0 tx=0).stop 2024-09-21T03:59:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 -- 172.21.15.22:0/2675889036 shutdown_connections 2024-09-21T03:59:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6c180b6510 0x7f6c180b8a20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6c2c109e10 0x7f6c2c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6c2c1094c0 0x7f6c2c19a970 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:24.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 --2- 172.21.15.22:0/2675889036 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6c2c103b80 0x7f6c2c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 -- 172.21.15.22:0/2675889036 >> 172.21.15.22:0/2675889036 conn(0x7f6c2c0ff610 msgr2=0x7f6c2c101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 -- 172.21.15.22:0/2675889036 shutdown_connections 2024-09-21T03:59:24.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:24.480+0000 7f6c34410640 1 -- 172.21.15.22:0/2675889036 wait complete. 2024-09-21T03:59:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:24 smithi073 ceph-mon[34443]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:24 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:24 smithi060 ceph-mon[33722]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:24.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:24 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:25.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:25 smithi022 ceph-mon[31015]: Deploying daemon mds.j on smithi022 2024-09-21T03:59:25.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:25 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.60:6832/2373240323,v1:172.21.15.60:6833/2373240323] up:boot 2024-09-21T03:59:25.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:25 smithi022 ceph-mon[31015]: fsmap 2 up:standby 2024-09-21T03:59:25.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:25 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:59:25.603 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:25 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2675889036' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:25.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:25 smithi073 ceph-mon[34443]: Deploying daemon mds.j on smithi022 2024-09-21T03:59:25.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:25 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.60:6832/2373240323,v1:172.21.15.60:6833/2373240323] up:boot 2024-09-21T03:59:25.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:25 smithi073 ceph-mon[34443]: fsmap 2 up:standby 2024-09-21T03:59:25.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:25 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:59:25.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:25 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2675889036' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:25.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:25 smithi060 ceph-mon[33722]: Deploying daemon mds.j on smithi022 2024-09-21T03:59:25.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:25 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.60:6832/2373240323,v1:172.21.15.60:6833/2373240323] up:boot 2024-09-21T03:59:25.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:25 smithi060 ceph-mon[33722]: fsmap 2 up:standby 2024-09-21T03:59:25.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:25 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T03:59:25.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:25 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2675889036' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:26.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:26 smithi073 ceph-mon[34443]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:26 smithi060 ceph-mon[33722]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:26.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:26 smithi022 ceph-mon[31015]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:27.099 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 03:59:26 smithi022 systemd[1]: Starting Ceph mds.j for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:59:27.464 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 03:59:27 smithi022 podman[70569]: 2024-09-21 03:59:27.077396081 +0000 UTC m=+0.016373522 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:59:27.464 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 03:59:27 smithi022 podman[70569]: 2024-09-21 03:59:27.192818935 +0000 UTC m=+0.131796360 container create 808efe801ad4d455c1bfeb7580ed2ee2c60c0013c13d33ffcfb6f34cb5675da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-j, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:59:27.464 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 03:59:27 smithi022 podman[70569]: 2024-09-21 03:59:27.462699463 +0000 UTC m=+0.401676893 container init 808efe801ad4d455c1bfeb7580ed2ee2c60c0013c13d33ffcfb6f34cb5675da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-j, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:59:27.505 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:27.784 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:27.849 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 03:59:27 smithi022 podman[70569]: 2024-09-21 03:59:27.465805136 +0000 UTC m=+0.404782570 container start 808efe801ad4d455c1bfeb7580ed2ee2c60c0013c13d33ffcfb6f34cb5675da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-21T03:59:27.849 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 03:59:27 smithi022 ceph-mds[70588]: -- 172.21.15.22:0/2139444018 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559f769adc20 con 0x559f7ab55a80 2024-09-21T03:59:27.849 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 03:59:27 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-j[70584]: starting mds.j at 2024-09-21T03:59:27.850 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 03:59:27 smithi022 bash[70569]: 808efe801ad4d455c1bfeb7580ed2ee2c60c0013c13d33ffcfb6f34cb5675da8 2024-09-21T03:59:27.850 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 03:59:27 smithi022 systemd[1]: Started Ceph mds.j for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:28.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.267+0000 7f1fd10b5640 1 -- 172.21.15.22:0/3007478788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fcc1094c0 msgr2=0x7f1fcc1098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:28.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.267+0000 7f1fd10b5640 1 --2- 172.21.15.22:0/3007478788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fcc1094c0 0x7f1fcc1098d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f1fc0009900 tx=0x7f1fc002a3f0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.267+0000 7f1fd10b5640 1 -- 172.21.15.22:0/3007478788 shutdown_connections 2024-09-21T03:59:28.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.267+0000 7f1fd10b5640 1 --2- 172.21.15.22:0/3007478788 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fcc109e10 0x7f1fcc110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.267+0000 7f1fd10b5640 1 --2- 172.21.15.22:0/3007478788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fcc1094c0 0x7f1fcc1098d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.267+0000 7f1fd10b5640 1 --2- 172.21.15.22:0/3007478788 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc103b80 0x7f1fcc103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.267+0000 7f1fd10b5640 1 -- 172.21.15.22:0/3007478788 >> 172.21.15.22:0/3007478788 conn(0x7f1fcc0ff610 msgr2=0x7f1fcc101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:28.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.267+0000 7f1fd10b5640 1 -- 172.21.15.22:0/3007478788 shutdown_connections 2024-09-21T03:59:28.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.267+0000 7f1fd10b5640 1 -- 172.21.15.22:0/3007478788 wait complete. 2024-09-21T03:59:28.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.268+0000 7f1fd10b5640 1 Processor -- start 2024-09-21T03:59:28.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.268+0000 7f1fd10b5640 1 -- start start 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.268+0000 7f1fd10b5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fcc103b80 0x7f1fcc075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.268+0000 7f1fd10b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc1094c0 0x7f1fcc075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fd10b5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fcc109e10 0x7f1fcc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fd10b5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc1139a0 con 0x7f1fcc103b80 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fd10b5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc113820 con 0x7f1fcc109e10 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fd10b5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1fcc113b20 con 0x7f1fcc1094c0 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fcad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fcc103b80 0x7f1fcc075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fcad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fcc103b80 0x7f1fcc075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44876/0 (socket says 172.21.15.22:44876) 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fcad9d640 1 -- 172.21.15.22:0/670510495 learned_addr learned my addr 172.21.15.22:0/670510495 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fca59c640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc1094c0 0x7f1fcc075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fcb59e640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fcc109e10 0x7f1fcc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fcad9d640 1 -- 172.21.15.22:0/670510495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc1094c0 msgr2=0x7f1fcc075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fcad9d640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc1094c0 0x7f1fcc075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fcad9d640 1 -- 172.21.15.22:0/670510495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fcc109e10 msgr2=0x7f1fcc076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fcad9d640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fcc109e10 0x7f1fcc076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fcad9d640 1 -- 172.21.15.22:0/670510495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fcc1a8640 con 0x7f1fcc103b80 2024-09-21T03:59:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fca59c640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc1094c0 0x7f1fcc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fcad9d640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fcc103b80 0x7f1fcc075710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00c920 tx=0x7f1fbc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fb3fff640 1 -- 172.21.15.22:0/670510495 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc007c70 con 0x7f1fcc103b80 2024-09-21T03:59:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fd10b5640 1 -- 172.21.15.22:0/670510495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fcc1a8930 con 0x7f1fcc103b80 2024-09-21T03:59:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fb3fff640 1 -- 172.21.15.22:0/670510495 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1fbc007e10 con 0x7f1fcc103b80 2024-09-21T03:59:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.269+0000 7f1fb3fff640 1 -- 172.21.15.22:0/670510495 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fbc0186f0 con 0x7f1fcc103b80 2024-09-21T03:59:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.270+0000 7f1fd10b5640 1 -- 172.21.15.22:0/670510495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fcc1a8f10 con 0x7f1fcc103b80 2024-09-21T03:59:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.270+0000 7f1fd10b5640 1 -- 172.21.15.22:0/670510495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fcc103f90 con 0x7f1fcc103b80 2024-09-21T03:59:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.272+0000 7f1fb3fff640 1 -- 172.21.15.22:0/670510495 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f1fbc00f450 con 0x7f1fcc103b80 2024-09-21T03:59:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.273+0000 7f1fb3fff640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1fb40b6590 0x7f1fb40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.273+0000 7f1fca59c640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1fb40b6590 0x7f1fb40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.273+0000 7f1fb3fff640 1 -- 172.21.15.22:0/670510495 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f1fbc0e72c0 con 0x7f1fcc103b80 2024-09-21T03:59:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.273+0000 7f1fca59c640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1fb40b6590 0x7f1fb40b8aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00057c0 tx=0x7f1fc0009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.276+0000 7f1fb3fff640 1 -- 172.21.15.22:0/670510495 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1fbc014030 con 0x7f1fcc103b80 2024-09-21T03:59:28.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.513+0000 7f1fd10b5640 1 -- 172.21.15.22:0/670510495 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1fcc076a10 con 0x7f1fcc103b80 2024-09-21T03:59:28.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.513+0000 7f1fb3fff640 1 -- 172.21.15.22:0/670510495 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3082 (secure 0 0 0) 0x7f1fbc0ae100 con 0x7f1fcc103b80 2024-09-21T03:59:28.516 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:28.516 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":4,"btime":"2024-09-21T03:59:28:352519+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:59:28.516 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 4 2024-09-21T03:59:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.515+0000 7f1fd10b5640 1 -- 172.21.15.22:0/670510495 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1fb40b6590 msgr2=0x7f1fb40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.515+0000 7f1fd10b5640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1fb40b6590 0x7f1fb40b8aa0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f1fc00057c0 tx=0x7f1fc0009680 comp rx=0 tx=0).stop 2024-09-21T03:59:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.515+0000 7f1fd10b5640 1 -- 172.21.15.22:0/670510495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fcc103b80 msgr2=0x7f1fcc075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.515+0000 7f1fd10b5640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fcc103b80 0x7f1fcc075710 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc00c920 tx=0x7f1fbc00cde0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.515+0000 7f1fd10b5640 1 -- 172.21.15.22:0/670510495 shutdown_connections 2024-09-21T03:59:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.515+0000 7f1fd10b5640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1fb40b6590 0x7f1fb40b8aa0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.515+0000 7f1fd10b5640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1fcc1094c0 0x7f1fcc075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.515+0000 7f1fd10b5640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1fcc109e10 0x7f1fcc076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.515+0000 7f1fd10b5640 1 --2- 172.21.15.22:0/670510495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1fcc103b80 0x7f1fcc075710 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.516+0000 7f1fd10b5640 1 -- 172.21.15.22:0/670510495 >> 172.21.15.22:0/670510495 conn(0x7f1fcc0ff610 msgr2=0x7f1fcc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.516+0000 7f1fd10b5640 1 -- 172.21.15.22:0/670510495 shutdown_connections 2024-09-21T03:59:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:28.516+0000 7f1fd10b5640 1 -- 172.21.15.22:0/670510495 wait complete. 2024-09-21T03:59:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:28.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:28.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:28.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: Deploying daemon mds.d on smithi022 2024-09-21T03:59:28.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.22:6834/536633009,v1:172.21.15.22:6835/536633009] up:boot 2024-09-21T03:59:28.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: fsmap 3 up:standby 2024-09-21T03:59:28.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:59:28.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:28 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/670510495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:28.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: Deploying daemon mds.d on smithi022 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.22:6834/536633009,v1:172.21.15.22:6835/536633009] up:boot 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: fsmap 3 up:standby 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:59:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:28 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/670510495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: Deploying daemon mds.d on smithi022 2024-09-21T03:59:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.22:6834/536633009,v1:172.21.15.22:6835/536633009] up:boot 2024-09-21T03:59:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: fsmap 3 up:standby 2024-09-21T03:59:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "j"} : dispatch 2024-09-21T03:59:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:28 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/670510495' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:30.705 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:30 smithi022 ceph-mon[31015]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:30.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:30 smithi073 ceph-mon[34443]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:30.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:30 smithi060 ceph-mon[33722]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:31.100 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 03:59:30 smithi022 systemd[1]: Starting Ceph mds.d for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:59:31.378 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 03:59:31 smithi022 podman[70957]: 2024-09-21 03:59:31.004436814 +0000 UTC m=+0.016334286 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:59:31.378 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 03:59:31 smithi022 podman[70957]: 2024-09-21 03:59:31.10351043 +0000 UTC m=+0.115407888 container create 8a1cd8c88917fcba3dbef56db87a1804414494754fb3d0df3999e2c4a0b1323b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-d, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T03:59:31.378 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 03:59:31 smithi022 podman[70957]: 2024-09-21 03:59:31.339551798 +0000 UTC m=+0.351449256 container init 8a1cd8c88917fcba3dbef56db87a1804414494754fb3d0df3999e2c4a0b1323b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-d, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T03:59:31.378 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 03:59:31 smithi022 podman[70957]: 2024-09-21 03:59:31.342532052 +0000 UTC m=+0.354429518 container start 8a1cd8c88917fcba3dbef56db87a1804414494754fb3d0df3999e2c4a0b1323b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-d, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:59:31.482 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:31.849 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 03:59:31 smithi022 ceph-mds[70977]: -- 172.21.15.22:0/4008808629 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fa51f51c20 con 0x55fa560f9a80 2024-09-21T03:59:31.932 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 03:59:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-d[70973]: starting mds.d at 2024-09-21T03:59:31.933 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 03:59:31 smithi022 bash[70957]: 8a1cd8c88917fcba3dbef56db87a1804414494754fb3d0df3999e2c4a0b1323b 2024-09-21T03:59:31.933 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 03:59:31 smithi022 systemd[1]: Started Ceph mds.d for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:32.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.261+0000 7fa68b0a0640 1 -- 172.21.15.22:0/1965326719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa684109df0 msgr2=0x7fa684110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:32.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.261+0000 7fa68b0a0640 1 --2- 172.21.15.22:0/1965326719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa684109df0 0x7fa684110620 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009ca0 tx=0x7fa67c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.261+0000 7fa68b0a0640 1 -- 172.21.15.22:0/1965326719 shutdown_connections 2024-09-21T03:59:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.261+0000 7fa68b0a0640 1 --2- 172.21.15.22:0/1965326719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa684109df0 0x7fa684110620 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.261+0000 7fa68b0a0640 1 --2- 172.21.15.22:0/1965326719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6841094a0 0x7fa6841098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.261+0000 7fa68b0a0640 1 --2- 172.21.15.22:0/1965326719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa684103b60 0x7fa684103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.261+0000 7fa68b0a0640 1 -- 172.21.15.22:0/1965326719 >> 172.21.15.22:0/1965326719 conn(0x7fa68407b850 msgr2=0x7fa68407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.261+0000 7fa68b0a0640 1 -- 172.21.15.22:0/1965326719 shutdown_connections 2024-09-21T03:59:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.261+0000 7fa68b0a0640 1 -- 172.21.15.22:0/1965326719 wait complete. 2024-09-21T03:59:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68b0a0640 1 Processor -- start 2024-09-21T03:59:32.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68b0a0640 1 -- start start 2024-09-21T03:59:32.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68b0a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa684103b60 0x7fa68419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:32.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68b0a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6841094a0 0x7fa68419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:32.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68b0a0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa684109df0 0x7fa68419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:32.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68b0a0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6841139b0 con 0x7fa684109df0 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68b0a0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa684113830 con 0x7fa684103b60 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68b0a0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa684113b30 con 0x7fa6841094a0 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68963d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa684109df0 0x7fa68419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa688e3c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa684103b60 0x7fa68419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68963d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa684109df0 0x7fa68419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44548/0 (socket says 172.21.15.22:44548) 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.262+0000 7fa68963d640 1 -- 172.21.15.22:0/2614114434 learned_addr learned my addr 172.21.15.22:0/2614114434 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa683fff640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6841094a0 0x7fa68419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa688e3c640 1 -- 172.21.15.22:0/2614114434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6841094a0 msgr2=0x7fa68419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa688e3c640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6841094a0 0x7fa68419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa688e3c640 1 -- 172.21.15.22:0/2614114434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa684109df0 msgr2=0x7fa68419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:32.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa688e3c640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa684109df0 0x7fa68419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa688e3c640 1 -- 172.21.15.22:0/2614114434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6841a0370 con 0x7fa684103b60 2024-09-21T03:59:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa68963d640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa684109df0 0x7fa68419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:59:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa688e3c640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa684103b60 0x7fa68419a4c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa67800d720 tx=0x7fa67800db20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa681ffb640 1 -- 172.21.15.22:0/2614114434 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678017070 con 0x7fa684103b60 2024-09-21T03:59:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa681ffb640 1 -- 172.21.15.22:0/2614114434 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6780054b0 con 0x7fa684103b60 2024-09-21T03:59:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa68b0a0640 1 -- 172.21.15.22:0/2614114434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6841a0660 con 0x7fa684103b60 2024-09-21T03:59:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.263+0000 7fa681ffb640 1 -- 172.21.15.22:0/2614114434 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa678009e00 con 0x7fa684103b60 2024-09-21T03:59:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.264+0000 7fa68b0a0640 1 -- 172.21.15.22:0/2614114434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6841a6e80 con 0x7fa684103b60 2024-09-21T03:59:32.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.265+0000 7fa68b0a0640 1 -- 172.21.15.22:0/2614114434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa684103f70 con 0x7fa684103b60 2024-09-21T03:59:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.266+0000 7fa681ffb640 1 -- 172.21.15.22:0/2614114434 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa678005020 con 0x7fa684103b60 2024-09-21T03:59:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.267+0000 7fa681ffb640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6740b65c0 0x7fa6740b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:32.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.267+0000 7fa683fff640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6740b65c0 0x7fa6740b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:32.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.267+0000 7fa681ffb640 1 -- 172.21.15.22:0/2614114434 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fa6780e6bb0 con 0x7fa684103b60 2024-09-21T03:59:32.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.267+0000 7fa683fff640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6740b65c0 0x7fa6740b8ad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa6841071a0 tx=0x7fa67000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:32.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.270+0000 7fa681ffb640 1 -- 172.21.15.22:0/2614114434 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa678020020 con 0x7fa684103b60 2024-09-21T03:59:32.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.499+0000 7fa68b0a0640 1 -- 172.21.15.22:0/2614114434 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa68410bbe0 con 0x7fa684103b60 2024-09-21T03:59:32.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.499+0000 7fa681ffb640 1 -- 172.21.15.22:0/2614114434 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7fa6780ad940 con 0x7fa684103b60 2024-09-21T03:59:32.502 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:32.502 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"btime":"2024-09-21T03:59:31:601403+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-21T03:59:32.503 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 5 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 -- 172.21.15.22:0/2614114434 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6740b65c0 msgr2=0x7fa6740b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6740b65c0 0x7fa6740b8ad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa6841071a0 tx=0x7fa67000a2d0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 -- 172.21.15.22:0/2614114434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa684103b60 msgr2=0x7fa68419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa684103b60 0x7fa68419a4c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa67800d720 tx=0x7fa67800db20 comp rx=0 tx=0).stop 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 -- 172.21.15.22:0/2614114434 shutdown_connections 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6740b65c0 0x7fa6740b8ad0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6841094a0 0x7fa68419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa684109df0 0x7fa68419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 --2- 172.21.15.22:0/2614114434 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa684103b60 0x7fa68419a4c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 -- 172.21.15.22:0/2614114434 >> 172.21.15.22:0/2614114434 conn(0x7fa68407b850 msgr2=0x7fa684105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:32.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 -- 172.21.15.22:0/2614114434 shutdown_connections 2024-09-21T03:59:32.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:32.502+0000 7fa68b0a0640 1 -- 172.21.15.22:0/2614114434 wait complete. 2024-09-21T03:59:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:32.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:32.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: Deploying daemon mds.e on smithi060 2024-09-21T03:59:32.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.22:6836/3675102872,v1:172.21.15.22:6837/3675102872] up:boot 2024-09-21T03:59:32.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: fsmap 4 up:standby 2024-09-21T03:59:32.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:32 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:59:32.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:32.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: Deploying daemon mds.e on smithi060 2024-09-21T03:59:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.22:6836/3675102872,v1:172.21.15.22:6837/3675102872] up:boot 2024-09-21T03:59:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: fsmap 4 up:standby 2024-09-21T03:59:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:32 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:59:32.946 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:32.946 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:32.946 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:32.946 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:32.947 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:32.947 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:32.947 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:32.947 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: Deploying daemon mds.e on smithi060 2024-09-21T03:59:32.947 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.22:6836/3675102872,v1:172.21.15.22:6837/3675102872] up:boot 2024-09-21T03:59:32.947 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: fsmap 4 up:standby 2024-09-21T03:59:32.947 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:32 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "d"} : dispatch 2024-09-21T03:59:33.667 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:33 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2614114434' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:33.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:33 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2614114434' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:33.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:33 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2614114434' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:33.952 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 03:59:33 smithi060 podman[61255]: 2024-09-21 03:59:33.902043241 +0000 UTC m=+0.137583435 container create d36b2b6e68805ae54025da1d5949184faa7bf0c96d045ddb7e4628397309c5a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:59:34.452 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 03:59:34 smithi060 podman[61255]: 2024-09-21 03:59:34.147390541 +0000 UTC m=+0.382930744 container init d36b2b6e68805ae54025da1d5949184faa7bf0c96d045ddb7e4628397309c5a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T03:59:34.452 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 03:59:34 smithi060 podman[61255]: 2024-09-21 03:59:34.150423266 +0000 UTC m=+0.385963455 container start d36b2b6e68805ae54025da1d5949184faa7bf0c96d045ddb7e4628397309c5a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T03:59:34.452 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 03:59:34 smithi060 ceph-mds[61274]: -- 172.21.15.60:0/3986213776 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5600dff29860 con 0x5600e40d1a80 2024-09-21T03:59:34.452 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 03:59:34 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e[61270]: starting mds.e at 2024-09-21T03:59:34.452 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 03:59:34 smithi060 bash[61255]: d36b2b6e68805ae54025da1d5949184faa7bf0c96d045ddb7e4628397309c5a3 2024-09-21T03:59:34.452 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 03:59:34 smithi060 systemd[1]: Started Ceph mds.e for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:34.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:34 smithi022 ceph-mon[31015]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:34.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:34 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:34.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:34 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:34.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:34 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:34.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:34 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:34.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:34 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:34.758 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:34 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:34.849 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:34 smithi073 ceph-mon[34443]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:34.849 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:34 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:34.849 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:34 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:34.849 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:34 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:34.849 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:34 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:34.849 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:34 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:34.849 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:34 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:34 smithi060 ceph-mon[33722]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:34 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:34 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:34 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:34 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:34 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:34 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:35.394 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:35.668 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:35.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:35 smithi022 ceph-mon[31015]: Deploying daemon mds.f on smithi073 2024-09-21T03:59:35.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:35 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.60:6834/2092262185,v1:172.21.15.60:6835/2092262185] up:boot 2024-09-21T03:59:35.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:35 smithi022 ceph-mon[31015]: fsmap 5 up:standby 2024-09-21T03:59:35.789 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:35 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:59:35.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:35 smithi073 ceph-mon[34443]: Deploying daemon mds.f on smithi073 2024-09-21T03:59:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:35 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.60:6834/2092262185,v1:172.21.15.60:6835/2092262185] up:boot 2024-09-21T03:59:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:35 smithi073 ceph-mon[34443]: fsmap 5 up:standby 2024-09-21T03:59:35.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:35 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:59:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:35 smithi060 ceph-mon[33722]: Deploying daemon mds.f on smithi073 2024-09-21T03:59:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:35 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.60:6834/2092262185,v1:172.21.15.60:6835/2092262185] up:boot 2024-09-21T03:59:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:35 smithi060 ceph-mon[33722]: fsmap 5 up:standby 2024-09-21T03:59:35.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:35 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T03:59:36.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.168+0000 7fd6d6536640 1 -- 172.21.15.22:0/927010816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d0108cf0 msgr2=0x7fd6d010f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:36.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.168+0000 7fd6d6536640 1 --2- 172.21.15.22:0/927010816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d0108cf0 0x7fd6d010f520 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009ca0 tx=0x7fd6c802a8c0 comp rx=0 tx=0).stop 2024-09-21T03:59:36.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.168+0000 7fd6d6536640 1 -- 172.21.15.22:0/927010816 shutdown_connections 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.168+0000 7fd6d6536640 1 --2- 172.21.15.22:0/927010816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d0108cf0 0x7fd6d010f520 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.168+0000 7fd6d6536640 1 --2- 172.21.15.22:0/927010816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d01083a0 0x7fd6d01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.168+0000 7fd6d6536640 1 --2- 172.21.15.22:0/927010816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d0102a60 0x7fd6d0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.168+0000 7fd6d6536640 1 -- 172.21.15.22:0/927010816 >> 172.21.15.22:0/927010816 conn(0x7fd6d0079730 msgr2=0x7fd6d0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.168+0000 7fd6d6536640 1 -- 172.21.15.22:0/927010816 shutdown_connections 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.168+0000 7fd6d6536640 1 -- 172.21.15.22:0/927010816 wait complete. 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.169+0000 7fd6d6536640 1 Processor -- start 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.169+0000 7fd6d6536640 1 -- start start 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d6536640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d0102a60 0x7fd6d019a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d6536640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d01083a0 0x7fd6d019a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d6536640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d0108cf0 0x7fd6d019fb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:36.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d6536640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d0113960 con 0x7fd6d0108cf0 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d6536640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d01137e0 con 0x7fd6d01083a0 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d6536640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d0113ae0 con 0x7fd6d0102a60 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d4ad3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d0108cf0 0x7fd6d019fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d4ad3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d0108cf0 0x7fd6d019fb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44566/0 (socket says 172.21.15.22:44566) 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d4ad3640 1 -- 172.21.15.22:0/1553674696 learned_addr learned my addr 172.21.15.22:0/1553674696 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6cffff640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d0102a60 0x7fd6d019a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6cf7fe640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d01083a0 0x7fd6d019a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d4ad3640 1 -- 172.21.15.22:0/1553674696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d0102a60 msgr2=0x7fd6d019a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d4ad3640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d0102a60 0x7fd6d019a2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d4ad3640 1 -- 172.21.15.22:0/1553674696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d01083a0 msgr2=0x7fd6d019a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d4ad3640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d01083a0 0x7fd6d019a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6d4ad3640 1 -- 172.21.15.22:0/1553674696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d01a0260 con 0x7fd6d0108cf0 2024-09-21T03:59:36.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.170+0000 7fd6cffff640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d0102a60 0x7fd6d019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.171+0000 7fd6d4ad3640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d0108cf0 0x7fd6d019fb30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8005cc0 tx=0x7fd6c8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.171+0000 7fd6cd7fa640 1 -- 172.21.15.22:0/1553674696 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8032c10 con 0x7fd6d0108cf0 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.171+0000 7fd6cd7fa640 1 -- 172.21.15.22:0/1553674696 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6c8032db0 con 0x7fd6d0108cf0 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.171+0000 7fd6d6536640 1 -- 172.21.15.22:0/1553674696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d01a04f0 con 0x7fd6d0108cf0 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.171+0000 7fd6cd7fa640 1 -- 172.21.15.22:0/1553674696 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c8030a60 con 0x7fd6d0108cf0 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.171+0000 7fd6d6536640 1 -- 172.21.15.22:0/1553674696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d01a6cb0 con 0x7fd6d0108cf0 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.172+0000 7fd6d6536640 1 -- 172.21.15.22:0/1553674696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d0102e70 con 0x7fd6d0108cf0 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.173+0000 7fd6cd7fa640 1 -- 172.21.15.22:0/1553674696 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd6c8030c20 con 0x7fd6d0108cf0 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.174+0000 7fd6cd7fa640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6b80b6510 0x7fd6b80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.174+0000 7fd6cffff640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6b80b6510 0x7fd6b80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.174+0000 7fd6cd7fa640 1 -- 172.21.15.22:0/1553674696 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fd6c8108060 con 0x7fd6d0108cf0 2024-09-21T03:59:36.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.175+0000 7fd6cffff640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6b80b6510 0x7fd6b80b8a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009fc0 tx=0x7fd6c0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:36.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.179+0000 7fd6cd7fa640 1 -- 172.21.15.22:0/1553674696 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6c80cecf0 con 0x7fd6d0108cf0 2024-09-21T03:59:36.333 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 03:59:36 smithi073 systemd[1]: Starting Ceph mds.f for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:59:36.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.405+0000 7fd6d6536640 1 -- 172.21.15.22:0/1553674696 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd6d010ab40 con 0x7fd6d0108cf0 2024-09-21T03:59:36.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.405+0000 7fd6cd7fa640 1 -- 172.21.15.22:0/1553674696 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4732 (secure 0 0 0) 0x7fd6c80098b0 con 0x7fd6d0108cf0 2024-09-21T03:59:36.408 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:36.408 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":6,"btime":"2024-09-21T03:59:34:495685+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24596,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-21T03:59:36.408 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 6 2024-09-21T03:59:36.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 -- 172.21.15.22:0/1553674696 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6b80b6510 msgr2=0x7fd6b80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6b80b6510 0x7fd6b80b8a20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fd6c0009fc0 tx=0x7fd6c0005f90 comp rx=0 tx=0).stop 2024-09-21T03:59:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 -- 172.21.15.22:0/1553674696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d0108cf0 msgr2=0x7fd6d019fb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d0108cf0 0x7fd6d019fb30 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8005cc0 tx=0x7fd6c8003f90 comp rx=0 tx=0).stop 2024-09-21T03:59:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 -- 172.21.15.22:0/1553674696 shutdown_connections 2024-09-21T03:59:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6b80b6510 0x7fd6b80b8a20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6d0108cf0 0x7fd6d019fb30 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6d01083a0 0x7fd6d019a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 --2- 172.21.15.22:0/1553674696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6d0102a60 0x7fd6d019a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 -- 172.21.15.22:0/1553674696 >> 172.21.15.22:0/1553674696 conn(0x7fd6d0079730 msgr2=0x7fd6d01043b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:36.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 -- 172.21.15.22:0/1553674696 shutdown_connections 2024-09-21T03:59:36.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:36.408+0000 7fd6d6536640 1 -- 172.21.15.22:0/1553674696 wait complete. 2024-09-21T03:59:36.587 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:36 smithi073 ceph-mon[34443]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:36.587 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:36 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1553674696' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:36.588 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 03:59:36 smithi073 podman[62518]: 2024-09-21 03:59:36.234725235 +0000 UTC m=+0.015306878 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:59:36.588 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 03:59:36 smithi073 podman[62518]: 2024-09-21 03:59:36.341768055 +0000 UTC m=+0.122349686 container create 0d2eb9eae6154d573f02e001976969da3a7c48ff64069e8e63e19b028e58ce93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T03:59:36.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:36 smithi022 ceph-mon[31015]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:36.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:36 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1553674696' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:36.854 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 03:59:36 smithi073 podman[62518]: 2024-09-21 03:59:36.586395934 +0000 UTC m=+0.366977573 container init 0d2eb9eae6154d573f02e001976969da3a7c48ff64069e8e63e19b028e58ce93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T03:59:36.855 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 03:59:36 smithi073 podman[62518]: 2024-09-21 03:59:36.589590551 +0000 UTC m=+0.370172183 container start 0d2eb9eae6154d573f02e001976969da3a7c48ff64069e8e63e19b028e58ce93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS) 2024-09-21T03:59:36.855 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 03:59:36 smithi073 ceph-mds[62537]: -- 172.21.15.73:0/2810420072 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fc0d6ad860 con 0x55fc11855a80 2024-09-21T03:59:36.855 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 03:59:36 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f[62533]: starting mds.f at 2024-09-21T03:59:36.855 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 03:59:36 smithi073 bash[62518]: 0d2eb9eae6154d573f02e001976969da3a7c48ff64069e8e63e19b028e58ce93 2024-09-21T03:59:36.855 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 03:59:36 smithi073 systemd[1]: Started Ceph mds.f for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:36.951 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:36 smithi060 ceph-mon[33722]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:36 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1553674696' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:38.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:38.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:38.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:38.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:38.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:38.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:38.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: Deploying daemon mds.c on smithi073 2024-09-21T03:59:38.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:38.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] up:boot 2024-09-21T03:59:38.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: fsmap 6 up:standby 2024-09-21T03:59:38.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:37 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:59:38.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:38.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:38.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:38.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:38.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:38.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:38.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: Deploying daemon mds.c on smithi073 2024-09-21T03:59:38.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:38.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] up:boot 2024-09-21T03:59:38.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: fsmap 6 up:standby 2024-09-21T03:59:38.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:37 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:59:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: Deploying daemon mds.c on smithi073 2024-09-21T03:59:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] up:boot 2024-09-21T03:59:38.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: fsmap 6 up:standby 2024-09-21T03:59:38.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:37 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T03:59:38.823 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 03:59:38 smithi073 systemd[1]: Starting Ceph mds.c for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:59:39.104 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 03:59:38 smithi073 podman[62785]: 2024-09-21 03:59:38.724279657 +0000 UTC m=+0.015687396 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:59:39.105 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 03:59:38 smithi073 podman[62785]: 2024-09-21 03:59:38.864176156 +0000 UTC m=+0.155583881 container create 7db555eed38f8e5ae5d19b5ab15acedfabdee0f50b6b7e09717c247aaafacecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:59:39.331 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:39.605 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:39.605 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 03:59:39 smithi073 podman[62785]: 2024-09-21 03:59:39.108471421 +0000 UTC m=+0.399879147 container init 7db555eed38f8e5ae5d19b5ab15acedfabdee0f50b6b7e09717c247aaafacecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T03:59:39.605 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 03:59:39 smithi073 podman[62785]: 2024-09-21 03:59:39.111211569 +0000 UTC m=+0.402619304 container start 7db555eed38f8e5ae5d19b5ab15acedfabdee0f50b6b7e09717c247aaafacecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T03:59:39.605 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 03:59:39 smithi073 ceph-mds[62804]: -- 172.21.15.73:0/3977460393 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5578f07b3c20 con 0x5578f495ba80 2024-09-21T03:59:39.605 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 03:59:39 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c[62800]: starting mds.c at 2024-09-21T03:59:39.605 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 03:59:39 smithi073 bash[62785]: 7db555eed38f8e5ae5d19b5ab15acedfabdee0f50b6b7e09717c247aaafacecb 2024-09-21T03:59:39.605 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 03:59:39 smithi073 systemd[1]: Started Ceph mds.c for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:40.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.104+0000 7f5939542640 1 -- 172.21.15.22:0/441109838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5934108cf0 msgr2=0x7f593410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:40.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.104+0000 7f5939542640 1 --2- 172.21.15.22:0/441109838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5934108cf0 0x7f593410f520 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f592c009ca0 tx=0x7f592c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.104+0000 7f5939542640 1 -- 172.21.15.22:0/441109838 shutdown_connections 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.104+0000 7f5939542640 1 --2- 172.21.15.22:0/441109838 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5934108cf0 0x7f593410f520 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.104+0000 7f5939542640 1 --2- 172.21.15.22:0/441109838 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59341083a0 0x7f59341087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.104+0000 7f5939542640 1 --2- 172.21.15.22:0/441109838 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5934102a60 0x7f5934102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.104+0000 7f5939542640 1 -- 172.21.15.22:0/441109838 >> 172.21.15.22:0/441109838 conn(0x7f5934079730 msgr2=0x7f5934079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.104+0000 7f5939542640 1 -- 172.21.15.22:0/441109838 shutdown_connections 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.104+0000 7f5939542640 1 -- 172.21.15.22:0/441109838 wait complete. 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.105+0000 7f5939542640 1 Processor -- start 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.105+0000 7f5939542640 1 -- start start 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.105+0000 7f5939542640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5934102a60 0x7f593419b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.105+0000 7f5939542640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59341083a0 0x7f593419b610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:40.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.105+0000 7f5939542640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5934108cf0 0x7f593419bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.105+0000 7f5939542640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5934112860 con 0x7f5934108cf0 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.105+0000 7f5939542640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f59341126e0 con 0x7f59341083a0 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.105+0000 7f5939542640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f59341129e0 con 0x7f5934102a60 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f59337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5934108cf0 0x7f593419bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f59337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5934108cf0 0x7f593419bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44586/0 (socket says 172.21.15.22:44586) 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f59337fe640 1 -- 172.21.15.22:0/950303871 learned_addr learned my addr 172.21.15.22:0/950303871 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f59327fc640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59341083a0 0x7f593419b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f5932ffd640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5934102a60 0x7f593419b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f59337fe640 1 -- 172.21.15.22:0/950303871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5934102a60 msgr2=0x7f593419b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f59337fe640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5934102a60 0x7f593419b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f59337fe640 1 -- 172.21.15.22:0/950303871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59341083a0 msgr2=0x7f593419b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f59337fe640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59341083a0 0x7f593419b610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f59337fe640 1 -- 172.21.15.22:0/950303871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59341a6350 con 0x7f5934108cf0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f59337fe640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5934108cf0 0x7f593419bb50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f592c005cc0 tx=0x7f592c032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.106+0000 7f591bfff640 1 -- 172.21.15.22:0/950303871 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c004040 con 0x7f5934108cf0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.107+0000 7f5939542640 1 -- 172.21.15.22:0/950303871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59341a65e0 con 0x7f5934108cf0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.107+0000 7f591bfff640 1 -- 172.21.15.22:0/950303871 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f592c004670 con 0x7f5934108cf0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.107+0000 7f591bfff640 1 -- 172.21.15.22:0/950303871 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c030cc0 con 0x7f5934108cf0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.107+0000 7f5939542640 1 -- 172.21.15.22:0/950303871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59341a6b70 con 0x7f5934108cf0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.108+0000 7f5939542640 1 -- 172.21.15.22:0/950303871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5934102e70 con 0x7f5934108cf0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.109+0000 7f591bfff640 1 -- 172.21.15.22:0/950303871 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f592c0041e0 con 0x7f5934108cf0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.110+0000 7f591bfff640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f591c0b6510 0x7f591c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.110+0000 7f591bfff640 1 -- 172.21.15.22:0/950303871 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f592c108420 con 0x7f5934108cf0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.111+0000 7f5932ffd640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f591c0b6510 0x7f591c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:40.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.111+0000 7f5932ffd640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f591c0b6510 0x7f591c0b8a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f59240058c0 tx=0x7f592400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:40.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.118+0000 7f591bfff640 1 -- 172.21.15.22:0/950303871 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f592c0cf0b0 con 0x7f5934108cf0 2024-09-21T03:59:40.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:40.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:40.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:40.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:40.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:40.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:40.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:40.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: Deploying daemon mds.h on smithi060 2024-09-21T03:59:40.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] up:boot 2024-09-21T03:59:40.303 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: fsmap 7 up:standby 2024-09-21T03:59:40.304 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:40 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:59:40.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.347+0000 7f5939542640 1 -- 172.21.15.22:0/950303871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f593410ab20 con 0x7f5934108cf0 2024-09-21T03:59:40.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.348+0000 7f591bfff640 1 -- 172.21.15.22:0/950303871 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6382 (secure 0 0 0) 0x7f592c0d3490 con 0x7f5934108cf0 2024-09-21T03:59:40.350 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:40.350 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":8,"btime":"2024-09-21T03:59:39:954063+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24596,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-09-21T03:59:40.351 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 8 2024-09-21T03:59:40.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 -- 172.21.15.22:0/950303871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f591c0b6510 msgr2=0x7f591c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:40.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f591c0b6510 0x7f591c0b8a20 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f59240058c0 tx=0x7f592400a2d0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 -- 172.21.15.22:0/950303871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5934108cf0 msgr2=0x7f593419bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:40.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5934108cf0 0x7f593419bb50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f592c005cc0 tx=0x7f592c032c40 comp rx=0 tx=0).stop 2024-09-21T03:59:40.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 -- 172.21.15.22:0/950303871 shutdown_connections 2024-09-21T03:59:40.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f591c0b6510 0x7f591c0b8a20 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5934108cf0 0x7f593419bb50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59341083a0 0x7f593419b610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 --2- 172.21.15.22:0/950303871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5934102a60 0x7f593419b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:40.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 -- 172.21.15.22:0/950303871 >> 172.21.15.22:0/950303871 conn(0x7f5934079730 msgr2=0x7f59341043d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:40.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 -- 172.21.15.22:0/950303871 shutdown_connections 2024-09-21T03:59:40.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:40.351+0000 7f5939542640 1 -- 172.21.15.22:0/950303871 wait complete. 2024-09-21T03:59:40.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: Deploying daemon mds.h on smithi060 2024-09-21T03:59:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] up:boot 2024-09-21T03:59:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: fsmap 7 up:standby 2024-09-21T03:59:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:40 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:59:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:40.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:40.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: Deploying daemon mds.h on smithi060 2024-09-21T03:59:40.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] up:boot 2024-09-21T03:59:40.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: fsmap 7 up:standby 2024-09-21T03:59:40.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:40 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T03:59:41.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:41 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/950303871' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:41.452 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 03:59:41 smithi060 systemd[1]: Starting Ceph mds.h for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:59:41.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:41 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/950303871' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:41.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:41 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/950303871' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:41.855 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 03:59:41 smithi060 podman[61525]: 2024-09-21 03:59:41.465273785 +0000 UTC m=+0.016347114 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:59:41.856 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 03:59:41 smithi060 podman[61525]: 2024-09-21 03:59:41.600998703 +0000 UTC m=+0.152072022 container create a283df23cc3dadb819a7277f158b48398194806ae329ae84ee6d492cdbdd8c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:59:41.856 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 03:59:41 smithi060 podman[61525]: 2024-09-21 03:59:41.854263745 +0000 UTC m=+0.405337071 container init a283df23cc3dadb819a7277f158b48398194806ae329ae84ee6d492cdbdd8c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T03:59:42.202 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 03:59:41 smithi060 podman[61525]: 2024-09-21 03:59:41.85731686 +0000 UTC m=+0.408390188 container start a283df23cc3dadb819a7277f158b48398194806ae329ae84ee6d492cdbdd8c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:59:42.202 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 03:59:41 smithi060 ceph-mds[61544]: -- 172.21.15.60:0/9369525 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56533d57f860 con 0x565341727180 2024-09-21T03:59:42.202 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 03:59:41 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h[61540]: starting mds.h at 2024-09-21T03:59:42.202 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 03:59:41 smithi060 bash[61525]: a283df23cc3dadb819a7277f158b48398194806ae329ae84ee6d492cdbdd8c45 2024-09-21T03:59:42.202 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 03:59:41 smithi060 systemd[1]: Started Ceph mds.h for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:42.518 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:42 smithi073 ceph-mon[34443]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:42.518 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:42 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:42.518 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:42 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:42.519 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:42 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:42.519 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:42 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:42.519 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:42 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:42.519 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:42 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:42 smithi022 ceph-mon[31015]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:42.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:42 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:42 smithi060 ceph-mon[33722]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:42 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:42 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:42 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:42 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:42 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:42 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:43.031 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:43.305 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:43.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:43 smithi022 ceph-mon[31015]: Deploying daemon mds.i on smithi073 2024-09-21T03:59:43.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:43 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] up:boot 2024-09-21T03:59:43.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:43 smithi022 ceph-mon[31015]: fsmap 8 up:standby 2024-09-21T03:59:43.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:43 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:59:43.490 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:43 smithi060 ceph-mon[33722]: Deploying daemon mds.i on smithi073 2024-09-21T03:59:43.490 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:43 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] up:boot 2024-09-21T03:59:43.490 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:43 smithi060 ceph-mon[33722]: fsmap 8 up:standby 2024-09-21T03:59:43.490 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:43 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:59:43.559 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:43 smithi073 ceph-mon[34443]: Deploying daemon mds.i on smithi073 2024-09-21T03:59:43.559 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:43 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] up:boot 2024-09-21T03:59:43.559 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:43 smithi073 ceph-mon[34443]: fsmap 8 up:standby 2024-09-21T03:59:43.560 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:43 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T03:59:43.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.769+0000 7fde5aeac640 1 -- 172.21.15.22:0/1228750080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde54109df0 msgr2=0x7fde54110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:43.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.769+0000 7fde5aeac640 1 --2- 172.21.15.22:0/1228750080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde54109df0 0x7fde54110620 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009ca0 tx=0x7fde4c02a8c0 comp rx=0 tx=0).stop 2024-09-21T03:59:43.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.769+0000 7fde5aeac640 1 -- 172.21.15.22:0/1228750080 shutdown_connections 2024-09-21T03:59:43.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.769+0000 7fde5aeac640 1 --2- 172.21.15.22:0/1228750080 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde541094a0 0x7fde541098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:43.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.769+0000 7fde5aeac640 1 --2- 172.21.15.22:0/1228750080 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde54109df0 0x7fde54110620 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.769+0000 7fde5aeac640 1 --2- 172.21.15.22:0/1228750080 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde54103b60 0x7fde54103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.769+0000 7fde5aeac640 1 -- 172.21.15.22:0/1228750080 >> 172.21.15.22:0/1228750080 conn(0x7fde5407b850 msgr2=0x7fde5407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.769+0000 7fde5aeac640 1 -- 172.21.15.22:0/1228750080 shutdown_connections 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.769+0000 7fde5aeac640 1 -- 172.21.15.22:0/1228750080 wait complete. 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.770+0000 7fde5aeac640 1 Processor -- start 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.770+0000 7fde5aeac640 1 -- start start 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde5aeac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde54103b60 0x7fde5419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde5aeac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde541094a0 0x7fde5419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde5aeac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde54109df0 0x7fde5419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde5aeac640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fde541139b0 con 0x7fde54103b60 2024-09-21T03:59:43.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde5aeac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fde54113830 con 0x7fde54109df0 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde5aeac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fde54113b30 con 0x7fde541094a0 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde58c48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde54103b60 0x7fde5419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde58c48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde54103b60 0x7fde5419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49474/0 (socket says 172.21.15.22:49474) 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde58c48640 1 -- 172.21.15.22:0/1110460238 learned_addr learned my addr 172.21.15.22:0/1110460238 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde53fff640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde541094a0 0x7fde5419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde59449640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde54109df0 0x7fde5419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde58c48640 1 -- 172.21.15.22:0/1110460238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde541094a0 msgr2=0x7fde5419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde58c48640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde541094a0 0x7fde5419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde58c48640 1 -- 172.21.15.22:0/1110460238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde54109df0 msgr2=0x7fde5419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde58c48640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde54109df0 0x7fde5419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde58c48640 1 -- 172.21.15.22:0/1110460238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde541a0430 con 0x7fde54103b60 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde58c48640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde54103b60 0x7fde5419a4c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fde4400e9f0 tx=0x7fde4400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde51ffb640 1 -- 172.21.15.22:0/1110460238 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4400cd80 con 0x7fde54103b60 2024-09-21T03:59:43.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.771+0000 7fde51ffb640 1 -- 172.21.15.22:0/1110460238 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fde440108c0 con 0x7fde54103b60 2024-09-21T03:59:43.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.772+0000 7fde51ffb640 1 -- 172.21.15.22:0/1110460238 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde440187c0 con 0x7fde54103b60 2024-09-21T03:59:43.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.772+0000 7fde5aeac640 1 -- 172.21.15.22:0/1110460238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde541a0720 con 0x7fde54103b60 2024-09-21T03:59:43.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.772+0000 7fde5aeac640 1 -- 172.21.15.22:0/1110460238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde541a6e80 con 0x7fde54103b60 2024-09-21T03:59:43.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.773+0000 7fde5aeac640 1 -- 172.21.15.22:0/1110460238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde54103f70 con 0x7fde54103b60 2024-09-21T03:59:43.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.774+0000 7fde51ffb640 1 -- 172.21.15.22:0/1110460238 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fde44010430 con 0x7fde54103b60 2024-09-21T03:59:43.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.775+0000 7fde51ffb640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fde400b6590 0x7fde400b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:43.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.775+0000 7fde53fff640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fde400b6590 0x7fde400b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:43.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.776+0000 7fde51ffb640 1 -- 172.21.15.22:0/1110460238 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fde440e7610 con 0x7fde54103b60 2024-09-21T03:59:43.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.776+0000 7fde53fff640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fde400b6590 0x7fde400b8aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde54109220 tx=0x7fde3c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:43.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:43.779+0000 7fde51ffb640 1 -- 172.21.15.22:0/1110460238 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fde440b2700 con 0x7fde54103b60 2024-09-21T03:59:44.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.004+0000 7fde5aeac640 1 -- 172.21.15.22:0/1110460238 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fde5419b5f0 con 0x7fde54103b60 2024-09-21T03:59:44.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.005+0000 7fde51ffb640 1 -- 172.21.15.22:0/1110460238 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7207 (secure 0 0 0) 0x7fde440b7640 con 0x7fde54103b60 2024-09-21T03:59:44.008 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:44.008 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":9,"btime":"2024-09-21T03:59:42:255807+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24596,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-21T03:59:44.008 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 9 2024-09-21T03:59:44.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.007+0000 7fde5aeac640 1 -- 172.21.15.22:0/1110460238 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fde400b6590 msgr2=0x7fde400b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:44.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.007+0000 7fde5aeac640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fde400b6590 0x7fde400b8aa0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fde54109220 tx=0x7fde3c00b390 comp rx=0 tx=0).stop 2024-09-21T03:59:44.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.007+0000 7fde5aeac640 1 -- 172.21.15.22:0/1110460238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde54103b60 msgr2=0x7fde5419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:44.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.007+0000 7fde5aeac640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde54103b60 0x7fde5419a4c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fde4400e9f0 tx=0x7fde4400eeb0 comp rx=0 tx=0).stop 2024-09-21T03:59:44.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.007+0000 7fde5aeac640 1 -- 172.21.15.22:0/1110460238 shutdown_connections 2024-09-21T03:59:44.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.007+0000 7fde5aeac640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fde400b6590 0x7fde400b8aa0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:44.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.007+0000 7fde5aeac640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fde541094a0 0x7fde5419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:44.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.007+0000 7fde5aeac640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fde54109df0 0x7fde5419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:44.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.007+0000 7fde5aeac640 1 --2- 172.21.15.22:0/1110460238 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fde54103b60 0x7fde5419a4c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:44.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.007+0000 7fde5aeac640 1 -- 172.21.15.22:0/1110460238 >> 172.21.15.22:0/1110460238 conn(0x7fde5407b850 msgr2=0x7fde54107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:44.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.008+0000 7fde5aeac640 1 -- 172.21.15.22:0/1110460238 shutdown_connections 2024-09-21T03:59:44.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:44.008+0000 7fde5aeac640 1 -- 172.21.15.22:0/1110460238 wait complete. 2024-09-21T03:59:44.270 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 03:59:44 smithi073 podman[63066]: 2024-09-21 03:59:44.177759803 +0000 UTC m=+0.133925589 container create d4733cff45788abd26bb9ab5c5a1fd2754dfba88cc9f3257e03dd5d17c700048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T03:59:44.524 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:44 smithi073 ceph-mon[34443]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:44.524 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:44 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1110460238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:44.524 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 03:59:44 smithi073 podman[63066]: 2024-09-21 03:59:44.430858841 +0000 UTC m=+0.387024628 container init d4733cff45788abd26bb9ab5c5a1fd2754dfba88cc9f3257e03dd5d17c700048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:59:44.524 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 03:59:44 smithi073 podman[63066]: 2024-09-21 03:59:44.433650734 +0000 UTC m=+0.389816521 container start d4733cff45788abd26bb9ab5c5a1fd2754dfba88cc9f3257e03dd5d17c700048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T03:59:44.524 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 03:59:44 smithi073 ceph-mds[63085]: -- 172.21.15.73:0/3932499351 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c51478f860 con 0x55c518937180 2024-09-21T03:59:44.524 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 03:59:44 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i[63081]: starting mds.i at 2024-09-21T03:59:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:44 smithi022 ceph-mon[31015]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:44 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1110460238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:44.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:44 smithi060 ceph-mon[33722]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:44.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:44 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1110460238' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:44.854 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 03:59:44 smithi073 bash[63066]: d4733cff45788abd26bb9ab5c5a1fd2754dfba88cc9f3257e03dd5d17c700048 2024-09-21T03:59:44.854 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 03:59:44 smithi073 systemd[1]: Started Ceph mds.i for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:45.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:45 smithi022 ceph-mon[31015]: Deploying daemon mds.g on smithi022 2024-09-21T03:59:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:45 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] up:boot 2024-09-21T03:59:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:45 smithi022 ceph-mon[31015]: fsmap 9 up:standby 2024-09-21T03:59:45.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:45 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:59:45.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:45.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:45.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:45 smithi073 ceph-mon[34443]: Deploying daemon mds.g on smithi022 2024-09-21T03:59:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:45 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] up:boot 2024-09-21T03:59:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:45 smithi073 ceph-mon[34443]: fsmap 9 up:standby 2024-09-21T03:59:45.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:45 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:59:45.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:45.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:45.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:45.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:45.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:45.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:45.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:45 smithi060 ceph-mon[33722]: Deploying daemon mds.g on smithi022 2024-09-21T03:59:45.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:45 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] up:boot 2024-09-21T03:59:45.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:45 smithi060 ceph-mon[33722]: fsmap 9 up:standby 2024-09-21T03:59:45.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:45 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T03:59:46.590 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 03:59:46 smithi022 systemd[1]: Starting Ceph mds.g for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:59:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:46 smithi022 ceph-mon[31015]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:46.849 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:46.850 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 03:59:46 smithi022 podman[71705]: 2024-09-21 03:59:46.625719872 +0000 UTC m=+0.016706871 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:59:46.850 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 03:59:46 smithi022 podman[71705]: 2024-09-21 03:59:46.753326887 +0000 UTC m=+0.144313873 container create a5d6deb87649bc417832b4237a398a8f424022114a5559ac9450209c32f34f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T03:59:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:46 smithi073 ceph-mon[34443]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:46 smithi060 ceph-mon[33722]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:47.128 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 03:59:47 smithi022 podman[71705]: 2024-09-21 03:59:47.123009264 +0000 UTC m=+0.513996264 container init a5d6deb87649bc417832b4237a398a8f424022114a5559ac9450209c32f34f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T03:59:47.128 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 03:59:47 smithi022 podman[71705]: 2024-09-21 03:59:47.126436079 +0000 UTC m=+0.517423067 container start a5d6deb87649bc417832b4237a398a8f424022114a5559ac9450209c32f34f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:59:47.301 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:47.425 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 03:59:47 smithi022 ceph-mds[71754]: -- 172.21.15.22:0/3413822120 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564538b91860 con 0x56453cd39180 2024-09-21T03:59:47.425 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 03:59:47 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g[71737]: starting mds.g at 2024-09-21T03:59:47.425 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 03:59:47 smithi022 bash[71705]: a5d6deb87649bc417832b4237a398a8f424022114a5559ac9450209c32f34f0b 2024-09-21T03:59:47.425 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 03:59:47 smithi022 systemd[1]: Started Ceph mds.g for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:47.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.828+0000 7fcefa249640 1 -- 172.21.15.22:0/4274465752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcef4109df0 msgr2=0x7fcef4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:47.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.828+0000 7fcefa249640 1 --2- 172.21.15.22:0/4274465752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcef4109df0 0x7fcef4110620 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fceec009900 tx=0x7fceec02a3f0 comp rx=0 tx=0).stop 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.828+0000 7fcefa249640 1 -- 172.21.15.22:0/4274465752 shutdown_connections 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.828+0000 7fcefa249640 1 --2- 172.21.15.22:0/4274465752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcef4109df0 0x7fcef4110620 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.828+0000 7fcefa249640 1 --2- 172.21.15.22:0/4274465752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41094a0 0x7fcef41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.828+0000 7fcefa249640 1 --2- 172.21.15.22:0/4274465752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef4103b60 0x7fcef4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.828+0000 7fcefa249640 1 -- 172.21.15.22:0/4274465752 >> 172.21.15.22:0/4274465752 conn(0x7fcef407b850 msgr2=0x7fcef407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.828+0000 7fcefa249640 1 -- 172.21.15.22:0/4274465752 shutdown_connections 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.828+0000 7fcefa249640 1 -- 172.21.15.22:0/4274465752 wait complete. 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.829+0000 7fcefa249640 1 Processor -- start 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.829+0000 7fcefa249640 1 -- start start 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.829+0000 7fcefa249640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcef4103b60 0x7fcef4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.829+0000 7fcefa249640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41094a0 0x7fcef4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:47.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.829+0000 7fcefa249640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef4109df0 0x7fcef4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.829+0000 7fcefa249640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcef4113960 con 0x7fcef4103b60 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.829+0000 7fcefa249640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcef41137e0 con 0x7fcef41094a0 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.829+0000 7fcefa249640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcef4113ae0 con 0x7fcef4109df0 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcef4103b60 0x7fcef4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcef4103b60 0x7fcef4075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49508/0 (socket says 172.21.15.22:49508) 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef37fe640 1 -- 172.21.15.22:0/3713372270 learned_addr learned my addr 172.21.15.22:0/3713372270 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef2ffd640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41094a0 0x7fcef4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef37fe640 1 -- 172.21.15.22:0/3713372270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef4109df0 msgr2=0x7fcef4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef37fe640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef4109df0 0x7fcef4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef37fe640 1 -- 172.21.15.22:0/3713372270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41094a0 msgr2=0x7fcef4075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef37fe640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41094a0 0x7fcef4075c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef37fe640 1 -- 172.21.15.22:0/3713372270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef41a8600 con 0x7fcef4103b60 2024-09-21T03:59:47.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef2ffd640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41094a0 0x7fcef4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef37fe640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcef4103b60 0x7fcef4075710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcee400ea80 tx=0x7fcee400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef0ff9640 1 -- 172.21.15.22:0/3713372270 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee400ce40 con 0x7fcef4103b60 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef0ff9640 1 -- 172.21.15.22:0/3713372270 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcee4005020 con 0x7fcef4103b60 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcefa249640 1 -- 172.21.15.22:0/3713372270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef41a88f0 con 0x7fcef4103b60 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcef0ff9640 1 -- 172.21.15.22:0/3713372270 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee40116d0 con 0x7fcef4103b60 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.830+0000 7fcefa249640 1 -- 172.21.15.22:0/3713372270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef41a8de0 con 0x7fcef4103b60 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.831+0000 7fcefa249640 1 -- 172.21.15.22:0/3713372270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef4103f70 con 0x7fcef4103b60 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.833+0000 7fcef0ff9640 1 -- 172.21.15.22:0/3713372270 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fcee4004a40 con 0x7fcef4103b60 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.834+0000 7fcef0ff9640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcee00b6510 0x7fcee00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.834+0000 7fcef2ffd640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcee00b6510 0x7fcee00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.834+0000 7fcef0ff9640 1 -- 172.21.15.22:0/3713372270 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fcee40e7550 con 0x7fcef4103b60 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.834+0000 7fcef2ffd640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcee00b6510 0x7fcee00b8a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcef4107510 tx=0x7fcedc005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:47.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:47.837+0000 7fcef0ff9640 1 -- 172.21.15.22:0/3713372270 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcee4016030 con 0x7fcef4103b60 2024-09-21T03:59:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.072+0000 7fcefa249640 1 -- 172.21.15.22:0/3713372270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcef4076a10 con 0x7fcef4103b60 2024-09-21T03:59:48.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.073+0000 7fcef0ff9640 1 -- 172.21.15.22:0/3713372270 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8854 (secure 0 0 0) 0x7fcee40ae1e0 con 0x7fcef4103b60 2024-09-21T03:59:48.076 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:48.076 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":11,"btime":"2024-09-21T03:59:47:588111+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24596,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T03:59:48.076 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 11 2024-09-21T03:59:48.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 -- 172.21.15.22:0/3713372270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcee00b6510 msgr2=0x7fcee00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcee00b6510 0x7fcee00b8a20 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fcef4107510 tx=0x7fcedc005d20 comp rx=0 tx=0).stop 2024-09-21T03:59:48.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 -- 172.21.15.22:0/3713372270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcef4103b60 msgr2=0x7fcef4075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:48.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcef4103b60 0x7fcef4075710 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcee400ea80 tx=0x7fcee400ef40 comp rx=0 tx=0).stop 2024-09-21T03:59:48.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 -- 172.21.15.22:0/3713372270 shutdown_connections 2024-09-21T03:59:48.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcee00b6510 0x7fcee00b8a20 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcef4109df0 0x7fcef4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcef41094a0 0x7fcef4075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 --2- 172.21.15.22:0/3713372270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcef4103b60 0x7fcef4075710 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:48.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 -- 172.21.15.22:0/3713372270 >> 172.21.15.22:0/3713372270 conn(0x7fcef407b850 msgr2=0x7fcef4105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:48.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 -- 172.21.15.22:0/3713372270 shutdown_connections 2024-09-21T03:59:48.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:48.075+0000 7fcefa249640 1 -- 172.21.15.22:0/3713372270 wait complete. 2024-09-21T03:59:48.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:48.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:48.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:48.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:48.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:48.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:48.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:48.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: Deploying daemon mds.a on smithi022 2024-09-21T03:59:48.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.22:6838/61235994,v1:172.21.15.22:6839/61235994] up:boot 2024-09-21T03:59:48.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: fsmap 10 up:standby 2024-09-21T03:59:48.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:59:48.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:48 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3713372270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:48.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: Deploying daemon mds.a on smithi022 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.22:6838/61235994,v1:172.21.15.22:6839/61235994] up:boot 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: fsmap 10 up:standby 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:59:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:48 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3713372270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: Deploying daemon mds.a on smithi022 2024-09-21T03:59:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.22:6838/61235994,v1:172.21.15.22:6839/61235994] up:boot 2024-09-21T03:59:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: fsmap 10 up:standby 2024-09-21T03:59:48.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T03:59:48.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:48 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3713372270' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:50.152 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 03:59:49 smithi022 systemd[1]: Starting Ceph mds.a for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:59:50.434 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:50 smithi022 ceph-mon[31015]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:50.435 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 03:59:50 smithi022 podman[72089]: 2024-09-21 03:59:50.053914292 +0000 UTC m=+0.016378295 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:59:50.435 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 03:59:50 smithi022 podman[72089]: 2024-09-21 03:59:50.182861367 +0000 UTC m=+0.145325357 container create 90f20fbcc5b71d968f2203e7b8285822d53283b2162af4dd4b7c9c34cf38f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-21T03:59:50.435 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 03:59:50 smithi022 podman[72089]: 2024-09-21 03:59:50.433350845 +0000 UTC m=+0.395814842 container init 90f20fbcc5b71d968f2203e7b8285822d53283b2162af4dd4b7c9c34cf38f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T03:59:50.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:50 smithi073 ceph-mon[34443]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:50.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:50 smithi060 ceph-mon[33722]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:50.806 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 03:59:50 smithi022 podman[72089]: 2024-09-21 03:59:50.436595773 +0000 UTC m=+0.399059761 container start 90f20fbcc5b71d968f2203e7b8285822d53283b2162af4dd4b7c9c34cf38f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T03:59:50.807 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 03:59:50 smithi022 ceph-mds[72108]: -- 172.21.15.22:0/3045964714 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557421f35c20 con 0x5574260dd600 2024-09-21T03:59:50.807 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 03:59:50 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a[72104]: starting mds.a at 2024-09-21T03:59:50.807 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 03:59:50 smithi022 bash[72089]: 90f20fbcc5b71d968f2203e7b8285822d53283b2162af4dd4b7c9c34cf38f1a3 2024-09-21T03:59:50.807 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 03:59:50 smithi022 systemd[1]: Started Ceph mds.a for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:51.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:51 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:51.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:51 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:51.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:51 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:51.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:51 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:51.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:51 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:51.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:51 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:51.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:51 smithi060 ceph-mon[33722]: Deploying daemon mds.b on smithi060 2024-09-21T03:59:51.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:51 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.22:6840/2021253625,v1:172.21.15.22:6841/2021253625] up:boot 2024-09-21T03:59:51.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:51 smithi060 ceph-mon[33722]: fsmap 11 up:standby 2024-09-21T03:59:51.704 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:51 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:59:51.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:51 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:51.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:51 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:51.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:51 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:51.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:51 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:51.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:51 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:51.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:51 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:51.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:51 smithi022 ceph-mon[31015]: Deploying daemon mds.b on smithi060 2024-09-21T03:59:51.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:51 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.22:6840/2021253625,v1:172.21.15.22:6841/2021253625] up:boot 2024-09-21T03:59:51.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:51 smithi022 ceph-mon[31015]: fsmap 11 up:standby 2024-09-21T03:59:51.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:51 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:59:51.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:51 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:51.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:51 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:51.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:51 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:51.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:51 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T03:59:51.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:51 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T03:59:51.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:51 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:51.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:51 smithi073 ceph-mon[34443]: Deploying daemon mds.b on smithi060 2024-09-21T03:59:51.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:51 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.22:6840/2021253625,v1:172.21.15.22:6841/2021253625] up:boot 2024-09-21T03:59:51.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:51 smithi073 ceph-mon[34443]: fsmap 11 up:standby 2024-09-21T03:59:51.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:51 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T03:59:51.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:52.178 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.704+0000 7fbc0c87b640 1 -- 172.21.15.22:0/3584397490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc08108cf0 msgr2=0x7fbc0810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.704+0000 7fbc0c87b640 1 --2- 172.21.15.22:0/3584397490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc08108cf0 0x7fbc0810f520 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbc00009ca0 tx=0x7fbc0002a8c0 comp rx=0 tx=0).stop 2024-09-21T03:59:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.704+0000 7fbc0c87b640 1 -- 172.21.15.22:0/3584397490 shutdown_connections 2024-09-21T03:59:52.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.704+0000 7fbc0c87b640 1 --2- 172.21.15.22:0/3584397490 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc08108cf0 0x7fbc0810f520 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.704+0000 7fbc0c87b640 1 --2- 172.21.15.22:0/3584397490 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc081083a0 0x7fbc081087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.704+0000 7fbc0c87b640 1 --2- 172.21.15.22:0/3584397490 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc08102a60 0x7fbc08102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.704+0000 7fbc0c87b640 1 -- 172.21.15.22:0/3584397490 >> 172.21.15.22:0/3584397490 conn(0x7fbc08079730 msgr2=0x7fbc08079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.704+0000 7fbc0c87b640 1 -- 172.21.15.22:0/3584397490 shutdown_connections 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.704+0000 7fbc0c87b640 1 -- 172.21.15.22:0/3584397490 wait complete. 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.705+0000 7fbc0c87b640 1 Processor -- start 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.705+0000 7fbc0c87b640 1 -- start start 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.705+0000 7fbc0c87b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc08102a60 0x7fbc0819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.705+0000 7fbc0c87b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc081083a0 0x7fbc0819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.705+0000 7fbc0c87b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc08108cf0 0x7fbc081a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.705+0000 7fbc0c87b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbc08112860 con 0x7fbc08102a60 2024-09-21T03:59:52.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.705+0000 7fbc0c87b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbc081126e0 con 0x7fbc081083a0 2024-09-21T03:59:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.705+0000 7fbc0c87b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbc081129e0 con 0x7fbc08108cf0 2024-09-21T03:59:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc0659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc08102a60 0x7fbc0819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc0659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc08102a60 0x7fbc0819c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40562/0 (socket says 172.21.15.22:40562) 2024-09-21T03:59:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc0659c640 1 -- 172.21.15.22:0/2709428186 learned_addr learned my addr 172.21.15.22:0/2709428186 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc05d9b640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc081083a0 0x7fbc0819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:52.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc06d9d640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc08108cf0 0x7fbc081a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc05d9b640 1 -- 172.21.15.22:0/2709428186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc08108cf0 msgr2=0x7fbc081a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc05d9b640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc08108cf0 0x7fbc081a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc05d9b640 1 -- 172.21.15.22:0/2709428186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc08102a60 msgr2=0x7fbc0819c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc05d9b640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc08102a60 0x7fbc0819c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc05d9b640 1 -- 172.21.15.22:0/2709428186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc081a2500 con 0x7fbc081083a0 2024-09-21T03:59:52.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc0659c640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc08102a60 0x7fbc0819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T03:59:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc05d9b640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc081083a0 0x7fbc0819cb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00e9c0 tx=0x7fbbfc00ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbbf77fe640 1 -- 172.21.15.22:0/2709428186 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc00cd80 con 0x7fbc081083a0 2024-09-21T03:59:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbc0c87b640 1 -- 172.21.15.22:0/2709428186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc081a27f0 con 0x7fbc081083a0 2024-09-21T03:59:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbbf77fe640 1 -- 172.21.15.22:0/2709428186 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbfc0035f0 con 0x7fbc081083a0 2024-09-21T03:59:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.706+0000 7fbbf77fe640 1 -- 172.21.15.22:0/2709428186 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbfc010690 con 0x7fbc081083a0 2024-09-21T03:59:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.707+0000 7fbc0c87b640 1 -- 172.21.15.22:0/2709428186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc081a8f50 con 0x7fbc081083a0 2024-09-21T03:59:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.707+0000 7fbc0c87b640 1 -- 172.21.15.22:0/2709428186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc08102e70 con 0x7fbc081083a0 2024-09-21T03:59:52.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.709+0000 7fbbf77fe640 1 -- 172.21.15.22:0/2709428186 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fbbfc004000 con 0x7fbc081083a0 2024-09-21T03:59:52.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.710+0000 7fbbf77fe640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbbf00b6510 0x7fbbf00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:52.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.710+0000 7fbc0659c640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbbf00b6510 0x7fbbf00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:52.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.710+0000 7fbbf77fe640 1 -- 172.21.15.22:0/2709428186 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7fbbfc0e72f0 con 0x7fbc081083a0 2024-09-21T03:59:52.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.711+0000 7fbc0659c640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbbf00b6510 0x7fbbf00b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8005fd0 tx=0x7fbbf800b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:52.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.713+0000 7fbbf77fe640 1 -- 172.21.15.22:0/2709428186 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbbfc056710 con 0x7fbc081083a0 2024-09-21T03:59:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:52 smithi022 ceph-mon[31015]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:52.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:52 smithi073 ceph-mon[34443]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:52.950 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:52 smithi060 ceph-mon[33722]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:52.950 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 03:59:52 smithi060 systemd[1]: Starting Ceph mds.b for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T03:59:52.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.957+0000 7fbc0c87b640 1 -- 172.21.15.22:0/2709428186 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc0819d6c0 con 0x7fbc081083a0 2024-09-21T03:59:52.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.958+0000 7fbbf77fe640 1 -- 172.21.15.22:0/2709428186 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9680 (secure 0 0 0) 0x7fbc0819d6c0 con 0x7fbc081083a0 2024-09-21T03:59:52.961 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:52.961 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":12,"btime":"2024-09-21T03:59:51:286268+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24596,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-09-21T03:59:52.961 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 12 2024-09-21T03:59:52.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.960+0000 7fbc0c87b640 1 -- 172.21.15.22:0/2709428186 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbbf00b6510 msgr2=0x7fbbf00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:52.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbbf00b6510 0x7fbbf00b8a20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbbf8005fd0 tx=0x7fbbf800b480 comp rx=0 tx=0).stop 2024-09-21T03:59:52.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 -- 172.21.15.22:0/2709428186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc081083a0 msgr2=0x7fbc0819cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:52.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc081083a0 0x7fbc0819cb30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc00e9c0 tx=0x7fbbfc00ee80 comp rx=0 tx=0).stop 2024-09-21T03:59:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 -- 172.21.15.22:0/2709428186 shutdown_connections 2024-09-21T03:59:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbbf00b6510 0x7fbbf00b8a20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbc08108cf0 0x7fbc081a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbc081083a0 0x7fbc0819cb30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 --2- 172.21.15.22:0/2709428186 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc08102a60 0x7fbc0819c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 -- 172.21.15.22:0/2709428186 >> 172.21.15.22:0/2709428186 conn(0x7fbc08079730 msgr2=0x7fbc0806b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 -- 172.21.15.22:0/2709428186 shutdown_connections 2024-09-21T03:59:52.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:52.961+0000 7fbc0c87b640 1 -- 172.21.15.22:0/2709428186 wait complete. 2024-09-21T03:59:53.202 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 03:59:52 smithi060 podman[61807]: 2024-09-21 03:59:52.850485722 +0000 UTC m=+0.016102696 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T03:59:53.202 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 03:59:52 smithi060 podman[61807]: 2024-09-21 03:59:52.966151672 +0000 UTC m=+0.131768665 container create c174ba78bae85c96b249359c2a939ea8bf008fdb31a157dd2e8d88b93dcd5892 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T03:59:53.597 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 03:59:53 smithi060 podman[61807]: 2024-09-21 03:59:53.220529077 +0000 UTC m=+0.386146042 container init c174ba78bae85c96b249359c2a939ea8bf008fdb31a157dd2e8d88b93dcd5892 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T03:59:53.597 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 03:59:53 smithi060 podman[61807]: 2024-09-21 03:59:53.223513649 +0000 UTC m=+0.389130606 container start c174ba78bae85c96b249359c2a939ea8bf008fdb31a157dd2e8d88b93dcd5892 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T03:59:53.597 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 03:59:53 smithi060 ceph-mds[61826]: -- 172.21.15.60:0/2810957871 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55813141f860 con 0x5581355c7a80 2024-09-21T03:59:53.597 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 03:59:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b[61822]: starting mds.b at 2024-09-21T03:59:53.597 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 03:59:53 smithi060 bash[61807]: c174ba78bae85c96b249359c2a939ea8bf008fdb31a157dd2e8d88b93dcd5892 2024-09-21T03:59:53.597 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 03:59:53 smithi060 systemd[1]: Started Ceph mds.b for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T03:59:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:53 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2709428186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:53 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:53.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:53 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2709428186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:53.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:53 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:53.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:53 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2709428186' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:53.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:53.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:53 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:54 smithi022 ceph-mon[31015]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:54 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] up:boot 2024-09-21T03:59:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:54 smithi022 ceph-mon[31015]: fsmap 12 up:standby 2024-09-21T03:59:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:59:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:54 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:54.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:54 smithi073 ceph-mon[34443]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:54.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:54 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] up:boot 2024-09-21T03:59:54.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:54 smithi073 ceph-mon[34443]: fsmap 12 up:standby 2024-09-21T03:59:54.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:59:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:54 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:54.951 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:54 smithi060 ceph-mon[33722]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:54 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] up:boot 2024-09-21T03:59:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:54 smithi060 ceph-mon[33722]: fsmap 12 up:standby 2024-09-21T03:59:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T03:59:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:54 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:55.627 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T03:59:55.968 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:55.968 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:55.968 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:55.968 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:55.968 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:55.968 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:55.968 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:55.968 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:55.969 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:55.969 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:55.969 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:55 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:56.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:56.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:56.138 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:56.139 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.139 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:55 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:56.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:56.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:56.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:56.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:56.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:55 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T03:59:56.376 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:56.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.878+0000 7f4541137640 1 -- 172.21.15.22:0/2905184170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f453c102090 msgr2=0x7f453c1024a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:56.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.878+0000 7f4541137640 1 --2- 172.21.15.22:0/2905184170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f453c102090 0x7f453c1024a0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f452c009900 tx=0x7f452c02a410 comp rx=0 tx=0).stop 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.878+0000 7f4541137640 1 -- 172.21.15.22:0/2905184170 shutdown_connections 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.878+0000 7f4541137640 1 --2- 172.21.15.22:0/2905184170 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f453c1094e0 0x7f453c1098f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.878+0000 7f4541137640 1 --2- 172.21.15.22:0/2905184170 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453c109e30 0x7f453c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.878+0000 7f4541137640 1 --2- 172.21.15.22:0/2905184170 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f453c102090 0x7f453c1024a0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.878+0000 7f4541137640 1 -- 172.21.15.22:0/2905184170 >> 172.21.15.22:0/2905184170 conn(0x7f453c079e30 msgr2=0x7f453c07a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.878+0000 7f4541137640 1 -- 172.21.15.22:0/2905184170 shutdown_connections 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.878+0000 7f4541137640 1 -- 172.21.15.22:0/2905184170 wait complete. 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f4541137640 1 Processor -- start 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f4541137640 1 -- start start 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f4541137640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453c102090 0x7f453c19c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f4541137640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f453c1094e0 0x7f453c19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:56.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f4541137640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f453c109e30 0x7f453c1a1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f4541137640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f453c1139a0 con 0x7f453c1094e0 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f4541137640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f453c113820 con 0x7f453c102090 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f4541137640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f453c113b20 con 0x7f453c109e30 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f453a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f453c1094e0 0x7f453c19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f453a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f453c1094e0 0x7f453c19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40588/0 (socket says 172.21.15.22:40588) 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f453a59c640 1 -- 172.21.15.22:0/638982777 learned_addr learned my addr 172.21.15.22:0/638982777 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f453ad9d640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453c102090 0x7f453c19c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.879+0000 7f453b59e640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f453c109e30 0x7f453c1a1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f453a59c640 1 -- 172.21.15.22:0/638982777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f453c109e30 msgr2=0x7f453c1a1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f453a59c640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f453c109e30 0x7f453c1a1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f453a59c640 1 -- 172.21.15.22:0/638982777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453c102090 msgr2=0x7f453c19c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:56.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f453a59c640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453c102090 0x7f453c19c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f453a59c640 1 -- 172.21.15.22:0/638982777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453c1a25a0 con 0x7f453c1094e0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f453a59c640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f453c1094e0 0x7f453c19cbd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f453000d750 tx=0x7f453000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f4523fff640 1 -- 172.21.15.22:0/638982777 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530017070 con 0x7f453c1094e0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f4523fff640 1 -- 172.21.15.22:0/638982777 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45300054b0 con 0x7f453c1094e0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f4541137640 1 -- 172.21.15.22:0/638982777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453c1a2890 con 0x7f453c1094e0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f4523fff640 1 -- 172.21.15.22:0/638982777 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4530004bc0 con 0x7f453c1094e0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.880+0000 7f4541137640 1 -- 172.21.15.22:0/638982777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f453c1a8ff0 con 0x7f453c1094e0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.881+0000 7f4541137640 1 -- 172.21.15.22:0/638982777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f453c1024a0 con 0x7f453c1094e0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.884+0000 7f4523fff640 1 -- 172.21.15.22:0/638982777 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4530009c30 con 0x7f453c1094e0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.884+0000 7f4523fff640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45240b6590 0x7f45240b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.885+0000 7f453ad9d640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45240b6590 0x7f45240b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.885+0000 7f4523fff640 1 -- 172.21.15.22:0/638982777 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f45300e6bb0 con 0x7f453c1094e0 2024-09-21T03:59:56.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.885+0000 7f453ad9d640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45240b6590 0x7f45240b8aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f452c0057c0 tx=0x7f452c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:56.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:56.888+0000 7f4523fff640 1 -- 172.21.15.22:0/638982777 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45300b1ca0 con 0x7f453c1094e0 2024-09-21T03:59:57.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.130+0000 7f4541137640 1 -- 172.21.15.22:0/638982777 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f453c1a9290 con 0x7f453c1094e0 2024-09-21T03:59:57.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.131+0000 7f4523fff640 1 -- 172.21.15.22:0/638982777 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10506 (secure 0 0 0) 0x7f45300b6be0 con 0x7f453c1094e0 2024-09-21T03:59:57.134 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:57.134 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":13,"btime":"2024-09-21T03:59:53:588280+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24596,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24647,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-21T03:59:57.134 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 13 2024-09-21T03:59:57.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.133+0000 7f4541137640 1 -- 172.21.15.22:0/638982777 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45240b6590 msgr2=0x7f45240b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:57.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.133+0000 7f4541137640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45240b6590 0x7f45240b8aa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f452c0057c0 tx=0x7f452c0058d0 comp rx=0 tx=0).stop 2024-09-21T03:59:57.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.133+0000 7f4541137640 1 -- 172.21.15.22:0/638982777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f453c1094e0 msgr2=0x7f453c19cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:57.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.133+0000 7f4541137640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f453c1094e0 0x7f453c19cbd0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f453000d750 tx=0x7f453000dc10 comp rx=0 tx=0).stop 2024-09-21T03:59:57.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.134+0000 7f4541137640 1 -- 172.21.15.22:0/638982777 shutdown_connections 2024-09-21T03:59:57.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.134+0000 7f4541137640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45240b6590 0x7f45240b8aa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:57.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.134+0000 7f4541137640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f453c109e30 0x7f453c1a1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:57.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.134+0000 7f4541137640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f453c1094e0 0x7f453c19cbd0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:57.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.134+0000 7f4541137640 1 --2- 172.21.15.22:0/638982777 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f453c102090 0x7f453c19c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:57.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.134+0000 7f4541137640 1 -- 172.21.15.22:0/638982777 >> 172.21.15.22:0/638982777 conn(0x7f453c079e30 msgr2=0x7f453c1072f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:57.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.134+0000 7f4541137640 1 -- 172.21.15.22:0/638982777 shutdown_connections 2024-09-21T03:59:57.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:57.134+0000 7f4541137640 1 -- 172.21.15.22:0/638982777 wait complete. 2024-09-21T03:59:57.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/638982777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:57.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.017 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph --format=json-pretty osd lspools 2024-09-21T03:59:58.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/638982777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T03:59:58.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T03:59:58.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T03:59:58.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/638982777' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T03:59:58.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T03:59:58.279 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T03:59:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.772+0000 7f2bac8a3640 1 -- 172.21.15.22:0/1152016421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ba8102ae0 msgr2=0x7f2ba8102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.772+0000 7f2bac8a3640 1 --2- 172.21.15.22:0/1152016421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ba8102ae0 0x7f2ba8102ef0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2b98009900 tx=0x7f2b9802a410 comp rx=0 tx=0).stop 2024-09-21T03:59:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.772+0000 7f2bac8a3640 1 -- 172.21.15.22:0/1152016421 shutdown_connections 2024-09-21T03:59:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.772+0000 7f2bac8a3640 1 --2- 172.21.15.22:0/1152016421 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba81083d0 0x7f2ba81087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.772+0000 7f2bac8a3640 1 --2- 172.21.15.22:0/1152016421 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ba8108d20 0x7f2ba810f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.772+0000 7f2bac8a3640 1 --2- 172.21.15.22:0/1152016421 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ba8102ae0 0x7f2ba8102ef0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.772+0000 7f2bac8a3640 1 -- 172.21.15.22:0/1152016421 >> 172.21.15.22:0/1152016421 conn(0x7f2ba8079760 msgr2=0x7f2ba8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.772+0000 7f2bac8a3640 1 -- 172.21.15.22:0/1152016421 shutdown_connections 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.772+0000 7f2bac8a3640 1 -- 172.21.15.22:0/1152016421 wait complete. 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2bac8a3640 1 Processor -- start 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2bac8a3640 1 -- start start 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2bac8a3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba8102ae0 0x7f2ba819b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2bac8a3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ba81083d0 0x7f2ba819b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2bac8a3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ba8108d20 0x7f2ba819bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2bac8a3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba8112920 con 0x7f2ba81083d0 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2bac8a3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba81127a0 con 0x7f2ba8108d20 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2bac8a3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2ba8112aa0 con 0x7f2ba8102ae0 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ba81083d0 0x7f2ba819b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ba81083d0 0x7f2ba819b7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40600/0 (socket says 172.21.15.22:40600) 2024-09-21T03:59:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba5d9b640 1 -- 172.21.15.22:0/3499526924 learned_addr learned my addr 172.21.15.22:0/3499526924 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T03:59:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba6d9d640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ba8108d20 0x7f2ba819bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba659c640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba8102ae0 0x7f2ba819b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba5d9b640 1 -- 172.21.15.22:0/3499526924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba8102ae0 msgr2=0x7f2ba819b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba5d9b640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba8102ae0 0x7f2ba819b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba5d9b640 1 -- 172.21.15.22:0/3499526924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ba8108d20 msgr2=0x7f2ba819bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba5d9b640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ba8108d20 0x7f2ba819bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba5d9b640 1 -- 172.21.15.22:0/3499526924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ba81a65a0 con 0x7f2ba81083d0 2024-09-21T03:59:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.773+0000 7f2ba6d9d640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ba8108d20 0x7f2ba819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T03:59:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.774+0000 7f2ba5d9b640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ba81083d0 0x7f2ba819b7d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00b450 tx=0x7f2b9c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.774+0000 7f2b977fe640 1 -- 172.21.15.22:0/3499526924 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c015020 con 0x7f2ba81083d0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.774+0000 7f2b977fe640 1 -- 172.21.15.22:0/3499526924 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2b9c011d20 con 0x7f2ba81083d0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.774+0000 7f2bac8a3640 1 -- 172.21.15.22:0/3499526924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ba81a6890 con 0x7f2ba81083d0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.774+0000 7f2b977fe640 1 -- 172.21.15.22:0/3499526924 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b9c010e10 con 0x7f2ba81083d0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.774+0000 7f2bac8a3640 1 -- 172.21.15.22:0/3499526924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ba81a6e50 con 0x7f2ba81083d0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.775+0000 7f2bac8a3640 1 -- 172.21.15.22:0/3499526924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ba8103d10 con 0x7f2ba81083d0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.777+0000 7f2b977fe640 1 -- 172.21.15.22:0/3499526924 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2b9c018020 con 0x7f2ba81083d0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.777+0000 7f2b977fe640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2b900b6510 0x7f2b900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.778+0000 7f2ba659c640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2b900b6510 0x7f2b900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.778+0000 7f2b977fe640 1 -- 172.21.15.22:0/3499526924 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f2b9c0e6c70 con 0x7f2ba81083d0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.778+0000 7f2ba659c640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2b900b6510 0x7f2b900b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b98006010 tx=0x7f2b98009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T03:59:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.781+0000 7f2b977fe640 1 -- 172.21.15.22:0/3499526924 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b9c01f020 con 0x7f2ba81083d0 2024-09-21T03:59:58.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.970+0000 7f2bac8a3640 1 -- 172.21.15.22:0/3499526924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f2ba806bfb0 con 0x7f2ba81083d0 2024-09-21T03:59:58.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.970+0000 7f2b977fe640 1 -- 172.21.15.22:0/3499526924 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v69) ==== 84+0+65 (secure 0 0 0) 0x7f2b9c00d040 con 0x7f2ba81083d0 2024-09-21T03:59:58.973 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T03:59:58.973 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-09-21T03:59:58.973 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T03:59:58.973 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2024-09-21T03:59:58.973 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2024-09-21T03:59:58.973 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T03:59:58.973 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-09-21T03:59:58.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 -- 172.21.15.22:0/3499526924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2b900b6510 msgr2=0x7f2b900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:58.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2b900b6510 0x7f2b900b8a20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b98006010 tx=0x7f2b98009680 comp rx=0 tx=0).stop 2024-09-21T03:59:58.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 -- 172.21.15.22:0/3499526924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ba81083d0 msgr2=0x7f2ba819b7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T03:59:58.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ba81083d0 0x7f2ba819b7d0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2b9c00b450 tx=0x7f2b9c00b910 comp rx=0 tx=0).stop 2024-09-21T03:59:58.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 -- 172.21.15.22:0/3499526924 shutdown_connections 2024-09-21T03:59:58.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2b900b6510 0x7f2b900b8a20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:58.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2ba8108d20 0x7f2ba819bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:58.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2ba81083d0 0x7f2ba819b7d0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:58.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 --2- 172.21.15.22:0/3499526924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2ba8102ae0 0x7f2ba819b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T03:59:58.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 -- 172.21.15.22:0/3499526924 >> 172.21.15.22:0/3499526924 conn(0x7f2ba8079760 msgr2=0x7f2ba81016a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T03:59:58.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 -- 172.21.15.22:0/3499526924 shutdown_connections 2024-09-21T03:59:58.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T03:59:58.972+0000 7f2bac8a3640 1 -- 172.21.15.22:0/3499526924 wait complete. 2024-09-21T03:59:59.600 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-21T03:59:59.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-21T03:59:59.859 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:00.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:59 smithi022 ceph-mon[31015]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:00.284 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 03:59:59 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3499526924' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T04:00:00.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:59 smithi073 ceph-mon[34443]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:00.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 03:59:59 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3499526924' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T04:00:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.379+0000 7f21f4af0640 1 -- 172.21.15.22:0/1601585830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21f0103bb0 msgr2=0x7f21f0103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.379+0000 7f21f4af0640 1 --2- 172.21.15.22:0/1601585830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21f0103bb0 0x7f21f0103fc0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009900 tx=0x7f21e002a410 comp rx=0 tx=0).stop 2024-09-21T04:00:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.379+0000 7f21f4af0640 1 -- 172.21.15.22:0/1601585830 shutdown_connections 2024-09-21T04:00:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.379+0000 7f21f4af0640 1 --2- 172.21.15.22:0/1601585830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f01094f0 0x7f21f0109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.379+0000 7f21f4af0640 1 --2- 172.21.15.22:0/1601585830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21f0109e40 0x7f21f0110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:00.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.379+0000 7f21f4af0640 1 --2- 172.21.15.22:0/1601585830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21f0103bb0 0x7f21f0103fc0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.379+0000 7f21f4af0640 1 -- 172.21.15.22:0/1601585830 >> 172.21.15.22:0/1601585830 conn(0x7f21f00ff600 msgr2=0x7f21f0101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.379+0000 7f21f4af0640 1 -- 172.21.15.22:0/1601585830 shutdown_connections 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.379+0000 7f21f4af0640 1 -- 172.21.15.22:0/1601585830 wait complete. 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21f4af0640 1 Processor -- start 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21f4af0640 1 -- start start 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21f4af0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0103bb0 0x7f21f019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21f4af0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21f01094f0 0x7f21f019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21f4af0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21f0109e40 0x7f21f019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21f4af0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f21f01139b0 con 0x7f21f01094f0 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21f4af0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f21f0113830 con 0x7f21f0109e40 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21f4af0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f21f0113b30 con 0x7f21f0103bb0 2024-09-21T04:00:00.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21e5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21f01094f0 0x7f21f019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21e5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21f01094f0 0x7f21f019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40630/0 (socket says 172.21.15.22:40630) 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.380+0000 7f21e5d9b640 1 -- 172.21.15.22:0/739903450 learned_addr learned my addr 172.21.15.22:0/739903450 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21ee59c640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0103bb0 0x7f21f019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21eed9d640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21f0109e40 0x7f21f019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21e5d9b640 1 -- 172.21.15.22:0/739903450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0103bb0 msgr2=0x7f21f019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21e5d9b640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0103bb0 0x7f21f019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21e5d9b640 1 -- 172.21.15.22:0/739903450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21f0109e40 msgr2=0x7f21f019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21e5d9b640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21f0109e40 0x7f21f019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21e5d9b640 1 -- 172.21.15.22:0/739903450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f01a0370 con 0x7f21f01094f0 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21e5d9b640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21f01094f0 0x7f21f019a9a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f21d800d950 tx=0x7f21d800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21e7fff640 1 -- 172.21.15.22:0/739903450 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d8017070 con 0x7f21f01094f0 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21e7fff640 1 -- 172.21.15.22:0/739903450 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f21d8009c30 con 0x7f21f01094f0 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21f4af0640 1 -- 172.21.15.22:0/739903450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f01a0660 con 0x7f21f01094f0 2024-09-21T04:00:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21e7fff640 1 -- 172.21.15.22:0/739903450 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21d80047a0 con 0x7f21f01094f0 2024-09-21T04:00:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.381+0000 7f21f4af0640 1 -- 172.21.15.22:0/739903450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f01a6dc0 con 0x7f21f01094f0 2024-09-21T04:00:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.382+0000 7f21f4af0640 1 -- 172.21.15.22:0/739903450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f0103fc0 con 0x7f21f01094f0 2024-09-21T04:00:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.384+0000 7f21e7fff640 1 -- 172.21.15.22:0/739903450 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f21d8004020 con 0x7f21f01094f0 2024-09-21T04:00:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.385+0000 7f21e7fff640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f21dc0b6510 0x7f21dc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.385+0000 7f21ee59c640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f21dc0b6510 0x7f21dc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.385+0000 7f21e7fff640 1 -- 172.21.15.22:0/739903450 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 7127+0+0 (secure 0 0 0) 0x7f21d80e6fd0 con 0x7f21f01094f0 2024-09-21T04:00:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.385+0000 7f21ee59c640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f21dc0b6510 0x7f21dc0b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f21e00057c0 tx=0x7f21e00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:00.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.388+0000 7f21e7fff640 1 -- 172.21.15.22:0/739903450 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f21d8020020 con 0x7f21f01094f0 2024-09-21T04:00:00.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:59 smithi060 ceph-mon[33722]: pgmap v284: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:00.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 03:59:59 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3499526924' entity='client.admin' cmd={"prefix": "osd lspools", "format": "json-pretty"} : dispatch 2024-09-21T04:00:00.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.580+0000 7f21f4af0640 1 -- 172.21.15.22:0/739903450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f21f002e640 con 0x7f21f01094f0 2024-09-21T04:00:00.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.964+0000 7f21e7fff640 1 -- 172.21.15.22:0/739903450 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v70) ==== 138+0+0 (secure 0 0 0) 0x7f21d80adc60 con 0x7f21f01094f0 2024-09-21T04:00:00.967 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.968+0000 7f21f4af0640 1 -- 172.21.15.22:0/739903450 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f21dc0b6510 msgr2=0x7f21dc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.968+0000 7f21f4af0640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f21dc0b6510 0x7f21dc0b8a20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f21e00057c0 tx=0x7f21e00058d0 comp rx=0 tx=0).stop 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.968+0000 7f21f4af0640 1 -- 172.21.15.22:0/739903450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21f01094f0 msgr2=0x7f21f019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.968+0000 7f21f4af0640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21f01094f0 0x7f21f019a9a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f21d800d950 tx=0x7f21d800de10 comp rx=0 tx=0).stop 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.968+0000 7f21f4af0640 1 -- 172.21.15.22:0/739903450 shutdown_connections 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.968+0000 7f21f4af0640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f21dc0b6510 0x7f21dc0b8a20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.968+0000 7f21f4af0640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f21f0109e40 0x7f21f019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.968+0000 7f21f4af0640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f21f01094f0 0x7f21f019a9a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.968+0000 7f21f4af0640 1 --2- 172.21.15.22:0/739903450 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f21f0103bb0 0x7f21f019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.968+0000 7f21f4af0640 1 -- 172.21.15.22:0/739903450 >> 172.21.15.22:0/739903450 conn(0x7f21f00ff600 msgr2=0x7f21f0101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.969+0000 7f21f4af0640 1 -- 172.21.15.22:0/739903450 shutdown_connections 2024-09-21T04:00:00.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:00.969+0000 7f21f4af0640 1 -- 172.21.15.22:0/739903450 wait complete. 2024-09-21T04:00:01.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:00 smithi022 ceph-mon[31015]: overall HEALTH_OK 2024-09-21T04:00:01.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:00 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/739903450' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T04:00:01.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:00 smithi073 ceph-mon[34443]: overall HEALTH_OK 2024-09-21T04:00:01.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:00 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/739903450' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T04:00:01.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:00 smithi060 ceph-mon[33722]: overall HEALTH_OK 2024-09-21T04:00:01.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:00 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/739903450' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} : dispatch 2024-09-21T04:00:01.885 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-09-21T04:00:02.159 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:02.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:01 smithi022 ceph-mon[31015]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:02.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:01 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/739903450' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T04:00:02.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:01 smithi022 ceph-mon[31015]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T04:00:02.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:01 smithi073 ceph-mon[34443]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:02.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:01 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/739903450' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T04:00:02.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:01 smithi073 ceph-mon[34443]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T04:00:02.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:01 smithi060 ceph-mon[33722]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:02.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:01 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/739903450' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-21T04:00:02.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:01 smithi060 ceph-mon[33722]: osdmap e70: 12 total, 12 up, 12 in 2024-09-21T04:00:02.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.683+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1777117476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4eac1083d0 msgr2=0x7f4eac1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:02.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.683+0000 7f4eb3f6a640 1 --2- 172.21.15.22:0/1777117476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4eac1083d0 0x7f4eac1087e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009900 tx=0x7f4e9c02a410 comp rx=0 tx=0).stop 2024-09-21T04:00:02.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.683+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1777117476 shutdown_connections 2024-09-21T04:00:02.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.683+0000 7f4eb3f6a640 1 --2- 172.21.15.22:0/1777117476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eac108d20 0x7f4eac10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:02.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.683+0000 7f4eb3f6a640 1 --2- 172.21.15.22:0/1777117476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4eac1083d0 0x7f4eac1087e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:02.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.683+0000 7f4eb3f6a640 1 --2- 172.21.15.22:0/1777117476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac102ae0 0x7f4eac102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:02.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.683+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1777117476 >> 172.21.15.22:0/1777117476 conn(0x7f4eac079760 msgr2=0x7f4eac079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:02.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.683+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1777117476 shutdown_connections 2024-09-21T04:00:02.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.683+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1777117476 wait complete. 2024-09-21T04:00:02.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.684+0000 7f4eb3f6a640 1 Processor -- start 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.684+0000 7f4eb3f6a640 1 -- start start 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.684+0000 7f4eb3f6a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4eac102ae0 0x7f4eac19a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.684+0000 7f4eb3f6a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac1083d0 0x7f4eac19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.684+0000 7f4eb3f6a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eac108d20 0x7f4eac19fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.684+0000 7f4eb3f6a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac112840 con 0x7f4eac102ae0 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.684+0000 7f4eb3f6a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1126c0 con 0x7f4eac1083d0 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.684+0000 7f4eb3f6a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4eac1129c0 con 0x7f4eac108d20 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.684+0000 7f4eb1d06640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4eac102ae0 0x7f4eac19a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb1d06640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4eac102ae0 0x7f4eac19a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42850/0 (socket says 172.21.15.22:42850) 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb1d06640 1 -- 172.21.15.22:0/1068957871 learned_addr learned my addr 172.21.15.22:0/1068957871 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb2507640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eac108d20 0x7f4eac19fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb1505640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac1083d0 0x7f4eac19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:02.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb1d06640 1 -- 172.21.15.22:0/1068957871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eac108d20 msgr2=0x7f4eac19fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb1d06640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eac108d20 0x7f4eac19fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb1d06640 1 -- 172.21.15.22:0/1068957871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac1083d0 msgr2=0x7f4eac19a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb1d06640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac1083d0 0x7f4eac19a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb1d06640 1 -- 172.21.15.22:0/1068957871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eac1a0270 con 0x7f4eac102ae0 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb1505640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac1083d0 0x7f4eac19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb1d06640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4eac102ae0 0x7f4eac19a3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c890 tx=0x7f4ea800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4ea2ffd640 1 -- 172.21.15.22:0/1068957871 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8004220 con 0x7f4eac102ae0 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1068957871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eac1a0560 con 0x7f4eac102ae0 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4ea2ffd640 1 -- 172.21.15.22:0/1068957871 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ea8007e40 con 0x7f4eac102ae0 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4ea2ffd640 1 -- 172.21.15.22:0/1068957871 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8004a00 con 0x7f4eac102ae0 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.685+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1068957871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eac1a6d80 con 0x7f4eac102ae0 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.686+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1068957871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4eac103d10 con 0x7f4eac102ae0 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.688+0000 7f4ea2ffd640 1 -- 172.21.15.22:0/1068957871 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4ea80079b0 con 0x7f4eac102ae0 2024-09-21T04:00:02.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.689+0000 7f4ea2ffd640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4e980ba950 0x7f4e980bce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:02.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.689+0000 7f4eb1505640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4e980ba950 0x7f4e980bce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:02.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.689+0000 7f4ea2ffd640 1 -- 172.21.15.22:0/1068957871 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 7497+0+0 (secure 0 0 0) 0x7f4ea80e71e0 con 0x7f4eac102ae0 2024-09-21T04:00:02.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.689+0000 7f4eb1505640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4e980ba950 0x7f4e980bce60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c006010 tx=0x7f4e9c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:02.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.692+0000 7f4ea2ffd640 1 -- 172.21.15.22:0/1068957871 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4ea8014030 con 0x7f4eac102ae0 2024-09-21T04:00:02.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.882+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1068957871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f4eac102ef0 con 0x7f4eac102ae0 2024-09-21T04:00:02.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.978+0000 7f4ea2ffd640 1 -- 172.21.15.22:0/1068957871 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v72) ==== 171+0+0 (secure 0 0 0) 0x7f4ea80add00 con 0x7f4eac102ae0 2024-09-21T04:00:02.981 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2024-09-21T04:00:02.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1068957871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4e980ba950 msgr2=0x7f4e980bce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:02.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4e980ba950 0x7f4e980bce60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c006010 tx=0x7f4e9c000bc0 comp rx=0 tx=0).stop 2024-09-21T04:00:02.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1068957871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4eac102ae0 msgr2=0x7f4eac19a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:02.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4eac102ae0 0x7f4eac19a3c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800c890 tx=0x7f4ea800cd50 comp rx=0 tx=0).stop 2024-09-21T04:00:02.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1068957871 shutdown_connections 2024-09-21T04:00:02.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4e980ba950 0x7f4e980bce60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:02.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4eac108d20 0x7f4eac19fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:02.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4eac1083d0 0x7f4eac19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:02.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 --2- 172.21.15.22:0/1068957871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4eac102ae0 0x7f4eac19a3c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:02.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1068957871 >> 172.21.15.22:0/1068957871 conn(0x7f4eac079760 msgr2=0x7f4eac101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:02.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1068957871 shutdown_connections 2024-09-21T04:00:02.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:02.981+0000 7f4eb3f6a640 1 -- 172.21.15.22:0/1068957871 wait complete. 2024-09-21T04:00:03.340 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:02 smithi022 ceph-mon[31015]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T04:00:03.340 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:02 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1068957871' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T04:00:03.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:02 smithi073 ceph-mon[34443]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T04:00:03.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:02 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1068957871' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T04:00:03.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:02 smithi060 ceph-mon[33722]: osdmap e71: 12 total, 12 up, 12 in 2024-09-21T04:00:03.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:02 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1068957871' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} : dispatch 2024-09-21T04:00:03.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-21T04:00:03.934 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:03 smithi022 ceph-mon[31015]: pgmap v288: 33 pgs: 1 creating+activating, 2 creating+peering, 22 unknown, 8 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:03 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1068957871' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T04:00:03.994 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:03 smithi022 ceph-mon[31015]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T04:00:04.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:03 smithi073 ceph-mon[34443]: pgmap v288: 33 pgs: 1 creating+activating, 2 creating+peering, 22 unknown, 8 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:04.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:03 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1068957871' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T04:00:04.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:03 smithi073 ceph-mon[34443]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T04:00:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.431+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1693931782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc28103bb0 msgr2=0x7fdc28103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.431+0000 7fdc2c9c4640 1 --2- 172.21.15.22:0/1693931782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc28103bb0 0x7fdc28103fc0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdc18009ca0 tx=0x7fdc1802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.432+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1693931782 shutdown_connections 2024-09-21T04:00:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.432+0000 7fdc2c9c4640 1 --2- 172.21.15.22:0/1693931782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc281094f0 0x7fdc28109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.432+0000 7fdc2c9c4640 1 --2- 172.21.15.22:0/1693931782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc28109e40 0x7fdc28110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.432+0000 7fdc2c9c4640 1 --2- 172.21.15.22:0/1693931782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc28103bb0 0x7fdc28103fc0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.432+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1693931782 >> 172.21.15.22:0/1693931782 conn(0x7fdc280ff600 msgr2=0x7fdc28101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:04.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.432+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1693931782 shutdown_connections 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.432+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1693931782 wait complete. 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.432+0000 7fdc2c9c4640 1 Processor -- start 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.432+0000 7fdc2c9c4640 1 -- start start 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc2c9c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc28103bb0 0x7fdc2819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc2c9c4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc281094f0 0x7fdc2819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc2c9c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc28109e40 0x7fdc2819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc2c9c4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdc28113a00 con 0x7fdc28109e40 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc2c9c4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdc28113880 con 0x7fdc281094f0 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc2c9c4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdc28113b80 con 0x7fdc28103bb0 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc26d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc28109e40 0x7fdc2819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc26d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc28109e40 0x7fdc2819fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42866/0 (socket says 172.21.15.22:42866) 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc26d9d640 1 -- 172.21.15.22:0/1866816816 learned_addr learned my addr 172.21.15.22:0/1866816816 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:04.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc2659c640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc28103bb0 0x7fdc2819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc25d9b640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc281094f0 0x7fdc2819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc26d9d640 1 -- 172.21.15.22:0/1866816816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc28103bb0 msgr2=0x7fdc2819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc26d9d640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc28103bb0 0x7fdc2819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc26d9d640 1 -- 172.21.15.22:0/1866816816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc281094f0 msgr2=0x7fdc2819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc26d9d640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc281094f0 0x7fdc2819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc26d9d640 1 -- 172.21.15.22:0/1866816816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc281a02c0 con 0x7fdc28109e40 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc2659c640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc28103bb0 0x7fdc2819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc25d9b640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc281094f0 0x7fdc2819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.433+0000 7fdc26d9d640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc28109e40 0x7fdc2819fc50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000d950 tx=0x7fdc2000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.434+0000 7fdc177fe640 1 -- 172.21.15.22:0/1866816816 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20017030 con 0x7fdc28109e40 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.434+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1866816816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc281a05b0 con 0x7fdc28109e40 2024-09-21T04:00:04.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.434+0000 7fdc177fe640 1 -- 172.21.15.22:0/1866816816 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdc20004020 con 0x7fdc28109e40 2024-09-21T04:00:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.434+0000 7fdc177fe640 1 -- 172.21.15.22:0/1866816816 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc20003ab0 con 0x7fdc28109e40 2024-09-21T04:00:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.434+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1866816816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc281a6dd0 con 0x7fdc28109e40 2024-09-21T04:00:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.435+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1866816816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc28103fc0 con 0x7fdc28109e40 2024-09-21T04:00:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.437+0000 7fdc177fe640 1 -- 172.21.15.22:0/1866816816 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fdc2001a070 con 0x7fdc28109e40 2024-09-21T04:00:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.437+0000 7fdc177fe640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdc100b6540 0x7fdc100b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.437+0000 7fdc2659c640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdc100b6540 0x7fdc100b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:04.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.437+0000 7fdc177fe640 1 -- 172.21.15.22:0/1866816816 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7879+0+0 (secure 0 0 0) 0x7fdc200e7010 con 0x7fdc28109e40 2024-09-21T04:00:04.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.438+0000 7fdc2659c640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdc100b6540 0x7fdc100b8a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc18000f80 tx=0x7fdc18009410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:04.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.441+0000 7fdc177fe640 1 -- 172.21.15.22:0/1866816816 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc200ada50 con 0x7fdc28109e40 2024-09-21T04:00:04.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:03 smithi060 ceph-mon[33722]: pgmap v288: 33 pgs: 1 creating+activating, 2 creating+peering, 22 unknown, 8 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:04.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:03 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1068957871' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-09-21T04:00:04.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:03 smithi060 ceph-mon[33722]: osdmap e72: 12 total, 12 up, 12 in 2024-09-21T04:00:04.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.668+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1866816816 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fdc2819b540 con 0x7fdc28109e40 2024-09-21T04:00:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:04.999+0000 7fdc177fe640 1 -- 172.21.15.22:0/1866816816 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7fdc2819b540 con 0x7fdc28109e40 2024-09-21T04:00:05.002 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 2 and data pool 3 2024-09-21T04:00:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.001+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1866816816 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdc100b6540 msgr2=0x7fdc100b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.001+0000 7fdc2c9c4640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdc100b6540 0x7fdc100b8a50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdc18000f80 tx=0x7fdc18009410 comp rx=0 tx=0).stop 2024-09-21T04:00:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.001+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1866816816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc28109e40 msgr2=0x7fdc2819fc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.001+0000 7fdc2c9c4640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc28109e40 0x7fdc2819fc50 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fdc2000d950 tx=0x7fdc2000de10 comp rx=0 tx=0).stop 2024-09-21T04:00:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.001+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1866816816 shutdown_connections 2024-09-21T04:00:05.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.001+0000 7fdc2c9c4640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdc100b6540 0x7fdc100b8a50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:05.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.001+0000 7fdc2c9c4640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdc28109e40 0x7fdc2819fc50 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:05.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.001+0000 7fdc2c9c4640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdc281094f0 0x7fdc2819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:05.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.001+0000 7fdc2c9c4640 1 --2- 172.21.15.22:0/1866816816 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdc28103bb0 0x7fdc2819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:05.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.001+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1866816816 >> 172.21.15.22:0/1866816816 conn(0x7fdc280ff600 msgr2=0x7fdc28101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:05.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.002+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1866816816 shutdown_connections 2024-09-21T04:00:05.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:05.002+0000 7fdc2c9c4640 1 -- 172.21.15.22:0/1866816816 wait complete. 2024-09-21T04:00:05.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:05 smithi022 ceph-mon[31015]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T04:00:05.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:05 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1866816816' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T04:00:05.326 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:05 smithi022 ceph-mon[31015]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T04:00:05.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:05 smithi073 ceph-mon[34443]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T04:00:05.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:05 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1866816816' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T04:00:05.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:05 smithi073 ceph-mon[34443]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T04:00:05.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:05 smithi060 ceph-mon[33722]: osdmap e73: 12 total, 12 up, 12 in 2024-09-21T04:00:05.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:05 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1866816816' entity='client.admin' cmd={"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} : dispatch 2024-09-21T04:00:05.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:05 smithi060 ceph-mon[33722]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-21T04:00:05.677 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-09-21T04:00:05.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-09-21T04:00:05.942 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:06.267 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:06 smithi022 ceph-mon[31015]: pgmap v291: 97 pgs: 1 creating+activating, 10 creating+peering, 49 unknown, 37 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:06.267 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:06 smithi022 ceph-mon[31015]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T04:00:06.267 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:06 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1866816816' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T04:00:06.267 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:06 smithi022 ceph-mon[31015]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T04:00:06.267 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:06 smithi022 ceph-mon[31015]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T04:00:06.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:06 smithi073 ceph-mon[34443]: pgmap v291: 97 pgs: 1 creating+activating, 10 creating+peering, 49 unknown, 37 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:06.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:06 smithi073 ceph-mon[34443]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T04:00:06.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1866816816' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T04:00:06.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:06 smithi073 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T04:00:06.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:06 smithi073 ceph-mon[34443]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T04:00:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:06 smithi060 ceph-mon[33722]: pgmap v291: 97 pgs: 1 creating+activating, 10 creating+peering, 49 unknown, 37 active+clean; 577 KiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:06 smithi060 ceph-mon[33722]: osdmap e74: 12 total, 12 up, 12 in 2024-09-21T04:00:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:06 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1866816816' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-21T04:00:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:06 smithi060 ceph-mon[33722]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-21T04:00:06.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:06 smithi060 ceph-mon[33722]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-21T04:00:06.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.467+0000 7f8344969640 1 -- 172.21.15.22:0/3203046234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83401094d0 msgr2=0x7f83401098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:06.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.467+0000 7f8344969640 1 --2- 172.21.15.22:0/3203046234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83401094d0 0x7f83401098e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f8328009900 tx=0x7f832802a410 comp rx=0 tx=0).stop 2024-09-21T04:00:06.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.467+0000 7f8344969640 1 -- 172.21.15.22:0/3203046234 shutdown_connections 2024-09-21T04:00:06.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.467+0000 7f8344969640 1 --2- 172.21.15.22:0/3203046234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8340109e20 0x7f8340110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:06.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.467+0000 7f8344969640 1 --2- 172.21.15.22:0/3203046234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83401094d0 0x7f83401098e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:06.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.467+0000 7f8344969640 1 --2- 172.21.15.22:0/3203046234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340103b90 0x7f8340103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:06.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.467+0000 7f8344969640 1 -- 172.21.15.22:0/3203046234 >> 172.21.15.22:0/3203046234 conn(0x7f83400ff5e0 msgr2=0x7f8340101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:06.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.467+0000 7f8344969640 1 -- 172.21.15.22:0/3203046234 shutdown_connections 2024-09-21T04:00:06.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.467+0000 7f8344969640 1 -- 172.21.15.22:0/3203046234 wait complete. 2024-09-21T04:00:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f8344969640 1 Processor -- start 2024-09-21T04:00:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f8344969640 1 -- start start 2024-09-21T04:00:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f8344969640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340103b90 0x7f834019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f8344969640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83401094d0 0x7f834019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f8344969640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8340109e20 0x7f834019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f8344969640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8340113990 con 0x7f83401094d0 2024-09-21T04:00:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f8344969640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8340113810 con 0x7f8340109e20 2024-09-21T04:00:06.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f8344969640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8340113b10 con 0x7f8340103b90 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f833dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83401094d0 0x7f834019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f833dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83401094d0 0x7f834019a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42878/0 (socket says 172.21.15.22:42878) 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f833dd9b640 1 -- 172.21.15.22:0/720479163 learned_addr learned my addr 172.21.15.22:0/720479163 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.468+0000 7f833e59c640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340103b90 0x7f834019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f833ed9d640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8340109e20 0x7f834019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f833dd9b640 1 -- 172.21.15.22:0/720479163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340103b90 msgr2=0x7f834019a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f833dd9b640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340103b90 0x7f834019a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f833dd9b640 1 -- 172.21.15.22:0/720479163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8340109e20 msgr2=0x7f834019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f833dd9b640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8340109e20 0x7f834019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f833dd9b640 1 -- 172.21.15.22:0/720479163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83401a0330 con 0x7f83401094d0 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f833dd9b640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83401094d0 0x7f834019a960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8328005940 tx=0x7f83280040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f83377fe640 1 -- 172.21.15.22:0/720479163 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f832803f030 con 0x7f83401094d0 2024-09-21T04:00:06.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f8344969640 1 -- 172.21.15.22:0/720479163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83401a05c0 con 0x7f83401094d0 2024-09-21T04:00:06.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f83377fe640 1 -- 172.21.15.22:0/720479163 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8328003a80 con 0x7f83401094d0 2024-09-21T04:00:06.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f83377fe640 1 -- 172.21.15.22:0/720479163 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8328035070 con 0x7f83401094d0 2024-09-21T04:00:06.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.469+0000 7f8344969640 1 -- 172.21.15.22:0/720479163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83401a6d80 con 0x7f83401094d0 2024-09-21T04:00:06.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.471+0000 7f8344969640 1 -- 172.21.15.22:0/720479163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8340104e10 con 0x7f83401094d0 2024-09-21T04:00:06.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.472+0000 7f83377fe640 1 -- 172.21.15.22:0/720479163 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8328042030 con 0x7f83401094d0 2024-09-21T04:00:06.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.473+0000 7f83377fe640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f832c0b6510 0x7f832c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:06.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.473+0000 7f833e59c640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f832c0b6510 0x7f832c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:06.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.473+0000 7f83377fe640 1 -- 172.21.15.22:0/720479163 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 7979+0+0 (secure 0 0 0) 0x7f83281076d0 con 0x7f83401094d0 2024-09-21T04:00:06.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.474+0000 7f833e59c640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f832c0b6510 0x7f832c0b8a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f83380058c0 tx=0x7f833800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:06.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.477+0000 7f83377fe640 1 -- 172.21.15.22:0/720479163 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83280d23f0 con 0x7f83401094d0 2024-09-21T04:00:06.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:06.673+0000 7f8344969640 1 -- 172.21.15.22:0/720479163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f834010bc10 con 0x7f83401094d0 2024-09-21T04:00:07.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.024+0000 7f83377fe640 1 -- 172.21.15.22:0/720479163 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v75) ==== 157+0+0 (secure 0 0 0) 0x7f83280d7330 con 0x7f83401094d0 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 -- 172.21.15.22:0/720479163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f832c0b6510 msgr2=0x7f832c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f832c0b6510 0x7f832c0b8a20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f83380058c0 tx=0x7f833800a2d0 comp rx=0 tx=0).stop 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 -- 172.21.15.22:0/720479163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83401094d0 msgr2=0x7f834019a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83401094d0 0x7f834019a960 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8328005940 tx=0x7f83280040e0 comp rx=0 tx=0).stop 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 -- 172.21.15.22:0/720479163 shutdown_connections 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f832c0b6510 0x7f832c0b8a20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8340109e20 0x7f834019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f83401094d0 0x7f834019a960 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 --2- 172.21.15.22:0/720479163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8340103b90 0x7f834019a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 -- 172.21.15.22:0/720479163 >> 172.21.15.22:0/720479163 conn(0x7f83400ff5e0 msgr2=0x7f8340101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:07.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 -- 172.21.15.22:0/720479163 shutdown_connections 2024-09-21T04:00:07.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:07.027+0000 7f8344969640 1 -- 172.21.15.22:0/720479163 wait complete. 2024-09-21T04:00:07.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:07 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] up:active 2024-09-21T04:00:07.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:07 smithi022 ceph-mon[31015]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:07.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:07 smithi022 ceph-mon[31015]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:07.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:07 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/720479163' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T04:00:07.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:07 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] up:active 2024-09-21T04:00:07.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:07 smithi073 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:07.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:07 smithi073 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:07.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:07 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/720479163' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T04:00:07.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:07 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] up:active 2024-09-21T04:00:07.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:07 smithi060 ceph-mon[33722]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:07.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:07 smithi060 ceph-mon[33722]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:07.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:07 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/720479163' entity='client.admin' cmd={"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} : dispatch 2024-09-21T04:00:07.768 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-09-21T04:00:08.029 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:08.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:08 smithi022 ceph-mon[31015]: pgmap v293: 97 pgs: 1 creating+activating, 8 creating+peering, 7 unknown, 81 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 830 B/s wr, 2 op/s 2024-09-21T04:00:08.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:08 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/720479163' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T04:00:08.333 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:08 smithi022 ceph-mon[31015]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T04:00:08.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:08 smithi073 ceph-mon[34443]: pgmap v293: 97 pgs: 1 creating+activating, 8 creating+peering, 7 unknown, 81 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 830 B/s wr, 2 op/s 2024-09-21T04:00:08.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:08 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/720479163' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T04:00:08.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:08 smithi073 ceph-mon[34443]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T04:00:08.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:08 smithi060 ceph-mon[33722]: pgmap v293: 97 pgs: 1 creating+activating, 8 creating+peering, 7 unknown, 81 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 830 B/s wr, 2 op/s 2024-09-21T04:00:08.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:08 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/720479163' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-09-21T04:00:08.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:08 smithi060 ceph-mon[33722]: osdmap e75: 12 total, 12 up, 12 in 2024-09-21T04:00:08.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.555+0000 7f3c5004f640 1 -- 172.21.15.22:0/1808435226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c48102a80 msgr2=0x7f3c48102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:08.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.555+0000 7f3c5004f640 1 --2- 172.21.15.22:0/1808435226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c48102a80 0x7f3c48102e90 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009900 tx=0x7f3c3c02a410 comp rx=0 tx=0).stop 2024-09-21T04:00:08.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.555+0000 7f3c5004f640 1 -- 172.21.15.22:0/1808435226 shutdown_connections 2024-09-21T04:00:08.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.555+0000 7f3c5004f640 1 --2- 172.21.15.22:0/1808435226 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48108e20 0x7f3c4810f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:08.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.555+0000 7f3c5004f640 1 --2- 172.21.15.22:0/1808435226 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c481084d0 0x7f3c481088e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:08.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.555+0000 7f3c5004f640 1 --2- 172.21.15.22:0/1808435226 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c48102a80 0x7f3c48102e90 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:08.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.555+0000 7f3c5004f640 1 -- 172.21.15.22:0/1808435226 >> 172.21.15.22:0/1808435226 conn(0x7f3c48079720 msgr2=0x7f3c48079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:08.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.556+0000 7f3c5004f640 1 -- 172.21.15.22:0/1808435226 shutdown_connections 2024-09-21T04:00:08.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.556+0000 7f3c5004f640 1 -- 172.21.15.22:0/1808435226 wait complete. 2024-09-21T04:00:08.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.556+0000 7f3c5004f640 1 Processor -- start 2024-09-21T04:00:08.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.556+0000 7f3c5004f640 1 -- start start 2024-09-21T04:00:08.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c5004f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c48102a80 0x7f3c4819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:08.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c5004f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c481084d0 0x7f3c4819aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:08.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c5004f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48108e20 0x7f3c4819fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:08.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c5004f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3c48112990 con 0x7f3c48102a80 2024-09-21T04:00:08.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c5004f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3c48112810 con 0x7f3c481084d0 2024-09-21T04:00:08.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c5004f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3c48112b10 con 0x7f3c48108e20 2024-09-21T04:00:08.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4ddeb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c48102a80 0x7f3c4819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:08.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4ddeb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c48102a80 0x7f3c4819a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42898/0 (socket says 172.21.15.22:42898) 2024-09-21T04:00:08.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4ddeb640 1 -- 172.21.15.22:0/2264574148 learned_addr learned my addr 172.21.15.22:0/2264574148 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:08.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4d5ea640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c481084d0 0x7f3c4819aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:08.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4ddeb640 1 -- 172.21.15.22:0/2264574148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48108e20 msgr2=0x7f3c4819fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:08.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4ddeb640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48108e20 0x7f3c4819fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:08.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4ddeb640 1 -- 172.21.15.22:0/2264574148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c481084d0 msgr2=0x7f3c4819aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:08.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4ddeb640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c481084d0 0x7f3c4819aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:08.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4ddeb640 1 -- 172.21.15.22:0/2264574148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c481a0480 con 0x7f3c48102a80 2024-09-21T04:00:08.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4d5ea640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c481084d0 0x7f3c4819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:08.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c4ddeb640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c48102a80 0x7f3c4819a510 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009230 tx=0x7f3c3c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:08.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c3affd640 1 -- 172.21.15.22:0/2264574148 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c03f030 con 0x7f3c48102a80 2024-09-21T04:00:08.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.557+0000 7f3c3affd640 1 -- 172.21.15.22:0/2264574148 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c3c003a80 con 0x7f3c48102a80 2024-09-21T04:00:08.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.558+0000 7f3c5004f640 1 -- 172.21.15.22:0/2264574148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c481a0710 con 0x7f3c48102a80 2024-09-21T04:00:08.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.558+0000 7f3c3affd640 1 -- 172.21.15.22:0/2264574148 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c035070 con 0x7f3c48102a80 2024-09-21T04:00:08.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.558+0000 7f3c5004f640 1 -- 172.21.15.22:0/2264574148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c481a6ed0 con 0x7f3c48102a80 2024-09-21T04:00:08.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.559+0000 7f3c5004f640 1 -- 172.21.15.22:0/2264574148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c48103d00 con 0x7f3c48102a80 2024-09-21T04:00:08.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.560+0000 7f3c3affd640 1 -- 172.21.15.22:0/2264574148 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f3c3c042030 con 0x7f3c48102a80 2024-09-21T04:00:08.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.561+0000 7f3c3affd640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3c340b6510 0x7f3c340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:08.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.561+0000 7f3c4d5ea640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3c340b6510 0x7f3c340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:08.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.561+0000 7f3c3affd640 1 -- 172.21.15.22:0/2264574148 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 8277+0+0 (secure 0 0 0) 0x7f3c3c107fc0 con 0x7f3c48102a80 2024-09-21T04:00:08.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.562+0000 7f3c4d5ea640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3c340b6510 0x7f3c340b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3c48104a60 tx=0x7f3c44005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:08.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.564+0000 7f3c3affd640 1 -- 172.21.15.22:0/2264574148 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3c3c0ce7c0 con 0x7f3c48102a80 2024-09-21T04:00:08.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:08.755+0000 7f3c5004f640 1 -- 172.21.15.22:0/2264574148 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3c4810bc00 con 0x7f3c48102a80 2024-09-21T04:00:08.952 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:00:08 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b[61822]: 2024-09-21T04:00:08.603+0000 7f2404c9c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-21T04:00:09.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:09 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2264574148' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T04:00:09.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:09 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2264574148' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T04:00:09.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:09 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2264574148' entity='client.admin' cmd={"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} : dispatch 2024-09-21T04:00:10.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.036+0000 7f3c3affd640 1 -- 172.21.15.22:0/2264574148 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v77) ==== 228+0+0 (secure 0 0 0) 0x7f3c3c0d2ba0 con 0x7f3c48102a80 2024-09-21T04:00:10.039 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data_ec' created 2024-09-21T04:00:10.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 -- 172.21.15.22:0/2264574148 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3c340b6510 msgr2=0x7f3c340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:10.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3c340b6510 0x7f3c340b8a20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3c48104a60 tx=0x7f3c44005ec0 comp rx=0 tx=0).stop 2024-09-21T04:00:10.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 -- 172.21.15.22:0/2264574148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c48102a80 msgr2=0x7f3c4819a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:10.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c48102a80 0x7f3c4819a510 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009230 tx=0x7f3c3c004270 comp rx=0 tx=0).stop 2024-09-21T04:00:10.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 -- 172.21.15.22:0/2264574148 shutdown_connections 2024-09-21T04:00:10.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3c340b6510 0x7f3c340b8a20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:10.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3c48108e20 0x7f3c4819fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:10.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3c481084d0 0x7f3c4819aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:10.043 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 --2- 172.21.15.22:0/2264574148 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3c48102a80 0x7f3c4819a510 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:10.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 -- 172.21.15.22:0/2264574148 >> 172.21.15.22:0/2264574148 conn(0x7f3c48079720 msgr2=0x7f3c4806bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:10.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.040+0000 7f3c5004f640 1 -- 172.21.15.22:0/2264574148 shutdown_connections 2024-09-21T04:00:10.044 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:10.041+0000 7f3c5004f640 1 -- 172.21.15.22:0/2264574148 wait complete. 2024-09-21T04:00:10.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:10 smithi022 ceph-mon[31015]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 3 op/s 2024-09-21T04:00:10.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:10 smithi022 ceph-mon[31015]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T04:00:10.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:10 smithi073 ceph-mon[34443]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 3 op/s 2024-09-21T04:00:10.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:10 smithi073 ceph-mon[34443]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T04:00:10.451 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:10 smithi060 ceph-mon[33722]: pgmap v295: 97 pgs: 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 KiB/s wr, 3 op/s 2024-09-21T04:00:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:10 smithi060 ceph-mon[33722]: osdmap e76: 12 total, 12 up, 12 in 2024-09-21T04:00:11.090 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-09-21T04:00:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:11 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2264574148' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T04:00:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:11 smithi022 ceph-mon[31015]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T04:00:11.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:11 smithi022 ceph-mon[31015]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T04:00:11.350 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:11.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:11 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2264574148' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T04:00:11.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:11 smithi073 ceph-mon[34443]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T04:00:11.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:11 smithi073 ceph-mon[34443]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T04:00:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:11 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2264574148' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-21T04:00:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:11 smithi060 ceph-mon[33722]: osdmap e77: 12 total, 12 up, 12 in 2024-09-21T04:00:11.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:11 smithi060 ceph-mon[33722]: osdmap e78: 12 total, 12 up, 12 in 2024-09-21T04:00:11.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.879+0000 7fcb92814640 1 -- 172.21.15.22:0/49567848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb8c105290 msgr2=0x7fcb8c10d920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:11.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.879+0000 7fcb92814640 1 --2- 172.21.15.22:0/49567848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb8c105290 0x7fcb8c10d920 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fcb80009900 tx=0x7fcb8002a410 comp rx=0 tx=0).stop 2024-09-21T04:00:11.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.880+0000 7fcb92814640 1 -- 172.21.15.22:0/49567848 shutdown_connections 2024-09-21T04:00:11.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.880+0000 7fcb92814640 1 --2- 172.21.15.22:0/49567848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c10de60 0x7fcb8c110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:11.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.880+0000 7fcb92814640 1 --2- 172.21.15.22:0/49567848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb8c105290 0x7fcb8c10d920 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.880+0000 7fcb92814640 1 --2- 172.21.15.22:0/49567848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c1048b0 0x7fcb8c104cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.880+0000 7fcb92814640 1 -- 172.21.15.22:0/49567848 >> 172.21.15.22:0/49567848 conn(0x7fcb8c0796d0 msgr2=0x7fcb8c079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.880+0000 7fcb92814640 1 -- 172.21.15.22:0/49567848 shutdown_connections 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.880+0000 7fcb92814640 1 -- 172.21.15.22:0/49567848 wait complete. 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.880+0000 7fcb92814640 1 Processor -- start 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.880+0000 7fcb92814640 1 -- start start 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb92814640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c1048b0 0x7fcb8c19a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb92814640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb8c105290 0x7fcb8c19a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb92814640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c10de60 0x7fcb8c19fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb92814640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c113950 con 0x7fcb8c105290 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb92814640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c1137d0 con 0x7fcb8c10de60 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb92814640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcb8c113ad0 con 0x7fcb8c1048b0 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb8b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb8c105290 0x7fcb8c19a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:11.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb8b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb8c105290 0x7fcb8c19a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54968/0 (socket says 172.21.15.22:54968) 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb8b7fe640 1 -- 172.21.15.22:0/4253151127 learned_addr learned my addr 172.21.15.22:0/4253151127 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb90db1640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c10de60 0x7fcb8c19fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb8bfff640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c1048b0 0x7fcb8c19a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb8b7fe640 1 -- 172.21.15.22:0/4253151127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c1048b0 msgr2=0x7fcb8c19a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb8b7fe640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c1048b0 0x7fcb8c19a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb8b7fe640 1 -- 172.21.15.22:0/4253151127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c10de60 msgr2=0x7fcb8c19fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb8b7fe640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c10de60 0x7fcb8c19fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb8b7fe640 1 -- 172.21.15.22:0/4253151127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb8c1a02b0 con 0x7fcb8c105290 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb90db1640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c10de60 0x7fcb8c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.881+0000 7fcb8b7fe640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb8c105290 0x7fcb8c19a9a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcb80005940 tx=0x7fcb800040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:11.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.882+0000 7fcb897fa640 1 -- 172.21.15.22:0/4253151127 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb8003f030 con 0x7fcb8c105290 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.882+0000 7fcb897fa640 1 -- 172.21.15.22:0/4253151127 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcb80003a80 con 0x7fcb8c105290 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.882+0000 7fcb92814640 1 -- 172.21.15.22:0/4253151127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb8c1a0540 con 0x7fcb8c105290 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.882+0000 7fcb897fa640 1 -- 172.21.15.22:0/4253151127 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb80035070 con 0x7fcb8c105290 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.882+0000 7fcb92814640 1 -- 172.21.15.22:0/4253151127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb8c1a0a20 con 0x7fcb8c105290 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.883+0000 7fcb92814640 1 -- 172.21.15.22:0/4253151127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb8c06c190 con 0x7fcb8c105290 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.885+0000 7fcb897fa640 1 -- 172.21.15.22:0/4253151127 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fcb80042030 con 0x7fcb8c105290 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.886+0000 7fcb897fa640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcb740b6540 0x7fcb740b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.886+0000 7fcb8bfff640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcb740b6540 0x7fcb740b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.886+0000 7fcb897fa640 1 -- 172.21.15.22:0/4253151127 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 8770+0+0 (secure 0 0 0) 0x7fcb80107f20 con 0x7fcb8c105290 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.887+0000 7fcb8bfff640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcb740b6540 0x7fcb740b8a50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c005fd0 tx=0x7fcb7c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:11.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:11.890+0000 7fcb897fa640 1 -- 172.21.15.22:0/4253151127 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb800ce530 con 0x7fcb8c105290 2024-09-21T04:00:12.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:12.082+0000 7fcb92814640 1 -- 172.21.15.22:0/4253151127 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fcb8c104cc0 con 0x7fcb8c105290 2024-09-21T04:00:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:12 smithi022 ceph-mon[31015]: pgmap v298: 129 pgs: 7 creating+peering, 25 unknown, 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-21T04:00:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:12 smithi022 ceph-mon[31015]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T04:00:12.353 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:12 smithi060 ceph-mon[33722]: pgmap v298: 129 pgs: 7 creating+peering, 25 unknown, 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-21T04:00:12.353 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:12 smithi060 ceph-mon[33722]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T04:00:12.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:12 smithi073 ceph-mon[34443]: pgmap v298: 129 pgs: 7 creating+peering, 25 unknown, 97 active+clean; 579 KiB data, 371 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s wr, 7 op/s 2024-09-21T04:00:12.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:12 smithi073 ceph-mon[34443]: osdmap e79: 12 total, 12 up, 12 in 2024-09-21T04:00:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.074+0000 7fcb897fa640 1 -- 172.21.15.22:0/4253151127 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v80) ==== 169+0+0 (secure 0 0 0) 0x7fcb8c104cc0 con 0x7fcb8c105290 2024-09-21T04:00:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:set pool 4 allow_ec_overwrites to true 2024-09-21T04:00:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 -- 172.21.15.22:0/4253151127 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcb740b6540 msgr2=0x7fcb740b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcb740b6540 0x7fcb740b8a50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c005fd0 tx=0x7fcb7c005850 comp rx=0 tx=0).stop 2024-09-21T04:00:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 -- 172.21.15.22:0/4253151127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb8c105290 msgr2=0x7fcb8c19a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb8c105290 0x7fcb8c19a9a0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcb80005940 tx=0x7fcb800040e0 comp rx=0 tx=0).stop 2024-09-21T04:00:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 -- 172.21.15.22:0/4253151127 shutdown_connections 2024-09-21T04:00:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcb740b6540 0x7fcb740b8a50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb8c10de60 0x7fcb8c19fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb8c105290 0x7fcb8c19a9a0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 --2- 172.21.15.22:0/4253151127 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb8c1048b0 0x7fcb8c19a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:13.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 -- 172.21.15.22:0/4253151127 >> 172.21.15.22:0/4253151127 conn(0x7fcb8c0796d0 msgr2=0x7fcb8c1009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:13.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 -- 172.21.15.22:0/4253151127 shutdown_connections 2024-09-21T04:00:13.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:13.077+0000 7fcb92814640 1 -- 172.21.15.22:0/4253151127 wait complete. 2024-09-21T04:00:13.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:13 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/4253151127' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T04:00:13.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:13 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/4253151127' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T04:00:13.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:13 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/4253151127' entity='client.admin' cmd={"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} : dispatch 2024-09-21T04:00:13.753 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-09-21T04:00:14.025 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:14.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:14 smithi022 ceph-mon[31015]: pgmap v301: 129 pgs: 7 creating+peering, 9 unknown, 113 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-21T04:00:14.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:14 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/4253151127' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T04:00:14.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:14 smithi022 ceph-mon[31015]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T04:00:14.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:14 smithi073 ceph-mon[34443]: pgmap v301: 129 pgs: 7 creating+peering, 9 unknown, 113 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-21T04:00:14.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:14 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/4253151127' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T04:00:14.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:14 smithi073 ceph-mon[34443]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T04:00:14.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:14 smithi060 ceph-mon[33722]: pgmap v301: 129 pgs: 7 creating+peering, 9 unknown, 113 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-21T04:00:14.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:14 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/4253151127' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-09-21T04:00:14.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:14 smithi060 ceph-mon[33722]: osdmap e80: 12 total, 12 up, 12 in 2024-09-21T04:00:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.530+0000 7fb36f583640 1 -- 172.21.15.22:0/3156943496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb368104a30 msgr2=0x7fb368104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.530+0000 7fb36f583640 1 --2- 172.21.15.22:0/3156943496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb368104a30 0x7fb368104e40 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb364009900 tx=0x7fb36402a410 comp rx=0 tx=0).stop 2024-09-21T04:00:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.530+0000 7fb36f583640 1 -- 172.21.15.22:0/3156943496 shutdown_connections 2024-09-21T04:00:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.530+0000 7fb36f583640 1 --2- 172.21.15.22:0/3156943496 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb368105380 0x7fb36810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.530+0000 7fb36f583640 1 --2- 172.21.15.22:0/3156943496 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb36810de60 0x7fb368110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.530+0000 7fb36f583640 1 --2- 172.21.15.22:0/3156943496 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb368104a30 0x7fb368104e40 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.530+0000 7fb36f583640 1 -- 172.21.15.22:0/3156943496 >> 172.21.15.22:0/3156943496 conn(0x7fb368079760 msgr2=0x7fb368079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.530+0000 7fb36f583640 1 -- 172.21.15.22:0/3156943496 shutdown_connections 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.530+0000 7fb36f583640 1 -- 172.21.15.22:0/3156943496 wait complete. 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.531+0000 7fb36f583640 1 Processor -- start 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.531+0000 7fb36f583640 1 -- start start 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.531+0000 7fb36f583640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb368104a30 0x7fb36819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.531+0000 7fb36f583640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb368105380 0x7fb36819ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.531+0000 7fb36f583640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb36810de60 0x7fb36819fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.531+0000 7fb36f583640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb368113a30 con 0x7fb368104a30 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.531+0000 7fb36f583640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb3681138b0 con 0x7fb368105380 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.531+0000 7fb36f583640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb368113bb0 con 0x7fb36810de60 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.531+0000 7fb36d31f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb368104a30 0x7fb36819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:14.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36d31f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb368104a30 0x7fb36819a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54988/0 (socket says 172.21.15.22:54988) 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36d31f640 1 -- 172.21.15.22:0/2437256614 learned_addr learned my addr 172.21.15.22:0/2437256614 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36db20640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb36810de60 0x7fb36819fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36cb1e640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb368105380 0x7fb36819ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36d31f640 1 -- 172.21.15.22:0/2437256614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb36810de60 msgr2=0x7fb36819fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36d31f640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb36810de60 0x7fb36819fe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36d31f640 1 -- 172.21.15.22:0/2437256614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb368105380 msgr2=0x7fb36819ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36d31f640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb368105380 0x7fb36819ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36d31f640 1 -- 172.21.15.22:0/2437256614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3681a0550 con 0x7fb368104a30 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36db20640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb36810de60 0x7fb36819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36d31f640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb368104a30 0x7fb36819a5e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb364005940 tx=0x7fb3640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb35e7fc640 1 -- 172.21.15.22:0/2437256614 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb36403f030 con 0x7fb368104a30 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb35e7fc640 1 -- 172.21.15.22:0/2437256614 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb364003c90 con 0x7fb368104a30 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb36f583640 1 -- 172.21.15.22:0/2437256614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3681a07e0 con 0x7fb368104a30 2024-09-21T04:00:14.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.532+0000 7fb35e7fc640 1 -- 172.21.15.22:0/2437256614 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364035070 con 0x7fb368104a30 2024-09-21T04:00:14.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.533+0000 7fb36f583640 1 -- 172.21.15.22:0/2437256614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3681a6fa0 con 0x7fb368104a30 2024-09-21T04:00:14.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.534+0000 7fb36f583640 1 -- 172.21.15.22:0/2437256614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb36806b350 con 0x7fb368104a30 2024-09-21T04:00:14.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.535+0000 7fb35e7fc640 1 -- 172.21.15.22:0/2437256614 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fb364042030 con 0x7fb368104a30 2024-09-21T04:00:14.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.536+0000 7fb35e7fc640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb3540b6590 0x7fb3540b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:14.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.536+0000 7fb36cb1e640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb3540b6590 0x7fb3540b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:14.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.536+0000 7fb35e7fc640 1 -- 172.21.15.22:0/2437256614 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 8770+0+0 (secure 0 0 0) 0x7fb364107f20 con 0x7fb368104a30 2024-09-21T04:00:14.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.536+0000 7fb36cb1e640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb3540b6590 0x7fb3540b8aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb3681017e0 tx=0x7fb358009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:14.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.539+0000 7fb35e7fc640 1 -- 172.21.15.22:0/2437256614 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3640ce530 con 0x7fb368104a30 2024-09-21T04:00:14.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:14.767+0000 7fb36f583640 1 -- 172.21.15.22:0/2437256614 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fb368104ec0 con 0x7fb368104a30 2024-09-21T04:00:15.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.082+0000 7fb35e7fc640 1 -- 172.21.15.22:0/2437256614 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fb3640d2910 con 0x7fb368104a30 2024-09-21T04:00:15.085 INFO:teuthology.orchestra.run.smithi022.stderr:added data pool 4 to fsmap 2024-09-21T04:00:15.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 -- 172.21.15.22:0/2437256614 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb3540b6590 msgr2=0x7fb3540b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:15.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb3540b6590 0x7fb3540b8aa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb3681017e0 tx=0x7fb358009110 comp rx=0 tx=0).stop 2024-09-21T04:00:15.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 -- 172.21.15.22:0/2437256614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb368104a30 msgr2=0x7fb36819a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:15.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb368104a30 0x7fb36819a5e0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb364005940 tx=0x7fb3640042f0 comp rx=0 tx=0).stop 2024-09-21T04:00:15.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 -- 172.21.15.22:0/2437256614 shutdown_connections 2024-09-21T04:00:15.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb3540b6590 0x7fb3540b8aa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:15.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb36810de60 0x7fb36819fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:15.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb368105380 0x7fb36819ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:15.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 --2- 172.21.15.22:0/2437256614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb368104a30 0x7fb36819a5e0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:15.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 -- 172.21.15.22:0/2437256614 >> 172.21.15.22:0/2437256614 conn(0x7fb368079760 msgr2=0x7fb3680ff880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:15.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 -- 172.21.15.22:0/2437256614 shutdown_connections 2024-09-21T04:00:15.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:15.085+0000 7fb36f583640 1 -- 172.21.15.22:0/2437256614 wait complete. 2024-09-21T04:00:15.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:15 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2437256614' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T04:00:15.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:15 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2437256614' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T04:00:15.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:15 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2437256614' entity='client.admin' cmd={"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} : dispatch 2024-09-21T04:00:15.792 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:00:16.053 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:16.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:16 smithi022 ceph-mon[31015]: pgmap v303: 129 pgs: 7 creating+peering, 122 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T04:00:16.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:16 smithi022 ceph-mon[31015]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T04:00:16.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:16 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2437256614' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T04:00:16.081 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:16 smithi022 ceph-mon[31015]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:16.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:16 smithi073 ceph-mon[34443]: pgmap v303: 129 pgs: 7 creating+peering, 122 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T04:00:16.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:16 smithi073 ceph-mon[34443]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T04:00:16.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:16 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2437256614' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T04:00:16.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:16 smithi073 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:16.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:16 smithi060 ceph-mon[33722]: pgmap v303: 129 pgs: 7 creating+peering, 122 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-09-21T04:00:16.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:16 smithi060 ceph-mon[33722]: osdmap e81: 12 total, 12 up, 12 in 2024-09-21T04:00:16.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:16 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2437256614' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-09-21T04:00:16.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:16 smithi060 ceph-mon[33722]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:16.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.529+0000 7fcb08e23640 1 -- 172.21.15.22:0/402219305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb0410de50 msgr2=0x7fcb04110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:16.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.529+0000 7fcb08e23640 1 --2- 172.21.15.22:0/402219305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb0410de50 0x7fcb04110320 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcafc009ca0 tx=0x7fcafc02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:16.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.529+0000 7fcb08e23640 1 -- 172.21.15.22:0/402219305 shutdown_connections 2024-09-21T04:00:16.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.529+0000 7fcb08e23640 1 --2- 172.21.15.22:0/402219305 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb04105370 0x7fcb0410d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:16.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.529+0000 7fcb08e23640 1 --2- 172.21.15.22:0/402219305 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb0410de50 0x7fcb04110320 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:16.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.529+0000 7fcb08e23640 1 --2- 172.21.15.22:0/402219305 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb04104a20 0x7fcb04104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:16.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.529+0000 7fcb08e23640 1 -- 172.21.15.22:0/402219305 >> 172.21.15.22:0/402219305 conn(0x7fcb040796d0 msgr2=0x7fcb04079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:16.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.529+0000 7fcb08e23640 1 -- 172.21.15.22:0/402219305 shutdown_connections 2024-09-21T04:00:16.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.529+0000 7fcb08e23640 1 -- 172.21.15.22:0/402219305 wait complete. 2024-09-21T04:00:16.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.530+0000 7fcb08e23640 1 Processor -- start 2024-09-21T04:00:16.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.530+0000 7fcb08e23640 1 -- start start 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb08e23640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb04104a20 0x7fcb0419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb08e23640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb04105370 0x7fcb0419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb08e23640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb0410de50 0x7fcb0419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb08e23640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcb041139b0 con 0x7fcb04105370 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb08e23640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcb04113830 con 0x7fcb0410de50 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb08e23640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcb04113b30 con 0x7fcb04104a20 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb01d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb04105370 0x7fcb0419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb01d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb04105370 0x7fcb0419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54998/0 (socket says 172.21.15.22:54998) 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb01d9b640 1 -- 172.21.15.22:0/3845579995 learned_addr learned my addr 172.21.15.22:0/3845579995 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb0259c640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb04104a20 0x7fcb0419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:16.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb02d9d640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb0410de50 0x7fcb0419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb01d9b640 1 -- 172.21.15.22:0/3845579995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb04104a20 msgr2=0x7fcb0419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb01d9b640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb04104a20 0x7fcb0419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb01d9b640 1 -- 172.21.15.22:0/3845579995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb0410de50 msgr2=0x7fcb0419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb01d9b640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb0410de50 0x7fcb0419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb01d9b640 1 -- 172.21.15.22:0/3845579995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb041a0310 con 0x7fcb04105370 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.531+0000 7fcb01d9b640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb04105370 0x7fcb0419a940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c970 tx=0x7fcaf800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.532+0000 7fcaf37fe640 1 -- 172.21.15.22:0/3845579995 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf8004220 con 0x7fcb04105370 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.532+0000 7fcaf37fe640 1 -- 172.21.15.22:0/3845579995 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcaf8007e40 con 0x7fcb04105370 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.532+0000 7fcb08e23640 1 -- 172.21.15.22:0/3845579995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb041a0600 con 0x7fcb04105370 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.532+0000 7fcaf37fe640 1 -- 172.21.15.22:0/3845579995 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcaf80047a0 con 0x7fcb04105370 2024-09-21T04:00:16.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.532+0000 7fcb08e23640 1 -- 172.21.15.22:0/3845579995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb041a6d60 con 0x7fcb04105370 2024-09-21T04:00:16.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.533+0000 7fcb08e23640 1 -- 172.21.15.22:0/3845579995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb0406c1f0 con 0x7fcb04105370 2024-09-21T04:00:16.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.534+0000 7fcaf37fe640 1 -- 172.21.15.22:0/3845579995 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fcaf80079b0 con 0x7fcb04105370 2024-09-21T04:00:16.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.535+0000 7fcaf37fe640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcaec0b6590 0x7fcaec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:16.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.535+0000 7fcb0259c640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcaec0b6590 0x7fcaec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:16.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.535+0000 7fcaf37fe640 1 -- 172.21.15.22:0/3845579995 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7fcaf80e74c0 con 0x7fcb04105370 2024-09-21T04:00:16.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.536+0000 7fcb0259c640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcaec0b6590 0x7fcaec0b8aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4005d00 tx=0x7fcaf400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:16.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.538+0000 7fcaf37fe640 1 -- 172.21.15.22:0/3845579995 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcaf8014030 con 0x7fcb04105370 2024-09-21T04:00:16.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.766+0000 7fcb08e23640 1 -- 172.21.15.22:0/3845579995 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcb04104e30 con 0x7fcb04105370 2024-09-21T04:00:16.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.767+0000 7fcaf37fe640 1 -- 172.21.15.22:0/3845579995 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11824 (secure 0 0 0) 0x7fcb04104e30 con 0x7fcb04105370 2024-09-21T04:00:16.770 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:16.770 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"btime":"2024-09-21T04:00:15:076988+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24596,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:00:14.769390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24647,"qdb_cluster":[24647]},"id":1}]} 2024-09-21T04:00:16.770 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 17 2024-09-21T04:00:16.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 -- 172.21.15.22:0/3845579995 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcaec0b6590 msgr2=0x7fcaec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcaec0b6590 0x7fcaec0b8aa0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fcaf4005d00 tx=0x7fcaf400b410 comp rx=0 tx=0).stop 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 -- 172.21.15.22:0/3845579995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb04105370 msgr2=0x7fcb0419a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb04105370 0x7fcb0419a940 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcaf800c970 tx=0x7fcaf800ce30 comp rx=0 tx=0).stop 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 -- 172.21.15.22:0/3845579995 shutdown_connections 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcaec0b6590 0x7fcaec0b8aa0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcb0410de50 0x7fcb0419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcb04105370 0x7fcb0419a940 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 --2- 172.21.15.22:0/3845579995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcb04104a20 0x7fcb0419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 -- 172.21.15.22:0/3845579995 >> 172.21.15.22:0/3845579995 conn(0x7fcb040796d0 msgr2=0x7fcb040ff580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 -- 172.21.15.22:0/3845579995 shutdown_connections 2024-09-21T04:00:16.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:16.770+0000 7fcb08e23640 1 -- 172.21.15.22:0/3845579995 wait complete. 2024-09-21T04:00:17.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:17 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3845579995' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:17.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:17 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3845579995' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:17.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:17 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3845579995' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:17.593 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:00:17.852 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:18.291 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:18 smithi022 ceph-mon[31015]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:18.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:18 smithi073 ceph-mon[34443]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:18.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.380+0000 7fd5bc497640 1 -- 172.21.15.22:0/331234162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b410de70 msgr2=0x7fd5b4110380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:18.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.380+0000 7fd5bc497640 1 --2- 172.21.15.22:0/331234162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b410de70 0x7fd5b4110380 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac009ca0 tx=0x7fd5ac02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.380+0000 7fd5bc497640 1 -- 172.21.15.22:0/331234162 shutdown_connections 2024-09-21T04:00:18.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.380+0000 7fd5bc497640 1 --2- 172.21.15.22:0/331234162 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5b41052f0 0x7fd5b410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.380+0000 7fd5bc497640 1 --2- 172.21.15.22:0/331234162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b410de70 0x7fd5b4110380 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.380+0000 7fd5bc497640 1 --2- 172.21.15.22:0/331234162 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5b41048c0 0x7fd5b4104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.380+0000 7fd5bc497640 1 -- 172.21.15.22:0/331234162 >> 172.21.15.22:0/331234162 conn(0x7fd5b4079770 msgr2=0x7fd5b4079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.380+0000 7fd5bc497640 1 -- 172.21.15.22:0/331234162 shutdown_connections 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.380+0000 7fd5bc497640 1 -- 172.21.15.22:0/331234162 wait complete. 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5bc497640 1 Processor -- start 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5bc497640 1 -- start start 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5bc497640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b41048c0 0x7fd5b419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5bc497640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5b41052f0 0x7fd5b419a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5bc497640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5b410de70 0x7fd5b419fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5bc497640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b41139f0 con 0x7fd5b41048c0 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5bc497640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4113870 con 0x7fd5b41052f0 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5bc497640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b4113b70 con 0x7fd5b410de70 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5ba233640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b41048c0 0x7fd5b419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:18.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5ba233640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b41048c0 0x7fd5b419a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55028/0 (socket says 172.21.15.22:55028) 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5ba233640 1 -- 172.21.15.22:0/309148770 learned_addr learned my addr 172.21.15.22:0/309148770 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5baa34640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5b410de70 0x7fd5b419fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5b9a32640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5b41052f0 0x7fd5b419a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5ba233640 1 -- 172.21.15.22:0/309148770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5b410de70 msgr2=0x7fd5b419fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5ba233640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5b410de70 0x7fd5b419fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.381+0000 7fd5ba233640 1 -- 172.21.15.22:0/309148770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5b41052f0 msgr2=0x7fd5b419a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.382+0000 7fd5ba233640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5b41052f0 0x7fd5b419a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.382+0000 7fd5ba233640 1 -- 172.21.15.22:0/309148770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b41a0350 con 0x7fd5b41048c0 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.382+0000 7fd5ba233640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b41048c0 0x7fd5b419a3e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000e9f0 tx=0x7fd5b000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.382+0000 7fd5ab7fe640 1 -- 172.21.15.22:0/309148770 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b000cd80 con 0x7fd5b41048c0 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.382+0000 7fd5ab7fe640 1 -- 172.21.15.22:0/309148770 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5b00108c0 con 0x7fd5b41048c0 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.382+0000 7fd5ab7fe640 1 -- 172.21.15.22:0/309148770 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b00187c0 con 0x7fd5b41048c0 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.382+0000 7fd5bc497640 1 -- 172.21.15.22:0/309148770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b41a0640 con 0x7fd5b41048c0 2024-09-21T04:00:18.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.382+0000 7fd5bc497640 1 -- 172.21.15.22:0/309148770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b41a6da0 con 0x7fd5b41048c0 2024-09-21T04:00:18.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.383+0000 7fd5bc497640 1 -- 172.21.15.22:0/309148770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5b406c200 con 0x7fd5b41048c0 2024-09-21T04:00:18.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.385+0000 7fd5ab7fe640 1 -- 172.21.15.22:0/309148770 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd5b0010430 con 0x7fd5b41048c0 2024-09-21T04:00:18.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.386+0000 7fd5ab7fe640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd5a00b6590 0x7fd5a00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:18.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.386+0000 7fd5b9a32640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd5a00b6590 0x7fd5a00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:18.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.386+0000 7fd5ab7fe640 1 -- 172.21.15.22:0/309148770 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7fd5b00e7d00 con 0x7fd5b41048c0 2024-09-21T04:00:18.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.387+0000 7fd5b9a32640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd5a00b6590 0x7fd5a00b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd5b410fb10 tx=0x7fd5a400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:18.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.389+0000 7fd5ab7fe640 1 -- 172.21.15.22:0/309148770 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd5b00b2730 con 0x7fd5b41048c0 2024-09-21T04:00:18.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:18 smithi060 ceph-mon[33722]: pgmap v305: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:18.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.580+0000 7fd5bc497640 1 -- 172.21.15.22:0/309148770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd5b419b510 con 0x7fd5b41048c0 2024-09-21T04:00:18.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.582+0000 7fd5ab7fe640 1 -- 172.21.15.22:0/309148770 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24126 (secure 0 0 0) 0x7fd5b00b7670 con 0x7fd5b41048c0 2024-09-21T04:00:18.585 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:18.585 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:00:14.769241+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:00:18.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 -- 172.21.15.22:0/309148770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd5a00b6590 msgr2=0x7fd5a00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:18.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd5a00b6590 0x7fd5a00b8aa0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd5b410fb10 tx=0x7fd5a400b410 comp rx=0 tx=0).stop 2024-09-21T04:00:18.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 -- 172.21.15.22:0/309148770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b41048c0 msgr2=0x7fd5b419a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:18.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b41048c0 0x7fd5b419a3e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd5b000e9f0 tx=0x7fd5b000eeb0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 -- 172.21.15.22:0/309148770 shutdown_connections 2024-09-21T04:00:18.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd5a00b6590 0x7fd5a00b8aa0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd5b410de70 0x7fd5b419fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd5b41052f0 0x7fd5b419a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 --2- 172.21.15.22:0/309148770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5b41048c0 0x7fd5b419a3e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:18.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 -- 172.21.15.22:0/309148770 >> 172.21.15.22:0/309148770 conn(0x7fd5b4079770 msgr2=0x7fd5b41079f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:18.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 -- 172.21.15.22:0/309148770 shutdown_connections 2024-09-21T04:00:18.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:18.585+0000 7fd5bc497640 1 -- 172.21.15.22:0/309148770 wait complete. 2024-09-21T04:00:19.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:19 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/309148770' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:19.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:19 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/309148770' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:19.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:19 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/309148770' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:19.534 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:00:19.796 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:20.212 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:20 smithi022 ceph-mon[31015]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:20.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.302+0000 7fd92547c640 1 -- 172.21.15.22:0/3945979346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9201094a0 msgr2=0x7fd9201098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:20.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.302+0000 7fd92547c640 1 --2- 172.21.15.22:0/3945979346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9201094a0 0x7fd9201098b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd908009900 tx=0x7fd90802a410 comp rx=0 tx=0).stop 2024-09-21T04:00:20.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.302+0000 7fd92547c640 1 -- 172.21.15.22:0/3945979346 shutdown_connections 2024-09-21T04:00:20.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.302+0000 7fd92547c640 1 --2- 172.21.15.22:0/3945979346 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd920109df0 0x7fd920110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:20.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.302+0000 7fd92547c640 1 --2- 172.21.15.22:0/3945979346 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd9201094a0 0x7fd9201098b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:20.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.302+0000 7fd92547c640 1 --2- 172.21.15.22:0/3945979346 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd920103b60 0x7fd920103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:20.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.302+0000 7fd92547c640 1 -- 172.21.15.22:0/3945979346 >> 172.21.15.22:0/3945979346 conn(0x7fd92007b850 msgr2=0x7fd92007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:20.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.302+0000 7fd92547c640 1 -- 172.21.15.22:0/3945979346 shutdown_connections 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.302+0000 7fd92547c640 1 -- 172.21.15.22:0/3945979346 wait complete. 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.302+0000 7fd92547c640 1 Processor -- start 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd92547c640 1 -- start start 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd92547c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd920103b60 0x7fd92019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd92547c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9201094a0 0x7fd92019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd92547c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd920109df0 0x7fd92019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd92547c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd920113960 con 0x7fd920103b60 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd92547c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd9201137e0 con 0x7fd9201094a0 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd92547c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd920113ae0 con 0x7fd920109df0 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd920103b60 0x7fd92019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd920103b60 0x7fd92019a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55056/0 (socket says 172.21.15.22:55056) 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91effd640 1 -- 172.21.15.22:0/186520144 learned_addr learned my addr 172.21.15.22:0/186520144 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91e7fc640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9201094a0 0x7fd92019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:20.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91f7fe640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd920109df0 0x7fd92019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91effd640 1 -- 172.21.15.22:0/186520144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd920109df0 msgr2=0x7fd92019fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91effd640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd920109df0 0x7fd92019fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91effd640 1 -- 172.21.15.22:0/186520144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9201094a0 msgr2=0x7fd92019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91effd640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9201094a0 0x7fd92019a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91effd640 1 -- 172.21.15.22:0/186520144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9201a0340 con 0x7fd920103b60 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.303+0000 7fd91effd640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd920103b60 0x7fd92019a3d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd91000d950 tx=0x7fd91000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.304+0000 7fd917fff640 1 -- 172.21.15.22:0/186520144 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd910017030 con 0x7fd920103b60 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.304+0000 7fd917fff640 1 -- 172.21.15.22:0/186520144 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd910004020 con 0x7fd920103b60 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.304+0000 7fd92547c640 1 -- 172.21.15.22:0/186520144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9201a0630 con 0x7fd920103b60 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.304+0000 7fd917fff640 1 -- 172.21.15.22:0/186520144 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9100055d0 con 0x7fd920103b60 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.304+0000 7fd92547c640 1 -- 172.21.15.22:0/186520144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9201a6d90 con 0x7fd920103b60 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.305+0000 7fd92547c640 1 -- 172.21.15.22:0/186520144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd920103f70 con 0x7fd920103b60 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.306+0000 7fd917fff640 1 -- 172.21.15.22:0/186520144 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd910009a30 con 0x7fd920103b60 2024-09-21T04:00:20.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.307+0000 7fd917fff640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd90c0b6510 0x7fd90c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.307+0000 7fd91e7fc640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd90c0b6510 0x7fd90c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.307+0000 7fd917fff640 1 -- 172.21.15.22:0/186520144 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7fd9100e76c0 con 0x7fd920103b60 2024-09-21T04:00:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.308+0000 7fd91e7fc640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd90c0b6510 0x7fd90c0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd908005940 tx=0x7fd9080058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:20.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.310+0000 7fd917fff640 1 -- 172.21.15.22:0/186520144 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd9100adcb0 con 0x7fd920103b60 2024-09-21T04:00:20.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:20 smithi073 ceph-mon[34443]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:20.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:20 smithi060 ceph-mon[33722]: pgmap v306: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:20.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.498+0000 7fd92547c640 1 -- 172.21.15.22:0/186520144 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd92002e640 con 0x7fd920103b60 2024-09-21T04:00:20.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.500+0000 7fd917fff640 1 -- 172.21.15.22:0/186520144 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24126 (secure 0 0 0) 0x7fd9100b2090 con 0x7fd920103b60 2024-09-21T04:00:20.503 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:20.503 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:00:14.769241+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:00:20.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 -- 172.21.15.22:0/186520144 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd90c0b6510 msgr2=0x7fd90c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:20.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd90c0b6510 0x7fd90c0b8a20 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd908005940 tx=0x7fd9080058d0 comp rx=0 tx=0).stop 2024-09-21T04:00:20.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 -- 172.21.15.22:0/186520144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd920103b60 msgr2=0x7fd92019a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:20.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd920103b60 0x7fd92019a3d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fd91000d950 tx=0x7fd91000de10 comp rx=0 tx=0).stop 2024-09-21T04:00:20.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 -- 172.21.15.22:0/186520144 shutdown_connections 2024-09-21T04:00:20.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd90c0b6510 0x7fd90c0b8a20 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:20.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd920109df0 0x7fd92019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:20.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd9201094a0 0x7fd92019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:20.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 --2- 172.21.15.22:0/186520144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd920103b60 0x7fd92019a3d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:20.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 -- 172.21.15.22:0/186520144 >> 172.21.15.22:0/186520144 conn(0x7fd92007b850 msgr2=0x7fd9201075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:20.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 -- 172.21.15.22:0/186520144 shutdown_connections 2024-09-21T04:00:20.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:20.502+0000 7fd92547c640 1 -- 172.21.15.22:0/186520144 wait complete. 2024-09-21T04:00:21.200 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:21 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/186520144' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:21.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:00:21.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:21 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/186520144' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:21.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:21 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/186520144' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:21.505 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.000+0000 7f06e463e640 1 -- 172.21.15.22:0/1239964859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06dc102ae0 msgr2=0x7f06dc102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.000+0000 7f06e463e640 1 --2- 172.21.15.22:0/1239964859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06dc102ae0 0x7f06dc102ef0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009900 tx=0x7f06d802a410 comp rx=0 tx=0).stop 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.001+0000 7f06e463e640 1 -- 172.21.15.22:0/1239964859 shutdown_connections 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.001+0000 7f06e463e640 1 --2- 172.21.15.22:0/1239964859 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06dc108d20 0x7f06dc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.001+0000 7f06e463e640 1 --2- 172.21.15.22:0/1239964859 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc1083d0 0x7f06dc1087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.001+0000 7f06e463e640 1 --2- 172.21.15.22:0/1239964859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06dc102ae0 0x7f06dc102ef0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.001+0000 7f06e463e640 1 -- 172.21.15.22:0/1239964859 >> 172.21.15.22:0/1239964859 conn(0x7f06dc079760 msgr2=0x7f06dc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.001+0000 7f06e463e640 1 -- 172.21.15.22:0/1239964859 shutdown_connections 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.001+0000 7f06e463e640 1 -- 172.21.15.22:0/1239964859 wait complete. 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.001+0000 7f06e463e640 1 Processor -- start 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.001+0000 7f06e463e640 1 -- start start 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e463e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc102ae0 0x7f06dc19b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e463e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06dc1083d0 0x7f06dc19b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e463e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06dc108d20 0x7f06dc19bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e463e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc112840 con 0x7f06dc1083d0 2024-09-21T04:00:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e463e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1126c0 con 0x7f06dc102ae0 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e463e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f06dc1129c0 con 0x7f06dc108d20 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e1bd9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06dc1083d0 0x7f06dc19b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e1bd9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06dc1083d0 0x7f06dc19b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50502/0 (socket says 172.21.15.22:50502) 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e1bd9640 1 -- 172.21.15.22:0/1754526733 learned_addr learned my addr 172.21.15.22:0/1754526733 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e23da640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc102ae0 0x7f06dc19b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e2bdb640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06dc108d20 0x7f06dc19bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e1bd9640 1 -- 172.21.15.22:0/1754526733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06dc108d20 msgr2=0x7f06dc19bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e1bd9640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06dc108d20 0x7f06dc19bbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e1bd9640 1 -- 172.21.15.22:0/1754526733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc102ae0 msgr2=0x7f06dc19b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e1bd9640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc102ae0 0x7f06dc19b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e1bd9640 1 -- 172.21.15.22:0/1754526733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06dc1a6400 con 0x7f06dc1083d0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e2bdb640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06dc108d20 0x7f06dc19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e23da640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc102ae0 0x7f06dc19b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.002+0000 7f06e1bd9640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06dc1083d0 0x7f06dc19b6b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f06d000c970 tx=0x7f06d000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.003+0000 7f06cf7fe640 1 -- 172.21.15.22:0/1754526733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0007bb0 con 0x7f06dc1083d0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.003+0000 7f06e463e640 1 -- 172.21.15.22:0/1754526733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06dc1a66f0 con 0x7f06dc1083d0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.003+0000 7f06cf7fe640 1 -- 172.21.15.22:0/1754526733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06d0007d50 con 0x7f06dc1083d0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.003+0000 7f06cf7fe640 1 -- 172.21.15.22:0/1754526733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d0004db0 con 0x7f06dc1083d0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.003+0000 7f06e463e640 1 -- 172.21.15.22:0/1754526733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06dc1a6c80 con 0x7f06dc1083d0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.004+0000 7f06e463e640 1 -- 172.21.15.22:0/1754526733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06dc103d10 con 0x7f06dc1083d0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.005+0000 7f06cf7fe640 1 -- 172.21.15.22:0/1754526733 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f06d0005000 con 0x7f06dc1083d0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.006+0000 7f06cf7fe640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06c80b6540 0x7f06c80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.006+0000 7f06e23da640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06c80b6540 0x7f06c80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.006+0000 7f06cf7fe640 1 -- 172.21.15.22:0/1754526733 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f06d00e75a0 con 0x7f06dc1083d0 2024-09-21T04:00:22.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.007+0000 7f06e23da640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06c80b6540 0x7f06c80b8a50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06d8006010 tx=0x7f06d8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:22.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.009+0000 7f06cf7fe640 1 -- 172.21.15.22:0/1754526733 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f06d0014030 con 0x7f06dc1083d0 2024-09-21T04:00:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.235+0000 7f06e463e640 1 -- 172.21.15.22:0/1754526733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f06dc102ef0 con 0x7f06dc1083d0 2024-09-21T04:00:22.238 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:22 smithi022 ceph-mon[31015]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.235+0000 7f06cf7fe640 1 -- 172.21.15.22:0/1754526733 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11824 (secure 0 0 0) 0x7f06dc102ef0 con 0x7f06dc1083d0 2024-09-21T04:00:22.238 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:22.239 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"btime":"2024-09-21T04:00:15:076988+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14775,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14787,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24566,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24571,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24596,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24610,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24616,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24617,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24634,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:00:14.769390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24647},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24647,"qdb_cluster":[24647]},"id":1}]} 2024-09-21T04:00:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 17 2024-09-21T04:00:22.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 -- 172.21.15.22:0/1754526733 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06c80b6540 msgr2=0x7f06c80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06c80b6540 0x7f06c80b8a50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f06d8006010 tx=0x7f06d8005a20 comp rx=0 tx=0).stop 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 -- 172.21.15.22:0/1754526733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06dc1083d0 msgr2=0x7f06dc19b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06dc1083d0 0x7f06dc19b6b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f06d000c970 tx=0x7f06d000ce30 comp rx=0 tx=0).stop 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 -- 172.21.15.22:0/1754526733 shutdown_connections 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06c80b6540 0x7f06c80b8a50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06dc108d20 0x7f06dc19bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06dc1083d0 0x7f06dc19b6b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 --2- 172.21.15.22:0/1754526733 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06dc102ae0 0x7f06dc19b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 -- 172.21.15.22:0/1754526733 >> 172.21.15.22:0/1754526733 conn(0x7f06dc079760 msgr2=0x7f06dc1015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 -- 172.21.15.22:0/1754526733 shutdown_connections 2024-09-21T04:00:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:22.238+0000 7f06e463e640 1 -- 172.21.15.22:0/1754526733 wait complete. 2024-09-21T04:00:22.451 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:22 smithi060 ceph-mon[33722]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:22 smithi073 ceph-mon[34443]: pgmap v307: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:22.948 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:00:23.210 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:23.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:23 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1754526733' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:23.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:23 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1754526733' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:23.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:23 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1754526733' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:23.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.709+0000 7f4a58efc640 1 -- 172.21.15.22:0/2297713748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a54108d10 msgr2=0x7f4a5410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:23.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.709+0000 7f4a58efc640 1 --2- 172.21.15.22:0/2297713748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a54108d10 0x7f4a5410f540 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4a4c009ca0 tx=0x7f4a4c02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:23.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.709+0000 7f4a58efc640 1 -- 172.21.15.22:0/2297713748 shutdown_connections 2024-09-21T04:00:23.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.709+0000 7f4a58efc640 1 --2- 172.21.15.22:0/2297713748 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a541083c0 0x7f4a541087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:23.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.709+0000 7f4a58efc640 1 --2- 172.21.15.22:0/2297713748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a54108d10 0x7f4a5410f540 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:23.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.709+0000 7f4a58efc640 1 --2- 172.21.15.22:0/2297713748 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a54102a80 0x7f4a54102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:23.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.709+0000 7f4a58efc640 1 -- 172.21.15.22:0/2297713748 >> 172.21.15.22:0/2297713748 conn(0x7f4a54079740 msgr2=0x7f4a54079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:23.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.709+0000 7f4a58efc640 1 -- 172.21.15.22:0/2297713748 shutdown_connections 2024-09-21T04:00:23.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.709+0000 7f4a58efc640 1 -- 172.21.15.22:0/2297713748 wait complete. 2024-09-21T04:00:23.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a58efc640 1 Processor -- start 2024-09-21T04:00:23.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a58efc640 1 -- start start 2024-09-21T04:00:23.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a58efc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a54102a80 0x7f4a5419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:23.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a58efc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a541083c0 0x7f4a5419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:23.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a58efc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a54108d10 0x7f4a5419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:23.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a58efc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54112880 con 0x7f4a54102a80 2024-09-21T04:00:23.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a58efc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54112700 con 0x7f4a54108d10 2024-09-21T04:00:23.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a58efc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4a54112a00 con 0x7f4a541083c0 2024-09-21T04:00:23.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a5259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a54102a80 0x7f4a5419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:23.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a5259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a54102a80 0x7f4a5419a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50516/0 (socket says 172.21.15.22:50516) 2024-09-21T04:00:23.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a5259c640 1 -- 172.21.15.22:0/2772450515 learned_addr learned my addr 172.21.15.22:0/2772450515 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:23.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a51d9b640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a541083c0 0x7f4a5419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:23.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a52d9d640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a54108d10 0x7f4a5419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:23.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a5259c640 1 -- 172.21.15.22:0/2772450515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a541083c0 msgr2=0x7f4a5419a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:23.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a5259c640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a541083c0 0x7f4a5419a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:23.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a5259c640 1 -- 172.21.15.22:0/2772450515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a54108d10 msgr2=0x7f4a5419fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:23.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a5259c640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a54108d10 0x7f4a5419fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:23.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.710+0000 7f4a5259c640 1 -- 172.21.15.22:0/2772450515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a541a02f0 con 0x7f4a54102a80 2024-09-21T04:00:23.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.711+0000 7f4a5259c640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a54102a80 0x7f4a5419a380 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400d950 tx=0x7f4a4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:23.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.711+0000 7f4a437fe640 1 -- 172.21.15.22:0/2772450515 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a44017070 con 0x7f4a54102a80 2024-09-21T04:00:23.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.711+0000 7f4a58efc640 1 -- 172.21.15.22:0/2772450515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a541a05e0 con 0x7f4a54102a80 2024-09-21T04:00:23.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.711+0000 7f4a437fe640 1 -- 172.21.15.22:0/2772450515 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a44009c30 con 0x7f4a54102a80 2024-09-21T04:00:23.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.711+0000 7f4a437fe640 1 -- 172.21.15.22:0/2772450515 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a4400f620 con 0x7f4a54102a80 2024-09-21T04:00:23.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.711+0000 7f4a58efc640 1 -- 172.21.15.22:0/2772450515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a541a6d40 con 0x7f4a54102a80 2024-09-21T04:00:23.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.712+0000 7f4a58efc640 1 -- 172.21.15.22:0/2772450515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a54103d00 con 0x7f4a54102a80 2024-09-21T04:00:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.714+0000 7f4a437fe640 1 -- 172.21.15.22:0/2772450515 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f4a44005030 con 0x7f4a54102a80 2024-09-21T04:00:23.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.715+0000 7f4a437fe640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a3c0b6510 0x7f4a3c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.715+0000 7f4a51d9b640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a3c0b6510 0x7f4a3c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.715+0000 7f4a437fe640 1 -- 172.21.15.22:0/2772450515 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f4a440e7180 con 0x7f4a54102a80 2024-09-21T04:00:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.715+0000 7f4a51d9b640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a3c0b6510 0x7f4a3c0b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4a5406b140 tx=0x7f4a4800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:23.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.718+0000 7f4a437fe640 1 -- 172.21.15.22:0/2772450515 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4a440ad770 con 0x7f4a54102a80 2024-09-21T04:00:23.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.907+0000 7f4a58efc640 1 -- 172.21.15.22:0/2772450515 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a54102e90 con 0x7f4a54102a80 2024-09-21T04:00:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.908+0000 7f4a437fe640 1 -- 172.21.15.22:0/2772450515 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+24126 (secure 0 0 0) 0x7f4a44009de0 con 0x7f4a54102a80 2024-09-21T04:00:23.911 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:23.911 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":81,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:00:14.769241+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":72,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:00:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 -- 172.21.15.22:0/2772450515 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a3c0b6510 msgr2=0x7f4a3c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a3c0b6510 0x7f4a3c0b8a20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f4a5406b140 tx=0x7f4a4800b390 comp rx=0 tx=0).stop 2024-09-21T04:00:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 -- 172.21.15.22:0/2772450515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a54102a80 msgr2=0x7f4a5419a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a54102a80 0x7f4a5419a380 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4a4400d950 tx=0x7f4a4400de10 comp rx=0 tx=0).stop 2024-09-21T04:00:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 -- 172.21.15.22:0/2772450515 shutdown_connections 2024-09-21T04:00:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a3c0b6510 0x7f4a3c0b8a20 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:23.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4a541083c0 0x7f4a5419a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4a54108d10 0x7f4a5419fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 --2- 172.21.15.22:0/2772450515 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4a54102a80 0x7f4a5419a380 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 -- 172.21.15.22:0/2772450515 >> 172.21.15.22:0/2772450515 conn(0x7f4a54079740 msgr2=0x7f4a5406bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.910+0000 7f4a58efc640 1 -- 172.21.15.22:0/2772450515 shutdown_connections 2024-09-21T04:00:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:23.911+0000 7f4a58efc640 1 -- 172.21.15.22:0/2772450515 wait complete. 2024-09-21T04:00:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:24 smithi022 ceph-mon[31015]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:24.283 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:24 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2772450515' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:24.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:24 smithi060 ceph-mon[33722]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:24.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:24 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2772450515' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:24.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:24 smithi073 ceph-mon[34443]: pgmap v308: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:24.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:24 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2772450515' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:24.651 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-21T04:00:04.669771+0000', 'modified': '2024-09-21T04:00:14.769390+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24647}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24647': {'gid': 24647, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.60:6839/3182487250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 3182487250}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 3182487250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24647, 'qdb_cluster': [24647]} 2024-09-21T04:00:24.652 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-21T04:00:24.652 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T04:00:24.915 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:25.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 -- 172.21.15.22:0/3530000366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a01094a0 msgr2=0x7f07a01098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:25.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 --2- 172.21.15.22:0/3530000366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a01094a0 0x7f07a01098b0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0788009900 tx=0x7f078802a410 comp rx=0 tx=0).stop 2024-09-21T04:00:25.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 -- 172.21.15.22:0/3530000366 shutdown_connections 2024-09-21T04:00:25.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 --2- 172.21.15.22:0/3530000366 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a0109df0 0x7f07a0110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 --2- 172.21.15.22:0/3530000366 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a01094a0 0x7f07a01098b0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 --2- 172.21.15.22:0/3530000366 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0103b60 0x7f07a0103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 -- 172.21.15.22:0/3530000366 >> 172.21.15.22:0/3530000366 conn(0x7f07a007b850 msgr2=0x7f07a007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:25.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 -- 172.21.15.22:0/3530000366 shutdown_connections 2024-09-21T04:00:25.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 -- 172.21.15.22:0/3530000366 wait complete. 2024-09-21T04:00:25.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 Processor -- start 2024-09-21T04:00:25.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 -- start start 2024-09-21T04:00:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0103b60 0x7f07a019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a01094a0 0x7f07a019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a0109df0 0x7f07a019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07a0113960 con 0x7f07a01094a0 2024-09-21T04:00:25.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07a01137e0 con 0x7f07a0103b60 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f07a5aa3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07a0113ae0 con 0x7f07a0109df0 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f0796ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a01094a0 0x7f07a019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f0796ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a01094a0 0x7f07a019a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50528/0 (socket says 172.21.15.22:50528) 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f0796ffd640 1 -- 172.21.15.22:0/4137550942 learned_addr learned my addr 172.21.15.22:0/4137550942 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f079f7fe640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0103b60 0x7f07a019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.437+0000 7f079ffff640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a0109df0 0x7f07a019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f0796ffd640 1 -- 172.21.15.22:0/4137550942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a0109df0 msgr2=0x7f07a019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f0796ffd640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a0109df0 0x7f07a019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f0796ffd640 1 -- 172.21.15.22:0/4137550942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0103b60 msgr2=0x7f07a019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f0796ffd640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0103b60 0x7f07a019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f0796ffd640 1 -- 172.21.15.22:0/4137550942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a01a03c0 con 0x7f07a01094a0 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f079ffff640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a0109df0 0x7f07a019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:25.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f0796ffd640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a01094a0 0x7f07a019a9f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0788005940 tx=0x7f07880040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:25.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f079d7fa640 1 -- 172.21.15.22:0/4137550942 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f078803f030 con 0x7f07a01094a0 2024-09-21T04:00:25.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f079d7fa640 1 -- 172.21.15.22:0/4137550942 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0788003a80 con 0x7f07a01094a0 2024-09-21T04:00:25.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f07a5aa3640 1 -- 172.21.15.22:0/4137550942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a01a0650 con 0x7f07a01094a0 2024-09-21T04:00:25.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f079d7fa640 1 -- 172.21.15.22:0/4137550942 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0788035070 con 0x7f07a01094a0 2024-09-21T04:00:25.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.439+0000 7f07a5aa3640 1 -- 172.21.15.22:0/4137550942 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a01a6e10 con 0x7f07a01094a0 2024-09-21T04:00:25.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f07ac017740 1 Processor -- start 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f07ac017740 1 -- start start 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f079d7fa640 1 -- 172.21.15.22:0/4137550942 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f0788042030 con 0x7f07a01094a0 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f07ac017740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fe6f60 0x55f2a138cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f07ac017740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fbe0a0 0x55f2a138d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f07ac017740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fc6280 0x55f2a138d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f07ac017740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f2a1304c10 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f07ac017740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f2a12f4040 con 0x55f2a0fc6280 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f07ac017740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f2a12f7e50 con 0x55f2a0fe6f60 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f079f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fbe0a0 0x55f2a138d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f079f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fbe0a0 0x55f2a138d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50540/0 (socket says 172.21.15.22:50540) 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f079f7fe640 1 -- 172.21.15.22:0/994915145 learned_addr learned my addr 172.21.15.22:0/994915145 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:25.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.441+0000 7f079ffff640 1 --2- 172.21.15.22:0/994915145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fe6f60 0x55f2a138cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f0796ffd640 1 --2- 172.21.15.22:0/994915145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fc6280 0x55f2a138d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f079f7fe640 1 -- 172.21.15.22:0/994915145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fe6f60 msgr2=0x55f2a138cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f079f7fe640 1 --2- 172.21.15.22:0/994915145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fe6f60 0x55f2a138cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f079f7fe640 1 -- 172.21.15.22:0/994915145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fc6280 msgr2=0x55f2a138d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f079f7fe640 1 --2- 172.21.15.22:0/994915145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fc6280 0x55f2a138d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f079f7fe640 1 -- 172.21.15.22:0/994915145 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a1052540 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f0796ffd640 1 --2- 172.21.15.22:0/994915145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fc6280 0x55f2a138d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f079f7fe640 1 --2- 172.21.15.22:0/994915145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fbe0a0 0x55f2a138d440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f079000bd10 tx=0x7f07900107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d3bbc27e4b83fc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f0795ffb640 1 -- 172.21.15.22:0/994915145 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0790004030 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f0795ffb640 1 -- 172.21.15.22:0/994915145 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07900035f0 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f0795ffb640 1 -- 172.21.15.22:0/994915145 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0790011660 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f079d7fa640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f078c0b6590 0x7f078c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f079ffff640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f078c0b6590 0x7f078c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.442+0000 7f079d7fa640 1 -- 172.21.15.22:0/4137550942 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f0788107a10 con 0x7f07a01094a0 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.443+0000 7f07ac017740 1 -- 172.21.15.22:0/994915145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fbe0a0 msgr2=0x55f2a138d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.443+0000 7f079ffff640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f078c0b6590 0x7f078c0b8aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0798005fd0 tx=0x7f07980098a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.443+0000 7f07ac017740 1 --2- 172.21.15.22:0/994915145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fbe0a0 0x55f2a138d440 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f079000bd10 tx=0x7f07900107a0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.443+0000 7f07ac017740 1 -- 172.21.15.22:0/994915145 shutdown_connections 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.443+0000 7f07ac017740 1 --2- 172.21.15.22:0/994915145 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fc6280 0x55f2a138d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.443+0000 7f07ac017740 1 --2- 172.21.15.22:0/994915145 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fbe0a0 0x55f2a138d440 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.443+0000 7f07ac017740 1 --2- 172.21.15.22:0/994915145 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fe6f60 0x55f2a138cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.443+0000 7f07ac017740 1 -- 172.21.15.22:0/994915145 >> 172.21.15.22:0/994915145 conn(0x55f2a0fdb350 msgr2=0x55f2a138adf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.443+0000 7f07ac017740 1 -- 172.21.15.22:0/994915145 shutdown_connections 2024-09-21T04:00:25.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.443+0000 7f07ac017740 1 -- 172.21.15.22:0/994915145 wait complete. 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f07ac017740 1 -- start start 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f07ac017740 1 Processor -- start 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f07ac017740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13987c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f07ac017740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fc6280 0x55f2a1398da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f07ac017740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fe6f60 0x55f2a13a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f07ac017740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f2a11555f0 con 0x55f2a0fc6280 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f07ac017740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f2a128f010 con 0x55f2a0fe6f60 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f07ac017740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f2a139b6e0 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f07ac017740 10 client.0 _ll_register_callbacks cb 0x55f2a12ee340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f0796ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fc6280 0x55f2a1398da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f079f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f0796ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fc6280 0x55f2a1398da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50552/0 (socket says 172.21.15.22:50552) 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.445+0000 7f0796ffd640 1 -- 172.21.15.22:0/3870702790 learned_addr learned my addr 172.21.15.22:0/3870702790 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f079ffff640 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fe6f60 0x55f2a13a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f079f7fe640 1 -- 172.21.15.22:0/3870702790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fe6f60 msgr2=0x55f2a13a4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f079f7fe640 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fe6f60 0x55f2a13a4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f079f7fe640 1 -- 172.21.15.22:0/3870702790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fc6280 msgr2=0x55f2a1398da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f079f7fe640 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fc6280 0x55f2a1398da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f079f7fe640 1 -- 172.21.15.22:0/3870702790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a12bca00 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f079f7fe640 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13987c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0790000c00 tx=0x7f079000ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=540fe0cbeca0bbcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f077effd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f077effd640 1 -- 172.21.15.22:0/3870702790 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0790004000 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f07ac017740 1 -- 172.21.15.22:0/3870702790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07900035f0 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.446+0000 7f077effd640 1 -- 172.21.15.22:0/3870702790 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f07900041a0 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f077effd640 1 -- 172.21.15.22:0/3870702790 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f07900043a0 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f07ac017740 10 client.24712 fetch_fsmap learned FSMap version 17 2024-09-21T04:00:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f07ac017740 1 -- 172.21.15.22:0/3870702790 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55f2a13a7540 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f077effd640 1 -- 172.21.15.22:0/3870702790 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07900035f0 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f077effd640 1 -- 172.21.15.22:0/3870702790 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f0790023070 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f07ac017740 10 client.24712 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T04:00:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f07ac017740 10 client.24712 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T04:00:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f07ac017740 20 client.24712 populate_metadata read hostname 'smithi022' 2024-09-21T04:00:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f07ac017740 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f2a0fa58e0 0x55f2a13aad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f07ac017740 4 client.24712 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:00:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.447+0000 7f07ac017740 1 -- 172.21.15.22:0/3870702790 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f2a1306b60 con 0x55f2a0fa58e0 2024-09-21T04:00:25.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.448+0000 7f0796ffd640 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f2a0fa58e0 0x55f2a13aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.448+0000 7f077effd640 10 client.24712 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.448+0000 7f0796ffd640 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f2a0fa58e0 0x55f2a13aad40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ce1527e8658ce696 server_cookie=653a6ce8289fe324 in_seq=0 out_seq=0 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f077effd640 1 -- 172.21.15.22:0/3870702790 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f2a1306b60 con 0x55f2a0fa58e0 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f077effd640 10 client.24712 handle_command_reply: tid=0 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 client.24712 shutdown 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 -- 172.21.15.22:0/3870702790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fbe0a0 msgr2=0x55f2a13987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13987c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0790000c00 tx=0x7f079000ba20 comp rx=0 tx=0).stop 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 -- 172.21.15.22:0/3870702790 shutdown_connections 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f2a0fa58e0 0x55f2a13aad40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fe6f60 0x55f2a13a4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fc6280 0x55f2a1398da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f077effd640 0 client.24712 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:00:25.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 --2- 172.21.15.22:0/3870702790 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13987c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 -- 172.21.15.22:0/3870702790 >> 172.21.15.22:0/3870702790 conn(0x55f2a0fdb350 msgr2=0x55f2a1390090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:25.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 -- 172.21.15.22:0/3870702790 shutdown_connections 2024-09-21T04:00:25.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 1 -- 172.21.15.22:0/3870702790 wait complete. 2024-09-21T04:00:25.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.449+0000 7f07ac017740 20 client.24712 trim_cache size 0 max 16384 2024-09-21T04:00:25.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f07ac017740 1 Processor -- start 2024-09-21T04:00:25.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f07ac017740 1 -- start start 2024-09-21T04:00:25.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f07ac017740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13aad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f07ac017740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fc6280 0x55f2a13a4970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f07ac017740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f07ac017740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f2a13a9080 con 0x55f2a0fe6f60 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f07ac017740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f2a13a9750 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f07ac017740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f2a13a9e20 con 0x55f2a0fc6280 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f079ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f079ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13a4eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50566/0 (socket says 172.21.15.22:50566) 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f079ffff640 1 -- 172.21.15.22:0/3681477306 learned_addr learned my addr 172.21.15.22:0/3681477306 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f079f7fe640 1 --2- 172.21.15.22:0/3681477306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13aad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f0796ffd640 1 --2- 172.21.15.22:0/3681477306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fc6280 0x55f2a13a4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f079ffff640 1 -- 172.21.15.22:0/3681477306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fc6280 msgr2=0x55f2a13a4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f079ffff640 1 --2- 172.21.15.22:0/3681477306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fc6280 0x55f2a13a4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f079ffff640 1 -- 172.21.15.22:0/3681477306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fbe0a0 msgr2=0x55f2a13aad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f079ffff640 1 --2- 172.21.15.22:0/3681477306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13aad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.468+0000 7f079ffff640 1 -- 172.21.15.22:0/3681477306 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f2a138f1f0 con 0x55f2a0fe6f60 2024-09-21T04:00:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.469+0000 7f079ffff640 1 --2- 172.21.15.22:0/3681477306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13a4eb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0798010850 tx=0x7f0798015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef215dca32a741d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.469+0000 7f07957fa640 1 -- 172.21.15.22:0/3681477306 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079801c430 con 0x55f2a0fe6f60 2024-09-21T04:00:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.469+0000 7f07957fa640 1 -- 172.21.15.22:0/3681477306 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f079801ca60 con 0x55f2a0fe6f60 2024-09-21T04:00:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.469+0000 7f07957fa640 1 -- 172.21.15.22:0/3681477306 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079801f9d0 con 0x55f2a0fe6f60 2024-09-21T04:00:25.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 -- 172.21.15.22:0/3681477306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 msgr2=0x55f2a13a4eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:25.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 --2- 172.21.15.22:0/3681477306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13a4eb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f0798010850 tx=0x7f0798015000 comp rx=0 tx=0).stop 2024-09-21T04:00:25.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 -- 172.21.15.22:0/3681477306 shutdown_connections 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 --2- 172.21.15.22:0/3681477306 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fc6280 0x55f2a13a4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 --2- 172.21.15.22:0/3681477306 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13a4eb0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 --2- 172.21.15.22:0/3681477306 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13aad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 -- 172.21.15.22:0/3681477306 >> 172.21.15.22:0/3681477306 conn(0x55f2a0fdb350 msgr2=0x55f2a138a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 -- 172.21.15.22:0/3681477306 shutdown_connections 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 -- 172.21.15.22:0/3681477306 wait complete. 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 -- start start 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.470+0000 7f07ac017740 1 Processor -- start 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f07ac017740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13acf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f07ac017740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fc6280 0x55f2a13ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f07ac017740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13ada00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f07ac017740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f2a13aabc0 con 0x55f2a0fe6f60 2024-09-21T04:00:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f07ac017740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f2a13aa4f0 con 0x55f2a0fbe0a0 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f07ac017740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f2a13ab290 con 0x55f2a0fc6280 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f07ac017740 10 client.0 _ll_register_callbacks cb 0x7f0798009740 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f079ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13ada00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f079ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13ada00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50574/0 (socket says 172.21.15.22:50574) 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f079ffff640 1 -- 172.21.15.22:0/3574692009 learned_addr learned my addr 172.21.15.22:0/3574692009 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f079f7fe640 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13acf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f0796ffd640 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fc6280 0x55f2a13ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f079ffff640 1 -- 172.21.15.22:0/3574692009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fc6280 msgr2=0x55f2a13ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f079ffff640 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fc6280 0x55f2a13ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f079ffff640 1 -- 172.21.15.22:0/3574692009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fbe0a0 msgr2=0x55f2a13acf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f079ffff640 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13acf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f079ffff640 1 -- 172.21.15.22:0/3574692009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f2a13b2710 con 0x55f2a0fe6f60 2024-09-21T04:00:25.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f079ffff640 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13ada00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f079801ce40 tx=0x7f079801ce70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952d17e7b24705a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.471+0000 7f077effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f077effd640 1 -- 172.21.15.22:0/3574692009 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0798004c50 con 0x55f2a0fe6f60 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f07ac017740 1 -- 172.21.15.22:0/3574692009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f079801ca60 con 0x55f2a0fe6f60 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f077effd640 1 -- 172.21.15.22:0/3574692009 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f079802e070 con 0x55f2a0fe6f60 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f077effd640 1 -- 172.21.15.22:0/3574692009 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f079803e050 con 0x55f2a0fe6f60 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f07ac017740 10 client.14901 fetch_fsmap learned FSMap version 17 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f07ac017740 1 -- 172.21.15.22:0/3574692009 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x55f2a1416440 con 0x55f2a0fe6f60 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f077effd640 1 -- 172.21.15.22:0/3574692009 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f079801ca60 con 0x55f2a0fe6f60 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f077effd640 1 -- 172.21.15.22:0/3574692009 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f0798039030 con 0x55f2a0fe6f60 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f07ac017740 10 client.14901 fetch_fsmap finished waiting for FSMap version 17 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f07ac017740 10 client.14901 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f07ac017740 20 client.14901 populate_metadata read hostname 'smithi022' 2024-09-21T04:00:25.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f07ac017740 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f2a0f7ac90 0x55f2a14199d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f07ac017740 4 client.14901 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.472+0000 7f07ac017740 1 -- 172.21.15.22:0/3574692009 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "status"}) -- 0x55f2a1302610 con 0x55f2a0f7ac90 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.473+0000 7f079f7fe640 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f2a0f7ac90 0x55f2a14199d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.473+0000 7f079f7fe640 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f2a0f7ac90 0x55f2a14199d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f961e0d92c7531b server_cookie=27d274afb48c3560 in_seq=0 out_seq=0 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.473+0000 7f077effd640 10 client.14901 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.473+0000 7f077effd640 1 -- 172.21.15.22:0/3574692009 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x55f2a1302610 con 0x55f2a0f7ac90 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.473+0000 7f077effd640 10 client.14901 handle_command_reply: tid=0 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.473+0000 7f07ac017740 1 client.14901 shutdown 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.473+0000 7f07ac017740 1 -- 172.21.15.22:0/3574692009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 msgr2=0x55f2a13ada00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.473+0000 7f07ac017740 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13ada00 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f079801ce40 tx=0x7f079801ce70 comp rx=0 tx=0).stop 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07ac017740 1 -- 172.21.15.22:0/3574692009 shutdown_connections 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07ac017740 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f2a0f7ac90 0x55f2a14199d0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07ac017740 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f2a0fc6280 0x55f2a13ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07ac017740 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f2a0fe6f60 0x55f2a13ada00 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07ac017740 1 --2- 172.21.15.22:0/3574692009 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f2a0fbe0a0 0x55f2a13acf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f077effd640 0 client.14901 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:00:25.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07ac017740 1 -- 172.21.15.22:0/3574692009 >> 172.21.15.22:0/3574692009 conn(0x55f2a0fdb350 msgr2=0x55f2a138a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:25.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07ac017740 1 -- 172.21.15.22:0/3574692009 shutdown_connections 2024-09-21T04:00:25.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07ac017740 1 -- 172.21.15.22:0/3574692009 wait complete. 2024-09-21T04:00:25.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07ac017740 20 client.14901 trim_cache size 0 max 16384 2024-09-21T04:00:25.480 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:00:25.480 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:00:25.480 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-21T04:00:25.481 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24647, 2024-09-21T04:00:25.481 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:00:25.481 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:00:25.481 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:00:25.481 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 20.472013857, 2024-09-21T04:00:25.481 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 17, 2024-09-21T04:00:25.481 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 81, 2024-09-21T04:00:25.481 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 81, 2024-09-21T04:00:25.481 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 32.213398644000002 2024-09-21T04:00:25.481 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:00:25.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07a5aa3640 1 -- 172.21.15.22:0/4137550942 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f078c0b6590 msgr2=0x7f078c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:25.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07a5aa3640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f078c0b6590 0x7f078c0b8aa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0798005fd0 tx=0x7f07980098a0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07a5aa3640 1 -- 172.21.15.22:0/4137550942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a01094a0 msgr2=0x7f07a019a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:25.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.474+0000 7f07a5aa3640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a01094a0 0x7f07a019a9f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f0788005940 tx=0x7f07880040e0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.475+0000 7f07a5aa3640 1 -- 172.21.15.22:0/4137550942 shutdown_connections 2024-09-21T04:00:25.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.475+0000 7f07a5aa3640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f078c0b6590 0x7f078c0b8aa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.475+0000 7f07a5aa3640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a0109df0 0x7f07a019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.475+0000 7f07a5aa3640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a01094a0 0x7f07a019a9f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.475+0000 7f07a5aa3640 1 --2- 172.21.15.22:0/4137550942 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a0103b60 0x7f07a019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:25.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.475+0000 7f07a5aa3640 1 -- 172.21.15.22:0/4137550942 >> 172.21.15.22:0/4137550942 conn(0x7f07a007b850 msgr2=0x7f07a0105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:25.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.475+0000 7f07a5aa3640 1 -- 172.21.15.22:0/4137550942 shutdown_connections 2024-09-21T04:00:25.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:25.475+0000 7f07a5aa3640 1 -- 172.21.15.22:0/4137550942 wait complete. 2024-09-21T04:00:26.298 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T04:00:26.298 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T04:00:26.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T04:00:26.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:26 smithi022 ceph-mon[31015]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:26.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:26 smithi060 ceph-mon[33722]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:26.556 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:26.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:26 smithi073 ceph-mon[34443]: pgmap v309: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:27.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.045+0000 7f5923f70640 1 -- 172.21.15.22:0/4222327768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c101da0 msgr2=0x7f591c1021b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.045+0000 7f5923f70640 1 --2- 172.21.15.22:0/4222327768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c101da0 0x7f591c1021b0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f59180074e0 tx=0x7f591802b070 comp rx=0 tx=0).stop 2024-09-21T04:00:27.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.046+0000 7f5923f70640 1 -- 172.21.15.22:0/4222327768 shutdown_connections 2024-09-21T04:00:27.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.046+0000 7f5923f70640 1 --2- 172.21.15.22:0/4222327768 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f591c1076e0 0x7f591c107af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.046+0000 7f5923f70640 1 --2- 172.21.15.22:0/4222327768 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f591c108030 0x7f591c10e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.046+0000 7f5923f70640 1 --2- 172.21.15.22:0/4222327768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c101da0 0x7f591c1021b0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.046+0000 7f5923f70640 1 -- 172.21.15.22:0/4222327768 >> 172.21.15.22:0/4222327768 conn(0x7f591c077800 msgr2=0x7f591c077c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:27.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.046+0000 7f5923f70640 1 -- 172.21.15.22:0/4222327768 shutdown_connections 2024-09-21T04:00:27.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.046+0000 7f5923f70640 1 -- 172.21.15.22:0/4222327768 wait complete. 2024-09-21T04:00:27.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.046+0000 7f5923f70640 1 Processor -- start 2024-09-21T04:00:27.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.046+0000 7f5923f70640 1 -- start start 2024-09-21T04:00:27.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f5923f70640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f591c101da0 0x7f591c0fe9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f5923f70640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f591c1076e0 0x7f591c0fef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f5923f70640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c108030 0x7f591c0ff450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f5923f70640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f591c1117a0 con 0x7f591c108030 2024-09-21T04:00:27.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f5923f70640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f591c111620 con 0x7f591c1076e0 2024-09-21T04:00:27.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f5923f70640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f591c111920 con 0x7f591c101da0 2024-09-21T04:00:27.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f592250d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c108030 0x7f591c0ff450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f592250d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c108030 0x7f591c0ff450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50590/0 (socket says 172.21.15.22:50590) 2024-09-21T04:00:27.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f592250d640 1 -- 172.21.15.22:0/1138712273 learned_addr learned my addr 172.21.15.22:0/1138712273 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:27.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f592150b640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f591c1076e0 0x7f591c0fef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f5921d0c640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f591c101da0 0x7f591c0fe9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f592250d640 1 -- 172.21.15.22:0/1138712273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f591c101da0 msgr2=0x7f591c0fe9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f592250d640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f591c101da0 0x7f591c0fe9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f592250d640 1 -- 172.21.15.22:0/1138712273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f591c1076e0 msgr2=0x7f591c0fef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f592250d640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f591c1076e0 0x7f591c0fef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f592250d640 1 -- 172.21.15.22:0/1138712273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f591c1a8600 con 0x7f591c108030 2024-09-21T04:00:27.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.047+0000 7f592250d640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c108030 0x7f591c0ff450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f591400eaa0 tx=0x7f591400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:27.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.048+0000 7f5912ffd640 1 -- 172.21.15.22:0/1138712273 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5914004d20 con 0x7f591c108030 2024-09-21T04:00:27.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.048+0000 7f5912ffd640 1 -- 172.21.15.22:0/1138712273 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5914005020 con 0x7f591c108030 2024-09-21T04:00:27.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.048+0000 7f5923f70640 1 -- 172.21.15.22:0/1138712273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f591c1a88f0 con 0x7f591c108030 2024-09-21T04:00:27.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.048+0000 7f5912ffd640 1 -- 172.21.15.22:0/1138712273 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59140116d0 con 0x7f591c108030 2024-09-21T04:00:27.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.048+0000 7f5923f70640 1 -- 172.21.15.22:0/1138712273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f591c1a8de0 con 0x7f591c108030 2024-09-21T04:00:27.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.049+0000 7f5923f70640 1 -- 172.21.15.22:0/1138712273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f591c1021b0 con 0x7f591c108030 2024-09-21T04:00:27.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.050+0000 7f5912ffd640 1 -- 172.21.15.22:0/1138712273 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f59140051d0 con 0x7f591c108030 2024-09-21T04:00:27.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.051+0000 7f5912ffd640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59080b6510 0x7f59080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:27.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.051+0000 7f5921d0c640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59080b6510 0x7f59080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:27.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.051+0000 7f5912ffd640 1 -- 172.21.15.22:0/1138712273 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8802+0+0 (secure 0 0 0) 0x7f59140e7ab0 con 0x7f591c108030 2024-09-21T04:00:27.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.052+0000 7f5921d0c640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59080b6510 0x7f59080b8a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f591c100420 tx=0x7f591802d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:27.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.055+0000 7f5912ffd640 1 -- 172.21.15.22:0/1138712273 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5914016030 con 0x7f591c108030 2024-09-21T04:00:27.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.289+0000 7f5923f70640 1 -- 172.21.15.22:0/1138712273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f591c02e640 con 0x7f591c108030 2024-09-21T04:00:27.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.289+0000 7f5912ffd640 1 -- 172.21.15.22:0/1138712273 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f59140ae0a0 con 0x7f591c108030 2024-09-21T04:00:27.291 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T04:00:27.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.291+0000 7f5923f70640 1 -- 172.21.15.22:0/1138712273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59080b6510 msgr2=0x7f59080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.291+0000 7f5923f70640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59080b6510 0x7f59080b8a20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f591c100420 tx=0x7f591802d040 comp rx=0 tx=0).stop 2024-09-21T04:00:27.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.291+0000 7f5923f70640 1 -- 172.21.15.22:0/1138712273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c108030 msgr2=0x7f591c0ff450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:27.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.291+0000 7f5923f70640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c108030 0x7f591c0ff450 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f591400eaa0 tx=0x7f591400eea0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.292+0000 7f5923f70640 1 -- 172.21.15.22:0/1138712273 shutdown_connections 2024-09-21T04:00:27.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.292+0000 7f5923f70640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59080b6510 0x7f59080b8a20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.292+0000 7f5923f70640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f591c108030 0x7f591c0ff450 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.292+0000 7f5923f70640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f591c1076e0 0x7f591c0fef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.292+0000 7f5923f70640 1 --2- 172.21.15.22:0/1138712273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f591c101da0 0x7f591c0fe9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:27.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.292+0000 7f5923f70640 1 -- 172.21.15.22:0/1138712273 >> 172.21.15.22:0/1138712273 conn(0x7f591c077800 msgr2=0x7f591c1059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:27.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.292+0000 7f5923f70640 1 -- 172.21.15.22:0/1138712273 shutdown_connections 2024-09-21T04:00:27.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:27.292+0000 7f5923f70640 1 -- 172.21.15.22:0/1138712273 wait complete. 2024-09-21T04:00:28.152 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-09-21T04:00:28.152 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T04:00:28.152 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-09-21T04:00:28.152 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-09-21T04:00:28.153 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-09-21T04:00:28.153 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-09-21T04:00:28.153 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T04:00:28.153 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T04:00:28.153 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T04:00:28.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:28.153 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-09-21T04:00:28.171 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T04:00:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T04:00:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T04:00:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-21T04:00:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-09-21T04:00:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-21T04:00:28.171 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T04:00:28.171 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42232sec preferred_lft 42232sec 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-09-21T04:00:28.172 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-09-21T04:00:28.173 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T04:00:28.173 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T04:00:28.173 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-21T04:00:28.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2024-09-21T04:00:28.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2024-09-21T04:00:28.173 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2024-09-21T04:00:28.174 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T04:00:28.174 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-21T04:00:28.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T04:00:28.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:28 smithi022 ceph-mon[31015]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:28.377 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:28 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1138712273' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T04:00:28.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:00:28.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:28.387 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T04:00:28.414 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-09-21T04:00:28.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:28.415 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-09-21T04:00:28.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:28 smithi060 ceph-mon[33722]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:28.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:28 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1138712273' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T04:00:28.495 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-09-21T04:00:28.496 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T04:00:28.496 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T04:00:28.496 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T04:00:28.496 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T04:00:28.496 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T04:00:28.496 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-21T04:00:28.496 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T04:00:28.496 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T04:00:28.497 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T04:00:28.497 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-21T04:00:28.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T04:00:28.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:28 smithi073 ceph-mon[34443]: pgmap v310: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:28.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:28 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1138712273' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T04:00:28.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:00:28.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:28.842 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-21T04:00:28.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:28.858 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2024-09-21T04:00:28.914 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T04:00:28.915 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-21T04:00:28.915 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T04:00:28.915 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-09-21T04:00:28.915 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-21T04:00:29.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T04:00:29.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:00:29.039 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-09-21T04:00:29.039 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T04:00:29.040 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-21T04:00:29.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-09-21T04:00:29.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T04:00:29.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-09-21T04:00:29.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-09-21T04:00:29.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-09-21T04:00:29.040 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-21T04:00:29.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T04:00:29.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:00:29.179 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T04:00:29.179 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-21T04:00:29.180 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-09-21T04:00:29.180 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T04:00:29.180 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-21T04:00:29.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:29 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T04:00:29.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:00:29.260 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-09-21T04:00:29.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T04:00:29.261 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-09-21T04:00:29.280 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-09-21T04:00:29.280 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T04:00:29.280 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-09-21T04:00:29.343 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-09-21T04:00:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-09-21T04:00:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-21T04:00:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-21T04:00:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]} : dispatch 2024-09-21T04:00:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T04:00:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2024-09-21T04:00:29.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-21T04:00:29.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]} : dispatch 2024-09-21T04:00:29.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-21T04:00:29.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:29 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T04:00:29.379 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T04:00:29.442 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-09-21T04:00:29.442 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-09-21T04:00:29.442 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-09-21T04:00:29.442 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-09-21T04:00:29.442 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-09-21T04:00:29.442 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-09-21T04:00:29.442 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-09-21T04:00:29.442 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-09-21T04:00:29.442 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T04:00:29.443 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/5f74897d9924b42859eb9057dc548fea6f42075012c0e10a17957f0836884f90/merged 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/945874f9596555e49ac527fdae9f00a1be4ba21bff7f4a1ae28b5a31113127a9/merged 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/0 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/8342034dba8271e9f00d39e79da86c17e0868294308f302935ab9a94a1faa79d/merged 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/cf89ac8d65367164789d66391644e441e4909e01e52f096b25c64952fc0a4b9e/merged 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/80f341a618e91f6431e23070fa999e75bd6a7f5bc8a8c8e0d1f22972c8913d58/merged 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/ff14717a4cf86ac0d202e82deb7b4e43ae7b5deb2f66b09989dbd992e89c1e59/merged 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/ca461000355198278aa2d497498f3d801f88a90343b1b5bb7d243de9ee7e85ef/merged 2024-09-21T04:00:29.444 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/44a6921cb3a25c706fa56a6b6dd741b157357b2c0f6f81fa314aba2835e3b028/merged 2024-09-21T04:00:29.445 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/b29d4065f379a5f01177d815f41f3d4cee4afc65631b47ea55fcfba2a70785d1/merged 2024-09-21T04:00:29.445 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/757f836a2b86b901ced2b1ad08377a22ac77397633ac3b8d71b74e6ba0885cf2/merged 2024-09-21T04:00:29.445 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-09-21T04:00:29.445 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T04:00:29.445 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T04:00:29.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:29.445 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-09-21T04:00:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-09-21T04:00:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-21T04:00:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-21T04:00:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]} : dispatch 2024-09-21T04:00:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T04:00:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2024-09-21T04:00:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-21T04:00:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]} : dispatch 2024-09-21T04:00:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-21T04:00:29.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:29 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T04:00:29.504 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T04:00:29.504 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-09-21T04:00:29.550 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-09-21T04:00:29.578 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T04:00:29.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]} : dispatch 2024-09-21T04:00:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]} : dispatch 2024-09-21T04:00:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]} : dispatch 2024-09-21T04:00:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]} : dispatch 2024-09-21T04:00:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]} : dispatch 2024-09-21T04:00:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]} : dispatch 2024-09-21T04:00:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]} : dispatch 2024-09-21T04:00:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]} : dispatch 2024-09-21T04:00:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]} : dispatch 2024-09-21T04:00:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:29 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]} : dispatch 2024-09-21T04:00:29.637 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-09-21T04:00:29.638 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-09-21T04:00:29.639 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/5f74897d9924b42859eb9057dc548fea6f42075012c0e10a17957f0836884f90/merged 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/945874f9596555e49ac527fdae9f00a1be4ba21bff7f4a1ae28b5a31113127a9/merged 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/0 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/8342034dba8271e9f00d39e79da86c17e0868294308f302935ab9a94a1faa79d/merged 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/cf89ac8d65367164789d66391644e441e4909e01e52f096b25c64952fc0a4b9e/merged 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/80f341a618e91f6431e23070fa999e75bd6a7f5bc8a8c8e0d1f22972c8913d58/merged 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/ff14717a4cf86ac0d202e82deb7b4e43ae7b5deb2f66b09989dbd992e89c1e59/merged 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/ca461000355198278aa2d497498f3d801f88a90343b1b5bb7d243de9ee7e85ef/merged 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/44a6921cb3a25c706fa56a6b6dd741b157357b2c0f6f81fa314aba2835e3b028/merged 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/b29d4065f379a5f01177d815f41f3d4cee4afc65631b47ea55fcfba2a70785d1/merged 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/757f836a2b86b901ced2b1ad08377a22ac77397633ac3b8d71b74e6ba0885cf2/merged 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-09-21T04:00:29.640 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T04:00:29.641 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T04:00:29.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:29.641 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-09-21T04:00:29.673 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:2024-09-21T04:00:29.671+0000 7f612531f480 -1 init, newargv = 0x7f61140046a0 newargc=15 2024-09-21T04:00:29.673 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:ceph-fuse[75248]: starting ceph client 2024-09-21T04:00:29.680 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:ceph-fuse[75248]: starting fuse 2024-09-21T04:00:29.691 INFO:teuthology.orchestra.run.smithi022.stdout:120 2024-09-21T04:00:29.691 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T04:00:29.692 DEBUG:teuthology.orchestra.run.smithi022:> sudo stdin-killer -- python3 -c ' 2024-09-21T04:00:29.692 DEBUG:teuthology.orchestra.run.smithi022:> import glob 2024-09-21T04:00:29.692 DEBUG:teuthology.orchestra.run.smithi022:> import re 2024-09-21T04:00:29.693 DEBUG:teuthology.orchestra.run.smithi022:> import os 2024-09-21T04:00:29.693 DEBUG:teuthology.orchestra.run.smithi022:> import subprocess 2024-09-21T04:00:29.693 DEBUG:teuthology.orchestra.run.smithi022:> 2024-09-21T04:00:29.693 DEBUG:teuthology.orchestra.run.smithi022:> def _find_admin_socket(client_name): 2024-09-21T04:00:29.693 DEBUG:teuthology.orchestra.run.smithi022:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-09-21T04:00:29.693 DEBUG:teuthology.orchestra.run.smithi022:> files = glob.glob(asok_path) 2024-09-21T04:00:29.693 DEBUG:teuthology.orchestra.run.smithi022:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-09-21T04:00:29.694 DEBUG:teuthology.orchestra.run.smithi022:> 2024-09-21T04:00:29.694 DEBUG:teuthology.orchestra.run.smithi022:> # Given a non-glob path, it better be there 2024-09-21T04:00:29.694 DEBUG:teuthology.orchestra.run.smithi022:> if "*" not in asok_path: 2024-09-21T04:00:29.694 DEBUG:teuthology.orchestra.run.smithi022:> assert(len(files) == 1) 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> return files[0] 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> for f in files: 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> contents = proc_f.read() 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> if mountpoint in contents: 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> return f 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> 2024-09-21T04:00:29.695 DEBUG:teuthology.orchestra.run.smithi022:> print(_find_admin_socket("client.admin")) 2024-09-21T04:00:29.696 DEBUG:teuthology.orchestra.run.smithi022:> ' 2024-09-21T04:00:29.811 INFO:teuthology.orchestra.run.smithi022.stdout:/var/run/ceph/ceph-client.admin.75248.asok 2024-09-21T04:00:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:00:29.822 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.75248.asok 2024-09-21T04:00:29.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:29.822 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.75248.asok status 2024-09-21T04:00:29.968 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": { 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "entity_id": "admin", 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": "smithi022", 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "pid": "75248", 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "root": "/" 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_count": 0, 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_pinned_count": 0, 2024-09-21T04:00:29.969 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 14913, 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "inst": { 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "name": { 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "client", 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "num": 14913 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3436355851 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2024-09-21T04:00:29.970 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3436355851 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "inst_str": "client.14913 192.168.0.1:0/3436355851", 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "addr_str": "192.168.0.1:0/3436355851", 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "inode_count": 1, 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_epoch": 17, 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch": 82, 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch_barrier": 0, 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklisted": false, 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs" 2024-09-21T04:00:29.971 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:00:29.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:29.978 DEBUG:teuthology.orchestra.run.smithi022:> stat --file-system '--printf=%T 2024-09-21T04:00:29.978 DEBUG:teuthology.orchestra.run.smithi022:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-09-21T04:00:29.994 INFO:teuthology.orchestra.run.smithi022.stdout:fuseblk 2024-09-21T04:00:29.994 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-09-21T04:00:29.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:29.994 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-09-21T04:00:30.062 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-09-21T04:00:30.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:30 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-21T04:00:30.184 INFO:teuthology.orchestra.run.smithi022.stdout:# file: . 2024-09-21T04:00:30.184 INFO:teuthology.orchestra.run.smithi022.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-09-21T04:00:30.185 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:30.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:00:30.190 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T04:00:30.191 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T04:00:30.208 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T04:00:30.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:30.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-21T04:00:30.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-21T04:00:30.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-21T04:00:30.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-21T04:00:30.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T04:00:30.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-21T04:00:30.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-21T04:00:30.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-09-21T04:00:30.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-21T04:00:30.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T04:00:30.351 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:30 smithi022 ceph-mon[31015]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T04:00:30.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:30.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-21T04:00:30.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-21T04:00:30.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-21T04:00:30.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-21T04:00:30.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T04:00:30.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-21T04:00:30.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-21T04:00:30.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-09-21T04:00:30.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-21T04:00:30.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T04:00:30.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:30 smithi060 ceph-mon[33722]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T04:00:30.509 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: pgmap v311: 129 pgs: 129 active+clean; 579 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:00:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.b", "id": [2, 4]}]': finished 2024-09-21T04:00:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1a", "id": [8, 1]}]': finished 2024-09-21T04:00:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-09-21T04:00:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-09-21T04:00:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-09-21T04:00:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.33", "id": [5, 9]}]': finished 2024-09-21T04:00:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.6", "id": [9, 11]}]': finished 2024-09-21T04:00:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-09-21T04:00:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [5, 8]}]': finished 2024-09-21T04:00:30.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.10", "id": [9, 8]}]': finished 2024-09-21T04:00:30.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:30 smithi073 ceph-mon[34443]: osdmap e82: 12 total, 12 up, 12 in 2024-09-21T04:00:31.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.059+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/2070281045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc1083a0 msgr2=0x7f8ccc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.059+0000 7f8cd0ebf640 1 --2- 172.21.15.22:0/2070281045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc1083a0 0x7f8ccc1087b0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8cb4009900 tx=0x7f8cb402a3f0 comp rx=0 tx=0).stop 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.059+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/2070281045 shutdown_connections 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.059+0000 7f8cd0ebf640 1 --2- 172.21.15.22:0/2070281045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ccc108cf0 0x7f8ccc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.059+0000 7f8cd0ebf640 1 --2- 172.21.15.22:0/2070281045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc1083a0 0x7f8ccc1087b0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.059+0000 7f8cd0ebf640 1 --2- 172.21.15.22:0/2070281045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ccc102a60 0x7f8ccc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.059+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/2070281045 >> 172.21.15.22:0/2070281045 conn(0x7f8ccc079730 msgr2=0x7f8ccc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.059+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/2070281045 shutdown_connections 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.059+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/2070281045 wait complete. 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.060+0000 7f8cd0ebf640 1 Processor -- start 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.060+0000 7f8cd0ebf640 1 -- start start 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.060+0000 7f8cd0ebf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ccc102a60 0x7f8ccc19b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8cd0ebf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ccc1083a0 0x7f8ccc19b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:31.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8cd0ebf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc108cf0 0x7f8ccc19bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8cd0ebf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8ccc112810 con 0x7f8ccc108cf0 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8cd0ebf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8ccc112690 con 0x7f8ccc1083a0 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8cd0ebf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8ccc112990 con 0x7f8ccc102a60 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8ccad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc108cf0 0x7f8ccc19bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8ccad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc108cf0 0x7f8ccc19bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34880/0 (socket says 172.21.15.22:34880) 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8ccad9d640 1 -- 172.21.15.22:0/3897307806 learned_addr learned my addr 172.21.15.22:0/3897307806 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8cc3fff640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ccc1083a0 0x7f8ccc19b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8cca59c640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ccc102a60 0x7f8ccc19b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8ccad9d640 1 -- 172.21.15.22:0/3897307806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ccc102a60 msgr2=0x7f8ccc19b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8ccad9d640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ccc102a60 0x7f8ccc19b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8ccad9d640 1 -- 172.21.15.22:0/3897307806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ccc1083a0 msgr2=0x7f8ccc19b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8ccad9d640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ccc1083a0 0x7f8ccc19b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8ccad9d640 1 -- 172.21.15.22:0/3897307806 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ccc1a63f0 con 0x7f8ccc108cf0 2024-09-21T04:00:31.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8cc3fff640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ccc1083a0 0x7f8ccc19b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8ccad9d640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc108cf0 0x7f8ccc19bc40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400cce0 tx=0x7f8cc400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.061+0000 7f8cc37fe640 1 -- 172.21.15.22:0/3897307806 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc400f450 con 0x7f8ccc108cf0 2024-09-21T04:00:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.062+0000 7f8cc37fe640 1 -- 172.21.15.22:0/3897307806 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cc400fa80 con 0x7f8ccc108cf0 2024-09-21T04:00:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.062+0000 7f8cc37fe640 1 -- 172.21.15.22:0/3897307806 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4018ad0 con 0x7f8ccc108cf0 2024-09-21T04:00:31.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.062+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/3897307806 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ccc1a66e0 con 0x7f8ccc108cf0 2024-09-21T04:00:31.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.062+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/3897307806 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ccc1a6bf0 con 0x7f8ccc108cf0 2024-09-21T04:00:31.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.063+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/3897307806 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ccc102e70 con 0x7f8ccc108cf0 2024-09-21T04:00:31.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.064+0000 7f8cc37fe640 1 -- 172.21.15.22:0/3897307806 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f8cc400f5f0 con 0x7f8ccc108cf0 2024-09-21T04:00:31.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.065+0000 7f8cc37fe640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cb80b6590 0x7f8cb80b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:31.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.065+0000 7f8cc37fe640 1 -- 172.21.15.22:0/3897307806 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f8cc40e7f50 con 0x7f8ccc108cf0 2024-09-21T04:00:31.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.065+0000 7f8cca59c640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cb80b6590 0x7f8cb80b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:31.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.066+0000 7f8cca59c640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cb80b6590 0x7f8cb80b8aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc005fd0 tx=0x7f8cbc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:31.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.068+0000 7f8cc37fe640 1 -- 172.21.15.22:0/3897307806 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8cc4014030 con 0x7f8ccc108cf0 2024-09-21T04:00:31.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.270+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/3897307806 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8ccc06b290 con 0x7f8ccc108cf0 2024-09-21T04:00:31.272 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:31 smithi022 ceph-mon[31015]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T04:00:31.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.271+0000 7f8cc37fe640 1 -- 172.21.15.22:0/3897307806 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v83) ==== 81+0+588 (secure 0 0 0) 0x7f8ccc06b290 con 0x7f8ccc108cf0 2024-09-21T04:00:31.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/2250622126 2024-09-22T03:52:28.809522+0000 2024-09-21T04:00:31.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1700605044 2024-09-22T03:52:28.809522+0000 2024-09-21T04:00:31.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/3598394913 2024-09-22T03:52:28.809522+0000 2024-09-21T04:00:31.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/4275033300 2024-09-22T03:52:02.449463+0000 2024-09-21T04:00:31.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/636257932 2024-09-22T03:52:02.449463+0000 2024-09-21T04:00:31.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/807920923 2024-09-22T03:52:02.449463+0000 2024-09-21T04:00:31.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/859526938 2024-09-22T03:52:02.449463+0000 2024-09-21T04:00:31.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1683797431 2024-09-22T03:52:28.809522+0000 2024-09-21T04:00:31.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/3598394913 2024-09-22T03:52:28.809522+0000 2024-09-21T04:00:31.273 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/859526938 2024-09-22T03:52:02.449463+0000 2024-09-21T04:00:31.274 INFO:teuthology.orchestra.run.smithi022.stderr:listed 10 entries 2024-09-21T04:00:31.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.274+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/3897307806 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cb80b6590 msgr2=0x7f8cb80b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:31.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.274+0000 7f8cd0ebf640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cb80b6590 0x7f8cb80b8aa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8cbc005fd0 tx=0x7f8cbc005850 comp rx=0 tx=0).stop 2024-09-21T04:00:31.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.274+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/3897307806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc108cf0 msgr2=0x7f8ccc19bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:31.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.274+0000 7f8cd0ebf640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc108cf0 0x7f8ccc19bc40 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8cc400cce0 tx=0x7f8cc400a620 comp rx=0 tx=0).stop 2024-09-21T04:00:31.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.274+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/3897307806 shutdown_connections 2024-09-21T04:00:31.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.275+0000 7f8cd0ebf640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cb80b6590 0x7f8cb80b8aa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:31.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.275+0000 7f8cd0ebf640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ccc108cf0 0x7f8ccc19bc40 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:31.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.275+0000 7f8cd0ebf640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ccc1083a0 0x7f8ccc19b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:31.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.275+0000 7f8cd0ebf640 1 --2- 172.21.15.22:0/3897307806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ccc102a60 0x7f8ccc19b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:31.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.275+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/3897307806 >> 172.21.15.22:0/3897307806 conn(0x7f8ccc079730 msgr2=0x7f8ccc1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:31.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.275+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/3897307806 shutdown_connections 2024-09-21T04:00:31.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:31.275+0000 7f8cd0ebf640 1 -- 172.21.15.22:0/3897307806 wait complete. 2024-09-21T04:00:31.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:31 smithi060 ceph-mon[33722]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T04:00:31.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:31 smithi073 ceph-mon[34443]: osdmap e83: 12 total, 12 up, 12 in 2024-09-21T04:00:32.091 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T04:00:32.091 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T04:00:32.112 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T04:00:32.323 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:32 smithi022 ceph-mon[31015]: pgmap v314: 129 pgs: 1 activating, 3 peering, 125 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T04:00:32.323 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:32 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3897307806' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:00:32.443 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:32.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:32 smithi060 ceph-mon[33722]: pgmap v314: 129 pgs: 1 activating, 3 peering, 125 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T04:00:32.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:32 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3897307806' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:00:32.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:32 smithi073 ceph-mon[34443]: pgmap v314: 129 pgs: 1 activating, 3 peering, 125 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T04:00:32.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:32 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3897307806' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:00:32.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.927+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/1257198147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b81038f0 msgr2=0x7fa7b810f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.927+0000 7fa7bd3bc640 1 --2- 172.21.15.22:0/1257198147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b81038f0 0x7fa7b810f4a0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009ca0 tx=0x7fa7b002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.927+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/1257198147 shutdown_connections 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.927+0000 7fa7bd3bc640 1 --2- 172.21.15.22:0/1257198147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b81038f0 0x7fa7b810f4a0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.927+0000 7fa7bd3bc640 1 --2- 172.21.15.22:0/1257198147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b8102fa0 0x7fa7b81033b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.927+0000 7fa7bd3bc640 1 --2- 172.21.15.22:0/1257198147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b8107630 0x7fa7b8107a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.927+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/1257198147 >> 172.21.15.22:0/1257198147 conn(0x7fa7b8079e40 msgr2=0x7fa7b807a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.927+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/1257198147 shutdown_connections 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.927+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/1257198147 wait complete. 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.927+0000 7fa7bd3bc640 1 Processor -- start 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7bd3bc640 1 -- start start 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7bd3bc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8102fa0 0x7fa7b819a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7bd3bc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b81038f0 0x7fa7b819a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:32.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7bd3bc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b8107630 0x7fa7b819fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7bd3bc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b81128e0 con 0x7fa7b8102fa0 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7bd3bc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b8112760 con 0x7fa7b81038f0 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7bd3bc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa7b8112a60 con 0x7fa7b8107630 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7b6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8102fa0 0x7fa7b819a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7b6ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8102fa0 0x7fa7b819a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34890/0 (socket says 172.21.15.22:34890) 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7b6ffd640 1 -- 172.21.15.22:0/2467259294 learned_addr learned my addr 172.21.15.22:0/2467259294 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7b67fc640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b81038f0 0x7fa7b819a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7b77fe640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b8107630 0x7fa7b819fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7b6ffd640 1 -- 172.21.15.22:0/2467259294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b8107630 msgr2=0x7fa7b819fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7b6ffd640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b8107630 0x7fa7b819fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7b6ffd640 1 -- 172.21.15.22:0/2467259294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b81038f0 msgr2=0x7fa7b819a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.928+0000 7fa7b6ffd640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b81038f0 0x7fa7b819a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.929+0000 7fa7b6ffd640 1 -- 172.21.15.22:0/2467259294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7b81a0230 con 0x7fa7b8102fa0 2024-09-21T04:00:32.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.929+0000 7fa7b6ffd640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8102fa0 0x7fa7b819a380 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800c920 tx=0x7fa7a800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.929+0000 7fa79ffff640 1 -- 172.21.15.22:0/2467259294 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a8007c70 con 0x7fa7b8102fa0 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.929+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/2467259294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7b81a0520 con 0x7fa7b8102fa0 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.929+0000 7fa79ffff640 1 -- 172.21.15.22:0/2467259294 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa7a8007e10 con 0x7fa7b8102fa0 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.929+0000 7fa79ffff640 1 -- 172.21.15.22:0/2467259294 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7a80186f0 con 0x7fa7b8102fa0 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.929+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/2467259294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7b81a6d40 con 0x7fa7b8102fa0 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.930+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/2467259294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7b81033b0 con 0x7fa7b8102fa0 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.931+0000 7fa79ffff640 1 -- 172.21.15.22:0/2467259294 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fa7a800f450 con 0x7fa7b8102fa0 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.932+0000 7fa79ffff640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa7a00b6540 0x7fa7a00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.932+0000 7fa79ffff640 1 -- 172.21.15.22:0/2467259294 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fa7a80e78a0 con 0x7fa7b8102fa0 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.932+0000 7fa7b67fc640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa7a00b6540 0x7fa7a00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:32.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.933+0000 7fa7b67fc640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa7a00b6540 0x7fa7a00b8a50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac005fd0 tx=0x7fa7ac005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:32.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:32.937+0000 7fa79ffff640 1 -- 172.21.15.22:0/2467259294 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa7a8014030 con 0x7fa7b8102fa0 2024-09-21T04:00:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.142+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/2467259294 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa7b819b4b0 con 0x7fa7b8102fa0 2024-09-21T04:00:33.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.142+0000 7fa79ffff640 1 -- 172.21.15.22:0/2467259294 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v83) ==== 81+0+588 (secure 0 0 0) 0x7fa7a80addd0 con 0x7fa7b8102fa0 2024-09-21T04:00:33.144 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/2250622126 2024-09-22T03:52:28.809522+0000 2024-09-21T04:00:33.144 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1700605044 2024-09-22T03:52:28.809522+0000 2024-09-21T04:00:33.144 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/3598394913 2024-09-22T03:52:28.809522+0000 2024-09-21T04:00:33.144 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/4275033300 2024-09-22T03:52:02.449463+0000 2024-09-21T04:00:33.145 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/636257932 2024-09-22T03:52:02.449463+0000 2024-09-21T04:00:33.145 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/807920923 2024-09-22T03:52:02.449463+0000 2024-09-21T04:00:33.145 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/859526938 2024-09-22T03:52:02.449463+0000 2024-09-21T04:00:33.145 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1683797431 2024-09-22T03:52:28.809522+0000 2024-09-21T04:00:33.145 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/3598394913 2024-09-22T03:52:28.809522+0000 2024-09-21T04:00:33.145 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/859526938 2024-09-22T03:52:02.449463+0000 2024-09-21T04:00:33.145 INFO:teuthology.orchestra.run.smithi022.stderr:listed 10 entries 2024-09-21T04:00:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/2467259294 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa7a00b6540 msgr2=0x7fa7a00b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa7a00b6540 0x7fa7a00b8a50 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa7ac005fd0 tx=0x7fa7ac005850 comp rx=0 tx=0).stop 2024-09-21T04:00:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/2467259294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8102fa0 msgr2=0x7fa7b819a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8102fa0 0x7fa7b819a380 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa7a800c920 tx=0x7fa7a800cde0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/2467259294 shutdown_connections 2024-09-21T04:00:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa7a00b6540 0x7fa7a00b8a50 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa7b8107630 0x7fa7b819fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa7b81038f0 0x7fa7b819a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 --2- 172.21.15.22:0/2467259294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa7b8102fa0 0x7fa7b819a380 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/2467259294 >> 172.21.15.22:0/2467259294 conn(0x7fa7b8079e40 msgr2=0x7fa7b81054a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/2467259294 shutdown_connections 2024-09-21T04:00:33.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:33.145+0000 7fa7bd3bc640 1 -- 172.21.15.22:0/2467259294 wait complete. 2024-09-21T04:00:33.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:33 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2467259294' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:00:33.521 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:33 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2467259294' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:00:33.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:33 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2467259294' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:00:33.977 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi022.front.sepia.ceph.com... 2024-09-21T04:00:33.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:33.977 DEBUG:teuthology.orchestra.run.smithi022:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-09-21T04:00:34.004 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:ceph-fuse[75248]: fuse finished with error 0 and tester_r 0 2024-09-21T04:00:34.005 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T04:00:34.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-09-21T04:00:34.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:00:34.065 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-09-21T04:00:34.100 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:00:34.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:34 smithi022 ceph-mon[31015]: pgmap v315: 129 pgs: 1 activating, 3 peering, 125 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T04:00:34.401 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:34.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:34 smithi060 ceph-mon[33722]: pgmap v315: 129 pgs: 1 activating, 3 peering, 125 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T04:00:34.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:34 smithi073 ceph-mon[34443]: pgmap v315: 129 pgs: 1 activating, 3 peering, 125 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s 2024-09-21T04:00:34.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.884+0000 7f2ac2276640 1 -- 172.21.15.22:0/3881658199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2abc102a60 msgr2=0x7f2abc102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.884+0000 7f2ac2276640 1 --2- 172.21.15.22:0/3881658199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2abc102a60 0x7f2abc102e70 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009900 tx=0x7f2aac02a410 comp rx=0 tx=0).stop 2024-09-21T04:00:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.884+0000 7f2ac2276640 1 -- 172.21.15.22:0/3881658199 shutdown_connections 2024-09-21T04:00:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.884+0000 7f2ac2276640 1 --2- 172.21.15.22:0/3881658199 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc108cf0 0x7f2abc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.884+0000 7f2ac2276640 1 --2- 172.21.15.22:0/3881658199 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2abc1083a0 0x7f2abc1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.884+0000 7f2ac2276640 1 --2- 172.21.15.22:0/3881658199 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2abc102a60 0x7f2abc102e70 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.884+0000 7f2ac2276640 1 -- 172.21.15.22:0/3881658199 >> 172.21.15.22:0/3881658199 conn(0x7f2abc079730 msgr2=0x7f2abc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.884+0000 7f2ac2276640 1 -- 172.21.15.22:0/3881658199 shutdown_connections 2024-09-21T04:00:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.884+0000 7f2ac2276640 1 -- 172.21.15.22:0/3881658199 wait complete. 2024-09-21T04:00:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.885+0000 7f2ac2276640 1 Processor -- start 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.885+0000 7f2ac2276640 1 -- start start 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.885+0000 7f2ac2276640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc102a60 0x7f2abc19a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.885+0000 7f2ac2276640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2abc1083a0 0x7f2abc19a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.885+0000 7f2ac2276640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2abc108cf0 0x7f2abc19fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.885+0000 7f2ac2276640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc112810 con 0x7f2abc1083a0 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.885+0000 7f2ac2276640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc112690 con 0x7f2abc108cf0 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.885+0000 7f2ac2276640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc112990 con 0x7f2abc102a60 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2abb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2abc1083a0 0x7f2abc19a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2abb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2abc1083a0 0x7f2abc19a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34912/0 (socket says 172.21.15.22:34912) 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2abb7fe640 1 -- 172.21.15.22:0/1754816591 learned_addr learned my addr 172.21.15.22:0/1754816591 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2abbfff640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc102a60 0x7f2abc19a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2ac0813640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2abc108cf0 0x7f2abc19fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2abb7fe640 1 -- 172.21.15.22:0/1754816591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc102a60 msgr2=0x7f2abc19a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2abb7fe640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc102a60 0x7f2abc19a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2abb7fe640 1 -- 172.21.15.22:0/1754816591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2abc108cf0 msgr2=0x7f2abc19fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2abb7fe640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2abc108cf0 0x7f2abc19fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2abb7fe640 1 -- 172.21.15.22:0/1754816591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2abc1a02e0 con 0x7f2abc1083a0 2024-09-21T04:00:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2abb7fe640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2abc1083a0 0x7f2abc19a910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000d770 tx=0x7f2ab000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2ab97fa640 1 -- 172.21.15.22:0/1754816591 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab0017070 con 0x7f2abc1083a0 2024-09-21T04:00:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2ac2276640 1 -- 172.21.15.22:0/1754816591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2abc1a05d0 con 0x7f2abc1083a0 2024-09-21T04:00:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2ab97fa640 1 -- 172.21.15.22:0/1754816591 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ab0009c30 con 0x7f2abc1083a0 2024-09-21T04:00:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2ab97fa640 1 -- 172.21.15.22:0/1754816591 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ab000f620 con 0x7f2abc1083a0 2024-09-21T04:00:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.886+0000 7f2ac2276640 1 -- 172.21.15.22:0/1754816591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2abc1a6d30 con 0x7f2abc1083a0 2024-09-21T04:00:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.887+0000 7f2ac2276640 1 -- 172.21.15.22:0/1754816591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2abc102e70 con 0x7f2abc1083a0 2024-09-21T04:00:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.889+0000 7f2ab97fa640 1 -- 172.21.15.22:0/1754816591 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f2ab001a070 con 0x7f2abc1083a0 2024-09-21T04:00:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.890+0000 7f2ab97fa640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2aa40b6510 0x7f2aa40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.890+0000 7f2abbfff640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2aa40b6510 0x7f2aa40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.890+0000 7f2ab97fa640 1 -- 172.21.15.22:0/1754816591 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f2ab00e7130 con 0x7f2abc1083a0 2024-09-21T04:00:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.890+0000 7f2abbfff640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2aa40b6510 0x7f2aa40b8a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0057c0 tx=0x7f2aac0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:34.893+0000 7f2ab97fa640 1 -- 172.21.15.22:0/1754816591 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2ab0009de0 con 0x7f2abc1083a0 2024-09-21T04:00:35.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.084+0000 7f2ac2276640 1 -- 172.21.15.22:0/1754816591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2abc1a6fd0 con 0x7f2abc1083a0 2024-09-21T04:00:35.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.086+0000 7f2ab97fa640 1 -- 172.21.15.22:0/1754816591 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24592 (secure 0 0 0) 0x7f2ab00ad660 con 0x7f2abc1083a0 2024-09-21T04:00:35.088 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:35.088 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:00:30.127586+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:00:35.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 -- 172.21.15.22:0/1754816591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2aa40b6510 msgr2=0x7f2aa40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:35.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2aa40b6510 0x7f2aa40b8a20 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2aac0057c0 tx=0x7f2aac0058d0 comp rx=0 tx=0).stop 2024-09-21T04:00:35.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 -- 172.21.15.22:0/1754816591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2abc1083a0 msgr2=0x7f2abc19a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:35.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2abc1083a0 0x7f2abc19a910 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f2ab000d770 tx=0x7f2ab000dc30 comp rx=0 tx=0).stop 2024-09-21T04:00:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 -- 172.21.15.22:0/1754816591 shutdown_connections 2024-09-21T04:00:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2aa40b6510 0x7f2aa40b8a20 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2abc108cf0 0x7f2abc19fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2abc1083a0 0x7f2abc19a910 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 --2- 172.21.15.22:0/1754816591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2abc102a60 0x7f2abc19a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 -- 172.21.15.22:0/1754816591 >> 172.21.15.22:0/1754816591 conn(0x7f2abc079730 msgr2=0x7f2abc101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 -- 172.21.15.22:0/1754816591 shutdown_connections 2024-09-21T04:00:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:35.089+0000 7f2ac2276640 1 -- 172.21.15.22:0/1754816591 wait complete. 2024-09-21T04:00:35.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:35 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1754816591' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:35.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:35 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1754816591' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:35.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:35 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1754816591' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:35.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:00:36.172 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:36.410 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:36 smithi022 ceph-mon[31015]: pgmap v316: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:36.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:36 smithi060 ceph-mon[33722]: pgmap v316: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:36.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:36 smithi073 ceph-mon[34443]: pgmap v316: 129 pgs: 1 activating, 128 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 511 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:36.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.644+0000 7f9a9d839640 1 -- 172.21.15.22:0/3848108385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a981094a0 msgr2=0x7f9a981098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:36.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.644+0000 7f9a9d839640 1 --2- 172.21.15.22:0/3848108385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a981094a0 0x7f9a981098b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c009900 tx=0x7f9a8c02a410 comp rx=0 tx=0).stop 2024-09-21T04:00:36.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.644+0000 7f9a9d839640 1 -- 172.21.15.22:0/3848108385 shutdown_connections 2024-09-21T04:00:36.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.644+0000 7f9a9d839640 1 --2- 172.21.15.22:0/3848108385 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a98109df0 0x7f9a98110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.644+0000 7f9a9d839640 1 --2- 172.21.15.22:0/3848108385 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a981094a0 0x7f9a981098b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.644+0000 7f9a9d839640 1 --2- 172.21.15.22:0/3848108385 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a98103b60 0x7f9a98103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.644+0000 7f9a9d839640 1 -- 172.21.15.22:0/3848108385 >> 172.21.15.22:0/3848108385 conn(0x7f9a9807b850 msgr2=0x7f9a9807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:36.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.644+0000 7f9a9d839640 1 -- 172.21.15.22:0/3848108385 shutdown_connections 2024-09-21T04:00:36.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.644+0000 7f9a9d839640 1 -- 172.21.15.22:0/3848108385 wait complete. 2024-09-21T04:00:36.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.645+0000 7f9a9d839640 1 Processor -- start 2024-09-21T04:00:36.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.645+0000 7f9a9d839640 1 -- start start 2024-09-21T04:00:36.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a9d839640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a98103b60 0x7f9a9819a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a9d839640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981094a0 0x7f9a9819a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a9d839640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a98109df0 0x7f9a9819fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a9d839640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a98113960 con 0x7f9a98103b60 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a9d839640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9a981137e0 con 0x7f9a98109df0 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a9d839640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9a98113ae0 con 0x7f9a981094a0 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a96ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a98103b60 0x7f9a9819a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a96ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a98103b60 0x7f9a9819a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34920/0 (socket says 172.21.15.22:34920) 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a96ffd640 1 -- 172.21.15.22:0/1718194619 learned_addr learned my addr 172.21.15.22:0/1718194619 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a967fc640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981094a0 0x7f9a9819a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a977fe640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a98109df0 0x7f9a9819fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a96ffd640 1 -- 172.21.15.22:0/1718194619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981094a0 msgr2=0x7f9a9819a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a96ffd640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981094a0 0x7f9a9819a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a96ffd640 1 -- 172.21.15.22:0/1718194619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a98109df0 msgr2=0x7f9a9819fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:36.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a96ffd640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a98109df0 0x7f9a9819fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a96ffd640 1 -- 172.21.15.22:0/1718194619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a981a03a0 con 0x7f9a98103b60 2024-09-21T04:00:36.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a977fe640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a98109df0 0x7f9a9819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:36.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.646+0000 7f9a96ffd640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a98103b60 0x7f9a9819a430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800d950 tx=0x7f9a8800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:36.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.647+0000 7f9a9c837640 1 -- 172.21.15.22:0/1718194619 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a88017070 con 0x7f9a98103b60 2024-09-21T04:00:36.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.647+0000 7f9a9d839640 1 -- 172.21.15.22:0/1718194619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a981a0690 con 0x7f9a98103b60 2024-09-21T04:00:36.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.647+0000 7f9a9c837640 1 -- 172.21.15.22:0/1718194619 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a88009c30 con 0x7f9a98103b60 2024-09-21T04:00:36.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.647+0000 7f9a9c837640 1 -- 172.21.15.22:0/1718194619 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a8800f620 con 0x7f9a98103b60 2024-09-21T04:00:36.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.647+0000 7f9a9d839640 1 -- 172.21.15.22:0/1718194619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a981a6df0 con 0x7f9a98103b60 2024-09-21T04:00:36.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.648+0000 7f9a9d839640 1 -- 172.21.15.22:0/1718194619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a98103f70 con 0x7f9a98103b60 2024-09-21T04:00:36.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.649+0000 7f9a9c837640 1 -- 172.21.15.22:0/1718194619 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f9a88005030 con 0x7f9a98103b60 2024-09-21T04:00:36.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.650+0000 7f9a9c837640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a800b6510 0x7f9a800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:36.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.650+0000 7f9a967fc640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a800b6510 0x7f9a800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:36.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.650+0000 7f9a9c837640 1 -- 172.21.15.22:0/1718194619 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f9a880e72f0 con 0x7f9a98103b60 2024-09-21T04:00:36.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.651+0000 7f9a967fc640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a800b6510 0x7f9a800b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0057c0 tx=0x7f9a8c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:36.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.653+0000 7f9a9c837640 1 -- 172.21.15.22:0/1718194619 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a880ad820 con 0x7f9a98103b60 2024-09-21T04:00:36.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.844+0000 7f9a9d839640 1 -- 172.21.15.22:0/1718194619 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a9802e640 con 0x7f9a98103b60 2024-09-21T04:00:36.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.845+0000 7f9a9c837640 1 -- 172.21.15.22:0/1718194619 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24592 (secure 0 0 0) 0x7f9a88009de0 con 0x7f9a98103b60 2024-09-21T04:00:36.847 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:36.847 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:00:30.127586+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:00:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 -- 172.21.15.22:0/1718194619 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a800b6510 msgr2=0x7f9a800b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a800b6510 0x7f9a800b8a20 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f9a8c0057c0 tx=0x7f9a8c000bc0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 -- 172.21.15.22:0/1718194619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a98103b60 msgr2=0x7f9a9819a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a98103b60 0x7f9a9819a430 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9a8800d950 tx=0x7f9a8800de10 comp rx=0 tx=0).stop 2024-09-21T04:00:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 -- 172.21.15.22:0/1718194619 shutdown_connections 2024-09-21T04:00:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a800b6510 0x7f9a800b8a20 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9a981094a0 0x7f9a9819a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9a98109df0 0x7f9a9819fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 --2- 172.21.15.22:0/1718194619 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a98103b60 0x7f9a9819a430 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:36.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 -- 172.21.15.22:0/1718194619 >> 172.21.15.22:0/1718194619 conn(0x7f9a9807b850 msgr2=0x7f9a981076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:36.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 -- 172.21.15.22:0/1718194619 shutdown_connections 2024-09-21T04:00:36.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:36.848+0000 7f9a9d839640 1 -- 172.21.15.22:0/1718194619 wait complete. 2024-09-21T04:00:37.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:37 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1718194619' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:37.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:37 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1718194619' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:37.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:37 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1718194619' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:37.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs set cephfs standby_count_wanted 0 2024-09-21T04:00:37.917 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:38.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:38 smithi022 ceph-mon[31015]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:38.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:38 smithi060 ceph-mon[33722]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:38.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.449+0000 7f985aa67640 1 -- 172.21.15.22:0/1031989491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9854104a30 msgr2=0x7f9854104e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:38.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.449+0000 7f985aa67640 1 --2- 172.21.15.22:0/1031989491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9854104a30 0x7f9854104e40 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9844009900 tx=0x7f984402a410 comp rx=0 tx=0).stop 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.449+0000 7f985aa67640 1 -- 172.21.15.22:0/1031989491 shutdown_connections 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.449+0000 7f985aa67640 1 --2- 172.21.15.22:0/1031989491 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9854105380 0x7f985410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.449+0000 7f985aa67640 1 --2- 172.21.15.22:0/1031989491 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f985410de90 0x7f9854110380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.449+0000 7f985aa67640 1 --2- 172.21.15.22:0/1031989491 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9854104a30 0x7f9854104e40 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.449+0000 7f985aa67640 1 -- 172.21.15.22:0/1031989491 >> 172.21.15.22:0/1031989491 conn(0x7f9854079770 msgr2=0x7f9854079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.449+0000 7f985aa67640 1 -- 172.21.15.22:0/1031989491 shutdown_connections 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.449+0000 7f985aa67640 1 -- 172.21.15.22:0/1031989491 wait complete. 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.450+0000 7f985aa67640 1 Processor -- start 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.450+0000 7f985aa67640 1 -- start start 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f985aa67640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9854104a30 0x7f985419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f985aa67640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9854105380 0x7f985419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:38.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f985aa67640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f985410de90 0x7f985419fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f985aa67640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f98541139c0 con 0x7f985410de90 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f985aa67640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9854113840 con 0x7f9854105380 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f985aa67640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9854113b40 con 0x7f9854104a30 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f9859004640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f985410de90 0x7f985419fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f9859004640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f985410de90 0x7f985419fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34932/0 (socket says 172.21.15.22:34932) 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f9859004640 1 -- 172.21.15.22:0/1343666423 learned_addr learned my addr 172.21.15.22:0/1343666423 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f9858803640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9854104a30 0x7f985419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f9853fff640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9854105380 0x7f985419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f9859004640 1 -- 172.21.15.22:0/1343666423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9854104a30 msgr2=0x7f985419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f9859004640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9854104a30 0x7f985419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f9859004640 1 -- 172.21.15.22:0/1343666423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9854105380 msgr2=0x7f985419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f9859004640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9854105380 0x7f985419aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.451+0000 7f9859004640 1 -- 172.21.15.22:0/1343666423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98541a0480 con 0x7f985410de90 2024-09-21T04:00:38.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.452+0000 7f9859004640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f985410de90 0x7f985419fd50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f984c009fd0 tx=0x7f984c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.452+0000 7f9851ffb640 1 -- 172.21.15.22:0/1343666423 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c017070 con 0x7f985410de90 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.452+0000 7f9851ffb640 1 -- 172.21.15.22:0/1343666423 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f984c003e00 con 0x7f985410de90 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.452+0000 7f9851ffb640 1 -- 172.21.15.22:0/1343666423 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f984c010460 con 0x7f985410de90 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.452+0000 7f985aa67640 1 -- 172.21.15.22:0/1343666423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98541a0770 con 0x7f985410de90 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.452+0000 7f985aa67640 1 -- 172.21.15.22:0/1343666423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98541a6ed0 con 0x7f985410de90 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.453+0000 7f985aa67640 1 -- 172.21.15.22:0/1343666423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f985406c260 con 0x7f985410de90 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.454+0000 7f9851ffb640 1 -- 172.21.15.22:0/1343666423 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f984c003970 con 0x7f985410de90 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.455+0000 7f9851ffb640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f983c0b6590 0x7f983c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.455+0000 7f9858803640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f983c0b6590 0x7f983c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.455+0000 7f9851ffb640 1 -- 172.21.15.22:0/1343666423 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f984c0e76f0 con 0x7f985410de90 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.456+0000 7f9858803640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f983c0b6590 0x7f983c0b8aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f98440057c0 tx=0x7f98440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:38.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.460+0000 7f9851ffb640 1 -- 172.21.15.22:0/1343666423 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f984c0adc20 con 0x7f985410de90 2024-09-21T04:00:38.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:38 smithi073 ceph-mon[34443]: pgmap v317: 129 pgs: 129 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 639 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:38.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:38.687+0000 7f985aa67640 1 -- 172.21.15.22:0/1343666423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f985419b640 con 0x7f985410de90 2024-09-21T04:00:39.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.170+0000 7f9851ffb640 1 -- 172.21.15.22:0/1343666423 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f985419b640 con 0x7f985410de90 2024-09-21T04:00:39.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 -- 172.21.15.22:0/1343666423 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f983c0b6590 msgr2=0x7f983c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:39.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f983c0b6590 0x7f983c0b8aa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f98440057c0 tx=0x7f98440058d0 comp rx=0 tx=0).stop 2024-09-21T04:00:39.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 -- 172.21.15.22:0/1343666423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f985410de90 msgr2=0x7f985419fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:39.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f985410de90 0x7f985419fd50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f984c009fd0 tx=0x7f984c00b260 comp rx=0 tx=0).stop 2024-09-21T04:00:39.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 -- 172.21.15.22:0/1343666423 shutdown_connections 2024-09-21T04:00:39.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f983c0b6590 0x7f983c0b8aa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:39.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f985410de90 0x7f985419fd50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:39.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9854105380 0x7f985419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:39.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 --2- 172.21.15.22:0/1343666423 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9854104a30 0x7f985419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:39.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 -- 172.21.15.22:0/1343666423 >> 172.21.15.22:0/1343666423 conn(0x7f9854079770 msgr2=0x7f98540ff830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:39.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 -- 172.21.15.22:0/1343666423 shutdown_connections 2024-09-21T04:00:39.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:39.173+0000 7f985aa67640 1 -- 172.21.15.22:0/1343666423 wait complete. 2024-09-21T04:00:39.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:39 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1343666423' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T04:00:39.493 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:39 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1343666423' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T04:00:39.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:39 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1343666423' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} : dispatch 2024-09-21T04:00:39.821 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--size 25000000000'}} 2024-09-21T04:00:39.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs set cephfs max_mds 5 2024-09-21T04:00:40.086 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:40.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:40 smithi060 ceph-mon[33722]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 523 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:40.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:40 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1343666423' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T04:00:40.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:40 smithi060 ceph-mon[33722]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:40.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:40 smithi022 ceph-mon[31015]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 523 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:40.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:40 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1343666423' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T04:00:40.481 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:40 smithi022 ceph-mon[31015]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.575+0000 7fe588a48640 1 -- 172.21.15.22:0/3597450987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe584103bb0 msgr2=0x7fe584103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.575+0000 7fe588a48640 1 --2- 172.21.15.22:0/3597450987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe584103bb0 0x7fe584103fc0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe574009900 tx=0x7fe57402a410 comp rx=0 tx=0).stop 2024-09-21T04:00:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.575+0000 7fe588a48640 1 -- 172.21.15.22:0/3597450987 shutdown_connections 2024-09-21T04:00:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.575+0000 7fe588a48640 1 --2- 172.21.15.22:0/3597450987 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe584109e40 0x7fe584110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.575+0000 7fe588a48640 1 --2- 172.21.15.22:0/3597450987 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe5841094f0 0x7fe584109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.575+0000 7fe588a48640 1 --2- 172.21.15.22:0/3597450987 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe584103bb0 0x7fe584103fc0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.575+0000 7fe588a48640 1 -- 172.21.15.22:0/3597450987 >> 172.21.15.22:0/3597450987 conn(0x7fe5840ff600 msgr2=0x7fe584101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.575+0000 7fe588a48640 1 -- 172.21.15.22:0/3597450987 shutdown_connections 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.575+0000 7fe588a48640 1 -- 172.21.15.22:0/3597450987 wait complete. 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe588a48640 1 Processor -- start 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe588a48640 1 -- start start 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe588a48640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe584103bb0 0x7fe58419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe588a48640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5841094f0 0x7fe58419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe588a48640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe584109e40 0x7fe58419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe588a48640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe5841139b0 con 0x7fe5841094f0 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe588a48640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe584113830 con 0x7fe584109e40 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe588a48640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe584113b30 con 0x7fe584103bb0 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe581d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5841094f0 0x7fe58419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe581d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5841094f0 0x7fe58419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36072/0 (socket says 172.21.15.22:36072) 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe581d9b640 1 -- 172.21.15.22:0/2293797534 learned_addr learned my addr 172.21.15.22:0/2293797534 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:40.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe582d9d640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe584109e40 0x7fe58419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.576+0000 7fe58259c640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe584103bb0 0x7fe58419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe581d9b640 1 -- 172.21.15.22:0/2293797534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe584103bb0 msgr2=0x7fe58419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe581d9b640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe584103bb0 0x7fe58419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe581d9b640 1 -- 172.21.15.22:0/2293797534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe584109e40 msgr2=0x7fe58419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe581d9b640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe584109e40 0x7fe58419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe581d9b640 1 -- 172.21.15.22:0/2293797534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5841a02b0 con 0x7fe5841094f0 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe581d9b640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5841094f0 0x7fe58419a9a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00d740 tx=0x7fe56c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe57b7fe640 1 -- 172.21.15.22:0/2293797534 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c017070 con 0x7fe5841094f0 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe57b7fe640 1 -- 172.21.15.22:0/2293797534 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe56c00de50 con 0x7fe5841094f0 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe588a48640 1 -- 172.21.15.22:0/2293797534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5841a05a0 con 0x7fe5841094f0 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe57b7fe640 1 -- 172.21.15.22:0/2293797534 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c00f620 con 0x7fe5841094f0 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.577+0000 7fe588a48640 1 -- 172.21.15.22:0/2293797534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5841a6dc0 con 0x7fe5841094f0 2024-09-21T04:00:40.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.578+0000 7fe588a48640 1 -- 172.21.15.22:0/2293797534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe584103fc0 con 0x7fe5841094f0 2024-09-21T04:00:40.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.581+0000 7fe57b7fe640 1 -- 172.21.15.22:0/2293797534 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe56c01a070 con 0x7fe5841094f0 2024-09-21T04:00:40.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.582+0000 7fe57b7fe640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5700b6540 0x7fe5700b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:40.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.582+0000 7fe58259c640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5700b6540 0x7fe5700b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:40.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.582+0000 7fe57b7fe640 1 -- 172.21.15.22:0/2293797534 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fe56c0e6f50 con 0x7fe5841094f0 2024-09-21T04:00:40.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.582+0000 7fe58259c640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5700b6540 0x7fe5700b8a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe5740057c0 tx=0x7fe5740058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:40.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.585+0000 7fe57b7fe640 1 -- 172.21.15.22:0/2293797534 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe56c0b1860 con 0x7fe5841094f0 2024-09-21T04:00:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:40 smithi073 ceph-mon[34443]: pgmap v318: 129 pgs: 129 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 523 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:40 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1343666423' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-21T04:00:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:40 smithi073 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:40.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:40.816+0000 7fe588a48640 1 -- 172.21.15.22:0/2293797534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7fe58410bc10 con 0x7fe5841094f0 2024-09-21T04:00:41.179 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.177+0000 7fe57b7fe640 1 -- 172.21.15.22:0/2293797534 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fe56c0b67a0 con 0x7fe5841094f0 2024-09-21T04:00:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 -- 172.21.15.22:0/2293797534 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5700b6540 msgr2=0x7fe5700b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5700b6540 0x7fe5700b8a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe5740057c0 tx=0x7fe5740058d0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 -- 172.21.15.22:0/2293797534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5841094f0 msgr2=0x7fe58419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5841094f0 0x7fe58419a9a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe56c00d740 tx=0x7fe56c00dc00 comp rx=0 tx=0).stop 2024-09-21T04:00:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 -- 172.21.15.22:0/2293797534 shutdown_connections 2024-09-21T04:00:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5700b6540 0x7fe5700b8a50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe584109e40 0x7fe58419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe5841094f0 0x7fe58419a9a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 --2- 172.21.15.22:0/2293797534 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe584103bb0 0x7fe58419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:41.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 -- 172.21.15.22:0/2293797534 >> 172.21.15.22:0/2293797534 conn(0x7fe5840ff600 msgr2=0x7fe584101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 -- 172.21.15.22:0/2293797534 shutdown_connections 2024-09-21T04:00:41.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:41.180+0000 7fe588a48640 1 -- 172.21.15.22:0/2293797534 wait complete. 2024-09-21T04:00:41.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:41 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2293797534' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T04:00:41.576 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:41 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2293797534' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T04:00:41.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:41 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2293797534' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} : dispatch 2024-09-21T04:00:42.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs set cephfs allow_standby_replay true 2024-09-21T04:00:42.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:42 smithi022 ceph-mon[31015]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 474 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:42.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:42 smithi022 ceph-mon[31015]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T04:00:42.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:42 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2293797534' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T04:00:42.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:42 smithi022 ceph-mon[31015]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T04:00:42.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:42 smithi022 ceph-mon[31015]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:42.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:42 smithi022 ceph-mon[31015]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T04:00:42.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:42 smithi022 ceph-mon[31015]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T04:00:42.403 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:42.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:42 smithi060 ceph-mon[33722]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 474 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:42.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:42 smithi060 ceph-mon[33722]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T04:00:42.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:42 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2293797534' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T04:00:42.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:42 smithi060 ceph-mon[33722]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T04:00:42.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:42 smithi060 ceph-mon[33722]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:42.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:42 smithi060 ceph-mon[33722]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T04:00:42.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:42 smithi060 ceph-mon[33722]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T04:00:42.505 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:42 smithi073 ceph-mon[34443]: pgmap v319: 129 pgs: 129 active+clean; 581 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 474 B/s wr, 0 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:42.505 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:42 smithi073 ceph-mon[34443]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T04:00:42.505 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:42 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2293797534' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-09-21T04:00:42.505 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:42 smithi073 ceph-mon[34443]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-21T04:00:42.506 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:42 smithi073 ceph-mon[34443]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-21T04:00:42.506 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:42 smithi073 ceph-mon[34443]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-09-21T04:00:42.506 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:42 smithi073 ceph-mon[34443]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.899+0000 7fe5824f9640 1 -- 172.21.15.22:0/3950109383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe57c103bb0 msgr2=0x7fe57c103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.899+0000 7fe5824f9640 1 --2- 172.21.15.22:0/3950109383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe57c103bb0 0x7fe57c103fc0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fe56c009900 tx=0x7fe56c02a410 comp rx=0 tx=0).stop 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.899+0000 7fe5824f9640 1 -- 172.21.15.22:0/3950109383 shutdown_connections 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.899+0000 7fe5824f9640 1 --2- 172.21.15.22:0/3950109383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c1094f0 0x7fe57c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.899+0000 7fe5824f9640 1 --2- 172.21.15.22:0/3950109383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe57c109e40 0x7fe57c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.899+0000 7fe5824f9640 1 --2- 172.21.15.22:0/3950109383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe57c103bb0 0x7fe57c103fc0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.899+0000 7fe5824f9640 1 -- 172.21.15.22:0/3950109383 >> 172.21.15.22:0/3950109383 conn(0x7fe57c0ff600 msgr2=0x7fe57c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.900+0000 7fe5824f9640 1 -- 172.21.15.22:0/3950109383 shutdown_connections 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.900+0000 7fe5824f9640 1 -- 172.21.15.22:0/3950109383 wait complete. 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.900+0000 7fe5824f9640 1 Processor -- start 2024-09-21T04:00:42.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.900+0000 7fe5824f9640 1 -- start start 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe5824f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe57c103bb0 0x7fe57c19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe5824f9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c1094f0 0x7fe57c19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe5824f9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe57c109e40 0x7fe57c19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe5824f9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe57c113a00 con 0x7fe57c103bb0 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe5824f9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe57c113880 con 0x7fe57c109e40 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe5824f9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe57c113b80 con 0x7fe57c1094f0 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe57bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe57c103bb0 0x7fe57c19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe57bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe57c103bb0 0x7fe57c19a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36086/0 (socket says 172.21.15.22:36086) 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe57bfff640 1 -- 172.21.15.22:0/53510191 learned_addr learned my addr 172.21.15.22:0/53510191 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe57b7fe640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c1094f0 0x7fe57c19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe580a96640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe57c109e40 0x7fe57c19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe57bfff640 1 -- 172.21.15.22:0/53510191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c1094f0 msgr2=0x7fe57c19aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:42.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe57bfff640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c1094f0 0x7fe57c19aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe57bfff640 1 -- 172.21.15.22:0/53510191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe57c109e40 msgr2=0x7fe57c19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe57bfff640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe57c109e40 0x7fe57c19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe57bfff640 1 -- 172.21.15.22:0/53510191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe57c1a0420 con 0x7fe57c103bb0 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe580a96640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe57c109e40 0x7fe57c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.901+0000 7fe57bfff640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe57c103bb0 0x7fe57c19a4b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe56c02a930 tx=0x7fe56c003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.902+0000 7fe5797fa640 1 -- 172.21.15.22:0/53510191 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c03f070 con 0x7fe57c103bb0 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.902+0000 7fe5824f9640 1 -- 172.21.15.22:0/53510191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe57c1a06b0 con 0x7fe57c103bb0 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.902+0000 7fe5797fa640 1 -- 172.21.15.22:0/53510191 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe56c03bdc0 con 0x7fe57c103bb0 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.902+0000 7fe5797fa640 1 -- 172.21.15.22:0/53510191 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe56c035030 con 0x7fe57c103bb0 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.902+0000 7fe5824f9640 1 -- 172.21.15.22:0/53510191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe57c1a6e70 con 0x7fe57c103bb0 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.903+0000 7fe5824f9640 1 -- 172.21.15.22:0/53510191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe57c103fc0 con 0x7fe57c103bb0 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.904+0000 7fe5797fa640 1 -- 172.21.15.22:0/53510191 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fe56c042070 con 0x7fe57c103bb0 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.905+0000 7fe5797fa640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5640b6510 0x7fe5640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:42.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.905+0000 7fe57b7fe640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5640b6510 0x7fe5640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:42.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.905+0000 7fe5797fa640 1 -- 172.21.15.22:0/53510191 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fe56c108540 con 0x7fe57c103bb0 2024-09-21T04:00:42.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.906+0000 7fe57b7fe640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5640b6510 0x7fe5640b8a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe570005fd0 tx=0x7fe570005e20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:42.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:42.908+0000 7fe5797fa640 1 -- 172.21.15.22:0/53510191 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe56c0ceb00 con 0x7fe57c103bb0 2024-09-21T04:00:43.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.140+0000 7fe5824f9640 1 -- 172.21.15.22:0/53510191 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fe57c19b5e0 con 0x7fe57c103bb0 2024-09-21T04:00:43.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.195+0000 7fe5797fa640 1 -- 172.21.15.22:0/53510191 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fe56c0d2ee0 con 0x7fe57c103bb0 2024-09-21T04:00:43.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 -- 172.21.15.22:0/53510191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5640b6510 msgr2=0x7fe5640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:43.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5640b6510 0x7fe5640b8a20 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe570005fd0 tx=0x7fe570005e20 comp rx=0 tx=0).stop 2024-09-21T04:00:43.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 -- 172.21.15.22:0/53510191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe57c103bb0 msgr2=0x7fe57c19a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:43.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe57c103bb0 0x7fe57c19a4b0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fe56c02a930 tx=0x7fe56c003d60 comp rx=0 tx=0).stop 2024-09-21T04:00:43.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 -- 172.21.15.22:0/53510191 shutdown_connections 2024-09-21T04:00:43.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe5640b6510 0x7fe5640b8a20 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:43.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe57c1094f0 0x7fe57c19aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:43.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe57c109e40 0x7fe57c19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:43.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 --2- 172.21.15.22:0/53510191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe57c103bb0 0x7fe57c19a4b0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:43.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 -- 172.21.15.22:0/53510191 >> 172.21.15.22:0/53510191 conn(0x7fe57c0ff600 msgr2=0x7fe57c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:43.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 -- 172.21.15.22:0/53510191 shutdown_connections 2024-09-21T04:00:43.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:43.198+0000 7fe5824f9640 1 -- 172.21.15.22:0/53510191 wait complete. 2024-09-21T04:00:43.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:43 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] up:active 2024-09-21T04:00:43.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:43 smithi060 ceph-mon[33722]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T04:00:43.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:43 smithi060 ceph-mon[33722]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T04:00:43.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:43 smithi060 ceph-mon[33722]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T04:00:43.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:43 smithi060 ceph-mon[33722]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T04:00:43.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:43 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/53510191' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T04:00:43.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:43 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] up:active 2024-09-21T04:00:43.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:43 smithi022 ceph-mon[31015]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T04:00:43.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:43 smithi022 ceph-mon[31015]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T04:00:43.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:43 smithi022 ceph-mon[31015]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T04:00:43.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:43 smithi022 ceph-mon[31015]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T04:00:43.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:43 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/53510191' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T04:00:43.517 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:43 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] up:active 2024-09-21T04:00:43.517 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:43 smithi073 ceph-mon[34443]: daemon mds.h assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-21T04:00:43.517 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:43 smithi073 ceph-mon[34443]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-09-21T04:00:43.517 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:43 smithi073 ceph-mon[34443]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:creating} 9 up:standby 2024-09-21T04:00:43.517 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:43 smithi073 ceph-mon[34443]: daemon mds.h is now active in filesystem cephfs as rank 2 2024-09-21T04:00:43.517 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:43 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/53510191' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} : dispatch 2024-09-21T04:00:43.952 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:00:43 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b[61822]: 2024-09-21T04:00:43.605+0000 7f2404c9c640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-21T04:00:43.952 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:00:43 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b[61822]: 2024-09-21T04:00:43.605+0000 7f2404c9c640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-21T04:00:44.042 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs set cephfs session_timeout 300 2024-09-21T04:00:44.317 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:44.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:44 smithi022 ceph-mon[31015]: pgmap v320: 129 pgs: 129 active+clean; 582 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:44.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:44 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/53510191' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T04:00:44.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:44 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] up:active 2024-09-21T04:00:44.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:44 smithi022 ceph-mon[31015]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T04:00:44.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:44 smithi022 ceph-mon[31015]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T04:00:44.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:44 smithi022 ceph-mon[31015]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T04:00:44.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:44 smithi022 ceph-mon[31015]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T04:00:44.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:44 smithi060 ceph-mon[33722]: pgmap v320: 129 pgs: 129 active+clean; 582 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:44.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:44 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/53510191' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T04:00:44.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:44 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] up:active 2024-09-21T04:00:44.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:44 smithi060 ceph-mon[33722]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T04:00:44.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:44 smithi060 ceph-mon[33722]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T04:00:44.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:44 smithi060 ceph-mon[33722]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T04:00:44.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:44 smithi060 ceph-mon[33722]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T04:00:44.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:44 smithi073 ceph-mon[34443]: pgmap v320: 129 pgs: 129 active+clean; 582 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 938 B/s wr, 1 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:44.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:44 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/53510191' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-21T04:00:44.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:44 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] up:active 2024-09-21T04:00:44.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:44 smithi073 ceph-mon[34443]: daemon mds.c assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-09-21T04:00:44.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:44 smithi073 ceph-mon[34443]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=h=up:active} 9 up:standby 2024-09-21T04:00:44.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:44 smithi073 ceph-mon[34443]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:creating} 8 up:standby 2024-09-21T04:00:44.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:44 smithi073 ceph-mon[34443]: daemon mds.c is now active in filesystem cephfs as rank 3 2024-09-21T04:00:44.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.846+0000 7f82f302c640 1 -- 172.21.15.22:0/3965236397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82ec103b80 msgr2=0x7f82ec103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.846+0000 7f82f302c640 1 --2- 172.21.15.22:0/3965236397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82ec103b80 0x7f82ec103f90 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f82e4009ca0 tx=0x7f82e402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.846+0000 7f82f302c640 1 -- 172.21.15.22:0/3965236397 shutdown_connections 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.846+0000 7f82f302c640 1 --2- 172.21.15.22:0/3965236397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82ec1094c0 0x7f82ec1098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.846+0000 7f82f302c640 1 --2- 172.21.15.22:0/3965236397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82ec109e10 0x7f82ec110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.846+0000 7f82f302c640 1 --2- 172.21.15.22:0/3965236397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82ec103b80 0x7f82ec103f90 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.846+0000 7f82f302c640 1 -- 172.21.15.22:0/3965236397 >> 172.21.15.22:0/3965236397 conn(0x7f82ec0ff610 msgr2=0x7f82ec101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.846+0000 7f82f302c640 1 -- 172.21.15.22:0/3965236397 shutdown_connections 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.846+0000 7f82f302c640 1 -- 172.21.15.22:0/3965236397 wait complete. 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82f302c640 1 Processor -- start 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82f302c640 1 -- start start 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82f302c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82ec103b80 0x7f82ec19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:44.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82f302c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82ec1094c0 0x7f82ec19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82f302c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82ec109e10 0x7f82ec19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82f302c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec1139d0 con 0x7f82ec1094c0 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82f302c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec113850 con 0x7f82ec109e10 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82f302c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f82ec113b50 con 0x7f82ec103b80 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82ec1094c0 0x7f82ec19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82ec1094c0 0x7f82ec19a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36100/0 (socket says 172.21.15.22:36100) 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82ebfff640 1 -- 172.21.15.22:0/2196873932 learned_addr learned my addr 172.21.15.22:0/2196873932 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82f0dc8640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82ec103b80 0x7f82ec19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.847+0000 7f82f15c9640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82ec109e10 0x7f82ec19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82ebfff640 1 -- 172.21.15.22:0/2196873932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82ec103b80 msgr2=0x7f82ec19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82ebfff640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82ec103b80 0x7f82ec19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82ebfff640 1 -- 172.21.15.22:0/2196873932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82ec109e10 msgr2=0x7f82ec19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:44.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82ebfff640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82ec109e10 0x7f82ec19fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82ebfff640 1 -- 172.21.15.22:0/2196873932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82ec1a0230 con 0x7f82ec1094c0 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82f15c9640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82ec109e10 0x7f82ec19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82ebfff640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82ec1094c0 0x7f82ec19a920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f82e000c8c0 tx=0x7f82e000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82e9ffb640 1 -- 172.21.15.22:0/2196873932 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e0007bb0 con 0x7f82ec1094c0 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82e9ffb640 1 -- 172.21.15.22:0/2196873932 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f82e0007d50 con 0x7f82ec1094c0 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82f302c640 1 -- 172.21.15.22:0/2196873932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82ec1a0520 con 0x7f82ec1094c0 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82e9ffb640 1 -- 172.21.15.22:0/2196873932 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82e00186a0 con 0x7f82ec1094c0 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.848+0000 7f82f302c640 1 -- 172.21.15.22:0/2196873932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82ec1a6d40 con 0x7f82ec1094c0 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.849+0000 7f82f302c640 1 -- 172.21.15.22:0/2196873932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82ec103f90 con 0x7f82ec1094c0 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.851+0000 7f82e9ffb640 1 -- 172.21.15.22:0/2196873932 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7f82e000fa00 con 0x7f82ec1094c0 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.852+0000 7f82e9ffb640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f82d40b6540 0x7f82d40b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.852+0000 7f82f0dc8640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f82d40b6540 0x7f82d40b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:44.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.852+0000 7f82e9ffb640 1 -- 172.21.15.22:0/2196873932 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f82e00e76c0 con 0x7f82ec1094c0 2024-09-21T04:00:44.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.853+0000 7f82f0dc8640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f82d40b6540 0x7f82d40b8a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82e40098d0 tx=0x7f82e4031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:44.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:44.857+0000 7f82e9ffb640 1 -- 172.21.15.22:0/2196873932 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82e0014030 con 0x7f82ec1094c0 2024-09-21T04:00:45.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.087+0000 7f82f302c640 1 -- 172.21.15.22:0/2196873932 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f82ec02e640 con 0x7f82ec1094c0 2024-09-21T04:00:45.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.210+0000 7f82e9ffb640 1 -- 172.21.15.22:0/2196873932 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v27) ==== 115+0+0 (secure 0 0 0) 0x7f82e00adbf0 con 0x7f82ec1094c0 2024-09-21T04:00:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.212+0000 7f82f302c640 1 -- 172.21.15.22:0/2196873932 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f82d40b6540 msgr2=0x7f82d40b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.212+0000 7f82f302c640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f82d40b6540 0x7f82d40b8a50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f82e40098d0 tx=0x7f82e4031000 comp rx=0 tx=0).stop 2024-09-21T04:00:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.212+0000 7f82f302c640 1 -- 172.21.15.22:0/2196873932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82ec1094c0 msgr2=0x7f82ec19a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:45.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.212+0000 7f82f302c640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82ec1094c0 0x7f82ec19a920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f82e000c8c0 tx=0x7f82e000cd80 comp rx=0 tx=0).stop 2024-09-21T04:00:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.213+0000 7f82f302c640 1 -- 172.21.15.22:0/2196873932 shutdown_connections 2024-09-21T04:00:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.213+0000 7f82f302c640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f82d40b6540 0x7f82d40b8a50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.213+0000 7f82f302c640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f82ec109e10 0x7f82ec19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.213+0000 7f82f302c640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f82ec1094c0 0x7f82ec19a920 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.213+0000 7f82f302c640 1 --2- 172.21.15.22:0/2196873932 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f82ec103b80 0x7f82ec19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.213+0000 7f82f302c640 1 -- 172.21.15.22:0/2196873932 >> 172.21.15.22:0/2196873932 conn(0x7f82ec0ff610 msgr2=0x7f82ec101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.213+0000 7f82f302c640 1 -- 172.21.15.22:0/2196873932 shutdown_connections 2024-09-21T04:00:45.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:45.213+0000 7f82f302c640 1 -- 172.21.15.22:0/2196873932 wait complete. 2024-09-21T04:00:45.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:45 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] up:active 2024-09-21T04:00:45.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:45 smithi022 ceph-mon[31015]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T04:00:45.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:45 smithi022 ceph-mon[31015]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T04:00:45.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:45 smithi022 ceph-mon[31015]: Cluster is now healthy 2024-09-21T04:00:45.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:45 smithi022 ceph-mon[31015]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T04:00:45.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:45 smithi022 ceph-mon[31015]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T04:00:45.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:45 smithi022 ceph-mon[31015]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T04:00:45.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:45 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2196873932' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T04:00:45.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:45 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] up:active 2024-09-21T04:00:45.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:45 smithi073 ceph-mon[34443]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T04:00:45.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:45 smithi073 ceph-mon[34443]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T04:00:45.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:45 smithi073 ceph-mon[34443]: Cluster is now healthy 2024-09-21T04:00:45.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:45 smithi073 ceph-mon[34443]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T04:00:45.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:45 smithi073 ceph-mon[34443]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T04:00:45.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:45 smithi073 ceph-mon[34443]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T04:00:45.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:45 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2196873932' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T04:00:45.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:45 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] up:active 2024-09-21T04:00:45.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:45 smithi060 ceph-mon[33722]: daemon mds.f assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-09-21T04:00:45.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:45 smithi060 ceph-mon[33722]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T04:00:45.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:45 smithi060 ceph-mon[33722]: Cluster is now healthy 2024-09-21T04:00:45.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:45 smithi060 ceph-mon[33722]: fsmap cephfs:4 {0=b=up:active,1=i=up:active,2=h=up:active,3=c=up:active} 8 up:standby 2024-09-21T04:00:45.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:45 smithi060 ceph-mon[33722]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-09-21T04:00:45.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:45 smithi060 ceph-mon[33722]: daemon mds.f is now active in filesystem cephfs as rank 4 2024-09-21T04:00:45.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:45 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2196873932' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} : dispatch 2024-09-21T04:00:45.932 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--size 25000000000'} subvols for filesystem 'cephfs' 2024-09-21T04:00:45.932 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs subvolumegroup create cephfs qa 2024-09-21T04:00:46.197 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:46.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:46 smithi022 ceph-mon[31015]: pgmap v321: 129 pgs: 129 active+clean; 584 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:46.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:46 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2196873932' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T04:00:46.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:46 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] up:active 2024-09-21T04:00:46.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:46 smithi022 ceph-mon[31015]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T04:00:46.466 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:46 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:00:46.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:46 smithi073 ceph-mon[34443]: pgmap v321: 129 pgs: 129 active+clean; 584 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:46.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:46 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2196873932' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T04:00:46.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:46 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] up:active 2024-09-21T04:00:46.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:46 smithi073 ceph-mon[34443]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T04:00:46.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:46 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:00:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:46 smithi060 ceph-mon[33722]: pgmap v321: 129 pgs: 129 active+clean; 584 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s wr, 7 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:00:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:46 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2196873932' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-21T04:00:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:46 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] up:active 2024-09-21T04:00:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:46 smithi060 ceph-mon[33722]: fsmap cephfs:5 7 up:standby 5 up:active 2024-09-21T04:00:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:46 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:00:46.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.705+0000 7fd0ee464640 1 -- 172.21.15.22:0/2520196780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e8109df0 msgr2=0x7fd0e8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:46.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.705+0000 7fd0ee464640 1 --2- 172.21.15.22:0/2520196780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e8109df0 0x7fd0e8110620 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0009ca0 tx=0x7fd0e002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:46.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.705+0000 7fd0ee464640 1 -- 172.21.15.22:0/2520196780 shutdown_connections 2024-09-21T04:00:46.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.705+0000 7fd0ee464640 1 --2- 172.21.15.22:0/2520196780 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e8109df0 0x7fd0e8110620 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:46.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.705+0000 7fd0ee464640 1 --2- 172.21.15.22:0/2520196780 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0e81094a0 0x7fd0e81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:46.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.705+0000 7fd0ee464640 1 --2- 172.21.15.22:0/2520196780 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e8103b60 0x7fd0e8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:46.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.705+0000 7fd0ee464640 1 -- 172.21.15.22:0/2520196780 >> 172.21.15.22:0/2520196780 conn(0x7fd0e807b850 msgr2=0x7fd0e807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:46.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.705+0000 7fd0ee464640 1 -- 172.21.15.22:0/2520196780 shutdown_connections 2024-09-21T04:00:46.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.705+0000 7fd0ee464640 1 -- 172.21.15.22:0/2520196780 wait complete. 2024-09-21T04:00:46.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.706+0000 7fd0ee464640 1 Processor -- start 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.706+0000 7fd0ee464640 1 -- start start 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.706+0000 7fd0ee464640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e8103b60 0x7fd0e819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.706+0000 7fd0ee464640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0e81094a0 0x7fd0e819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.706+0000 7fd0ee464640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e8109df0 0x7fd0e819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.706+0000 7fd0ee464640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e81139b0 con 0x7fd0e8109df0 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.706+0000 7fd0ee464640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8113830 con 0x7fd0e81094a0 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.706+0000 7fd0ee464640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd0e8113b30 con 0x7fd0e8103b60 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.706+0000 7fd0eca01640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e8109df0 0x7fd0e819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.706+0000 7fd0eca01640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e8109df0 0x7fd0e819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36122/0 (socket says 172.21.15.22:36122) 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0eca01640 1 -- 172.21.15.22:0/3559557273 learned_addr learned my addr 172.21.15.22:0/3559557273 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0e7fff640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e8103b60 0x7fd0e819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0dffff640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0e81094a0 0x7fd0e819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0eca01640 1 -- 172.21.15.22:0/3559557273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e8103b60 msgr2=0x7fd0e819a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:46.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0eca01640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e8103b60 0x7fd0e819a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:46.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0eca01640 1 -- 172.21.15.22:0/3559557273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0e81094a0 msgr2=0x7fd0e819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:46.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0eca01640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0e81094a0 0x7fd0e819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:46.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0eca01640 1 -- 172.21.15.22:0/3559557273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e81a0370 con 0x7fd0e8109df0 2024-09-21T04:00:46.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0eca01640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e8109df0 0x7fd0e819fc40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0005cc0 tx=0x7fd0e0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:46.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0e5ffb640 1 -- 172.21.15.22:0/3559557273 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0032e00 con 0x7fd0e8109df0 2024-09-21T04:00:46.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0e5ffb640 1 -- 172.21.15.22:0/3559557273 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd0e00044d0 con 0x7fd0e8109df0 2024-09-21T04:00:46.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0ee464640 1 -- 172.21.15.22:0/3559557273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e81a0600 con 0x7fd0e8109df0 2024-09-21T04:00:46.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0e5ffb640 1 -- 172.21.15.22:0/3559557273 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0e0030b70 con 0x7fd0e8109df0 2024-09-21T04:00:46.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.707+0000 7fd0ee464640 1 -- 172.21.15.22:0/3559557273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0e81a6dc0 con 0x7fd0e8109df0 2024-09-21T04:00:46.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.708+0000 7fd0ee464640 1 -- 172.21.15.22:0/3559557273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0e8103f70 con 0x7fd0e8109df0 2024-09-21T04:00:46.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.711+0000 7fd0e5ffb640 1 -- 172.21.15.22:0/3559557273 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 16) ==== 154512+0+0 (secure 0 0 0) 0x7fd0e0030d10 con 0x7fd0e8109df0 2024-09-21T04:00:46.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.712+0000 7fd0e5ffb640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd0d40b6510 0x7fd0d40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:46.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.712+0000 7fd0e7fff640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd0d40b6510 0x7fd0d40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:46.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.712+0000 7fd0e5ffb640 1 -- 172.21.15.22:0/3559557273 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fd0e01089f0 con 0x7fd0e8109df0 2024-09-21T04:00:46.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.712+0000 7fd0e7fff640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd0d40b6510 0x7fd0d40b8a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8005d00 tx=0x7fd0d800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:46.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.715+0000 7fd0e5ffb640 1 -- 172.21.15.22:0/3559557273 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd0e00ceec0 con 0x7fd0e8109df0 2024-09-21T04:00:46.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.929+0000 7fd0ee464640 1 -- 172.21.15.22:0/3559557273 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fd0e8063800 con 0x7fd0d40b6510 2024-09-21T04:00:46.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.958+0000 7fd0e5ffb640 1 -- 172.21.15.22:0/3559557273 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd0e8063800 con 0x7fd0d40b6510 2024-09-21T04:00:46.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 -- 172.21.15.22:0/3559557273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd0d40b6510 msgr2=0x7fd0d40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:46.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd0d40b6510 0x7fd0d40b8a20 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd0d8005d00 tx=0x7fd0d800b410 comp rx=0 tx=0).stop 2024-09-21T04:00:46.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 -- 172.21.15.22:0/3559557273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e8109df0 msgr2=0x7fd0e819fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e8109df0 0x7fd0e819fc40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd0e0005cc0 tx=0x7fd0e0032a10 comp rx=0 tx=0).stop 2024-09-21T04:00:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 -- 172.21.15.22:0/3559557273 shutdown_connections 2024-09-21T04:00:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd0d40b6510 0x7fd0d40b8a20 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd0e8109df0 0x7fd0e819fc40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd0e81094a0 0x7fd0e819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 --2- 172.21.15.22:0/3559557273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd0e8103b60 0x7fd0e819a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 -- 172.21.15.22:0/3559557273 >> 172.21.15.22:0/3559557273 conn(0x7fd0e807b850 msgr2=0x7fd0e8107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 -- 172.21.15.22:0/3559557273 shutdown_connections 2024-09-21T04:00:46.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:46.960+0000 7fd0ee464640 1 -- 172.21.15.22:0/3559557273 wait complete. 2024-09-21T04:00:46.972 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:00:46 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T04:00:46.934+0000 7fcbf249d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T04:00:46.972 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:00:46 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T04:00:46.934+0000 7fcbf249d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T04:00:46.972 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:00:46 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T04:00:46.934+0000 7fcbf249d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T04:00:46.973 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:00:46 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T04:00:46.934+0000 7fcbf249d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T04:00:46.973 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:00:46 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T04:00:46.934+0000 7fcbf249d640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-21T04:00:47.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-21T04:00:47.936 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:48.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:48 smithi022 ceph-mon[31015]: pgmap v322: 129 pgs: 129 active+clean; 585 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-21T04:00:48.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:48 smithi022 ceph-mon[31015]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:48.337 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:48 smithi022 ceph-mon[31015]: mgrmap e17: x(active, since 8m), standbys: y, z 2024-09-21T04:00:48.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.432+0000 7f0cbe640640 1 -- 172.21.15.22:0/3999968779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8102650 msgr2=0x7f0cb8102a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:48.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.432+0000 7f0cbe640640 1 --2- 172.21.15.22:0/3999968779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8102650 0x7f0cb8102a60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009900 tx=0x7f0ca802a480 comp rx=0 tx=0).stop 2024-09-21T04:00:48.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.432+0000 7f0cbe640640 1 -- 172.21.15.22:0/3999968779 shutdown_connections 2024-09-21T04:00:48.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.432+0000 7f0cbe640640 1 --2- 172.21.15.22:0/3999968779 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cb8102fa0 0x7f0cb810fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:48.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.432+0000 7f0cbe640640 1 --2- 172.21.15.22:0/3999968779 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb8110200 0x7f0cb8112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:48.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.432+0000 7f0cbe640640 1 --2- 172.21.15.22:0/3999968779 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8102650 0x7f0cb8102a60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:48.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.432+0000 7f0cbe640640 1 -- 172.21.15.22:0/3999968779 >> 172.21.15.22:0/3999968779 conn(0x7f0cb8079730 msgr2=0x7f0cb8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:48.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.432+0000 7f0cbe640640 1 -- 172.21.15.22:0/3999968779 shutdown_connections 2024-09-21T04:00:48.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.432+0000 7f0cbe640640 1 -- 172.21.15.22:0/3999968779 wait complete. 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cbe640640 1 Processor -- start 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cbe640640 1 -- start start 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cbe640640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8102650 0x7f0cb819c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cbe640640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb8102fa0 0x7f0cb819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cbe640640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cb8110200 0x7f0cb81a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cbe640640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb8115b20 con 0x7f0cb8102650 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cbe640640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb81159a0 con 0x7f0cb8102fa0 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cbe640640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb8115ca0 con 0x7f0cb8110200 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cb7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8102650 0x7f0cb819c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cb7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8102650 0x7f0cb819c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36152/0 (socket says 172.21.15.22:36152) 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cb7fff640 1 -- 172.21.15.22:0/1582977646 learned_addr learned my addr 172.21.15.22:0/1582977646 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:48.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cb77fe640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb8102fa0 0x7f0cb819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cbcbdd640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cb8110200 0x7f0cb81a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cb7fff640 1 -- 172.21.15.22:0/1582977646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cb8110200 msgr2=0x7f0cb81a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cb7fff640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cb8110200 0x7f0cb81a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cb7fff640 1 -- 172.21.15.22:0/1582977646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb8102fa0 msgr2=0x7f0cb819cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cb7fff640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb8102fa0 0x7f0cb819cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.433+0000 7f0cb7fff640 1 -- 172.21.15.22:0/1582977646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb81a2500 con 0x7f0cb8102650 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.434+0000 7f0cb77fe640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb8102fa0 0x7f0cb819cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.434+0000 7f0cbcbdd640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cb8110200 0x7f0cb81a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.434+0000 7f0cb7fff640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8102650 0x7f0cb819c590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009230 tx=0x7f0ca8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.434+0000 7f0cb57fa640 1 -- 172.21.15.22:0/1582977646 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca803f030 con 0x7f0cb8102650 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.434+0000 7f0cb57fa640 1 -- 172.21.15.22:0/1582977646 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ca8003a80 con 0x7f0cb8102650 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.434+0000 7f0cbe640640 1 -- 172.21.15.22:0/1582977646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb81a2790 con 0x7f0cb8102650 2024-09-21T04:00:48.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.434+0000 7f0cb57fa640 1 -- 172.21.15.22:0/1582977646 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ca8035070 con 0x7f0cb8102650 2024-09-21T04:00:48.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.434+0000 7f0cbe640640 1 -- 172.21.15.22:0/1582977646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb81a8f50 con 0x7f0cb8102650 2024-09-21T04:00:48.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.435+0000 7f0cbe640640 1 -- 172.21.15.22:0/1582977646 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb806c240 con 0x7f0cb8102650 2024-09-21T04:00:48.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.436+0000 7f0cb57fa640 1 -- 172.21.15.22:0/1582977646 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0ca8042030 con 0x7f0cb8102650 2024-09-21T04:00:48.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.437+0000 7f0cb57fa640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0ca00b65a0 0x7f0ca00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:48.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.437+0000 7f0cb57fa640 1 -- 172.21.15.22:0/1582977646 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f0ca8108300 con 0x7f0cb8102650 2024-09-21T04:00:48.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.437+0000 7f0cb77fe640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0ca00b65a0 0x7f0ca00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:48.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.438+0000 7f0cb77fe640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0ca00b65a0 0x7f0ca00b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8102430 tx=0x7f0cac005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:48.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.441+0000 7f0cb57fa640 1 -- 172.21.15.22:0/1582977646 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ca80ce6d0 con 0x7f0cb8102650 2024-09-21T04:00:48.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:48 smithi073 ceph-mon[34443]: pgmap v322: 129 pgs: 129 active+clean; 585 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-21T04:00:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:48 smithi073 ceph-mon[34443]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:48 smithi073 ceph-mon[34443]: mgrmap e17: x(active, since 8m), standbys: y, z 2024-09-21T04:00:48.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.658+0000 7f0cbe640640 1 -- 172.21.15.22:0/1582977646 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0cb80ff5c0 con 0x7f0ca00b65a0 2024-09-21T04:00:48.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.688+0000 7f0cb57fa640 1 -- 172.21.15.22:0/1582977646 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0cb80ff5c0 con 0x7f0ca00b65a0 2024-09-21T04:00:48.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 -- 172.21.15.22:0/1582977646 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0ca00b65a0 msgr2=0x7f0ca00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:48.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0ca00b65a0 0x7f0ca00b8ab0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f0cb8102430 tx=0x7f0cac005e50 comp rx=0 tx=0).stop 2024-09-21T04:00:48.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 -- 172.21.15.22:0/1582977646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8102650 msgr2=0x7f0cb819c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:48.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8102650 0x7f0cb819c590 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009230 tx=0x7f0ca8004270 comp rx=0 tx=0).stop 2024-09-21T04:00:48.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 -- 172.21.15.22:0/1582977646 shutdown_connections 2024-09-21T04:00:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0ca00b65a0 0x7f0ca00b8ab0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cb8110200 0x7f0cb81a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cb8102fa0 0x7f0cb819cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 --2- 172.21.15.22:0/1582977646 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cb8102650 0x7f0cb819c590 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 -- 172.21.15.22:0/1582977646 >> 172.21.15.22:0/1582977646 conn(0x7f0cb8079730 msgr2=0x7f0cb81007d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 -- 172.21.15.22:0/1582977646 shutdown_connections 2024-09-21T04:00:48.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:48.690+0000 7f0cbe640640 1 -- 172.21.15.22:0/1582977646 wait complete. 2024-09-21T04:00:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:48 smithi060 ceph-mon[33722]: pgmap v322: 129 pgs: 129 active+clean; 585 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 853 B/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-21T04:00:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:48 smithi060 ceph-mon[33722]: from='client.14967 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:48 smithi060 ceph-mon[33722]: mgrmap e17: x(active, since 8m), standbys: y, z 2024-09-21T04:00:49.425 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-21T04:00:49.685 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.171+0000 7f4963997640 1 -- 172.21.15.22:0/467621789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f495c108da0 msgr2=0x7f495c10f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.171+0000 7f4963997640 1 --2- 172.21.15.22:0/467621789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f495c108da0 0x7f495c10f5d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4954009ca0 tx=0x7f495402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.171+0000 7f4963997640 1 -- 172.21.15.22:0/467621789 shutdown_connections 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.171+0000 7f4963997640 1 --2- 172.21.15.22:0/467621789 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f495c108450 0x7f495c108860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.171+0000 7f4963997640 1 --2- 172.21.15.22:0/467621789 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f495c108da0 0x7f495c10f5d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.171+0000 7f4963997640 1 --2- 172.21.15.22:0/467621789 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495c102b10 0x7f495c102f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.171+0000 7f4963997640 1 -- 172.21.15.22:0/467621789 >> 172.21.15.22:0/467621789 conn(0x7f495c0796d0 msgr2=0x7f495c079ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.171+0000 7f4963997640 1 -- 172.21.15.22:0/467621789 shutdown_connections 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.171+0000 7f4963997640 1 -- 172.21.15.22:0/467621789 wait complete. 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4963997640 1 Processor -- start 2024-09-21T04:00:50.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4963997640 1 -- start start 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4963997640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f495c102b10 0x7f495c19c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4963997640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f495c108450 0x7f495c19cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4963997640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495c108da0 0x7f495c1a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4963997640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f495c112960 con 0x7f495c102b10 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4963997640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f495c1127e0 con 0x7f495c108da0 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4963997640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f495c112ae0 con 0x7f495c108450 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4961733640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f495c102b10 0x7f495c19c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4961733640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f495c102b10 0x7f495c19c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36162/0 (socket says 172.21.15.22:36162) 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.172+0000 7f4961733640 1 -- 172.21.15.22:0/2070793438 learned_addr learned my addr 172.21.15.22:0/2070793438 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4961f34640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495c108da0 0x7f495c1a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4960f32640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f495c108450 0x7f495c19cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4961733640 1 -- 172.21.15.22:0/2070793438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f495c108450 msgr2=0x7f495c19cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:50.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4961733640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f495c108450 0x7f495c19cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4961733640 1 -- 172.21.15.22:0/2070793438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495c108da0 msgr2=0x7f495c1a1e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4961733640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495c108da0 0x7f495c1a1e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4961733640 1 -- 172.21.15.22:0/2070793438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f495c1a2540 con 0x7f495c102b10 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4961f34640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495c108da0 0x7f495c1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4961733640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f495c102b10 0x7f495c19c5d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f495800e9f0 tx=0x7f495800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f49527fc640 1 -- 172.21.15.22:0/2070793438 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f495800cd80 con 0x7f495c102b10 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f49527fc640 1 -- 172.21.15.22:0/2070793438 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f49580108c0 con 0x7f495c102b10 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4963997640 1 -- 172.21.15.22:0/2070793438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f495c1a2830 con 0x7f495c102b10 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f49527fc640 1 -- 172.21.15.22:0/2070793438 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49580187c0 con 0x7f495c102b10 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.173+0000 7f4963997640 1 -- 172.21.15.22:0/2070793438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f495c1a8f90 con 0x7f495c102b10 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.174+0000 7f4963997640 1 -- 172.21.15.22:0/2070793438 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f495c102f20 con 0x7f495c102b10 2024-09-21T04:00:50.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.176+0000 7f49527fc640 1 -- 172.21.15.22:0/2070793438 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4958010430 con 0x7f495c102b10 2024-09-21T04:00:50.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.176+0000 7f49527fc640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49480b65a0 0x7f49480b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:50.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.177+0000 7f4960f32640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49480b65a0 0x7f49480b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:50.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.177+0000 7f49527fc640 1 -- 172.21.15.22:0/2070793438 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f49580e81a0 con 0x7f495c102b10 2024-09-21T04:00:50.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.177+0000 7f4960f32640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49480b65a0 0x7f49480b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f494c005fd0 tx=0x7f494c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:50.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.179+0000 7f49527fc640 1 -- 172.21.15.22:0/2070793438 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f49580ae570 con 0x7f495c102b10 2024-09-21T04:00:50.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:50 smithi022 ceph-mon[31015]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:50.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:50 smithi022 ceph-mon[31015]: pgmap v323: 129 pgs: 129 active+clean; 587 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.1 KiB/s wr, 16 op/s 2024-09-21T04:00:50.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.397+0000 7f4963997640 1 -- 172.21.15.22:0/2070793438 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f495c106c30 con 0x7f49480b65a0 2024-09-21T04:00:50.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.404+0000 7f49527fc640 1 -- 172.21.15.22:0/2070793438 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f495c106c30 con 0x7f49480b65a0 2024-09-21T04:00:50.407 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/qa/sv_0/81c13557-8a4c-4bf3-bc55-6e1a3770aeb4 2024-09-21T04:00:50.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.406+0000 7f4963997640 1 -- 172.21.15.22:0/2070793438 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49480b65a0 msgr2=0x7f49480b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:50.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.406+0000 7f4963997640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49480b65a0 0x7f49480b8ab0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f494c005fd0 tx=0x7f494c005850 comp rx=0 tx=0).stop 2024-09-21T04:00:50.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.406+0000 7f4963997640 1 -- 172.21.15.22:0/2070793438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f495c102b10 msgr2=0x7f495c19c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:50.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.406+0000 7f4963997640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f495c102b10 0x7f495c19c5d0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f495800e9f0 tx=0x7f495800eeb0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.406+0000 7f4963997640 1 -- 172.21.15.22:0/2070793438 shutdown_connections 2024-09-21T04:00:50.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.406+0000 7f4963997640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49480b65a0 0x7f49480b8ab0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.406+0000 7f4963997640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f495c108450 0x7f495c19cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.406+0000 7f4963997640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f495c108da0 0x7f495c1a1e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.406+0000 7f4963997640 1 --2- 172.21.15.22:0/2070793438 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f495c102b10 0x7f495c19c5d0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:50.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.406+0000 7f4963997640 1 -- 172.21.15.22:0/2070793438 >> 172.21.15.22:0/2070793438 conn(0x7f495c0796d0 msgr2=0x7f495c106520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:50.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.407+0000 7f4963997640 1 -- 172.21.15.22:0/2070793438 shutdown_connections 2024-09-21T04:00:50.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:50.407+0000 7f4963997640 1 -- 172.21.15.22:0/2070793438 wait complete. 2024-09-21T04:00:50.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:50 smithi073 ceph-mon[34443]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:50.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:50 smithi073 ceph-mon[34443]: pgmap v323: 129 pgs: 129 active+clean; 587 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.1 KiB/s wr, 16 op/s 2024-09-21T04:00:50.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:50 smithi060 ceph-mon[33722]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:50.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:50 smithi060 ceph-mon[33722]: pgmap v323: 129 pgs: 129 active+clean; 587 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4.1 KiB/s wr, 16 op/s 2024-09-21T04:00:51.087 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-21T04:00:51.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:51 smithi022 ceph-mon[31015]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:51.351 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:51.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:51 smithi073 ceph-mon[34443]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:51.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:51 smithi060 ceph-mon[33722]: from='client.14985 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:51.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.816+0000 7fefe6e72640 1 -- 172.21.15.22:0/3734798725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefe0109560 msgr2=0x7fefe0109970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:51.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.816+0000 7fefe6e72640 1 --2- 172.21.15.22:0/3734798725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefe0109560 0x7fefe0109970 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009900 tx=0x7fefc802a410 comp rx=0 tx=0).stop 2024-09-21T04:00:51.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.816+0000 7fefe6e72640 1 -- 172.21.15.22:0/3734798725 shutdown_connections 2024-09-21T04:00:51.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.816+0000 7fefe6e72640 1 --2- 172.21.15.22:0/3734798725 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefe0109eb0 0x7fefe01106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:51.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.816+0000 7fefe6e72640 1 --2- 172.21.15.22:0/3734798725 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefe0109560 0x7fefe0109970 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:51.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.816+0000 7fefe6e72640 1 --2- 172.21.15.22:0/3734798725 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe0102080 0x7fefe0102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:51.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.816+0000 7fefe6e72640 1 -- 172.21.15.22:0/3734798725 >> 172.21.15.22:0/3734798725 conn(0x7fefe0079ec0 msgr2=0x7fefe007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:51.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.816+0000 7fefe6e72640 1 -- 172.21.15.22:0/3734798725 shutdown_connections 2024-09-21T04:00:51.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.816+0000 7fefe6e72640 1 -- 172.21.15.22:0/3734798725 wait complete. 2024-09-21T04:00:51.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.817+0000 7fefe6e72640 1 Processor -- start 2024-09-21T04:00:51.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.817+0000 7fefe6e72640 1 -- start start 2024-09-21T04:00:51.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.817+0000 7fefe6e72640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefe0102080 0x7fefe019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:51.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.817+0000 7fefe6e72640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefe0109560 0x7fefe019a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:51.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.817+0000 7fefe6e72640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe0109eb0 0x7fefe019fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:51.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.817+0000 7fefe6e72640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0113a20 con 0x7fefe0102080 2024-09-21T04:00:51.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.817+0000 7fefe6e72640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fefe01138a0 con 0x7fefe0109eb0 2024-09-21T04:00:51.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.817+0000 7fefe6e72640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fefe0113ba0 con 0x7fefe0109560 2024-09-21T04:00:51.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.817+0000 7fefe4c0e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefe0102080 0x7fefe019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:51.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe4c0e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefe0102080 0x7fefe019a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60608/0 (socket says 172.21.15.22:60608) 2024-09-21T04:00:51.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe4c0e640 1 -- 172.21.15.22:0/4015709458 learned_addr learned my addr 172.21.15.22:0/4015709458 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:51.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefdffff640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefe0109560 0x7fefe019a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:51.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe540f640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe0109eb0 0x7fefe019fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:51.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe4c0e640 1 -- 172.21.15.22:0/4015709458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefe0109560 msgr2=0x7fefe019a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:51.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe4c0e640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefe0109560 0x7fefe019a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:51.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe4c0e640 1 -- 172.21.15.22:0/4015709458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe0109eb0 msgr2=0x7fefe019fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:51.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe4c0e640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe0109eb0 0x7fefe019fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:51.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe4c0e640 1 -- 172.21.15.22:0/4015709458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefe01a0300 con 0x7fefe0102080 2024-09-21T04:00:51.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe540f640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe0109eb0 0x7fefe019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:51.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe4c0e640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefe0102080 0x7fefe019a450 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fefd000c920 tx=0x7fefd000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:51.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefddffb640 1 -- 172.21.15.22:0/4015709458 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd0007c70 con 0x7fefe0102080 2024-09-21T04:00:51.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe6e72640 1 -- 172.21.15.22:0/4015709458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefe01a05f0 con 0x7fefe0102080 2024-09-21T04:00:51.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefddffb640 1 -- 172.21.15.22:0/4015709458 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefd0007e10 con 0x7fefe0102080 2024-09-21T04:00:51.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefddffb640 1 -- 172.21.15.22:0/4015709458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefd00186f0 con 0x7fefe0102080 2024-09-21T04:00:51.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.818+0000 7fefe6e72640 1 -- 172.21.15.22:0/4015709458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefe01a6e10 con 0x7fefe0102080 2024-09-21T04:00:51.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.819+0000 7fefe6e72640 1 -- 172.21.15.22:0/4015709458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefe0102490 con 0x7fefe0102080 2024-09-21T04:00:51.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.821+0000 7fefddffb640 1 -- 172.21.15.22:0/4015709458 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fefd000f450 con 0x7fefe0102080 2024-09-21T04:00:51.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.822+0000 7fefddffb640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fefcc0b65d0 0x7fefcc0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:51.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.822+0000 7fefddffb640 1 -- 172.21.15.22:0/4015709458 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fefd00e7a90 con 0x7fefe0102080 2024-09-21T04:00:51.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.822+0000 7fefdffff640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fefcc0b65d0 0x7fefcc0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:51.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.822+0000 7fefdffff640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fefcc0b65d0 0x7fefcc0b8ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fefc80057c0 tx=0x7fefc8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:51.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:51.826+0000 7fefddffb640 1 -- 172.21.15.22:0/4015709458 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fefd0014030 con 0x7fefe0102080 2024-09-21T04:00:52.047 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.044+0000 7fefe6e72640 1 -- 172.21.15.22:0/4015709458 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fefe0063800 con 0x7fefcc0b65d0 2024-09-21T04:00:52.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.074+0000 7fefddffb640 1 -- 172.21.15.22:0/4015709458 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fefe0063800 con 0x7fefcc0b65d0 2024-09-21T04:00:52.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 -- 172.21.15.22:0/4015709458 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fefcc0b65d0 msgr2=0x7fefcc0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:52.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fefcc0b65d0 0x7fefcc0b8ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fefc80057c0 tx=0x7fefc8000bc0 comp rx=0 tx=0).stop 2024-09-21T04:00:52.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 -- 172.21.15.22:0/4015709458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefe0102080 msgr2=0x7fefe019a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:52.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefe0102080 0x7fefe019a450 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fefd000c920 tx=0x7fefd000cde0 comp rx=0 tx=0).stop 2024-09-21T04:00:52.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 -- 172.21.15.22:0/4015709458 shutdown_connections 2024-09-21T04:00:52.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fefcc0b65d0 0x7fefcc0b8ae0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:52.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fefe0109560 0x7fefe019a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:52.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fefe0109eb0 0x7fefe019fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:52.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 --2- 172.21.15.22:0/4015709458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fefe0102080 0x7fefe019a450 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:52.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 -- 172.21.15.22:0/4015709458 >> 172.21.15.22:0/4015709458 conn(0x7fefe0079ec0 msgr2=0x7fefe0107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:52.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 -- 172.21.15.22:0/4015709458 shutdown_connections 2024-09-21T04:00:52.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:52.076+0000 7fefe6e72640 1 -- 172.21.15.22:0/4015709458 wait complete. 2024-09-21T04:00:52.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:52 smithi022 ceph-mon[31015]: pgmap v324: 129 pgs: 129 active+clean; 609 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.4 KiB/s wr, 21 op/s 2024-09-21T04:00:52.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:52 smithi073 ceph-mon[34443]: pgmap v324: 129 pgs: 129 active+clean; 609 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.4 KiB/s wr, 21 op/s 2024-09-21T04:00:52.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:52 smithi060 ceph-mon[33722]: pgmap v324: 129 pgs: 129 active+clean; 609 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.4 KiB/s wr, 21 op/s 2024-09-21T04:00:52.753 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-21T04:00:53.015 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:53.424 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:53 smithi022 ceph-mon[31015]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.519+0000 7f7fab9a9640 1 -- 172.21.15.22:0/3060359527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fa4103b60 msgr2=0x7f7fa4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.519+0000 7f7fab9a9640 1 --2- 172.21.15.22:0/3060359527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fa4103b60 0x7f7fa4103f70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f7fa0009900 tx=0x7f7fa002a410 comp rx=0 tx=0).stop 2024-09-21T04:00:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.519+0000 7f7fab9a9640 1 -- 172.21.15.22:0/3060359527 shutdown_connections 2024-09-21T04:00:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.519+0000 7f7fab9a9640 1 --2- 172.21.15.22:0/3060359527 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fa4109df0 0x7f7fa4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.519+0000 7f7fab9a9640 1 --2- 172.21.15.22:0/3060359527 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fa41094a0 0x7f7fa41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.519+0000 7f7fab9a9640 1 --2- 172.21.15.22:0/3060359527 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fa4103b60 0x7f7fa4103f70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.519+0000 7f7fab9a9640 1 -- 172.21.15.22:0/3060359527 >> 172.21.15.22:0/3060359527 conn(0x7f7fa407b850 msgr2=0x7f7fa407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.519+0000 7f7fab9a9640 1 -- 172.21.15.22:0/3060359527 shutdown_connections 2024-09-21T04:00:53.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.519+0000 7f7fab9a9640 1 -- 172.21.15.22:0/3060359527 wait complete. 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.520+0000 7f7fab9a9640 1 Processor -- start 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.520+0000 7f7fab9a9640 1 -- start start 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.520+0000 7f7fab9a9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fa4103b60 0x7f7fa419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.520+0000 7f7fab9a9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fa41094a0 0x7f7fa419a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fab9a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fa4109df0 0x7f7fa419fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fab9a9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4113960 con 0x7f7fa4109df0 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fab9a9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa41137e0 con 0x7f7fa41094a0 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fab9a9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7fa4113ae0 con 0x7f7fa4103b60 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa9f46640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fa4109df0 0x7f7fa419fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa9f46640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fa4109df0 0x7f7fa419fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60622/0 (socket says 172.21.15.22:60622) 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa9f46640 1 -- 172.21.15.22:0/1495280708 learned_addr learned my addr 172.21.15.22:0/1495280708 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa9745640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fa4103b60 0x7f7fa419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:53.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa8f44640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fa41094a0 0x7f7fa419a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa9f46640 1 -- 172.21.15.22:0/1495280708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fa4103b60 msgr2=0x7f7fa419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa9f46640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fa4103b60 0x7f7fa419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa9f46640 1 -- 172.21.15.22:0/1495280708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fa41094a0 msgr2=0x7f7fa419a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa9f46640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fa41094a0 0x7f7fa419a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa9f46640 1 -- 172.21.15.22:0/1495280708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fa41a0320 con 0x7f7fa4109df0 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa8f44640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fa41094a0 0x7f7fa419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fa9f46640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fa4109df0 0x7f7fa419fbf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00eaa0 tx=0x7f7f9c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7f9a7fc640 1 -- 172.21.15.22:0/1495280708 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c00cdb0 con 0x7f7fa4109df0 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7fab9a9640 1 -- 172.21.15.22:0/1495280708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fa41a0610 con 0x7f7fa4109df0 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7f9a7fc640 1 -- 172.21.15.22:0/1495280708 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f9c005020 con 0x7f7fa4109df0 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.521+0000 7f7f9a7fc640 1 -- 172.21.15.22:0/1495280708 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f9c0116d0 con 0x7f7fa4109df0 2024-09-21T04:00:53.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.522+0000 7f7fab9a9640 1 -- 172.21.15.22:0/1495280708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fa41a6d70 con 0x7f7fa4109df0 2024-09-21T04:00:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.523+0000 7f7fab9a9640 1 -- 172.21.15.22:0/1495280708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fa4103f70 con 0x7f7fa4109df0 2024-09-21T04:00:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.524+0000 7f7f9a7fc640 1 -- 172.21.15.22:0/1495280708 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7f9c004a40 con 0x7f7fa4109df0 2024-09-21T04:00:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.525+0000 7f7f9a7fc640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7f900b65a0 0x7f7f900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.525+0000 7f7fa9745640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7f900b65a0 0x7f7f900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:53.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.525+0000 7f7f9a7fc640 1 -- 172.21.15.22:0/1495280708 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f7f9c0e7d70 con 0x7f7fa4109df0 2024-09-21T04:00:53.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.526+0000 7f7fa9745640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7f900b65a0 0x7f7f900b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00057c0 tx=0x7f7fa00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:53.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.528+0000 7f7f9a7fc640 1 -- 172.21.15.22:0/1495280708 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7f9c016030 con 0x7f7fa4109df0 2024-09-21T04:00:53.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:53 smithi073 ceph-mon[34443]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:53 smithi060 ceph-mon[33722]: from='client.14991 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:53.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.748+0000 7f7fab9a9640 1 -- 172.21.15.22:0/1495280708 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f7fa4063800 con 0x7f7f900b65a0 2024-09-21T04:00:53.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.753+0000 7f7f9a7fc640 1 -- 172.21.15.22:0/1495280708 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f7fa4063800 con 0x7f7f900b65a0 2024-09-21T04:00:53.756 INFO:teuthology.orchestra.run.smithi022.stdout:/volumes/qa/sv_1/eafaa222-8a1a-4d76-87b9-97769ac1f3fa 2024-09-21T04:00:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 -- 172.21.15.22:0/1495280708 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7f900b65a0 msgr2=0x7f7f900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7f900b65a0 0x7f7f900b8ab0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7fa00057c0 tx=0x7f7fa00058d0 comp rx=0 tx=0).stop 2024-09-21T04:00:53.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 -- 172.21.15.22:0/1495280708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fa4109df0 msgr2=0x7f7fa419fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fa4109df0 0x7f7fa419fbf0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f7f9c00eaa0 tx=0x7f7f9c00ef60 comp rx=0 tx=0).stop 2024-09-21T04:00:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 -- 172.21.15.22:0/1495280708 shutdown_connections 2024-09-21T04:00:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7f900b65a0 0x7f7f900b8ab0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fa4109df0 0x7f7fa419fbf0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fa41094a0 0x7f7fa419a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 --2- 172.21.15.22:0/1495280708 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fa4103b60 0x7f7fa419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 -- 172.21.15.22:0/1495280708 >> 172.21.15.22:0/1495280708 conn(0x7f7fa407b850 msgr2=0x7f7fa41075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 -- 172.21.15.22:0/1495280708 shutdown_connections 2024-09-21T04:00:53.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:53.756+0000 7f7fab9a9640 1 -- 172.21.15.22:0/1495280708 wait complete. 2024-09-21T04:00:54.431 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:54 smithi022 ceph-mon[31015]: pgmap v325: 129 pgs: 129 active+clean; 609 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.4 KiB/s wr, 22 op/s 2024-09-21T04:00:54.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:54 smithi060 ceph-mon[33722]: pgmap v325: 129 pgs: 129 active+clean; 609 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.4 KiB/s wr, 22 op/s 2024-09-21T04:00:54.460 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:00:54.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:54 smithi073 ceph-mon[34443]: pgmap v325: 129 pgs: 129 active+clean; 609 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 6.4 KiB/s wr, 22 op/s 2024-09-21T04:00:54.718 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:55.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.191+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/3795236215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2bc1083a0 msgr2=0x7fc2bc1087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:55.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.191+0000 7fc2c0f5c640 1 --2- 172.21.15.22:0/3795236215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2bc1083a0 0x7fc2bc1087b0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fc2b0009900 tx=0x7fc2b002a410 comp rx=0 tx=0).stop 2024-09-21T04:00:55.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.191+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/3795236215 shutdown_connections 2024-09-21T04:00:55.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.191+0000 7fc2c0f5c640 1 --2- 172.21.15.22:0/3795236215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2bc108cf0 0x7fc2bc10f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.191+0000 7fc2c0f5c640 1 --2- 172.21.15.22:0/3795236215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2bc1083a0 0x7fc2bc1087b0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.191+0000 7fc2c0f5c640 1 --2- 172.21.15.22:0/3795236215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc102a60 0x7fc2bc102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.191+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/3795236215 >> 172.21.15.22:0/3795236215 conn(0x7fc2bc079730 msgr2=0x7fc2bc079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.191+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/3795236215 shutdown_connections 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.191+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/3795236215 wait complete. 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.192+0000 7fc2c0f5c640 1 Processor -- start 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.192+0000 7fc2c0f5c640 1 -- start start 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.192+0000 7fc2c0f5c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc102a60 0x7fc2bc0ff670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.192+0000 7fc2c0f5c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2bc1083a0 0x7fc2bc0ffbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.192+0000 7fc2c0f5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2bc108cf0 0x7fc2bc1000f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.192+0000 7fc2c0f5c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc112850 con 0x7fc2bc108cf0 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.192+0000 7fc2c0f5c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc1126d0 con 0x7fc2bc102a60 2024-09-21T04:00:55.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.192+0000 7fc2c0f5c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc1129d0 con 0x7fc2bc1083a0 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.192+0000 7fc2bad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2bc108cf0 0x7fc2bc1000f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2bad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2bc108cf0 0x7fc2bc1000f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60634/0 (socket says 172.21.15.22:60634) 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2bad9d640 1 -- 172.21.15.22:0/913282052 learned_addr learned my addr 172.21.15.22:0/913282052 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2b9d9b640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2bc1083a0 0x7fc2bc0ffbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2ba59c640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc102a60 0x7fc2bc0ff670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2bad9d640 1 -- 172.21.15.22:0/913282052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2bc1083a0 msgr2=0x7fc2bc0ffbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2bad9d640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2bc1083a0 0x7fc2bc0ffbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2bad9d640 1 -- 172.21.15.22:0/913282052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc102a60 msgr2=0x7fc2bc0ff670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2bad9d640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc102a60 0x7fc2bc0ff670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2bad9d640 1 -- 172.21.15.22:0/913282052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc1a86b0 con 0x7fc2bc108cf0 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2bad9d640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2bc108cf0 0x7fc2bc1000f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009fd0 tx=0x7fc2b400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/913282052 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4011830 con 0x7fc2bc108cf0 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/913282052 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2b4016070 con 0x7fc2bc108cf0 2024-09-21T04:00:55.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/913282052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2bc1a89a0 con 0x7fc2bc108cf0 2024-09-21T04:00:55.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/913282052 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4010d20 con 0x7fc2bc108cf0 2024-09-21T04:00:55.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.193+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/913282052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2bc1a8ee0 con 0x7fc2bc108cf0 2024-09-21T04:00:55.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.194+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/913282052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2bc103ce0 con 0x7fc2bc108cf0 2024-09-21T04:00:55.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.196+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/913282052 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc2b40119d0 con 0x7fc2bc108cf0 2024-09-21T04:00:55.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.196+0000 7fc2ab7fe640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc2a40b65a0 0x7fc2a40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:55.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.197+0000 7fc2ba59c640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc2a40b65a0 0x7fc2a40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:55.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.197+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/913282052 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fc2b40e7340 con 0x7fc2bc108cf0 2024-09-21T04:00:55.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.197+0000 7fc2ba59c640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc2a40b65a0 0x7fc2a40b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc1010c0 tx=0x7fc2ac0094a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:55.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.200+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/913282052 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc2b40ad7b0 con 0x7fc2bc108cf0 2024-09-21T04:00:55.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.429+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/913282052 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2bc102e70 con 0x7fc2bc108cf0 2024-09-21T04:00:55.432 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:55 smithi022 ceph-mon[31015]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:55.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.429+0000 7fc2ab7fe640 1 -- 172.21.15.22:0/913282052 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7fc2bc102e70 con 0x7fc2bc108cf0 2024-09-21T04:00:55.432 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:55.433 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-21T04:00:45:215178+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:00:45.215152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:00:55.433 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-21T04:00:55.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/913282052 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc2a40b65a0 msgr2=0x7fc2a40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:55.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc2a40b65a0 0x7fc2a40b8ab0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc1010c0 tx=0x7fc2ac0094a0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/913282052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2bc108cf0 msgr2=0x7fc2bc1000f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:55.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2bc108cf0 0x7fc2bc1000f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fc2b4009fd0 tx=0x7fc2b400b8e0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/913282052 shutdown_connections 2024-09-21T04:00:55.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc2a40b65a0 0x7fc2a40b8ab0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc2bc1083a0 0x7fc2bc0ffbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc2bc108cf0 0x7fc2bc1000f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 --2- 172.21.15.22:0/913282052 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc2bc102a60 0x7fc2bc0ff670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:55.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/913282052 >> 172.21.15.22:0/913282052 conn(0x7fc2bc079730 msgr2=0x7fc2bc06b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:55.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/913282052 shutdown_connections 2024-09-21T04:00:55.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:55.432+0000 7fc2c0f5c640 1 -- 172.21.15.22:0/913282052 wait complete. 2024-09-21T04:00:55.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:55 smithi073 ceph-mon[34443]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:55.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:55 smithi060 ceph-mon[33722]: from='client.14997 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:00:55.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:00:56.253 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:56.536 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:56 smithi022 ceph-mon[31015]: pgmap v326: 129 pgs: 129 active+clean; 609 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 22 op/s 2024-09-21T04:00:56.536 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:56 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/913282052' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:56.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:56 smithi073 ceph-mon[34443]: pgmap v326: 129 pgs: 129 active+clean; 609 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 22 op/s 2024-09-21T04:00:56.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:56 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/913282052' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:56 smithi060 ceph-mon[33722]: pgmap v326: 129 pgs: 129 active+clean; 609 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 5.7 KiB/s wr, 22 op/s 2024-09-21T04:00:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:56 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/913282052' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:00:56.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.792+0000 7fa0e9239640 1 -- 172.21.15.22:0/2148811426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0e4109df0 msgr2=0x7fa0e4110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:56.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.792+0000 7fa0e9239640 1 --2- 172.21.15.22:0/2148811426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0e4109df0 0x7fa0e4110620 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009ca0 tx=0x7fa0dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:56.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.792+0000 7fa0e9239640 1 -- 172.21.15.22:0/2148811426 shutdown_connections 2024-09-21T04:00:56.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.792+0000 7fa0e9239640 1 --2- 172.21.15.22:0/2148811426 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0e4109df0 0x7fa0e4110620 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:56.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.792+0000 7fa0e9239640 1 --2- 172.21.15.22:0/2148811426 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e41094a0 0x7fa0e41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:56.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.792+0000 7fa0e9239640 1 --2- 172.21.15.22:0/2148811426 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e4103b60 0x7fa0e4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:56.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.792+0000 7fa0e9239640 1 -- 172.21.15.22:0/2148811426 >> 172.21.15.22:0/2148811426 conn(0x7fa0e407b850 msgr2=0x7fa0e407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:56.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.792+0000 7fa0e9239640 1 -- 172.21.15.22:0/2148811426 shutdown_connections 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.792+0000 7fa0e9239640 1 -- 172.21.15.22:0/2148811426 wait complete. 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.793+0000 7fa0e9239640 1 Processor -- start 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e9239640 1 -- start start 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e9239640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e4103b60 0x7fa0e419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e9239640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e41094a0 0x7fa0e419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e9239640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0e4109df0 0x7fa0e419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e9239640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e41139b0 con 0x7fa0e4109df0 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e9239640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4113830 con 0x7fa0e4103b60 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e9239640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e4113b30 con 0x7fa0e41094a0 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0e4109df0 0x7fa0e419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0e4109df0 0x7fa0e419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60648/0 (socket says 172.21.15.22:60648) 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e359e640 1 -- 172.21.15.22:0/3631357420 learned_addr learned my addr 172.21.15.22:0/3631357420 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e2d9d640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e4103b60 0x7fa0e419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:56.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.794+0000 7fa0e259c640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e41094a0 0x7fa0e419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0e359e640 1 -- 172.21.15.22:0/3631357420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e41094a0 msgr2=0x7fa0e419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0e359e640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e41094a0 0x7fa0e419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0e359e640 1 -- 172.21.15.22:0/3631357420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e4103b60 msgr2=0x7fa0e419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0e359e640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e4103b60 0x7fa0e419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0e359e640 1 -- 172.21.15.22:0/3631357420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e41a0430 con 0x7fa0e4109df0 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0e359e640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0e4109df0 0x7fa0e419fd00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc005cc0 tx=0x7fa0dc032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0cbfff640 1 -- 172.21.15.22:0/3631357420 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc004040 con 0x7fa0e4109df0 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0e9239640 1 -- 172.21.15.22:0/3631357420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e41a06c0 con 0x7fa0e4109df0 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0cbfff640 1 -- 172.21.15.22:0/3631357420 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0dc004670 con 0x7fa0e4109df0 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0cbfff640 1 -- 172.21.15.22:0/3631357420 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0dc030cc0 con 0x7fa0e4109df0 2024-09-21T04:00:56.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.795+0000 7fa0e9239640 1 -- 172.21.15.22:0/3631357420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e41a6e80 con 0x7fa0e4109df0 2024-09-21T04:00:56.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.797+0000 7fa0e9239640 1 -- 172.21.15.22:0/3631357420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e4103f70 con 0x7fa0e4109df0 2024-09-21T04:00:56.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.798+0000 7fa0cbfff640 1 -- 172.21.15.22:0/3631357420 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa0dc0041e0 con 0x7fa0e4109df0 2024-09-21T04:00:56.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.799+0000 7fa0cbfff640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa0cc0b65a0 0x7fa0cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:56.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.799+0000 7fa0e2d9d640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa0cc0b65a0 0x7fa0cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:56.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.799+0000 7fa0cbfff640 1 -- 172.21.15.22:0/3631357420 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fa0dc108d90 con 0x7fa0e4109df0 2024-09-21T04:00:56.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.800+0000 7fa0e2d9d640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa0cc0b65a0 0x7fa0cc0b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40058c0 tx=0x7fa0d400a250 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:56.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.802+0000 7fa0cbfff640 1 -- 172.21.15.22:0/3631357420 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0dc0cf100 con 0x7fa0e4109df0 2024-09-21T04:00:56.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.992+0000 7fa0e9239640 1 -- 172.21.15.22:0/3631357420 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa0e410bbe0 con 0x7fa0e4109df0 2024-09-21T04:00:56.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.993+0000 7fa0cbfff640 1 -- 172.21.15.22:0/3631357420 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24592 (secure 0 0 0) 0x7fa0dc0d34e0 con 0x7fa0e4109df0 2024-09-21T04:00:56.996 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:56.996 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:00:30.127586+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:00:56.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.995+0000 7fa0e9239640 1 -- 172.21.15.22:0/3631357420 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa0cc0b65a0 msgr2=0x7fa0cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:56.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.995+0000 7fa0e9239640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa0cc0b65a0 0x7fa0cc0b8ab0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa0d40058c0 tx=0x7fa0d400a250 comp rx=0 tx=0).stop 2024-09-21T04:00:56.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.995+0000 7fa0e9239640 1 -- 172.21.15.22:0/3631357420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0e4109df0 msgr2=0x7fa0e419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.995+0000 7fa0e9239640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0e4109df0 0x7fa0e419fd00 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc005cc0 tx=0x7fa0dc032c40 comp rx=0 tx=0).stop 2024-09-21T04:00:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.995+0000 7fa0e9239640 1 -- 172.21.15.22:0/3631357420 shutdown_connections 2024-09-21T04:00:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.995+0000 7fa0e9239640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa0cc0b65a0 0x7fa0cc0b8ab0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.995+0000 7fa0e9239640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa0e41094a0 0x7fa0e419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.995+0000 7fa0e9239640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa0e4109df0 0x7fa0e419fd00 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.995+0000 7fa0e9239640 1 --2- 172.21.15.22:0/3631357420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa0e4103b60 0x7fa0e419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.995+0000 7fa0e9239640 1 -- 172.21.15.22:0/3631357420 >> 172.21.15.22:0/3631357420 conn(0x7fa0e407b850 msgr2=0x7fa0e4105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.996+0000 7fa0e9239640 1 -- 172.21.15.22:0/3631357420 shutdown_connections 2024-09-21T04:00:56.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:56.996+0000 7fa0e9239640 1 -- 172.21.15.22:0/3631357420 wait complete. 2024-09-21T04:00:57.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:57 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3631357420' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:57.360 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:57 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:00:57.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:57 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3631357420' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:57.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:57 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:00:57.673 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T04:00:57.674 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T04:00:57.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:57 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3631357420' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:00:57.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:57 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:00:58.251 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:00:58.374 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:58 smithi022 ceph-mon[31015]: pgmap v327: 129 pgs: 129 active+clean; 635 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 19 op/s 2024-09-21T04:00:58.451 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:58 smithi060 ceph-mon[33722]: pgmap v327: 129 pgs: 129 active+clean; 635 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 19 op/s 2024-09-21T04:00:58.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:58 smithi073 ceph-mon[34443]: pgmap v327: 129 pgs: 129 active+clean; 635 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 KiB/s wr, 19 op/s 2024-09-21T04:00:58.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.774+0000 7f45eaed3640 1 -- 172.21.15.22:0/265083126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45e4108cf0 msgr2=0x7f45e410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:58.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.774+0000 7f45eaed3640 1 --2- 172.21.15.22:0/265083126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45e4108cf0 0x7f45e410f520 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f45dc009ca0 tx=0x7f45dc02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:00:58.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.774+0000 7f45eaed3640 1 -- 172.21.15.22:0/265083126 shutdown_connections 2024-09-21T04:00:58.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.774+0000 7f45eaed3640 1 --2- 172.21.15.22:0/265083126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45e4108cf0 0x7f45e410f520 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:58.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.774+0000 7f45eaed3640 1 --2- 172.21.15.22:0/265083126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e41083a0 0x7f45e41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:58.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.774+0000 7f45eaed3640 1 --2- 172.21.15.22:0/265083126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4102a60 0x7f45e4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:58.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.774+0000 7f45eaed3640 1 -- 172.21.15.22:0/265083126 >> 172.21.15.22:0/265083126 conn(0x7f45e4079720 msgr2=0x7f45e4079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:58.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.774+0000 7f45eaed3640 1 -- 172.21.15.22:0/265083126 shutdown_connections 2024-09-21T04:00:58.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.774+0000 7f45eaed3640 1 -- 172.21.15.22:0/265083126 wait complete. 2024-09-21T04:00:58.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45eaed3640 1 Processor -- start 2024-09-21T04:00:58.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45eaed3640 1 -- start start 2024-09-21T04:00:58.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45eaed3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4102a60 0x7f45e4199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:58.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45eaed3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e41083a0 0x7f45e4199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45eaed3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45e4108cf0 0x7f45e419ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45eaed3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f45e4112860 con 0x7f45e4108cf0 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45eaed3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41126e0 con 0x7f45e41083a0 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45eaed3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f45e41129e0 con 0x7f45e4102a60 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45e9470640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45e4108cf0 0x7f45e419ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45e8c6f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4102a60 0x7f45e4199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45e9470640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45e4108cf0 0x7f45e419ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:60664/0 (socket says 172.21.15.22:60664) 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45e9470640 1 -- 172.21.15.22:0/2716267563 learned_addr learned my addr 172.21.15.22:0/2716267563 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.775+0000 7f45e3fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e41083a0 0x7f45e4199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45e9470640 1 -- 172.21.15.22:0/2716267563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4102a60 msgr2=0x7f45e4199290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:58.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45e9470640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4102a60 0x7f45e4199290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:58.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45e9470640 1 -- 172.21.15.22:0/2716267563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e41083a0 msgr2=0x7f45e4199830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:58.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45e9470640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e41083a0 0x7f45e4199830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:58.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45e9470640 1 -- 172.21.15.22:0/2716267563 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e419f200 con 0x7f45e4108cf0 2024-09-21T04:00:58.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45e8c6f640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4102a60 0x7f45e4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:00:58.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45e9470640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45e4108cf0 0x7f45e419ead0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f45dc005e30 tx=0x7f45dc003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:58.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45e1ffb640 1 -- 172.21.15.22:0/2716267563 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc04a070 con 0x7f45e4108cf0 2024-09-21T04:00:58.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45e1ffb640 1 -- 172.21.15.22:0/2716267563 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45dc032ca0 con 0x7f45e4108cf0 2024-09-21T04:00:58.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45eaed3640 1 -- 172.21.15.22:0/2716267563 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e419f490 con 0x7f45e4108cf0 2024-09-21T04:00:58.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45e1ffb640 1 -- 172.21.15.22:0/2716267563 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45dc030980 con 0x7f45e4108cf0 2024-09-21T04:00:58.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.776+0000 7f45eaed3640 1 -- 172.21.15.22:0/2716267563 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e406bb80 con 0x7f45e4108cf0 2024-09-21T04:00:58.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.778+0000 7f45eaed3640 1 -- 172.21.15.22:0/2716267563 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e4103ce0 con 0x7f45e4108cf0 2024-09-21T04:00:58.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.779+0000 7f45e1ffb640 1 -- 172.21.15.22:0/2716267563 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f45dc04d070 con 0x7f45e4108cf0 2024-09-21T04:00:58.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.780+0000 7f45e1ffb640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45cc0b65a0 0x7f45cc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:00:58.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.780+0000 7f45e8c6f640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45cc0b65a0 0x7f45cc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:00:58.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.780+0000 7f45e1ffb640 1 -- 172.21.15.22:0/2716267563 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f45dc109dd0 con 0x7f45e4108cf0 2024-09-21T04:00:58.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.781+0000 7f45e8c6f640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45cc0b65a0 0x7f45cc0b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009fc0 tx=0x7f45d4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:00:58.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.783+0000 7f45e1ffb640 1 -- 172.21.15.22:0/2716267563 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f45dc084710 con 0x7f45e4108cf0 2024-09-21T04:00:58.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.981+0000 7f45eaed3640 1 -- 172.21.15.22:0/2716267563 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f45e406c600 con 0x7f45cc0b65a0 2024-09-21T04:00:58.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.994+0000 7f45e1ffb640 1 -- 172.21.15.22:0/2716267563 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340652 (secure 0 0 0) 0x7f45e406c600 con 0x7f45cc0b65a0 2024-09-21T04:00:58.999 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:00:59.001 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-21T04:00:59.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 -- 172.21.15.22:0/2716267563 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45cc0b65a0 msgr2=0x7f45cc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45cc0b65a0 0x7f45cc0b8ab0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f45d4009fc0 tx=0x7f45d4005f90 comp rx=0 tx=0).stop 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 -- 172.21.15.22:0/2716267563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45e4108cf0 msgr2=0x7f45e419ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45e4108cf0 0x7f45e419ead0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f45dc005e30 tx=0x7f45dc003f30 comp rx=0 tx=0).stop 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 -- 172.21.15.22:0/2716267563 shutdown_connections 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f45cc0b65a0 0x7f45cc0b8ab0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f45e4108cf0 0x7f45e419ead0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f45e41083a0 0x7f45e4199830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 --2- 172.21.15.22:0/2716267563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f45e4102a60 0x7f45e4199290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 -- 172.21.15.22:0/2716267563 >> 172.21.15.22:0/2716267563 conn(0x7f45e4079720 msgr2=0x7f45e4104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 -- 172.21.15.22:0/2716267563 shutdown_connections 2024-09-21T04:00:59.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:00:58.998+0000 7f45eaed3640 1 -- 172.21.15.22:0/2716267563 wait complete. 2024-09-21T04:00:59.781 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-09-21T04:00:58.924744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650649,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":227,"num_read_kb":204,"num_write":358,"num_write_kb":2279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385520,"kb_used_data":11312,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556304,"statfs":{"total":1151940427776,"available":1151545655296,"internally_reserved":0,"allocated":11583488,"data_stored":7617785,"data_compressed":425772,"data_compressed_allocated":577536,"data_compressed_original":2654208,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51955,"num_objects":19,"num_object_clones":0,"num_object_copies":59,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":143,"num_read_kb":130,"num_write":54,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003682"},"pg_stats":[{"pgid":"2.1f","version":"83'13","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:54.239801+0000","last_change":"2024-09-21T04:00:01.985519+0000","last_active":"2024-09-21T04:00:54.239801+0000","last_peered":"2024-09-21T04:00:54.239801+0000","last_clean":"2024-09-21T04:00:54.239801+0000","last_became_active":"2024-09-21T04:00:01.984904+0000","last_became_peered":"2024-09-21T04:00:01.984904+0000","last_unstale":"2024-09-21T04:00:54.239801+0000","last_undegraded":"2024-09-21T04:00:54.239801+0000","last_fullsized":"2024-09-21T04:00:54.239801+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:20.596034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.394991+0000","last_change":"2024-09-21T04:00:04.007864+0000","last_active":"2024-09-21T04:00:30.394991+0000","last_peered":"2024-09-21T04:00:30.394991+0000","last_clean":"2024-09-21T04:00:30.394991+0000","last_became_active":"2024-09-21T04:00:04.007470+0000","last_became_peered":"2024-09-21T04:00:04.007470+0000","last_unstale":"2024-09-21T04:00:30.394991+0000","last_undegraded":"2024-09-21T04:00:30.394991+0000","last_fullsized":"2024-09-21T04:00:30.394991+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:11.452170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.136443+0000","last_change":"2024-09-21T04:00:11.068152+0000","last_active":"2024-09-21T04:00:30.136443+0000","last_peered":"2024-09-21T04:00:30.136443+0000","last_clean":"2024-09-21T04:00:30.136443+0000","last_became_active":"2024-09-21T04:00:11.067647+0000","last_became_peered":"2024-09-21T04:00:11.067647+0000","last_unstale":"2024-09-21T04:00:30.136443+0000","last_undegraded":"2024-09-21T04:00:30.136443+0000","last_fullsized":"2024-09-21T04:00:30.136443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:35.652827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395452+0000","last_change":"2024-09-21T04:00:02.162198+0000","last_active":"2024-09-21T04:00:30.395452+0000","last_peered":"2024-09-21T04:00:30.395452+0000","last_clean":"2024-09-21T04:00:30.395452+0000","last_became_active":"2024-09-21T04:00:02.161840+0000","last_became_peered":"2024-09-21T04:00:02.161840+0000","last_unstale":"2024-09-21T04:00:30.395452+0000","last_undegraded":"2024-09-21T04:00:30.395452+0000","last_fullsized":"2024-09-21T04:00:30.395452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:31.353273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.133357+0000","last_change":"2024-09-21T04:00:03.997274+0000","last_active":"2024-09-21T04:00:30.133357+0000","last_peered":"2024-09-21T04:00:30.133357+0000","last_clean":"2024-09-21T04:00:30.133357+0000","last_became_active":"2024-09-21T04:00:03.996917+0000","last_became_peered":"2024-09-21T04:00:03.996917+0000","last_unstale":"2024-09-21T04:00:30.133357+0000","last_undegraded":"2024-09-21T04:00:30.133357+0000","last_fullsized":"2024-09-21T04:00:30.133357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:05.700703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131535+0000","last_change":"2024-09-21T04:00:11.058687+0000","last_active":"2024-09-21T04:00:30.131535+0000","last_peered":"2024-09-21T04:00:30.131535+0000","last_clean":"2024-09-21T04:00:30.131535+0000","last_became_active":"2024-09-21T04:00:11.058099+0000","last_became_peered":"2024-09-21T04:00:11.058099+0000","last_unstale":"2024-09-21T04:00:30.131535+0000","last_undegraded":"2024-09-21T04:00:30.131535+0000","last_fullsized":"2024-09-21T04:00:30.131535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:50.332295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:45.221823+0000","last_change":"2024-09-21T04:00:01.990262+0000","last_active":"2024-09-21T04:00:45.221823+0000","last_peered":"2024-09-21T04:00:45.221823+0000","last_clean":"2024-09-21T04:00:45.221823+0000","last_became_active":"2024-09-21T04:00:01.989777+0000","last_became_peered":"2024-09-21T04:00:01.989777+0000","last_unstale":"2024-09-21T04:00:45.221823+0000","last_undegraded":"2024-09-21T04:00:45.221823+0000","last_fullsized":"2024-09-21T04:00:45.221823+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:34.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181499+0000","last_change":"2024-09-21T04:00:04.012120+0000","last_active":"2024-09-21T04:00:30.181499+0000","last_peered":"2024-09-21T04:00:30.181499+0000","last_clean":"2024-09-21T04:00:30.181499+0000","last_became_active":"2024-09-21T04:00:04.011648+0000","last_became_peered":"2024-09-21T04:00:04.011648+0000","last_unstale":"2024-09-21T04:00:30.181499+0000","last_undegraded":"2024-09-21T04:00:30.181499+0000","last_fullsized":"2024-09-21T04:00:30.181499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.716845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132193+0000","last_change":"2024-09-21T04:00:11.059509+0000","last_active":"2024-09-21T04:00:30.132193+0000","last_peered":"2024-09-21T04:00:30.132193+0000","last_clean":"2024-09-21T04:00:30.132193+0000","last_became_active":"2024-09-21T04:00:11.058674+0000","last_became_peered":"2024-09-21T04:00:11.058674+0000","last_unstale":"2024-09-21T04:00:30.132193+0000","last_undegraded":"2024-09-21T04:00:30.132193+0000","last_fullsized":"2024-09-21T04:00:30.132193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:13.078117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.220114+0000","last_change":"2024-09-21T04:00:01.987624+0000","last_active":"2024-09-21T04:00:44.220114+0000","last_peered":"2024-09-21T04:00:44.220114+0000","last_clean":"2024-09-21T04:00:44.220114+0000","last_became_active":"2024-09-21T04:00:01.987212+0000","last_became_peered":"2024-09-21T04:00:01.987212+0000","last_unstale":"2024-09-21T04:00:44.220114+0000","last_undegraded":"2024-09-21T04:00:44.220114+0000","last_fullsized":"2024-09-21T04:00:44.220114+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:18.554590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.133008+0000","last_change":"2024-09-21T04:00:04.017507+0000","last_active":"2024-09-21T04:00:30.133008+0000","last_peered":"2024-09-21T04:00:30.133008+0000","last_clean":"2024-09-21T04:00:30.133008+0000","last_became_active":"2024-09-21T04:00:04.017120+0000","last_became_peered":"2024-09-21T04:00:04.017120+0000","last_unstale":"2024-09-21T04:00:30.133008+0000","last_undegraded":"2024-09-21T04:00:30.133008+0000","last_fullsized":"2024-09-21T04:00:30.133008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:19.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132528+0000","last_change":"2024-09-21T04:00:11.055047+0000","last_active":"2024-09-21T04:00:30.132528+0000","last_peered":"2024-09-21T04:00:30.132528+0000","last_clean":"2024-09-21T04:00:30.132528+0000","last_became_active":"2024-09-21T04:00:11.054504+0000","last_became_peered":"2024-09-21T04:00:11.054504+0000","last_unstale":"2024-09-21T04:00:30.132528+0000","last_undegraded":"2024-09-21T04:00:30.132528+0000","last_fullsized":"2024-09-21T04:00:30.132528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.963011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.139283+0000","last_change":"2024-09-21T04:00:04.012633+0000","last_active":"2024-09-21T04:00:30.139283+0000","last_peered":"2024-09-21T04:00:30.139283+0000","last_clean":"2024-09-21T04:00:30.139283+0000","last_became_active":"2024-09-21T04:00:04.012246+0000","last_became_peered":"2024-09-21T04:00:04.012246+0000","last_unstale":"2024-09-21T04:00:30.139283+0000","last_undegraded":"2024-09-21T04:00:30.139283+0000","last_fullsized":"2024-09-21T04:00:30.139283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:58.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:41.195715+0000","last_change":"2024-09-21T04:00:30.144195+0000","last_active":"2024-09-21T04:00:41.195715+0000","last_peered":"2024-09-21T04:00:41.195715+0000","last_clean":"2024-09-21T04:00:41.195715+0000","last_became_active":"2024-09-21T04:00:30.140690+0000","last_became_peered":"2024-09-21T04:00:30.140690+0000","last_unstale":"2024-09-21T04:00:41.195715+0000","last_undegraded":"2024-09-21T04:00:41.195715+0000","last_fullsized":"2024-09-21T04:00:41.195715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:42.686216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132528+0000","last_change":"2024-09-21T04:00:11.333935+0000","last_active":"2024-09-21T04:00:30.132528+0000","last_peered":"2024-09-21T04:00:30.132528+0000","last_clean":"2024-09-21T04:00:30.132528+0000","last_became_active":"2024-09-21T04:00:11.333336+0000","last_became_peered":"2024-09-21T04:00:11.333336+0000","last_unstale":"2024-09-21T04:00:30.132528+0000","last_undegraded":"2024-09-21T04:00:30.132528+0000","last_fullsized":"2024-09-21T04:00:30.132528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:23.890845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.394802+0000","last_change":"2024-09-21T04:00:04.002579+0000","last_active":"2024-09-21T04:00:30.394802+0000","last_peered":"2024-09-21T04:00:30.394802+0000","last_clean":"2024-09-21T04:00:30.394802+0000","last_became_active":"2024-09-21T04:00:04.001926+0000","last_became_peered":"2024-09-21T04:00:04.001926+0000","last_unstale":"2024-09-21T04:00:30.394802+0000","last_undegraded":"2024-09-21T04:00:30.394802+0000","last_fullsized":"2024-09-21T04:00:30.394802+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:11.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:43.212027+0000","last_change":"2024-09-21T04:00:01.983276+0000","last_active":"2024-09-21T04:00:43.212027+0000","last_peered":"2024-09-21T04:00:43.212027+0000","last_clean":"2024-09-21T04:00:43.212027+0000","last_became_active":"2024-09-21T04:00:01.982828+0000","last_became_peered":"2024-09-21T04:00:01.982828+0000","last_unstale":"2024-09-21T04:00:43.212027+0000","last_undegraded":"2024-09-21T04:00:43.212027+0000","last_fullsized":"2024-09-21T04:00:43.212027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:52.266947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132881+0000","last_change":"2024-09-21T04:00:11.067529+0000","last_active":"2024-09-21T04:00:30.132881+0000","last_peered":"2024-09-21T04:00:30.132881+0000","last_clean":"2024-09-21T04:00:30.132881+0000","last_became_active":"2024-09-21T04:00:11.066975+0000","last_became_peered":"2024-09-21T04:00:11.066975+0000","last_unstale":"2024-09-21T04:00:30.132881+0000","last_undegraded":"2024-09-21T04:00:30.132881+0000","last_fullsized":"2024-09-21T04:00:30.132881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:09.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348079+0000","last_change":"2024-09-21T04:00:04.005822+0000","last_active":"2024-09-21T04:00:30.348079+0000","last_peered":"2024-09-21T04:00:30.348079+0000","last_clean":"2024-09-21T04:00:30.348079+0000","last_became_active":"2024-09-21T04:00:04.005468+0000","last_became_peered":"2024-09-21T04:00:04.005468+0000","last_unstale":"2024-09-21T04:00:30.348079+0000","last_undegraded":"2024-09-21T04:00:30.348079+0000","last_fullsized":"2024-09-21T04:00:30.348079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:08.863103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.220273+0000","last_change":"2024-09-21T04:00:01.984489+0000","last_active":"2024-09-21T04:00:44.220273+0000","last_peered":"2024-09-21T04:00:44.220273+0000","last_clean":"2024-09-21T04:00:44.220273+0000","last_became_active":"2024-09-21T04:00:01.983873+0000","last_became_peered":"2024-09-21T04:00:01.983873+0000","last_unstale":"2024-09-21T04:00:44.220273+0000","last_undegraded":"2024-09-21T04:00:44.220273+0000","last_fullsized":"2024-09-21T04:00:44.220273+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:22.717693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131411+0000","last_change":"2024-09-21T04:00:11.069148+0000","last_active":"2024-09-21T04:00:30.131411+0000","last_peered":"2024-09-21T04:00:30.131411+0000","last_clean":"2024-09-21T04:00:30.131411+0000","last_became_active":"2024-09-21T04:00:11.068723+0000","last_became_peered":"2024-09-21T04:00:11.068723+0000","last_unstale":"2024-09-21T04:00:30.131411+0000","last_undegraded":"2024-09-21T04:00:30.131411+0000","last_fullsized":"2024-09-21T04:00:30.131411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:42.822525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132332+0000","last_change":"2024-09-21T04:00:04.000526+0000","last_active":"2024-09-21T04:00:30.132332+0000","last_peered":"2024-09-21T04:00:30.132332+0000","last_clean":"2024-09-21T04:00:30.132332+0000","last_became_active":"2024-09-21T04:00:04.000137+0000","last_became_peered":"2024-09-21T04:00:04.000137+0000","last_unstale":"2024-09-21T04:00:30.132332+0000","last_undegraded":"2024-09-21T04:00:30.132332+0000","last_fullsized":"2024-09-21T04:00:30.132332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:12.055499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:41.195973+0000","last_change":"2024-09-21T04:00:02.162359+0000","last_active":"2024-09-21T04:00:41.195973+0000","last_peered":"2024-09-21T04:00:41.195973+0000","last_clean":"2024-09-21T04:00:41.195973+0000","last_became_active":"2024-09-21T04:00:02.161946+0000","last_became_peered":"2024-09-21T04:00:02.161946+0000","last_unstale":"2024-09-21T04:00:41.195973+0000","last_undegraded":"2024-09-21T04:00:41.195973+0000","last_fullsized":"2024-09-21T04:00:41.195973+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:18.841278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.138795+0000","last_change":"2024-09-21T04:00:30.138669+0000","last_active":"2024-09-21T04:00:30.138795+0000","last_peered":"2024-09-21T04:00:30.138795+0000","last_clean":"2024-09-21T04:00:30.138795+0000","last_became_active":"2024-09-21T04:00:30.137548+0000","last_became_peered":"2024-09-21T04:00:30.137548+0000","last_unstale":"2024-09-21T04:00:30.138795+0000","last_undegraded":"2024-09-21T04:00:30.138795+0000","last_fullsized":"2024-09-21T04:00:30.138795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:56.867964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.396753+0000","last_change":"2024-09-21T04:00:30.396672+0000","last_active":"2024-09-21T04:00:30.396753+0000","last_peered":"2024-09-21T04:00:30.396753+0000","last_clean":"2024-09-21T04:00:30.396753+0000","last_became_active":"2024-09-21T04:00:30.396066+0000","last_became_peered":"2024-09-21T04:00:30.396066+0000","last_unstale":"2024-09-21T04:00:30.396753+0000","last_undegraded":"2024-09-21T04:00:30.396753+0000","last_fullsized":"2024-09-21T04:00:30.396753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:01.582768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.219508+0000","last_change":"2024-09-21T04:00:02.213481+0000","last_active":"2024-09-21T04:00:44.219508+0000","last_peered":"2024-09-21T04:00:44.219508+0000","last_clean":"2024-09-21T04:00:44.219508+0000","last_became_active":"2024-09-21T04:00:02.213093+0000","last_became_peered":"2024-09-21T04:00:02.213093+0000","last_unstale":"2024-09-21T04:00:44.219508+0000","last_undegraded":"2024-09-21T04:00:44.219508+0000","last_fullsized":"2024-09-21T04:00:44.219508+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:20.700406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.136454+0000","last_change":"2024-09-21T04:00:11.058780+0000","last_active":"2024-09-21T04:00:30.136454+0000","last_peered":"2024-09-21T04:00:30.136454+0000","last_clean":"2024-09-21T04:00:30.136454+0000","last_became_active":"2024-09-21T04:00:11.058309+0000","last_became_peered":"2024-09-21T04:00:11.058309+0000","last_unstale":"2024-09-21T04:00:30.136454+0000","last_undegraded":"2024-09-21T04:00:30.136454+0000","last_fullsized":"2024-09-21T04:00:30.136454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:31.134604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395410+0000","last_change":"2024-09-21T04:00:04.005954+0000","last_active":"2024-09-21T04:00:30.395410+0000","last_peered":"2024-09-21T04:00:30.395410+0000","last_clean":"2024-09-21T04:00:30.395410+0000","last_became_active":"2024-09-21T04:00:04.005609+0000","last_became_peered":"2024-09-21T04:00:04.005609+0000","last_unstale":"2024-09-21T04:00:30.395410+0000","last_undegraded":"2024-09-21T04:00:30.395410+0000","last_fullsized":"2024-09-21T04:00:30.395410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:52.596627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'11","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:53.014617+0000","last_change":"2024-09-21T04:00:01.982700+0000","last_active":"2024-09-21T04:00:53.014617+0000","last_peered":"2024-09-21T04:00:53.014617+0000","last_clean":"2024-09-21T04:00:53.014617+0000","last_became_active":"2024-09-21T04:00:01.982321+0000","last_became_peered":"2024-09-21T04:00:01.982321+0000","last_unstale":"2024-09-21T04:00:53.014617+0000","last_undegraded":"2024-09-21T04:00:53.014617+0000","last_fullsized":"2024-09-21T04:00:53.014617+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:56.088066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.394623+0000","last_change":"2024-09-21T04:00:11.334127+0000","last_active":"2024-09-21T04:00:30.394623+0000","last_peered":"2024-09-21T04:00:30.394623+0000","last_clean":"2024-09-21T04:00:30.394623+0000","last_became_active":"2024-09-21T04:00:11.333601+0000","last_became_peered":"2024-09-21T04:00:11.333601+0000","last_unstale":"2024-09-21T04:00:30.394623+0000","last_undegraded":"2024-09-21T04:00:30.394623+0000","last_fullsized":"2024-09-21T04:00:30.394623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.114185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135553+0000","last_change":"2024-09-21T04:00:03.988967+0000","last_active":"2024-09-21T04:00:30.135553+0000","last_peered":"2024-09-21T04:00:30.135553+0000","last_clean":"2024-09-21T04:00:30.135553+0000","last_became_active":"2024-09-21T04:00:03.988617+0000","last_became_peered":"2024-09-21T04:00:03.988617+0000","last_unstale":"2024-09-21T04:00:30.135553+0000","last_undegraded":"2024-09-21T04:00:30.135553+0000","last_fullsized":"2024-09-21T04:00:30.135553+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.220877+0000","last_change":"2024-09-21T04:00:02.162698+0000","last_active":"2024-09-21T04:00:44.220877+0000","last_peered":"2024-09-21T04:00:44.220877+0000","last_clean":"2024-09-21T04:00:44.220877+0000","last_became_active":"2024-09-21T04:00:02.162254+0000","last_became_peered":"2024-09-21T04:00:02.162254+0000","last_unstale":"2024-09-21T04:00:44.220877+0000","last_undegraded":"2024-09-21T04:00:44.220877+0000","last_fullsized":"2024-09-21T04:00:44.220877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:07.409718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348186+0000","last_change":"2024-09-21T04:00:11.057825+0000","last_active":"2024-09-21T04:00:30.348186+0000","last_peered":"2024-09-21T04:00:30.348186+0000","last_clean":"2024-09-21T04:00:30.348186+0000","last_became_active":"2024-09-21T04:00:11.057308+0000","last_became_peered":"2024-09-21T04:00:11.057308+0000","last_unstale":"2024-09-21T04:00:30.348186+0000","last_undegraded":"2024-09-21T04:00:30.348186+0000","last_fullsized":"2024-09-21T04:00:30.348186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.925835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135182+0000","last_change":"2024-09-21T04:00:03.996631+0000","last_active":"2024-09-21T04:00:30.135182+0000","last_peered":"2024-09-21T04:00:30.135182+0000","last_clean":"2024-09-21T04:00:30.135182+0000","last_became_active":"2024-09-21T04:00:03.996264+0000","last_became_peered":"2024-09-21T04:00:03.996264+0000","last_unstale":"2024-09-21T04:00:30.135182+0000","last_undegraded":"2024-09-21T04:00:30.135182+0000","last_fullsized":"2024-09-21T04:00:30.135182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:27.270843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131269+0000","last_change":"2024-09-21T04:00:02.162450+0000","last_active":"2024-09-21T04:00:30.131269+0000","last_peered":"2024-09-21T04:00:30.131269+0000","last_clean":"2024-09-21T04:00:30.131269+0000","last_became_active":"2024-09-21T04:00:02.161991+0000","last_became_peered":"2024-09-21T04:00:02.161991+0000","last_unstale":"2024-09-21T04:00:30.131269+0000","last_undegraded":"2024-09-21T04:00:30.131269+0000","last_fullsized":"2024-09-21T04:00:30.131269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:09.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132498+0000","last_change":"2024-09-21T04:00:11.333873+0000","last_active":"2024-09-21T04:00:30.132498+0000","last_peered":"2024-09-21T04:00:30.132498+0000","last_clean":"2024-09-21T04:00:30.132498+0000","last_became_active":"2024-09-21T04:00:11.333368+0000","last_became_peered":"2024-09-21T04:00:11.333368+0000","last_unstale":"2024-09-21T04:00:30.132498+0000","last_undegraded":"2024-09-21T04:00:30.132498+0000","last_fullsized":"2024-09-21T04:00:30.132498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:53.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.138441+0000","last_change":"2024-09-21T04:00:30.138320+0000","last_active":"2024-09-21T04:00:30.138441+0000","last_peered":"2024-09-21T04:00:30.138441+0000","last_clean":"2024-09-21T04:00:30.138441+0000","last_became_active":"2024-09-21T04:00:30.137866+0000","last_became_peered":"2024-09-21T04:00:30.137866+0000","last_unstale":"2024-09-21T04:00:30.138441+0000","last_undegraded":"2024-09-21T04:00:30.138441+0000","last_fullsized":"2024-09-21T04:00:30.138441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:39.992746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:57.244466+0000","last_change":"2024-09-21T04:00:01.986355+0000","last_active":"2024-09-21T04:00:57.244466+0000","last_peered":"2024-09-21T04:00:57.244466+0000","last_clean":"2024-09-21T04:00:57.244466+0000","last_became_active":"2024-09-21T04:00:01.985960+0000","last_became_peered":"2024-09-21T04:00:01.985960+0000","last_unstale":"2024-09-21T04:00:57.244466+0000","last_undegraded":"2024-09-21T04:00:57.244466+0000","last_fullsized":"2024-09-21T04:00:57.244466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:08.417218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135582+0000","last_change":"2024-09-21T04:00:11.066363+0000","last_active":"2024-09-21T04:00:30.135582+0000","last_peered":"2024-09-21T04:00:30.135582+0000","last_clean":"2024-09-21T04:00:30.135582+0000","last_became_active":"2024-09-21T04:00:11.065923+0000","last_became_peered":"2024-09-21T04:00:11.065923+0000","last_unstale":"2024-09-21T04:00:30.135582+0000","last_undegraded":"2024-09-21T04:00:30.135582+0000","last_fullsized":"2024-09-21T04:00:30.135582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:49.720377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132115+0000","last_change":"2024-09-21T04:00:04.010139+0000","last_active":"2024-09-21T04:00:30.132115+0000","last_peered":"2024-09-21T04:00:30.132115+0000","last_clean":"2024-09-21T04:00:30.132115+0000","last_became_active":"2024-09-21T04:00:04.009764+0000","last_became_peered":"2024-09-21T04:00:04.009764+0000","last_unstale":"2024-09-21T04:00:30.132115+0000","last_undegraded":"2024-09-21T04:00:30.132115+0000","last_fullsized":"2024-09-21T04:00:30.132115+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:08.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:53.238449+0000","last_change":"2024-09-21T04:00:02.162297+0000","last_active":"2024-09-21T04:00:53.238449+0000","last_peered":"2024-09-21T04:00:53.238449+0000","last_clean":"2024-09-21T04:00:53.238449+0000","last_became_active":"2024-09-21T04:00:02.161884+0000","last_became_peered":"2024-09-21T04:00:02.161884+0000","last_unstale":"2024-09-21T04:00:53.238449+0000","last_undegraded":"2024-09-21T04:00:53.238449+0000","last_fullsized":"2024-09-21T04:00:53.238449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:21.108188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135542+0000","last_change":"2024-09-21T04:00:11.335000+0000","last_active":"2024-09-21T04:00:30.135542+0000","last_peered":"2024-09-21T04:00:30.135542+0000","last_clean":"2024-09-21T04:00:30.135542+0000","last_became_active":"2024-09-21T04:00:11.334529+0000","last_became_peered":"2024-09-21T04:00:11.334529+0000","last_unstale":"2024-09-21T04:00:30.135542+0000","last_undegraded":"2024-09-21T04:00:30.135542+0000","last_fullsized":"2024-09-21T04:00:30.135542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:54.148883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135766+0000","last_change":"2024-09-21T04:00:03.988089+0000","last_active":"2024-09-21T04:00:30.135766+0000","last_peered":"2024-09-21T04:00:30.135766+0000","last_clean":"2024-09-21T04:00:30.135766+0000","last_became_active":"2024-09-21T04:00:03.987641+0000","last_became_peered":"2024-09-21T04:00:03.987641+0000","last_unstale":"2024-09-21T04:00:30.135766+0000","last_undegraded":"2024-09-21T04:00:30.135766+0000","last_fullsized":"2024-09-21T04:00:30.135766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:46.249510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:42.204019+0000","last_change":"2024-09-21T04:00:01.989141+0000","last_active":"2024-09-21T04:00:42.204019+0000","last_peered":"2024-09-21T04:00:42.204019+0000","last_clean":"2024-09-21T04:00:42.204019+0000","last_became_active":"2024-09-21T04:00:01.988772+0000","last_became_peered":"2024-09-21T04:00:01.988772+0000","last_unstale":"2024-09-21T04:00:42.204019+0000","last_undegraded":"2024-09-21T04:00:42.204019+0000","last_fullsized":"2024-09-21T04:00:42.204019+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:28.106233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.349803+0000","last_change":"2024-09-21T04:00:30.349715+0000","last_active":"2024-09-21T04:00:30.349803+0000","last_peered":"2024-09-21T04:00:30.349803+0000","last_clean":"2024-09-21T04:00:30.349803+0000","last_became_active":"2024-09-21T04:00:30.349233+0000","last_became_peered":"2024-09-21T04:00:30.349233+0000","last_unstale":"2024-09-21T04:00:30.349803+0000","last_undegraded":"2024-09-21T04:00:30.349803+0000","last_fullsized":"2024-09-21T04:00:30.349803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.933082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395291+0000","last_change":"2024-09-21T04:00:04.005025+0000","last_active":"2024-09-21T04:00:30.395291+0000","last_peered":"2024-09-21T04:00:30.395291+0000","last_clean":"2024-09-21T04:00:30.395291+0000","last_became_active":"2024-09-21T04:00:04.004697+0000","last_became_peered":"2024-09-21T04:00:04.004697+0000","last_unstale":"2024-09-21T04:00:30.395291+0000","last_undegraded":"2024-09-21T04:00:30.395291+0000","last_fullsized":"2024-09-21T04:00:30.395291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:30.663231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:45.221985+0000","last_change":"2024-09-21T04:00:01.987438+0000","last_active":"2024-09-21T04:00:45.221985+0000","last_peered":"2024-09-21T04:00:45.221985+0000","last_clean":"2024-09-21T04:00:45.221985+0000","last_became_active":"2024-09-21T04:00:01.986995+0000","last_became_peered":"2024-09-21T04:00:01.986995+0000","last_unstale":"2024-09-21T04:00:45.221985+0000","last_undegraded":"2024-09-21T04:00:45.221985+0000","last_fullsized":"2024-09-21T04:00:45.221985+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:16.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":112,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.138429+0000","last_change":"2024-09-21T03:58:47.597000+0000","last_active":"2024-09-21T04:00:30.138429+0000","last_peered":"2024-09-21T04:00:30.138429+0000","last_clean":"2024-09-21T04:00:30.138429+0000","last_became_active":"2024-09-21T03:58:47.590826+0000","last_became_peered":"2024-09-21T03:58:47.590826+0000","last_unstale":"2024-09-21T04:00:30.138429+0000","last_undegraded":"2024-09-21T04:00:30.138429+0000","last_fullsized":"2024-09-21T04:00:30.138429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_clean_scrub_stamp":"2024-09-21T03:55:20.271286+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:53.813660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.139686+0000","last_change":"2024-09-21T04:00:11.057229+0000","last_active":"2024-09-21T04:00:30.139686+0000","last_peered":"2024-09-21T04:00:30.139686+0000","last_clean":"2024-09-21T04:00:30.139686+0000","last_became_active":"2024-09-21T04:00:11.056722+0000","last_became_peered":"2024-09-21T04:00:11.056722+0000","last_unstale":"2024-09-21T04:00:30.139686+0000","last_undegraded":"2024-09-21T04:00:30.139686+0000","last_fullsized":"2024-09-21T04:00:30.139686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:53.311589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.140048+0000","last_change":"2024-09-21T04:00:04.013650+0000","last_active":"2024-09-21T04:00:30.140048+0000","last_peered":"2024-09-21T04:00:30.140048+0000","last_clean":"2024-09-21T04:00:30.140048+0000","last_became_active":"2024-09-21T04:00:04.013284+0000","last_became_peered":"2024-09-21T04:00:04.013284+0000","last_unstale":"2024-09-21T04:00:30.140048+0000","last_undegraded":"2024-09-21T04:00:30.140048+0000","last_fullsized":"2024-09-21T04:00:30.140048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:53.098998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":54,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:53.239846+0000","last_change":"2024-09-21T04:00:02.213332+0000","last_active":"2024-09-21T04:00:53.239846+0000","last_peered":"2024-09-21T04:00:53.239846+0000","last_clean":"2024-09-21T04:00:53.239846+0000","last_became_active":"2024-09-21T04:00:02.212853+0000","last_became_peered":"2024-09-21T04:00:02.212853+0000","last_unstale":"2024-09-21T04:00:53.239846+0000","last_undegraded":"2024-09-21T04:00:53.239846+0000","last_fullsized":"2024-09-21T04:00:53.239846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:52.923489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181210+0000","last_change":"2024-09-21T04:00:11.057139+0000","last_active":"2024-09-21T04:00:30.181210+0000","last_peered":"2024-09-21T04:00:30.181210+0000","last_clean":"2024-09-21T04:00:30.181210+0000","last_became_active":"2024-09-21T04:00:11.056549+0000","last_became_peered":"2024-09-21T04:00:11.056549+0000","last_unstale":"2024-09-21T04:00:30.181210+0000","last_undegraded":"2024-09-21T04:00:30.181210+0000","last_fullsized":"2024-09-21T04:00:30.181210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:28.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.141420+0000","last_change":"2024-09-21T04:00:30.141278+0000","last_active":"2024-09-21T04:00:30.141420+0000","last_peered":"2024-09-21T04:00:30.141420+0000","last_clean":"2024-09-21T04:00:30.141420+0000","last_became_active":"2024-09-21T04:00:30.140692+0000","last_became_peered":"2024-09-21T04:00:30.140692+0000","last_unstale":"2024-09-21T04:00:30.141420+0000","last_undegraded":"2024-09-21T04:00:30.141420+0000","last_fullsized":"2024-09-21T04:00:30.141420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:15.600486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.217144+0000","last_change":"2024-09-21T04:00:01.990532+0000","last_active":"2024-09-21T04:00:44.217144+0000","last_peered":"2024-09-21T04:00:44.217144+0000","last_clean":"2024-09-21T04:00:44.217144+0000","last_became_active":"2024-09-21T04:00:01.990114+0000","last_became_peered":"2024-09-21T04:00:01.990114+0000","last_unstale":"2024-09-21T04:00:44.217144+0000","last_undegraded":"2024-09-21T04:00:44.217144+0000","last_fullsized":"2024-09-21T04:00:44.217144+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:51.313576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.182292+0000","last_change":"2024-09-21T04:00:30.182161+0000","last_active":"2024-09-21T04:00:30.182292+0000","last_peered":"2024-09-21T04:00:30.182292+0000","last_clean":"2024-09-21T04:00:30.182292+0000","last_became_active":"2024-09-21T04:00:30.181777+0000","last_became_peered":"2024-09-21T04:00:30.181777+0000","last_unstale":"2024-09-21T04:00:30.182292+0000","last_undegraded":"2024-09-21T04:00:30.182292+0000","last_fullsized":"2024-09-21T04:00:30.182292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:35.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.140262+0000","last_change":"2024-09-21T04:00:04.006784+0000","last_active":"2024-09-21T04:00:30.140262+0000","last_peered":"2024-09-21T04:00:30.140262+0000","last_clean":"2024-09-21T04:00:30.140262+0000","last_became_active":"2024-09-21T04:00:04.003841+0000","last_became_peered":"2024-09-21T04:00:04.003841+0000","last_unstale":"2024-09-21T04:00:30.140262+0000","last_undegraded":"2024-09-21T04:00:30.140262+0000","last_fullsized":"2024-09-21T04:00:30.140262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:50.088980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.220437+0000","last_change":"2024-09-21T04:00:01.986202+0000","last_active":"2024-09-21T04:00:44.220437+0000","last_peered":"2024-09-21T04:00:44.220437+0000","last_clean":"2024-09-21T04:00:44.220437+0000","last_became_active":"2024-09-21T04:00:01.985812+0000","last_became_peered":"2024-09-21T04:00:01.985812+0000","last_unstale":"2024-09-21T04:00:44.220437+0000","last_undegraded":"2024-09-21T04:00:44.220437+0000","last_fullsized":"2024-09-21T04:00:44.220437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:05.777175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131567+0000","last_change":"2024-09-21T04:00:11.057253+0000","last_active":"2024-09-21T04:00:30.131567+0000","last_peered":"2024-09-21T04:00:30.131567+0000","last_clean":"2024-09-21T04:00:30.131567+0000","last_became_active":"2024-09-21T04:00:11.056721+0000","last_became_peered":"2024-09-21T04:00:11.056721+0000","last_unstale":"2024-09-21T04:00:30.131567+0000","last_undegraded":"2024-09-21T04:00:30.131567+0000","last_fullsized":"2024-09-21T04:00:30.131567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:19.202714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348559+0000","last_change":"2024-09-21T04:00:04.003674+0000","last_active":"2024-09-21T04:00:30.348559+0000","last_peered":"2024-09-21T04:00:30.348559+0000","last_clean":"2024-09-21T04:00:30.348559+0000","last_became_active":"2024-09-21T04:00:04.003297+0000","last_became_peered":"2024-09-21T04:00:04.003297+0000","last_unstale":"2024-09-21T04:00:30.348559+0000","last_undegraded":"2024-09-21T04:00:30.348559+0000","last_fullsized":"2024-09-21T04:00:30.348559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.063721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.198218+0000","last_change":"2024-09-21T04:00:01.986007+0000","last_active":"2024-09-21T04:00:44.198218+0000","last_peered":"2024-09-21T04:00:44.198218+0000","last_clean":"2024-09-21T04:00:44.198218+0000","last_became_active":"2024-09-21T04:00:01.985582+0000","last_became_peered":"2024-09-21T04:00:01.985582+0000","last_unstale":"2024-09-21T04:00:44.198218+0000","last_undegraded":"2024-09-21T04:00:44.198218+0000","last_fullsized":"2024-09-21T04:00:44.198218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:48.429307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131735+0000","last_change":"2024-09-21T04:00:11.061522+0000","last_active":"2024-09-21T04:00:30.131735+0000","last_peered":"2024-09-21T04:00:30.131735+0000","last_clean":"2024-09-21T04:00:30.131735+0000","last_became_active":"2024-09-21T04:00:11.060984+0000","last_became_peered":"2024-09-21T04:00:11.060984+0000","last_unstale":"2024-09-21T04:00:30.131735+0000","last_undegraded":"2024-09-21T04:00:30.131735+0000","last_fullsized":"2024-09-21T04:00:30.131735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:51.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132022+0000","last_change":"2024-09-21T04:00:04.016468+0000","last_active":"2024-09-21T04:00:30.132022+0000","last_peered":"2024-09-21T04:00:30.132022+0000","last_clean":"2024-09-21T04:00:30.132022+0000","last_became_active":"2024-09-21T04:00:04.016177+0000","last_became_peered":"2024-09-21T04:00:04.016177+0000","last_unstale":"2024-09-21T04:00:30.132022+0000","last_undegraded":"2024-09-21T04:00:30.132022+0000","last_fullsized":"2024-09-21T04:00:30.132022+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:58.670552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.219965+0000","last_change":"2024-09-21T04:00:02.162746+0000","last_active":"2024-09-21T04:00:44.219965+0000","last_peered":"2024-09-21T04:00:44.219965+0000","last_clean":"2024-09-21T04:00:44.219965+0000","last_became_active":"2024-09-21T04:00:02.162121+0000","last_became_peered":"2024-09-21T04:00:02.162121+0000","last_unstale":"2024-09-21T04:00:44.219965+0000","last_undegraded":"2024-09-21T04:00:44.219965+0000","last_fullsized":"2024-09-21T04:00:44.219965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:02.798790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135411+0000","last_change":"2024-09-21T04:00:11.068043+0000","last_active":"2024-09-21T04:00:30.135411+0000","last_peered":"2024-09-21T04:00:30.135411+0000","last_clean":"2024-09-21T04:00:30.135411+0000","last_became_active":"2024-09-21T04:00:11.067553+0000","last_became_peered":"2024-09-21T04:00:11.067553+0000","last_unstale":"2024-09-21T04:00:30.135411+0000","last_undegraded":"2024-09-21T04:00:30.135411+0000","last_fullsized":"2024-09-21T04:00:30.135411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:34.095708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.137711+0000","last_change":"2024-09-21T04:00:04.010725+0000","last_active":"2024-09-21T04:00:30.137711+0000","last_peered":"2024-09-21T04:00:30.137711+0000","last_clean":"2024-09-21T04:00:30.137711+0000","last_became_active":"2024-09-21T04:00:04.010295+0000","last_became_peered":"2024-09-21T04:00:04.010295+0000","last_unstale":"2024-09-21T04:00:30.137711+0000","last_undegraded":"2024-09-21T04:00:30.137711+0000","last_fullsized":"2024-09-21T04:00:30.137711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:40.417814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:55.242362+0000","last_change":"2024-09-21T04:00:01.985123+0000","last_active":"2024-09-21T04:00:55.242362+0000","last_peered":"2024-09-21T04:00:55.242362+0000","last_clean":"2024-09-21T04:00:55.242362+0000","last_became_active":"2024-09-21T04:00:01.984686+0000","last_became_peered":"2024-09-21T04:00:01.984686+0000","last_unstale":"2024-09-21T04:00:55.242362+0000","last_undegraded":"2024-09-21T04:00:55.242362+0000","last_fullsized":"2024-09-21T04:00:55.242362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:18.825567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131522+0000","last_change":"2024-09-21T04:00:11.068045+0000","last_active":"2024-09-21T04:00:30.131522+0000","last_peered":"2024-09-21T04:00:30.131522+0000","last_clean":"2024-09-21T04:00:30.131522+0000","last_became_active":"2024-09-21T04:00:11.067528+0000","last_became_peered":"2024-09-21T04:00:11.067528+0000","last_unstale":"2024-09-21T04:00:30.131522+0000","last_undegraded":"2024-09-21T04:00:30.131522+0000","last_fullsized":"2024-09-21T04:00:30.131522+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:54.054763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.139022+0000","last_change":"2024-09-21T04:00:04.008068+0000","last_active":"2024-09-21T04:00:30.139022+0000","last_peered":"2024-09-21T04:00:30.139022+0000","last_clean":"2024-09-21T04:00:30.139022+0000","last_became_active":"2024-09-21T04:00:04.007611+0000","last_became_peered":"2024-09-21T04:00:04.007611+0000","last_unstale":"2024-09-21T04:00:30.139022+0000","last_undegraded":"2024-09-21T04:00:30.139022+0000","last_fullsized":"2024-09-21T04:00:30.139022+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:02.363722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.218758+0000","last_change":"2024-09-21T04:00:01.986011+0000","last_active":"2024-09-21T04:00:44.218758+0000","last_peered":"2024-09-21T04:00:44.218758+0000","last_clean":"2024-09-21T04:00:44.218758+0000","last_became_active":"2024-09-21T04:00:01.985637+0000","last_became_peered":"2024-09-21T04:00:01.985637+0000","last_unstale":"2024-09-21T04:00:44.218758+0000","last_undegraded":"2024-09-21T04:00:44.218758+0000","last_fullsized":"2024-09-21T04:00:44.218758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:36.226063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348235+0000","last_change":"2024-09-21T04:00:11.067798+0000","last_active":"2024-09-21T04:00:30.348235+0000","last_peered":"2024-09-21T04:00:30.348235+0000","last_clean":"2024-09-21T04:00:30.348235+0000","last_became_active":"2024-09-21T04:00:11.067319+0000","last_became_peered":"2024-09-21T04:00:11.067319+0000","last_unstale":"2024-09-21T04:00:30.348235+0000","last_undegraded":"2024-09-21T04:00:30.348235+0000","last_fullsized":"2024-09-21T04:00:30.348235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:37.118986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135482+0000","last_change":"2024-09-21T04:00:04.003222+0000","last_active":"2024-09-21T04:00:30.135482+0000","last_peered":"2024-09-21T04:00:30.135482+0000","last_clean":"2024-09-21T04:00:30.135482+0000","last_became_active":"2024-09-21T04:00:04.002893+0000","last_became_peered":"2024-09-21T04:00:04.002893+0000","last_unstale":"2024-09-21T04:00:30.135482+0000","last_undegraded":"2024-09-21T04:00:30.135482+0000","last_fullsized":"2024-09-21T04:00:30.135482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:18.806695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:45.221978+0000","last_change":"2024-09-21T04:00:01.985978+0000","last_active":"2024-09-21T04:00:45.221978+0000","last_peered":"2024-09-21T04:00:45.221978+0000","last_clean":"2024-09-21T04:00:45.221978+0000","last_became_active":"2024-09-21T04:00:01.985607+0000","last_became_peered":"2024-09-21T04:00:01.985607+0000","last_unstale":"2024-09-21T04:00:45.221978+0000","last_undegraded":"2024-09-21T04:00:45.221978+0000","last_fullsized":"2024-09-21T04:00:45.221978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:30.113727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132867+0000","last_change":"2024-09-21T04:00:11.069332+0000","last_active":"2024-09-21T04:00:30.132867+0000","last_peered":"2024-09-21T04:00:30.132867+0000","last_clean":"2024-09-21T04:00:30.132867+0000","last_became_active":"2024-09-21T04:00:11.068832+0000","last_became_peered":"2024-09-21T04:00:11.068832+0000","last_unstale":"2024-09-21T04:00:30.132867+0000","last_undegraded":"2024-09-21T04:00:30.132867+0000","last_fullsized":"2024-09-21T04:00:30.132867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:03.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.133277+0000","last_change":"2024-09-21T04:00:04.004234+0000","last_active":"2024-09-21T04:00:30.133277+0000","last_peered":"2024-09-21T04:00:30.133277+0000","last_clean":"2024-09-21T04:00:30.133277+0000","last_became_active":"2024-09-21T04:00:04.003839+0000","last_became_peered":"2024-09-21T04:00:04.003839+0000","last_unstale":"2024-09-21T04:00:30.133277+0000","last_undegraded":"2024-09-21T04:00:30.133277+0000","last_fullsized":"2024-09-21T04:00:30.133277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.971580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'28","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:55.243744+0000","last_change":"2024-09-21T04:00:01.990623+0000","last_active":"2024-09-21T04:00:55.243744+0000","last_peered":"2024-09-21T04:00:55.243744+0000","last_clean":"2024-09-21T04:00:55.243744+0000","last_became_active":"2024-09-21T04:00:01.990030+0000","last_became_peered":"2024-09-21T04:00:01.990030+0000","last_unstale":"2024-09-21T04:00:55.243744+0000","last_undegraded":"2024-09-21T04:00:55.243744+0000","last_fullsized":"2024-09-21T04:00:55.243744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:07.150261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53234,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":66,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.130838+0000","last_change":"2024-09-21T04:00:11.064198+0000","last_active":"2024-09-21T04:00:30.130838+0000","last_peered":"2024-09-21T04:00:30.130838+0000","last_clean":"2024-09-21T04:00:30.130838+0000","last_became_active":"2024-09-21T04:00:11.063519+0000","last_became_peered":"2024-09-21T04:00:11.063519+0000","last_unstale":"2024-09-21T04:00:30.130838+0000","last_undegraded":"2024-09-21T04:00:30.130838+0000","last_fullsized":"2024-09-21T04:00:30.130838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:16.189027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181506+0000","last_change":"2024-09-21T04:00:04.009685+0000","last_active":"2024-09-21T04:00:30.181506+0000","last_peered":"2024-09-21T04:00:30.181506+0000","last_clean":"2024-09-21T04:00:30.181506+0000","last_became_active":"2024-09-21T04:00:04.009217+0000","last_became_peered":"2024-09-21T04:00:04.009217+0000","last_unstale":"2024-09-21T04:00:30.181506+0000","last_undegraded":"2024-09-21T04:00:30.181506+0000","last_fullsized":"2024-09-21T04:00:30.181506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:31.780399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:43.213491+0000","last_change":"2024-09-21T04:00:02.164467+0000","last_active":"2024-09-21T04:00:43.213491+0000","last_peered":"2024-09-21T04:00:43.213491+0000","last_clean":"2024-09-21T04:00:43.213491+0000","last_became_active":"2024-09-21T04:00:02.164091+0000","last_became_peered":"2024-09-21T04:00:02.164091+0000","last_unstale":"2024-09-21T04:00:43.213491+0000","last_undegraded":"2024-09-21T04:00:43.213491+0000","last_fullsized":"2024-09-21T04:00:43.213491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:12.327745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132051+0000","last_change":"2024-09-21T04:00:11.058828+0000","last_active":"2024-09-21T04:00:30.132051+0000","last_peered":"2024-09-21T04:00:30.132051+0000","last_clean":"2024-09-21T04:00:30.132051+0000","last_became_active":"2024-09-21T04:00:11.058188+0000","last_became_peered":"2024-09-21T04:00:11.058188+0000","last_unstale":"2024-09-21T04:00:30.132051+0000","last_undegraded":"2024-09-21T04:00:30.132051+0000","last_fullsized":"2024-09-21T04:00:30.132051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.767306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.133855+0000","last_change":"2024-09-21T04:00:04.004693+0000","last_active":"2024-09-21T04:00:30.133855+0000","last_peered":"2024-09-21T04:00:30.133855+0000","last_clean":"2024-09-21T04:00:30.133855+0000","last_became_active":"2024-09-21T04:00:04.004357+0000","last_became_peered":"2024-09-21T04:00:04.004357+0000","last_unstale":"2024-09-21T04:00:30.133855+0000","last_undegraded":"2024-09-21T04:00:30.133855+0000","last_fullsized":"2024-09-21T04:00:30.133855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.218860+0000","last_change":"2024-09-21T04:00:01.987319+0000","last_active":"2024-09-21T04:00:44.218860+0000","last_peered":"2024-09-21T04:00:44.218860+0000","last_clean":"2024-09-21T04:00:44.218860+0000","last_became_active":"2024-09-21T04:00:01.986012+0000","last_became_peered":"2024-09-21T04:00:01.986012+0000","last_unstale":"2024-09-21T04:00:44.218860+0000","last_undegraded":"2024-09-21T04:00:44.218860+0000","last_fullsized":"2024-09-21T04:00:44.218860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:03.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.139664+0000","last_change":"2024-09-21T04:00:30.139534+0000","last_active":"2024-09-21T04:00:30.139664+0000","last_peered":"2024-09-21T04:00:30.139664+0000","last_clean":"2024-09-21T04:00:30.139664+0000","last_became_active":"2024-09-21T04:00:30.138954+0000","last_became_peered":"2024-09-21T04:00:30.138954+0000","last_unstale":"2024-09-21T04:00:30.139664+0000","last_undegraded":"2024-09-21T04:00:30.139664+0000","last_fullsized":"2024-09-21T04:00:30.139664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:21.368007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181590+0000","last_change":"2024-09-21T04:00:04.013737+0000","last_active":"2024-09-21T04:00:30.181590+0000","last_peered":"2024-09-21T04:00:30.181590+0000","last_clean":"2024-09-21T04:00:30.181590+0000","last_became_active":"2024-09-21T04:00:04.012901+0000","last_became_peered":"2024-09-21T04:00:04.012901+0000","last_unstale":"2024-09-21T04:00:30.181590+0000","last_undegraded":"2024-09-21T04:00:30.181590+0000","last_fullsized":"2024-09-21T04:00:30.181590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:50.952778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":63,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:55.242175+0000","last_change":"2024-09-21T04:00:01.987988+0000","last_active":"2024-09-21T04:00:55.242175+0000","last_peered":"2024-09-21T04:00:55.242175+0000","last_clean":"2024-09-21T04:00:55.242175+0000","last_became_active":"2024-09-21T04:00:01.986593+0000","last_became_peered":"2024-09-21T04:00:01.986593+0000","last_unstale":"2024-09-21T04:00:55.242175+0000","last_undegraded":"2024-09-21T04:00:55.242175+0000","last_fullsized":"2024-09-21T04:00:55.242175+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.256609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395293+0000","last_change":"2024-09-21T04:00:11.064937+0000","last_active":"2024-09-21T04:00:30.395293+0000","last_peered":"2024-09-21T04:00:30.395293+0000","last_clean":"2024-09-21T04:00:30.395293+0000","last_became_active":"2024-09-21T04:00:11.063809+0000","last_became_peered":"2024-09-21T04:00:11.063809+0000","last_unstale":"2024-09-21T04:00:30.395293+0000","last_undegraded":"2024-09-21T04:00:30.395293+0000","last_fullsized":"2024-09-21T04:00:30.395293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:00.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132621+0000","last_change":"2024-09-21T04:00:11.068084+0000","last_active":"2024-09-21T04:00:30.132621+0000","last_peered":"2024-09-21T04:00:30.132621+0000","last_clean":"2024-09-21T04:00:30.132621+0000","last_became_active":"2024-09-21T04:00:11.067587+0000","last_became_peered":"2024-09-21T04:00:11.067587+0000","last_unstale":"2024-09-21T04:00:30.132621+0000","last_undegraded":"2024-09-21T04:00:30.132621+0000","last_fullsized":"2024-09-21T04:00:30.132621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:30.849467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131008+0000","last_change":"2024-09-21T04:00:03.997501+0000","last_active":"2024-09-21T04:00:30.131008+0000","last_peered":"2024-09-21T04:00:30.131008+0000","last_clean":"2024-09-21T04:00:30.131008+0000","last_became_active":"2024-09-21T04:00:03.997100+0000","last_became_peered":"2024-09-21T04:00:03.997100+0000","last_unstale":"2024-09-21T04:00:30.131008+0000","last_undegraded":"2024-09-21T04:00:30.131008+0000","last_fullsized":"2024-09-21T04:00:30.131008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:31.813970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.218990+0000","last_change":"2024-09-21T04:00:01.986224+0000","last_active":"2024-09-21T04:00:44.218990+0000","last_peered":"2024-09-21T04:00:44.218990+0000","last_clean":"2024-09-21T04:00:44.218990+0000","last_became_active":"2024-09-21T04:00:01.985845+0000","last_became_peered":"2024-09-21T04:00:01.985845+0000","last_unstale":"2024-09-21T04:00:44.218990+0000","last_undegraded":"2024-09-21T04:00:44.218990+0000","last_fullsized":"2024-09-21T04:00:44.218990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:38.895288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348497+0000","last_change":"2024-09-21T04:00:11.067705+0000","last_active":"2024-09-21T04:00:30.348497+0000","last_peered":"2024-09-21T04:00:30.348497+0000","last_clean":"2024-09-21T04:00:30.348497+0000","last_became_active":"2024-09-21T04:00:11.067252+0000","last_became_peered":"2024-09-21T04:00:11.067252+0000","last_unstale":"2024-09-21T04:00:30.348497+0000","last_undegraded":"2024-09-21T04:00:30.348497+0000","last_fullsized":"2024-09-21T04:00:30.348497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:47.003323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395044+0000","last_change":"2024-09-21T04:00:03.996067+0000","last_active":"2024-09-21T04:00:30.395044+0000","last_peered":"2024-09-21T04:00:30.395044+0000","last_clean":"2024-09-21T04:00:30.395044+0000","last_became_active":"2024-09-21T04:00:03.995603+0000","last_became_peered":"2024-09-21T04:00:03.995603+0000","last_unstale":"2024-09-21T04:00:30.395044+0000","last_undegraded":"2024-09-21T04:00:30.395044+0000","last_fullsized":"2024-09-21T04:00:30.395044+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:19.348461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:42.204354+0000","last_change":"2024-09-21T04:00:01.985283+0000","last_active":"2024-09-21T04:00:42.204354+0000","last_peered":"2024-09-21T04:00:42.204354+0000","last_clean":"2024-09-21T04:00:42.204354+0000","last_became_active":"2024-09-21T04:00:01.984860+0000","last_became_peered":"2024-09-21T04:00:01.984860+0000","last_unstale":"2024-09-21T04:00:42.204354+0000","last_undegraded":"2024-09-21T04:00:42.204354+0000","last_fullsized":"2024-09-21T04:00:42.204354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:38.739987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:43.213271+0000","last_change":"2024-09-21T04:00:30.183241+0000","last_active":"2024-09-21T04:00:43.213271+0000","last_peered":"2024-09-21T04:00:43.213271+0000","last_clean":"2024-09-21T04:00:43.213271+0000","last_became_active":"2024-09-21T04:00:30.182788+0000","last_became_peered":"2024-09-21T04:00:30.182788+0000","last_unstale":"2024-09-21T04:00:43.213271+0000","last_undegraded":"2024-09-21T04:00:43.213271+0000","last_fullsized":"2024-09-21T04:00:43.213271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:47.129478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132201+0000","last_change":"2024-09-21T04:00:04.004526+0000","last_active":"2024-09-21T04:00:30.132201+0000","last_peered":"2024-09-21T04:00:30.132201+0000","last_clean":"2024-09-21T04:00:30.132201+0000","last_became_active":"2024-09-21T04:00:04.004114+0000","last_became_peered":"2024-09-21T04:00:04.004114+0000","last_unstale":"2024-09-21T04:00:30.132201+0000","last_undegraded":"2024-09-21T04:00:30.132201+0000","last_fullsized":"2024-09-21T04:00:30.132201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:50.212647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.136657+0000","last_change":"2024-09-21T04:00:11.067811+0000","last_active":"2024-09-21T04:00:30.136657+0000","last_peered":"2024-09-21T04:00:30.136657+0000","last_clean":"2024-09-21T04:00:30.136657+0000","last_became_active":"2024-09-21T04:00:11.067280+0000","last_became_peered":"2024-09-21T04:00:11.067280+0000","last_unstale":"2024-09-21T04:00:30.136657+0000","last_undegraded":"2024-09-21T04:00:30.136657+0000","last_fullsized":"2024-09-21T04:00:30.136657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:08.152231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:56.244480+0000","last_change":"2024-09-21T04:00:01.987215+0000","last_active":"2024-09-21T04:00:56.244480+0000","last_peered":"2024-09-21T04:00:56.244480+0000","last_clean":"2024-09-21T04:00:56.244480+0000","last_became_active":"2024-09-21T04:00:01.986738+0000","last_became_peered":"2024-09-21T04:00:01.986738+0000","last_unstale":"2024-09-21T04:00:56.244480+0000","last_undegraded":"2024-09-21T04:00:56.244480+0000","last_fullsized":"2024-09-21T04:00:56.244480+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:16.204316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132688+0000","last_change":"2024-09-21T04:00:04.003232+0000","last_active":"2024-09-21T04:00:30.132688+0000","last_peered":"2024-09-21T04:00:30.132688+0000","last_clean":"2024-09-21T04:00:30.132688+0000","last_became_active":"2024-09-21T04:00:04.002865+0000","last_became_peered":"2024-09-21T04:00:04.002865+0000","last_unstale":"2024-09-21T04:00:30.132688+0000","last_undegraded":"2024-09-21T04:00:30.132688+0000","last_fullsized":"2024-09-21T04:00:30.132688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:29.298836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.137586+0000","last_change":"2024-09-21T04:00:11.057591+0000","last_active":"2024-09-21T04:00:30.137586+0000","last_peered":"2024-09-21T04:00:30.137586+0000","last_clean":"2024-09-21T04:00:30.137586+0000","last_became_active":"2024-09-21T04:00:11.057092+0000","last_became_peered":"2024-09-21T04:00:11.057092+0000","last_unstale":"2024-09-21T04:00:30.137586+0000","last_undegraded":"2024-09-21T04:00:30.137586+0000","last_fullsized":"2024-09-21T04:00:30.137586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:47.487649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.347982+0000","last_change":"2024-09-21T04:00:04.010297+0000","last_active":"2024-09-21T04:00:30.347982+0000","last_peered":"2024-09-21T04:00:30.347982+0000","last_clean":"2024-09-21T04:00:30.347982+0000","last_became_active":"2024-09-21T04:00:04.009948+0000","last_became_peered":"2024-09-21T04:00:04.009948+0000","last_unstale":"2024-09-21T04:00:30.347982+0000","last_undegraded":"2024-09-21T04:00:30.347982+0000","last_fullsized":"2024-09-21T04:00:30.347982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:07.927430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.136744+0000","last_change":"2024-09-21T04:00:04.005564+0000","last_active":"2024-09-21T04:00:30.136744+0000","last_peered":"2024-09-21T04:00:30.136744+0000","last_clean":"2024-09-21T04:00:30.136744+0000","last_became_active":"2024-09-21T04:00:04.005119+0000","last_became_peered":"2024-09-21T04:00:04.005119+0000","last_unstale":"2024-09-21T04:00:30.136744+0000","last_undegraded":"2024-09-21T04:00:30.136744+0000","last_fullsized":"2024-09-21T04:00:30.136744+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:05.844333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.137110+0000","last_change":"2024-09-21T04:00:03.997004+0000","last_active":"2024-09-21T04:00:30.137110+0000","last_peered":"2024-09-21T04:00:30.137110+0000","last_clean":"2024-09-21T04:00:30.137110+0000","last_became_active":"2024-09-21T04:00:03.996570+0000","last_became_peered":"2024-09-21T04:00:03.996570+0000","last_unstale":"2024-09-21T04:00:30.137110+0000","last_undegraded":"2024-09-21T04:00:30.137110+0000","last_fullsized":"2024-09-21T04:00:30.137110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.134182+0000","last_change":"2024-09-21T04:00:04.005794+0000","last_active":"2024-09-21T04:00:30.134182+0000","last_peered":"2024-09-21T04:00:30.134182+0000","last_clean":"2024-09-21T04:00:30.134182+0000","last_became_active":"2024-09-21T04:00:04.005345+0000","last_became_peered":"2024-09-21T04:00:04.005345+0000","last_unstale":"2024-09-21T04:00:30.134182+0000","last_undegraded":"2024-09-21T04:00:30.134182+0000","last_fullsized":"2024-09-21T04:00:30.134182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:20.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135356+0000","last_change":"2024-09-21T04:00:03.992204+0000","last_active":"2024-09-21T04:00:30.135356+0000","last_peered":"2024-09-21T04:00:30.135356+0000","last_clean":"2024-09-21T04:00:30.135356+0000","last_became_active":"2024-09-21T04:00:03.991826+0000","last_became_peered":"2024-09-21T04:00:03.991826+0000","last_unstale":"2024-09-21T04:00:30.135356+0000","last_undegraded":"2024-09-21T04:00:30.135356+0000","last_fullsized":"2024-09-21T04:00:30.135356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.443227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348543+0000","last_change":"2024-09-21T04:00:04.004401+0000","last_active":"2024-09-21T04:00:30.348543+0000","last_peered":"2024-09-21T04:00:30.348543+0000","last_clean":"2024-09-21T04:00:30.348543+0000","last_became_active":"2024-09-21T04:00:04.003983+0000","last_became_peered":"2024-09-21T04:00:04.003983+0000","last_unstale":"2024-09-21T04:00:30.348543+0000","last_undegraded":"2024-09-21T04:00:30.348543+0000","last_fullsized":"2024-09-21T04:00:30.348543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:06.250069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.137447+0000","last_change":"2024-09-21T04:00:03.999692+0000","last_active":"2024-09-21T04:00:30.137447+0000","last_peered":"2024-09-21T04:00:30.137447+0000","last_clean":"2024-09-21T04:00:30.137447+0000","last_became_active":"2024-09-21T04:00:03.999282+0000","last_became_peered":"2024-09-21T04:00:03.999282+0000","last_unstale":"2024-09-21T04:00:30.137447+0000","last_undegraded":"2024-09-21T04:00:30.137447+0000","last_fullsized":"2024-09-21T04:00:30.137447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.323350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395275+0000","last_change":"2024-09-21T04:00:04.002947+0000","last_active":"2024-09-21T04:00:30.395275+0000","last_peered":"2024-09-21T04:00:30.395275+0000","last_clean":"2024-09-21T04:00:30.395275+0000","last_became_active":"2024-09-21T04:00:04.002550+0000","last_became_peered":"2024-09-21T04:00:04.002550+0000","last_unstale":"2024-09-21T04:00:30.395275+0000","last_undegraded":"2024-09-21T04:00:30.395275+0000","last_fullsized":"2024-09-21T04:00:30.395275+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:17.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131820+0000","last_change":"2024-09-21T04:00:04.009700+0000","last_active":"2024-09-21T04:00:30.131820+0000","last_peered":"2024-09-21T04:00:30.131820+0000","last_clean":"2024-09-21T04:00:30.131820+0000","last_became_active":"2024-09-21T04:00:04.009311+0000","last_became_peered":"2024-09-21T04:00:04.009311+0000","last_unstale":"2024-09-21T04:00:30.131820+0000","last_undegraded":"2024-09-21T04:00:30.131820+0000","last_fullsized":"2024-09-21T04:00:30.131820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.658543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395001+0000","last_change":"2024-09-21T04:00:04.002975+0000","last_active":"2024-09-21T04:00:30.395001+0000","last_peered":"2024-09-21T04:00:30.395001+0000","last_clean":"2024-09-21T04:00:30.395001+0000","last_became_active":"2024-09-21T04:00:04.002608+0000","last_became_peered":"2024-09-21T04:00:04.002608+0000","last_unstale":"2024-09-21T04:00:30.395001+0000","last_undegraded":"2024-09-21T04:00:30.395001+0000","last_fullsized":"2024-09-21T04:00:30.395001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:13.044615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181506+0000","last_change":"2024-09-21T04:00:04.010797+0000","last_active":"2024-09-21T04:00:30.181506+0000","last_peered":"2024-09-21T04:00:30.181506+0000","last_clean":"2024-09-21T04:00:30.181506+0000","last_became_active":"2024-09-21T04:00:04.010377+0000","last_became_peered":"2024-09-21T04:00:04.010377+0000","last_unstale":"2024-09-21T04:00:30.181506+0000","last_undegraded":"2024-09-21T04:00:30.181506+0000","last_fullsized":"2024-09-21T04:00:30.181506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:58.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135262+0000","last_change":"2024-09-21T04:00:04.002841+0000","last_active":"2024-09-21T04:00:30.135262+0000","last_peered":"2024-09-21T04:00:30.135262+0000","last_clean":"2024-09-21T04:00:30.135262+0000","last_became_active":"2024-09-21T04:00:04.002491+0000","last_became_peered":"2024-09-21T04:00:04.002491+0000","last_unstale":"2024-09-21T04:00:30.135262+0000","last_undegraded":"2024-09-21T04:00:30.135262+0000","last_fullsized":"2024-09-21T04:00:30.135262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:52.816860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348286+0000","last_change":"2024-09-21T04:00:04.007238+0000","last_active":"2024-09-21T04:00:30.348286+0000","last_peered":"2024-09-21T04:00:30.348286+0000","last_clean":"2024-09-21T04:00:30.348286+0000","last_became_active":"2024-09-21T04:00:04.006898+0000","last_became_peered":"2024-09-21T04:00:04.006898+0000","last_unstale":"2024-09-21T04:00:30.348286+0000","last_undegraded":"2024-09-21T04:00:30.348286+0000","last_fullsized":"2024-09-21T04:00:30.348286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.957214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.137877+0000","last_change":"2024-09-21T04:00:03.997131+0000","last_active":"2024-09-21T04:00:30.137877+0000","last_peered":"2024-09-21T04:00:30.137877+0000","last_clean":"2024-09-21T04:00:30.137877+0000","last_became_active":"2024-09-21T04:00:03.996711+0000","last_became_peered":"2024-09-21T04:00:03.996711+0000","last_unstale":"2024-09-21T04:00:30.137877+0000","last_undegraded":"2024-09-21T04:00:30.137877+0000","last_fullsized":"2024-09-21T04:00:30.137877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:25.373743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131542+0000","last_change":"2024-09-21T04:00:04.004067+0000","last_active":"2024-09-21T04:00:30.131542+0000","last_peered":"2024-09-21T04:00:30.131542+0000","last_clean":"2024-09-21T04:00:30.131542+0000","last_became_active":"2024-09-21T04:00:04.003707+0000","last_became_peered":"2024-09-21T04:00:04.003707+0000","last_unstale":"2024-09-21T04:00:30.131542+0000","last_undegraded":"2024-09-21T04:00:30.131542+0000","last_fullsized":"2024-09-21T04:00:30.131542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:24.148194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348770+0000","last_change":"2024-09-21T04:00:04.000068+0000","last_active":"2024-09-21T04:00:30.348770+0000","last_peered":"2024-09-21T04:00:30.348770+0000","last_clean":"2024-09-21T04:00:30.348770+0000","last_became_active":"2024-09-21T04:00:03.999709+0000","last_became_peered":"2024-09-21T04:00:03.999709+0000","last_unstale":"2024-09-21T04:00:30.348770+0000","last_undegraded":"2024-09-21T04:00:30.348770+0000","last_fullsized":"2024-09-21T04:00:30.348770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:51.249309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.180986+0000","last_change":"2024-09-21T04:00:04.011884+0000","last_active":"2024-09-21T04:00:30.180986+0000","last_peered":"2024-09-21T04:00:30.180986+0000","last_clean":"2024-09-21T04:00:30.180986+0000","last_became_active":"2024-09-21T04:00:04.011449+0000","last_became_peered":"2024-09-21T04:00:04.011449+0000","last_unstale":"2024-09-21T04:00:30.180986+0000","last_undegraded":"2024-09-21T04:00:30.180986+0000","last_fullsized":"2024-09-21T04:00:30.180986+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:46.948465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132422+0000","last_change":"2024-09-21T04:00:03.992848+0000","last_active":"2024-09-21T04:00:30.132422+0000","last_peered":"2024-09-21T04:00:30.132422+0000","last_clean":"2024-09-21T04:00:30.132422+0000","last_became_active":"2024-09-21T04:00:03.991096+0000","last_became_peered":"2024-09-21T04:00:03.991096+0000","last_unstale":"2024-09-21T04:00:30.132422+0000","last_undegraded":"2024-09-21T04:00:30.132422+0000","last_fullsized":"2024-09-21T04:00:30.132422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:19.599848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132458+0000","last_change":"2024-09-21T04:00:04.000380+0000","last_active":"2024-09-21T04:00:30.132458+0000","last_peered":"2024-09-21T04:00:30.132458+0000","last_clean":"2024-09-21T04:00:30.132458+0000","last_became_active":"2024-09-21T04:00:03.999918+0000","last_became_peered":"2024-09-21T04:00:03.999918+0000","last_unstale":"2024-09-21T04:00:30.132458+0000","last_undegraded":"2024-09-21T04:00:30.132458+0000","last_fullsized":"2024-09-21T04:00:30.132458+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:25.607882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.138159+0000","last_change":"2024-09-21T04:00:30.138053+0000","last_active":"2024-09-21T04:00:30.138159+0000","last_peered":"2024-09-21T04:00:30.138159+0000","last_clean":"2024-09-21T04:00:30.138159+0000","last_became_active":"2024-09-21T04:00:30.137682+0000","last_became_peered":"2024-09-21T04:00:30.137682+0000","last_unstale":"2024-09-21T04:00:30.138159+0000","last_undegraded":"2024-09-21T04:00:30.138159+0000","last_fullsized":"2024-09-21T04:00:30.138159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.031655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132817+0000","last_change":"2024-09-21T04:00:04.004313+0000","last_active":"2024-09-21T04:00:30.132817+0000","last_peered":"2024-09-21T04:00:30.132817+0000","last_clean":"2024-09-21T04:00:30.132817+0000","last_became_active":"2024-09-21T04:00:04.003128+0000","last_became_peered":"2024-09-21T04:00:04.003128+0000","last_unstale":"2024-09-21T04:00:30.132817+0000","last_undegraded":"2024-09-21T04:00:30.132817+0000","last_fullsized":"2024-09-21T04:00:30.132817+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:43.469449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.139897+0000","last_change":"2024-09-21T04:00:04.017136+0000","last_active":"2024-09-21T04:00:30.139897+0000","last_peered":"2024-09-21T04:00:30.139897+0000","last_clean":"2024-09-21T04:00:30.139897+0000","last_became_active":"2024-09-21T04:00:04.016732+0000","last_became_peered":"2024-09-21T04:00:04.016732+0000","last_unstale":"2024-09-21T04:00:30.139897+0000","last_undegraded":"2024-09-21T04:00:30.139897+0000","last_fullsized":"2024-09-21T04:00:30.139897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:04.021078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.136071+0000","last_change":"2024-09-21T04:00:04.012098+0000","last_active":"2024-09-21T04:00:30.136071+0000","last_peered":"2024-09-21T04:00:30.136071+0000","last_clean":"2024-09-21T04:00:30.136071+0000","last_became_active":"2024-09-21T04:00:04.011681+0000","last_became_peered":"2024-09-21T04:00:04.011681+0000","last_unstale":"2024-09-21T04:00:30.136071+0000","last_undegraded":"2024-09-21T04:00:30.136071+0000","last_fullsized":"2024-09-21T04:00:30.136071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:59.202312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181838+0000","last_change":"2024-09-21T04:00:04.017056+0000","last_active":"2024-09-21T04:00:30.181838+0000","last_peered":"2024-09-21T04:00:30.181838+0000","last_clean":"2024-09-21T04:00:30.181838+0000","last_became_active":"2024-09-21T04:00:04.015950+0000","last_became_peered":"2024-09-21T04:00:04.015950+0000","last_unstale":"2024-09-21T04:00:30.181838+0000","last_undegraded":"2024-09-21T04:00:30.181838+0000","last_fullsized":"2024-09-21T04:00:30.181838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:11.267161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.394931+0000","last_change":"2024-09-21T04:00:04.010314+0000","last_active":"2024-09-21T04:00:30.394931+0000","last_peered":"2024-09-21T04:00:30.394931+0000","last_clean":"2024-09-21T04:00:30.394931+0000","last_became_active":"2024-09-21T04:00:04.009917+0000","last_became_peered":"2024-09-21T04:00:04.009917+0000","last_unstale":"2024-09-21T04:00:30.394931+0000","last_undegraded":"2024-09-21T04:00:30.394931+0000","last_fullsized":"2024-09-21T04:00:30.394931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:32.947079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.138830+0000","last_change":"2024-09-21T04:00:04.007104+0000","last_active":"2024-09-21T04:00:30.138830+0000","last_peered":"2024-09-21T04:00:30.138830+0000","last_clean":"2024-09-21T04:00:30.138830+0000","last_became_active":"2024-09-21T04:00:04.006655+0000","last_became_peered":"2024-09-21T04:00:04.006655+0000","last_unstale":"2024-09-21T04:00:30.138830+0000","last_undegraded":"2024-09-21T04:00:30.138830+0000","last_fullsized":"2024-09-21T04:00:30.138830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.834305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.134726+0000","last_change":"2024-09-21T04:00:04.007842+0000","last_active":"2024-09-21T04:00:30.134726+0000","last_peered":"2024-09-21T04:00:30.134726+0000","last_clean":"2024-09-21T04:00:30.134726+0000","last_became_active":"2024-09-21T04:00:04.007223+0000","last_became_peered":"2024-09-21T04:00:04.007223+0000","last_unstale":"2024-09-21T04:00:30.134726+0000","last_undegraded":"2024-09-21T04:00:30.134726+0000","last_fullsized":"2024-09-21T04:00:30.134726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:01.501836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132353+0000","last_change":"2024-09-21T04:00:03.997390+0000","last_active":"2024-09-21T04:00:30.132353+0000","last_peered":"2024-09-21T04:00:30.132353+0000","last_clean":"2024-09-21T04:00:30.132353+0000","last_became_active":"2024-09-21T04:00:03.997075+0000","last_became_peered":"2024-09-21T04:00:03.997075+0000","last_unstale":"2024-09-21T04:00:30.132353+0000","last_undegraded":"2024-09-21T04:00:30.132353+0000","last_fullsized":"2024-09-21T04:00:30.132353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:50.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132678+0000","last_change":"2024-09-21T04:00:04.006203+0000","last_active":"2024-09-21T04:00:30.132678+0000","last_peered":"2024-09-21T04:00:30.132678+0000","last_clean":"2024-09-21T04:00:30.132678+0000","last_became_active":"2024-09-21T04:00:04.005150+0000","last_became_peered":"2024-09-21T04:00:04.005150+0000","last_unstale":"2024-09-21T04:00:30.132678+0000","last_undegraded":"2024-09-21T04:00:30.132678+0000","last_fullsized":"2024-09-21T04:00:30.132678+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:17.635568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132931+0000","last_change":"2024-09-21T04:00:04.011843+0000","last_active":"2024-09-21T04:00:30.132931+0000","last_peered":"2024-09-21T04:00:30.132931+0000","last_clean":"2024-09-21T04:00:30.132931+0000","last_became_active":"2024-09-21T04:00:04.011570+0000","last_became_peered":"2024-09-21T04:00:04.011570+0000","last_unstale":"2024-09-21T04:00:30.132931+0000","last_undegraded":"2024-09-21T04:00:30.132931+0000","last_fullsized":"2024-09-21T04:00:30.132931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:59.883217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132743+0000","last_change":"2024-09-21T04:00:04.002111+0000","last_active":"2024-09-21T04:00:30.132743+0000","last_peered":"2024-09-21T04:00:30.132743+0000","last_clean":"2024-09-21T04:00:30.132743+0000","last_became_active":"2024-09-21T04:00:04.001723+0000","last_became_peered":"2024-09-21T04:00:04.001723+0000","last_unstale":"2024-09-21T04:00:30.132743+0000","last_undegraded":"2024-09-21T04:00:30.132743+0000","last_fullsized":"2024-09-21T04:00:30.132743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:32.595150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348687+0000","last_change":"2024-09-21T04:00:03.998822+0000","last_active":"2024-09-21T04:00:30.348687+0000","last_peered":"2024-09-21T04:00:30.348687+0000","last_clean":"2024-09-21T04:00:30.348687+0000","last_became_active":"2024-09-21T04:00:03.998445+0000","last_became_peered":"2024-09-21T04:00:03.998445+0000","last_unstale":"2024-09-21T04:00:30.348687+0000","last_undegraded":"2024-09-21T04:00:30.348687+0000","last_fullsized":"2024-09-21T04:00:30.348687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.090570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60047,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":151,"num_read_kb":140,"num_write":233,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":180141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282913,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":474769,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972380,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1114819,"data_compressed":62460,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135905,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":478795,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332134,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":475077,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528364,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1071574,"data_compressed":62460,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691889,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":470594,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888119,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":1066765,"data_compressed":62460,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051643,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":474277,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":469911,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":524687,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":524858,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":471659,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":55377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":55206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":54970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T04:00:59.786 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T04:00:59.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:59 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:00:59.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:59 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:00:59.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:59 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:00:59.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:00:59 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:00.092 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:00.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:59 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:00.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:59 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:00.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:59 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:00.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:00:59 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:00.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:59 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:00.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:59 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:00.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:59 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:00.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:00:59 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.595+0000 7f4763423640 1 -- 172.21.15.22:0/2752169752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c1083d0 msgr2=0x7f475c1087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.595+0000 7f4763423640 1 --2- 172.21.15.22:0/2752169752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c1083d0 0x7f475c1087e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4758009900 tx=0x7f475802a3f0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.596+0000 7f4763423640 1 -- 172.21.15.22:0/2752169752 shutdown_connections 2024-09-21T04:01:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.596+0000 7f4763423640 1 --2- 172.21.15.22:0/2752169752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f475c108d20 0x7f475c10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.596+0000 7f4763423640 1 --2- 172.21.15.22:0/2752169752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c1083d0 0x7f475c1087e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.596+0000 7f4763423640 1 --2- 172.21.15.22:0/2752169752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f475c102ae0 0x7f475c102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.596+0000 7f4763423640 1 -- 172.21.15.22:0/2752169752 >> 172.21.15.22:0/2752169752 conn(0x7f475c079760 msgr2=0x7f475c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.596+0000 7f4763423640 1 -- 172.21.15.22:0/2752169752 shutdown_connections 2024-09-21T04:01:00.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.596+0000 7f4763423640 1 -- 172.21.15.22:0/2752169752 wait complete. 2024-09-21T04:01:00.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.596+0000 7f4763423640 1 Processor -- start 2024-09-21T04:01:00.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.596+0000 7f4763423640 1 -- start start 2024-09-21T04:01:00.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f4763423640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f475c102ae0 0x7f475c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f4763423640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c1083d0 0x7f475c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f4763423640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f475c108d20 0x7f475c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f4763423640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f475c113960 con 0x7f475c1083d0 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f4763423640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f475c1137e0 con 0x7f475c102ae0 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f4763423640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f475c113ae0 con 0x7f475c108d20 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f47609be640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c1083d0 0x7f475c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f47609be640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c1083d0 0x7f475c19a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46572/0 (socket says 172.21.15.22:46572) 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f47609be640 1 -- 172.21.15.22:0/3568586886 learned_addr learned my addr 172.21.15.22:0/3568586886 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f47611bf640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f475c102ae0 0x7f475c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f47609be640 1 -- 172.21.15.22:0/3568586886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f475c108d20 msgr2=0x7f475c19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:00.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f47609be640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f475c108d20 0x7f475c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f47609be640 1 -- 172.21.15.22:0/3568586886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f475c102ae0 msgr2=0x7f475c19a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f47609be640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f475c102ae0 0x7f475c19a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f47609be640 1 -- 172.21.15.22:0/3568586886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f475c1a0280 con 0x7f475c1083d0 2024-09-21T04:01:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.597+0000 7f47609be640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c1083d0 0x7f475c19a970 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4758005940 tx=0x7f47580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.598+0000 7f474e7fc640 1 -- 172.21.15.22:0/3568586886 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475803f030 con 0x7f475c1083d0 2024-09-21T04:01:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.598+0000 7f474e7fc640 1 -- 172.21.15.22:0/3568586886 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4758003c90 con 0x7f475c1083d0 2024-09-21T04:01:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.598+0000 7f474e7fc640 1 -- 172.21.15.22:0/3568586886 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758035070 con 0x7f475c1083d0 2024-09-21T04:01:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.598+0000 7f4763423640 1 -- 172.21.15.22:0/3568586886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f475c1a0510 con 0x7f475c1083d0 2024-09-21T04:01:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.598+0000 7f4763423640 1 -- 172.21.15.22:0/3568586886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f475c1a09f0 con 0x7f475c1083d0 2024-09-21T04:01:00.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.599+0000 7f4763423640 1 -- 172.21.15.22:0/3568586886 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f475c103d10 con 0x7f475c1083d0 2024-09-21T04:01:00.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.600+0000 7f474e7fc640 1 -- 172.21.15.22:0/3568586886 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4758042030 con 0x7f475c1083d0 2024-09-21T04:01:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.601+0000 7f474e7fc640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47480b65d0 0x7f47480b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.601+0000 7f47611bf640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47480b65d0 0x7f47480b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:00.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.601+0000 7f474e7fc640 1 -- 172.21.15.22:0/3568586886 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f4758107d10 con 0x7f475c1083d0 2024-09-21T04:01:00.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.602+0000 7f47611bf640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47480b65d0 0x7f47480b8ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4750007ec0 tx=0x7f47500075b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:00.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.605+0000 7f474e7fc640 1 -- 172.21.15.22:0/3568586886 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f47580ce0e0 con 0x7f475c1083d0 2024-09-21T04:01:00.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.794+0000 7f4763423640 1 -- 172.21.15.22:0/3568586886 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f475c063800 con 0x7f47480b65d0 2024-09-21T04:01:00.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:00 smithi022 ceph-mon[31015]: pgmap v328: 129 pgs: 129 active+clean; 635 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-21T04:01:00.797 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:00 smithi022 ceph-mon[31015]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:00.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.802+0000 7f474e7fc640 1 -- 172.21.15.22:0/3568586886 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340652 (secure 0 0 0) 0x7f475c063800 con 0x7f47480b65d0 2024-09-21T04:01:00.805 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:00.810 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-21T04:01:00.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 -- 172.21.15.22:0/3568586886 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47480b65d0 msgr2=0x7f47480b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:00.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47480b65d0 0x7f47480b8ae0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f4750007ec0 tx=0x7f47500075b0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 -- 172.21.15.22:0/3568586886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c1083d0 msgr2=0x7f475c19a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c1083d0 0x7f475c19a970 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4758005940 tx=0x7f47580042f0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 -- 172.21.15.22:0/3568586886 shutdown_connections 2024-09-21T04:01:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f47480b65d0 0x7f47480b8ae0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f475c108d20 0x7f475c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f475c1083d0 0x7f475c19a970 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 --2- 172.21.15.22:0/3568586886 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f475c102ae0 0x7f475c19a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 -- 172.21.15.22:0/3568586886 >> 172.21.15.22:0/3568586886 conn(0x7f475c079760 msgr2=0x7f475c105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 -- 172.21.15.22:0/3568586886 shutdown_connections 2024-09-21T04:01:00.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:00.806+0000 7f4763423640 1 -- 172.21.15.22:0/3568586886 wait complete. 2024-09-21T04:01:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:00 smithi060 ceph-mon[33722]: pgmap v328: 129 pgs: 129 active+clean; 635 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-21T04:01:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:00 smithi060 ceph-mon[33722]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:01.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:00 smithi073 ceph-mon[34443]: pgmap v328: 129 pgs: 129 active+clean; 635 KiB data, 376 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.2 KiB/s wr, 16 op/s 2024-09-21T04:01:01.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:00 smithi073 ceph-mon[34443]: from='client.15015 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:01.575 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2024-09-21T04:00:58.924744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":650649,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":227,"num_read_kb":204,"num_write":358,"num_write_kb":2279,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385520,"kb_used_data":11312,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124556304,"statfs":{"total":1151940427776,"available":1151545655296,"internally_reserved":0,"allocated":11583488,"data_stored":7617785,"data_compressed":425772,"data_compressed_allocated":577536,"data_compressed_original":2654208,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":51955,"num_objects":19,"num_object_clones":0,"num_object_copies":59,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":143,"num_read_kb":130,"num_write":54,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003682"},"pg_stats":[{"pgid":"2.1f","version":"83'13","reported_seq":62,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:54.239801+0000","last_change":"2024-09-21T04:00:01.985519+0000","last_active":"2024-09-21T04:00:54.239801+0000","last_peered":"2024-09-21T04:00:54.239801+0000","last_clean":"2024-09-21T04:00:54.239801+0000","last_became_active":"2024-09-21T04:00:01.984904+0000","last_became_peered":"2024-09-21T04:00:01.984904+0000","last_unstale":"2024-09-21T04:00:54.239801+0000","last_undegraded":"2024-09-21T04:00:54.239801+0000","last_fullsized":"2024-09-21T04:00:54.239801+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:20.596034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.394991+0000","last_change":"2024-09-21T04:00:04.007864+0000","last_active":"2024-09-21T04:00:30.394991+0000","last_peered":"2024-09-21T04:00:30.394991+0000","last_clean":"2024-09-21T04:00:30.394991+0000","last_became_active":"2024-09-21T04:00:04.007470+0000","last_became_peered":"2024-09-21T04:00:04.007470+0000","last_unstale":"2024-09-21T04:00:30.394991+0000","last_undegraded":"2024-09-21T04:00:30.394991+0000","last_fullsized":"2024-09-21T04:00:30.394991+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:11.452170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.136443+0000","last_change":"2024-09-21T04:00:11.068152+0000","last_active":"2024-09-21T04:00:30.136443+0000","last_peered":"2024-09-21T04:00:30.136443+0000","last_clean":"2024-09-21T04:00:30.136443+0000","last_became_active":"2024-09-21T04:00:11.067647+0000","last_became_peered":"2024-09-21T04:00:11.067647+0000","last_unstale":"2024-09-21T04:00:30.136443+0000","last_undegraded":"2024-09-21T04:00:30.136443+0000","last_fullsized":"2024-09-21T04:00:30.136443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:35.652827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395452+0000","last_change":"2024-09-21T04:00:02.162198+0000","last_active":"2024-09-21T04:00:30.395452+0000","last_peered":"2024-09-21T04:00:30.395452+0000","last_clean":"2024-09-21T04:00:30.395452+0000","last_became_active":"2024-09-21T04:00:02.161840+0000","last_became_peered":"2024-09-21T04:00:02.161840+0000","last_unstale":"2024-09-21T04:00:30.395452+0000","last_undegraded":"2024-09-21T04:00:30.395452+0000","last_fullsized":"2024-09-21T04:00:30.395452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:31.353273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.133357+0000","last_change":"2024-09-21T04:00:03.997274+0000","last_active":"2024-09-21T04:00:30.133357+0000","last_peered":"2024-09-21T04:00:30.133357+0000","last_clean":"2024-09-21T04:00:30.133357+0000","last_became_active":"2024-09-21T04:00:03.996917+0000","last_became_peered":"2024-09-21T04:00:03.996917+0000","last_unstale":"2024-09-21T04:00:30.133357+0000","last_undegraded":"2024-09-21T04:00:30.133357+0000","last_fullsized":"2024-09-21T04:00:30.133357+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:05.700703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131535+0000","last_change":"2024-09-21T04:00:11.058687+0000","last_active":"2024-09-21T04:00:30.131535+0000","last_peered":"2024-09-21T04:00:30.131535+0000","last_clean":"2024-09-21T04:00:30.131535+0000","last_became_active":"2024-09-21T04:00:11.058099+0000","last_became_peered":"2024-09-21T04:00:11.058099+0000","last_unstale":"2024-09-21T04:00:30.131535+0000","last_undegraded":"2024-09-21T04:00:30.131535+0000","last_fullsized":"2024-09-21T04:00:30.131535+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:50.332295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":50,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:45.221823+0000","last_change":"2024-09-21T04:00:01.990262+0000","last_active":"2024-09-21T04:00:45.221823+0000","last_peered":"2024-09-21T04:00:45.221823+0000","last_clean":"2024-09-21T04:00:45.221823+0000","last_became_active":"2024-09-21T04:00:01.989777+0000","last_became_peered":"2024-09-21T04:00:01.989777+0000","last_unstale":"2024-09-21T04:00:45.221823+0000","last_undegraded":"2024-09-21T04:00:45.221823+0000","last_fullsized":"2024-09-21T04:00:45.221823+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:39:34.677105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181499+0000","last_change":"2024-09-21T04:00:04.012120+0000","last_active":"2024-09-21T04:00:30.181499+0000","last_peered":"2024-09-21T04:00:30.181499+0000","last_clean":"2024-09-21T04:00:30.181499+0000","last_became_active":"2024-09-21T04:00:04.011648+0000","last_became_peered":"2024-09-21T04:00:04.011648+0000","last_unstale":"2024-09-21T04:00:30.181499+0000","last_undegraded":"2024-09-21T04:00:30.181499+0000","last_fullsized":"2024-09-21T04:00:30.181499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.716845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132193+0000","last_change":"2024-09-21T04:00:11.059509+0000","last_active":"2024-09-21T04:00:30.132193+0000","last_peered":"2024-09-21T04:00:30.132193+0000","last_clean":"2024-09-21T04:00:30.132193+0000","last_became_active":"2024-09-21T04:00:11.058674+0000","last_became_peered":"2024-09-21T04:00:11.058674+0000","last_unstale":"2024-09-21T04:00:30.132193+0000","last_undegraded":"2024-09-21T04:00:30.132193+0000","last_fullsized":"2024-09-21T04:00:30.132193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:13.078117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.220114+0000","last_change":"2024-09-21T04:00:01.987624+0000","last_active":"2024-09-21T04:00:44.220114+0000","last_peered":"2024-09-21T04:00:44.220114+0000","last_clean":"2024-09-21T04:00:44.220114+0000","last_became_active":"2024-09-21T04:00:01.987212+0000","last_became_peered":"2024-09-21T04:00:01.987212+0000","last_unstale":"2024-09-21T04:00:44.220114+0000","last_undegraded":"2024-09-21T04:00:44.220114+0000","last_fullsized":"2024-09-21T04:00:44.220114+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:18.554590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.133008+0000","last_change":"2024-09-21T04:00:04.017507+0000","last_active":"2024-09-21T04:00:30.133008+0000","last_peered":"2024-09-21T04:00:30.133008+0000","last_clean":"2024-09-21T04:00:30.133008+0000","last_became_active":"2024-09-21T04:00:04.017120+0000","last_became_peered":"2024-09-21T04:00:04.017120+0000","last_unstale":"2024-09-21T04:00:30.133008+0000","last_undegraded":"2024-09-21T04:00:30.133008+0000","last_fullsized":"2024-09-21T04:00:30.133008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:19.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132528+0000","last_change":"2024-09-21T04:00:11.055047+0000","last_active":"2024-09-21T04:00:30.132528+0000","last_peered":"2024-09-21T04:00:30.132528+0000","last_clean":"2024-09-21T04:00:30.132528+0000","last_became_active":"2024-09-21T04:00:11.054504+0000","last_became_peered":"2024-09-21T04:00:11.054504+0000","last_unstale":"2024-09-21T04:00:30.132528+0000","last_undegraded":"2024-09-21T04:00:30.132528+0000","last_fullsized":"2024-09-21T04:00:30.132528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.963011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.139283+0000","last_change":"2024-09-21T04:00:04.012633+0000","last_active":"2024-09-21T04:00:30.139283+0000","last_peered":"2024-09-21T04:00:30.139283+0000","last_clean":"2024-09-21T04:00:30.139283+0000","last_became_active":"2024-09-21T04:00:04.012246+0000","last_became_peered":"2024-09-21T04:00:04.012246+0000","last_unstale":"2024-09-21T04:00:30.139283+0000","last_undegraded":"2024-09-21T04:00:30.139283+0000","last_fullsized":"2024-09-21T04:00:30.139283+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:58.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":53,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:41.195715+0000","last_change":"2024-09-21T04:00:30.144195+0000","last_active":"2024-09-21T04:00:41.195715+0000","last_peered":"2024-09-21T04:00:41.195715+0000","last_clean":"2024-09-21T04:00:41.195715+0000","last_became_active":"2024-09-21T04:00:30.140690+0000","last_became_peered":"2024-09-21T04:00:30.140690+0000","last_unstale":"2024-09-21T04:00:41.195715+0000","last_undegraded":"2024-09-21T04:00:41.195715+0000","last_fullsized":"2024-09-21T04:00:41.195715+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:42.686216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132528+0000","last_change":"2024-09-21T04:00:11.333935+0000","last_active":"2024-09-21T04:00:30.132528+0000","last_peered":"2024-09-21T04:00:30.132528+0000","last_clean":"2024-09-21T04:00:30.132528+0000","last_became_active":"2024-09-21T04:00:11.333336+0000","last_became_peered":"2024-09-21T04:00:11.333336+0000","last_unstale":"2024-09-21T04:00:30.132528+0000","last_undegraded":"2024-09-21T04:00:30.132528+0000","last_fullsized":"2024-09-21T04:00:30.132528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:23.890845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.394802+0000","last_change":"2024-09-21T04:00:04.002579+0000","last_active":"2024-09-21T04:00:30.394802+0000","last_peered":"2024-09-21T04:00:30.394802+0000","last_clean":"2024-09-21T04:00:30.394802+0000","last_became_active":"2024-09-21T04:00:04.001926+0000","last_became_peered":"2024-09-21T04:00:04.001926+0000","last_unstale":"2024-09-21T04:00:30.394802+0000","last_undegraded":"2024-09-21T04:00:30.394802+0000","last_fullsized":"2024-09-21T04:00:30.394802+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:11.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:43.212027+0000","last_change":"2024-09-21T04:00:01.983276+0000","last_active":"2024-09-21T04:00:43.212027+0000","last_peered":"2024-09-21T04:00:43.212027+0000","last_clean":"2024-09-21T04:00:43.212027+0000","last_became_active":"2024-09-21T04:00:01.982828+0000","last_became_peered":"2024-09-21T04:00:01.982828+0000","last_unstale":"2024-09-21T04:00:43.212027+0000","last_undegraded":"2024-09-21T04:00:43.212027+0000","last_fullsized":"2024-09-21T04:00:43.212027+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:52.266947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132881+0000","last_change":"2024-09-21T04:00:11.067529+0000","last_active":"2024-09-21T04:00:30.132881+0000","last_peered":"2024-09-21T04:00:30.132881+0000","last_clean":"2024-09-21T04:00:30.132881+0000","last_became_active":"2024-09-21T04:00:11.066975+0000","last_became_peered":"2024-09-21T04:00:11.066975+0000","last_unstale":"2024-09-21T04:00:30.132881+0000","last_undegraded":"2024-09-21T04:00:30.132881+0000","last_fullsized":"2024-09-21T04:00:30.132881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:09.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348079+0000","last_change":"2024-09-21T04:00:04.005822+0000","last_active":"2024-09-21T04:00:30.348079+0000","last_peered":"2024-09-21T04:00:30.348079+0000","last_clean":"2024-09-21T04:00:30.348079+0000","last_became_active":"2024-09-21T04:00:04.005468+0000","last_became_peered":"2024-09-21T04:00:04.005468+0000","last_unstale":"2024-09-21T04:00:30.348079+0000","last_undegraded":"2024-09-21T04:00:30.348079+0000","last_fullsized":"2024-09-21T04:00:30.348079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:08.863103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":44,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.220273+0000","last_change":"2024-09-21T04:00:01.984489+0000","last_active":"2024-09-21T04:00:44.220273+0000","last_peered":"2024-09-21T04:00:44.220273+0000","last_clean":"2024-09-21T04:00:44.220273+0000","last_became_active":"2024-09-21T04:00:01.983873+0000","last_became_peered":"2024-09-21T04:00:01.983873+0000","last_unstale":"2024-09-21T04:00:44.220273+0000","last_undegraded":"2024-09-21T04:00:44.220273+0000","last_fullsized":"2024-09-21T04:00:44.220273+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:22.717693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131411+0000","last_change":"2024-09-21T04:00:11.069148+0000","last_active":"2024-09-21T04:00:30.131411+0000","last_peered":"2024-09-21T04:00:30.131411+0000","last_clean":"2024-09-21T04:00:30.131411+0000","last_became_active":"2024-09-21T04:00:11.068723+0000","last_became_peered":"2024-09-21T04:00:11.068723+0000","last_unstale":"2024-09-21T04:00:30.131411+0000","last_undegraded":"2024-09-21T04:00:30.131411+0000","last_fullsized":"2024-09-21T04:00:30.131411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:42.822525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132332+0000","last_change":"2024-09-21T04:00:04.000526+0000","last_active":"2024-09-21T04:00:30.132332+0000","last_peered":"2024-09-21T04:00:30.132332+0000","last_clean":"2024-09-21T04:00:30.132332+0000","last_became_active":"2024-09-21T04:00:04.000137+0000","last_became_peered":"2024-09-21T04:00:04.000137+0000","last_unstale":"2024-09-21T04:00:30.132332+0000","last_undegraded":"2024-09-21T04:00:30.132332+0000","last_fullsized":"2024-09-21T04:00:30.132332+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:12.055499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:41.195973+0000","last_change":"2024-09-21T04:00:02.162359+0000","last_active":"2024-09-21T04:00:41.195973+0000","last_peered":"2024-09-21T04:00:41.195973+0000","last_clean":"2024-09-21T04:00:41.195973+0000","last_became_active":"2024-09-21T04:00:02.161946+0000","last_became_peered":"2024-09-21T04:00:02.161946+0000","last_unstale":"2024-09-21T04:00:41.195973+0000","last_undegraded":"2024-09-21T04:00:41.195973+0000","last_fullsized":"2024-09-21T04:00:41.195973+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:18.841278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.138795+0000","last_change":"2024-09-21T04:00:30.138669+0000","last_active":"2024-09-21T04:00:30.138795+0000","last_peered":"2024-09-21T04:00:30.138795+0000","last_clean":"2024-09-21T04:00:30.138795+0000","last_became_active":"2024-09-21T04:00:30.137548+0000","last_became_peered":"2024-09-21T04:00:30.137548+0000","last_unstale":"2024-09-21T04:00:30.138795+0000","last_undegraded":"2024-09-21T04:00:30.138795+0000","last_fullsized":"2024-09-21T04:00:30.138795+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:56.867964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.396753+0000","last_change":"2024-09-21T04:00:30.396672+0000","last_active":"2024-09-21T04:00:30.396753+0000","last_peered":"2024-09-21T04:00:30.396753+0000","last_clean":"2024-09-21T04:00:30.396753+0000","last_became_active":"2024-09-21T04:00:30.396066+0000","last_became_peered":"2024-09-21T04:00:30.396066+0000","last_unstale":"2024-09-21T04:00:30.396753+0000","last_undegraded":"2024-09-21T04:00:30.396753+0000","last_fullsized":"2024-09-21T04:00:30.396753+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:01.582768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":45,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.219508+0000","last_change":"2024-09-21T04:00:02.213481+0000","last_active":"2024-09-21T04:00:44.219508+0000","last_peered":"2024-09-21T04:00:44.219508+0000","last_clean":"2024-09-21T04:00:44.219508+0000","last_became_active":"2024-09-21T04:00:02.213093+0000","last_became_peered":"2024-09-21T04:00:02.213093+0000","last_unstale":"2024-09-21T04:00:44.219508+0000","last_undegraded":"2024-09-21T04:00:44.219508+0000","last_fullsized":"2024-09-21T04:00:44.219508+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:20.700406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.136454+0000","last_change":"2024-09-21T04:00:11.058780+0000","last_active":"2024-09-21T04:00:30.136454+0000","last_peered":"2024-09-21T04:00:30.136454+0000","last_clean":"2024-09-21T04:00:30.136454+0000","last_became_active":"2024-09-21T04:00:11.058309+0000","last_became_peered":"2024-09-21T04:00:11.058309+0000","last_unstale":"2024-09-21T04:00:30.136454+0000","last_undegraded":"2024-09-21T04:00:30.136454+0000","last_fullsized":"2024-09-21T04:00:30.136454+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:31.134604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395410+0000","last_change":"2024-09-21T04:00:04.005954+0000","last_active":"2024-09-21T04:00:30.395410+0000","last_peered":"2024-09-21T04:00:30.395410+0000","last_clean":"2024-09-21T04:00:30.395410+0000","last_became_active":"2024-09-21T04:00:04.005609+0000","last_became_peered":"2024-09-21T04:00:04.005609+0000","last_unstale":"2024-09-21T04:00:30.395410+0000","last_undegraded":"2024-09-21T04:00:30.395410+0000","last_fullsized":"2024-09-21T04:00:30.395410+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:52.596627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'11","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:53.014617+0000","last_change":"2024-09-21T04:00:01.982700+0000","last_active":"2024-09-21T04:00:53.014617+0000","last_peered":"2024-09-21T04:00:53.014617+0000","last_clean":"2024-09-21T04:00:53.014617+0000","last_became_active":"2024-09-21T04:00:01.982321+0000","last_became_peered":"2024-09-21T04:00:01.982321+0000","last_unstale":"2024-09-21T04:00:53.014617+0000","last_undegraded":"2024-09-21T04:00:53.014617+0000","last_fullsized":"2024-09-21T04:00:53.014617+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:56.088066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.394623+0000","last_change":"2024-09-21T04:00:11.334127+0000","last_active":"2024-09-21T04:00:30.394623+0000","last_peered":"2024-09-21T04:00:30.394623+0000","last_clean":"2024-09-21T04:00:30.394623+0000","last_became_active":"2024-09-21T04:00:11.333601+0000","last_became_peered":"2024-09-21T04:00:11.333601+0000","last_unstale":"2024-09-21T04:00:30.394623+0000","last_undegraded":"2024-09-21T04:00:30.394623+0000","last_fullsized":"2024-09-21T04:00:30.394623+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.114185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135553+0000","last_change":"2024-09-21T04:00:03.988967+0000","last_active":"2024-09-21T04:00:30.135553+0000","last_peered":"2024-09-21T04:00:30.135553+0000","last_clean":"2024-09-21T04:00:30.135553+0000","last_became_active":"2024-09-21T04:00:03.988617+0000","last_became_peered":"2024-09-21T04:00:03.988617+0000","last_unstale":"2024-09-21T04:00:30.135553+0000","last_undegraded":"2024-09-21T04:00:30.135553+0000","last_fullsized":"2024-09-21T04:00:30.135553+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.220877+0000","last_change":"2024-09-21T04:00:02.162698+0000","last_active":"2024-09-21T04:00:44.220877+0000","last_peered":"2024-09-21T04:00:44.220877+0000","last_clean":"2024-09-21T04:00:44.220877+0000","last_became_active":"2024-09-21T04:00:02.162254+0000","last_became_peered":"2024-09-21T04:00:02.162254+0000","last_unstale":"2024-09-21T04:00:44.220877+0000","last_undegraded":"2024-09-21T04:00:44.220877+0000","last_fullsized":"2024-09-21T04:00:44.220877+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:07.409718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348186+0000","last_change":"2024-09-21T04:00:11.057825+0000","last_active":"2024-09-21T04:00:30.348186+0000","last_peered":"2024-09-21T04:00:30.348186+0000","last_clean":"2024-09-21T04:00:30.348186+0000","last_became_active":"2024-09-21T04:00:11.057308+0000","last_became_peered":"2024-09-21T04:00:11.057308+0000","last_unstale":"2024-09-21T04:00:30.348186+0000","last_undegraded":"2024-09-21T04:00:30.348186+0000","last_fullsized":"2024-09-21T04:00:30.348186+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.925835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135182+0000","last_change":"2024-09-21T04:00:03.996631+0000","last_active":"2024-09-21T04:00:30.135182+0000","last_peered":"2024-09-21T04:00:30.135182+0000","last_clean":"2024-09-21T04:00:30.135182+0000","last_became_active":"2024-09-21T04:00:03.996264+0000","last_became_peered":"2024-09-21T04:00:03.996264+0000","last_unstale":"2024-09-21T04:00:30.135182+0000","last_undegraded":"2024-09-21T04:00:30.135182+0000","last_fullsized":"2024-09-21T04:00:30.135182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:27.270843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131269+0000","last_change":"2024-09-21T04:00:02.162450+0000","last_active":"2024-09-21T04:00:30.131269+0000","last_peered":"2024-09-21T04:00:30.131269+0000","last_clean":"2024-09-21T04:00:30.131269+0000","last_became_active":"2024-09-21T04:00:02.161991+0000","last_became_peered":"2024-09-21T04:00:02.161991+0000","last_unstale":"2024-09-21T04:00:30.131269+0000","last_undegraded":"2024-09-21T04:00:30.131269+0000","last_fullsized":"2024-09-21T04:00:30.131269+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:09.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132498+0000","last_change":"2024-09-21T04:00:11.333873+0000","last_active":"2024-09-21T04:00:30.132498+0000","last_peered":"2024-09-21T04:00:30.132498+0000","last_clean":"2024-09-21T04:00:30.132498+0000","last_became_active":"2024-09-21T04:00:11.333368+0000","last_became_peered":"2024-09-21T04:00:11.333368+0000","last_unstale":"2024-09-21T04:00:30.132498+0000","last_undegraded":"2024-09-21T04:00:30.132498+0000","last_fullsized":"2024-09-21T04:00:30.132498+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:53.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.138441+0000","last_change":"2024-09-21T04:00:30.138320+0000","last_active":"2024-09-21T04:00:30.138441+0000","last_peered":"2024-09-21T04:00:30.138441+0000","last_clean":"2024-09-21T04:00:30.138441+0000","last_became_active":"2024-09-21T04:00:30.137866+0000","last_became_peered":"2024-09-21T04:00:30.137866+0000","last_unstale":"2024-09-21T04:00:30.138441+0000","last_undegraded":"2024-09-21T04:00:30.138441+0000","last_fullsized":"2024-09-21T04:00:30.138441+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:39.992746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":58,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:57.244466+0000","last_change":"2024-09-21T04:00:01.986355+0000","last_active":"2024-09-21T04:00:57.244466+0000","last_peered":"2024-09-21T04:00:57.244466+0000","last_clean":"2024-09-21T04:00:57.244466+0000","last_became_active":"2024-09-21T04:00:01.985960+0000","last_became_peered":"2024-09-21T04:00:01.985960+0000","last_unstale":"2024-09-21T04:00:57.244466+0000","last_undegraded":"2024-09-21T04:00:57.244466+0000","last_fullsized":"2024-09-21T04:00:57.244466+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:08.417218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135582+0000","last_change":"2024-09-21T04:00:11.066363+0000","last_active":"2024-09-21T04:00:30.135582+0000","last_peered":"2024-09-21T04:00:30.135582+0000","last_clean":"2024-09-21T04:00:30.135582+0000","last_became_active":"2024-09-21T04:00:11.065923+0000","last_became_peered":"2024-09-21T04:00:11.065923+0000","last_unstale":"2024-09-21T04:00:30.135582+0000","last_undegraded":"2024-09-21T04:00:30.135582+0000","last_fullsized":"2024-09-21T04:00:30.135582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:49.720377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132115+0000","last_change":"2024-09-21T04:00:04.010139+0000","last_active":"2024-09-21T04:00:30.132115+0000","last_peered":"2024-09-21T04:00:30.132115+0000","last_clean":"2024-09-21T04:00:30.132115+0000","last_became_active":"2024-09-21T04:00:04.009764+0000","last_became_peered":"2024-09-21T04:00:04.009764+0000","last_unstale":"2024-09-21T04:00:30.132115+0000","last_undegraded":"2024-09-21T04:00:30.132115+0000","last_fullsized":"2024-09-21T04:00:30.132115+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:08.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":52,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:53.238449+0000","last_change":"2024-09-21T04:00:02.162297+0000","last_active":"2024-09-21T04:00:53.238449+0000","last_peered":"2024-09-21T04:00:53.238449+0000","last_clean":"2024-09-21T04:00:53.238449+0000","last_became_active":"2024-09-21T04:00:02.161884+0000","last_became_peered":"2024-09-21T04:00:02.161884+0000","last_unstale":"2024-09-21T04:00:53.238449+0000","last_undegraded":"2024-09-21T04:00:53.238449+0000","last_fullsized":"2024-09-21T04:00:53.238449+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:21.108188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135542+0000","last_change":"2024-09-21T04:00:11.335000+0000","last_active":"2024-09-21T04:00:30.135542+0000","last_peered":"2024-09-21T04:00:30.135542+0000","last_clean":"2024-09-21T04:00:30.135542+0000","last_became_active":"2024-09-21T04:00:11.334529+0000","last_became_peered":"2024-09-21T04:00:11.334529+0000","last_unstale":"2024-09-21T04:00:30.135542+0000","last_undegraded":"2024-09-21T04:00:30.135542+0000","last_fullsized":"2024-09-21T04:00:30.135542+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:54.148883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135766+0000","last_change":"2024-09-21T04:00:03.988089+0000","last_active":"2024-09-21T04:00:30.135766+0000","last_peered":"2024-09-21T04:00:30.135766+0000","last_clean":"2024-09-21T04:00:30.135766+0000","last_became_active":"2024-09-21T04:00:03.987641+0000","last_became_peered":"2024-09-21T04:00:03.987641+0000","last_unstale":"2024-09-21T04:00:30.135766+0000","last_undegraded":"2024-09-21T04:00:30.135766+0000","last_fullsized":"2024-09-21T04:00:30.135766+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:46.249510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:42.204019+0000","last_change":"2024-09-21T04:00:01.989141+0000","last_active":"2024-09-21T04:00:42.204019+0000","last_peered":"2024-09-21T04:00:42.204019+0000","last_clean":"2024-09-21T04:00:42.204019+0000","last_became_active":"2024-09-21T04:00:01.988772+0000","last_became_peered":"2024-09-21T04:00:01.988772+0000","last_unstale":"2024-09-21T04:00:42.204019+0000","last_undegraded":"2024-09-21T04:00:42.204019+0000","last_fullsized":"2024-09-21T04:00:42.204019+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:39:28.106233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.349803+0000","last_change":"2024-09-21T04:00:30.349715+0000","last_active":"2024-09-21T04:00:30.349803+0000","last_peered":"2024-09-21T04:00:30.349803+0000","last_clean":"2024-09-21T04:00:30.349803+0000","last_became_active":"2024-09-21T04:00:30.349233+0000","last_became_peered":"2024-09-21T04:00:30.349233+0000","last_unstale":"2024-09-21T04:00:30.349803+0000","last_undegraded":"2024-09-21T04:00:30.349803+0000","last_fullsized":"2024-09-21T04:00:30.349803+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.933082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395291+0000","last_change":"2024-09-21T04:00:04.005025+0000","last_active":"2024-09-21T04:00:30.395291+0000","last_peered":"2024-09-21T04:00:30.395291+0000","last_clean":"2024-09-21T04:00:30.395291+0000","last_became_active":"2024-09-21T04:00:04.004697+0000","last_became_peered":"2024-09-21T04:00:04.004697+0000","last_unstale":"2024-09-21T04:00:30.395291+0000","last_undegraded":"2024-09-21T04:00:30.395291+0000","last_fullsized":"2024-09-21T04:00:30.395291+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:30.663231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":46,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:45.221985+0000","last_change":"2024-09-21T04:00:01.987438+0000","last_active":"2024-09-21T04:00:45.221985+0000","last_peered":"2024-09-21T04:00:45.221985+0000","last_clean":"2024-09-21T04:00:45.221985+0000","last_became_active":"2024-09-21T04:00:01.986995+0000","last_became_peered":"2024-09-21T04:00:01.986995+0000","last_unstale":"2024-09-21T04:00:45.221985+0000","last_undegraded":"2024-09-21T04:00:45.221985+0000","last_fullsized":"2024-09-21T04:00:45.221985+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:16.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":112,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.138429+0000","last_change":"2024-09-21T03:58:47.597000+0000","last_active":"2024-09-21T04:00:30.138429+0000","last_peered":"2024-09-21T04:00:30.138429+0000","last_clean":"2024-09-21T04:00:30.138429+0000","last_became_active":"2024-09-21T03:58:47.590826+0000","last_became_peered":"2024-09-21T03:58:47.590826+0000","last_unstale":"2024-09-21T04:00:30.138429+0000","last_undegraded":"2024-09-21T04:00:30.138429+0000","last_fullsized":"2024-09-21T04:00:30.138429+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_clean_scrub_stamp":"2024-09-21T03:55:20.271286+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:53.813660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.139686+0000","last_change":"2024-09-21T04:00:11.057229+0000","last_active":"2024-09-21T04:00:30.139686+0000","last_peered":"2024-09-21T04:00:30.139686+0000","last_clean":"2024-09-21T04:00:30.139686+0000","last_became_active":"2024-09-21T04:00:11.056722+0000","last_became_peered":"2024-09-21T04:00:11.056722+0000","last_unstale":"2024-09-21T04:00:30.139686+0000","last_undegraded":"2024-09-21T04:00:30.139686+0000","last_fullsized":"2024-09-21T04:00:30.139686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:53.311589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.140048+0000","last_change":"2024-09-21T04:00:04.013650+0000","last_active":"2024-09-21T04:00:30.140048+0000","last_peered":"2024-09-21T04:00:30.140048+0000","last_clean":"2024-09-21T04:00:30.140048+0000","last_became_active":"2024-09-21T04:00:04.013284+0000","last_became_peered":"2024-09-21T04:00:04.013284+0000","last_unstale":"2024-09-21T04:00:30.140048+0000","last_undegraded":"2024-09-21T04:00:30.140048+0000","last_fullsized":"2024-09-21T04:00:30.140048+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:53.098998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":54,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:53.239846+0000","last_change":"2024-09-21T04:00:02.213332+0000","last_active":"2024-09-21T04:00:53.239846+0000","last_peered":"2024-09-21T04:00:53.239846+0000","last_clean":"2024-09-21T04:00:53.239846+0000","last_became_active":"2024-09-21T04:00:02.212853+0000","last_became_peered":"2024-09-21T04:00:02.212853+0000","last_unstale":"2024-09-21T04:00:53.239846+0000","last_undegraded":"2024-09-21T04:00:53.239846+0000","last_fullsized":"2024-09-21T04:00:53.239846+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:52.923489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181210+0000","last_change":"2024-09-21T04:00:11.057139+0000","last_active":"2024-09-21T04:00:30.181210+0000","last_peered":"2024-09-21T04:00:30.181210+0000","last_clean":"2024-09-21T04:00:30.181210+0000","last_became_active":"2024-09-21T04:00:11.056549+0000","last_became_peered":"2024-09-21T04:00:11.056549+0000","last_unstale":"2024-09-21T04:00:30.181210+0000","last_undegraded":"2024-09-21T04:00:30.181210+0000","last_fullsized":"2024-09-21T04:00:30.181210+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:28.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.141420+0000","last_change":"2024-09-21T04:00:30.141278+0000","last_active":"2024-09-21T04:00:30.141420+0000","last_peered":"2024-09-21T04:00:30.141420+0000","last_clean":"2024-09-21T04:00:30.141420+0000","last_became_active":"2024-09-21T04:00:30.140692+0000","last_became_peered":"2024-09-21T04:00:30.140692+0000","last_unstale":"2024-09-21T04:00:30.141420+0000","last_undegraded":"2024-09-21T04:00:30.141420+0000","last_fullsized":"2024-09-21T04:00:30.141420+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:15.600486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.217144+0000","last_change":"2024-09-21T04:00:01.990532+0000","last_active":"2024-09-21T04:00:44.217144+0000","last_peered":"2024-09-21T04:00:44.217144+0000","last_clean":"2024-09-21T04:00:44.217144+0000","last_became_active":"2024-09-21T04:00:01.990114+0000","last_became_peered":"2024-09-21T04:00:01.990114+0000","last_unstale":"2024-09-21T04:00:44.217144+0000","last_undegraded":"2024-09-21T04:00:44.217144+0000","last_fullsized":"2024-09-21T04:00:44.217144+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:51.313576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":33,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.182292+0000","last_change":"2024-09-21T04:00:30.182161+0000","last_active":"2024-09-21T04:00:30.182292+0000","last_peered":"2024-09-21T04:00:30.182292+0000","last_clean":"2024-09-21T04:00:30.182292+0000","last_became_active":"2024-09-21T04:00:30.181777+0000","last_became_peered":"2024-09-21T04:00:30.181777+0000","last_unstale":"2024-09-21T04:00:30.182292+0000","last_undegraded":"2024-09-21T04:00:30.182292+0000","last_fullsized":"2024-09-21T04:00:30.182292+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:35.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.140262+0000","last_change":"2024-09-21T04:00:04.006784+0000","last_active":"2024-09-21T04:00:30.140262+0000","last_peered":"2024-09-21T04:00:30.140262+0000","last_clean":"2024-09-21T04:00:30.140262+0000","last_became_active":"2024-09-21T04:00:04.003841+0000","last_became_peered":"2024-09-21T04:00:04.003841+0000","last_unstale":"2024-09-21T04:00:30.140262+0000","last_undegraded":"2024-09-21T04:00:30.140262+0000","last_fullsized":"2024-09-21T04:00:30.140262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:50.088980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.220437+0000","last_change":"2024-09-21T04:00:01.986202+0000","last_active":"2024-09-21T04:00:44.220437+0000","last_peered":"2024-09-21T04:00:44.220437+0000","last_clean":"2024-09-21T04:00:44.220437+0000","last_became_active":"2024-09-21T04:00:01.985812+0000","last_became_peered":"2024-09-21T04:00:01.985812+0000","last_unstale":"2024-09-21T04:00:44.220437+0000","last_undegraded":"2024-09-21T04:00:44.220437+0000","last_fullsized":"2024-09-21T04:00:44.220437+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:05.777175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131567+0000","last_change":"2024-09-21T04:00:11.057253+0000","last_active":"2024-09-21T04:00:30.131567+0000","last_peered":"2024-09-21T04:00:30.131567+0000","last_clean":"2024-09-21T04:00:30.131567+0000","last_became_active":"2024-09-21T04:00:11.056721+0000","last_became_peered":"2024-09-21T04:00:11.056721+0000","last_unstale":"2024-09-21T04:00:30.131567+0000","last_undegraded":"2024-09-21T04:00:30.131567+0000","last_fullsized":"2024-09-21T04:00:30.131567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:19.202714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348559+0000","last_change":"2024-09-21T04:00:04.003674+0000","last_active":"2024-09-21T04:00:30.348559+0000","last_peered":"2024-09-21T04:00:30.348559+0000","last_clean":"2024-09-21T04:00:30.348559+0000","last_became_active":"2024-09-21T04:00:04.003297+0000","last_became_peered":"2024-09-21T04:00:04.003297+0000","last_unstale":"2024-09-21T04:00:30.348559+0000","last_undegraded":"2024-09-21T04:00:30.348559+0000","last_fullsized":"2024-09-21T04:00:30.348559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.063721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.198218+0000","last_change":"2024-09-21T04:00:01.986007+0000","last_active":"2024-09-21T04:00:44.198218+0000","last_peered":"2024-09-21T04:00:44.198218+0000","last_clean":"2024-09-21T04:00:44.198218+0000","last_became_active":"2024-09-21T04:00:01.985582+0000","last_became_peered":"2024-09-21T04:00:01.985582+0000","last_unstale":"2024-09-21T04:00:44.198218+0000","last_undegraded":"2024-09-21T04:00:44.198218+0000","last_fullsized":"2024-09-21T04:00:44.198218+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:48.429307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131735+0000","last_change":"2024-09-21T04:00:11.061522+0000","last_active":"2024-09-21T04:00:30.131735+0000","last_peered":"2024-09-21T04:00:30.131735+0000","last_clean":"2024-09-21T04:00:30.131735+0000","last_became_active":"2024-09-21T04:00:11.060984+0000","last_became_peered":"2024-09-21T04:00:11.060984+0000","last_unstale":"2024-09-21T04:00:30.131735+0000","last_undegraded":"2024-09-21T04:00:30.131735+0000","last_fullsized":"2024-09-21T04:00:30.131735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:51.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132022+0000","last_change":"2024-09-21T04:00:04.016468+0000","last_active":"2024-09-21T04:00:30.132022+0000","last_peered":"2024-09-21T04:00:30.132022+0000","last_clean":"2024-09-21T04:00:30.132022+0000","last_became_active":"2024-09-21T04:00:04.016177+0000","last_became_peered":"2024-09-21T04:00:04.016177+0000","last_unstale":"2024-09-21T04:00:30.132022+0000","last_undegraded":"2024-09-21T04:00:30.132022+0000","last_fullsized":"2024-09-21T04:00:30.132022+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:58.670552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":55,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.219965+0000","last_change":"2024-09-21T04:00:02.162746+0000","last_active":"2024-09-21T04:00:44.219965+0000","last_peered":"2024-09-21T04:00:44.219965+0000","last_clean":"2024-09-21T04:00:44.219965+0000","last_became_active":"2024-09-21T04:00:02.162121+0000","last_became_peered":"2024-09-21T04:00:02.162121+0000","last_unstale":"2024-09-21T04:00:44.219965+0000","last_undegraded":"2024-09-21T04:00:44.219965+0000","last_fullsized":"2024-09-21T04:00:44.219965+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:02.798790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135411+0000","last_change":"2024-09-21T04:00:11.068043+0000","last_active":"2024-09-21T04:00:30.135411+0000","last_peered":"2024-09-21T04:00:30.135411+0000","last_clean":"2024-09-21T04:00:30.135411+0000","last_became_active":"2024-09-21T04:00:11.067553+0000","last_became_peered":"2024-09-21T04:00:11.067553+0000","last_unstale":"2024-09-21T04:00:30.135411+0000","last_undegraded":"2024-09-21T04:00:30.135411+0000","last_fullsized":"2024-09-21T04:00:30.135411+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:34.095708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.137711+0000","last_change":"2024-09-21T04:00:04.010725+0000","last_active":"2024-09-21T04:00:30.137711+0000","last_peered":"2024-09-21T04:00:30.137711+0000","last_clean":"2024-09-21T04:00:30.137711+0000","last_became_active":"2024-09-21T04:00:04.010295+0000","last_became_peered":"2024-09-21T04:00:04.010295+0000","last_unstale":"2024-09-21T04:00:30.137711+0000","last_undegraded":"2024-09-21T04:00:30.137711+0000","last_fullsized":"2024-09-21T04:00:30.137711+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:40.417814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:55.242362+0000","last_change":"2024-09-21T04:00:01.985123+0000","last_active":"2024-09-21T04:00:55.242362+0000","last_peered":"2024-09-21T04:00:55.242362+0000","last_clean":"2024-09-21T04:00:55.242362+0000","last_became_active":"2024-09-21T04:00:01.984686+0000","last_became_peered":"2024-09-21T04:00:01.984686+0000","last_unstale":"2024-09-21T04:00:55.242362+0000","last_undegraded":"2024-09-21T04:00:55.242362+0000","last_fullsized":"2024-09-21T04:00:55.242362+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:18.825567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131522+0000","last_change":"2024-09-21T04:00:11.068045+0000","last_active":"2024-09-21T04:00:30.131522+0000","last_peered":"2024-09-21T04:00:30.131522+0000","last_clean":"2024-09-21T04:00:30.131522+0000","last_became_active":"2024-09-21T04:00:11.067528+0000","last_became_peered":"2024-09-21T04:00:11.067528+0000","last_unstale":"2024-09-21T04:00:30.131522+0000","last_undegraded":"2024-09-21T04:00:30.131522+0000","last_fullsized":"2024-09-21T04:00:30.131522+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:54.054763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.139022+0000","last_change":"2024-09-21T04:00:04.008068+0000","last_active":"2024-09-21T04:00:30.139022+0000","last_peered":"2024-09-21T04:00:30.139022+0000","last_clean":"2024-09-21T04:00:30.139022+0000","last_became_active":"2024-09-21T04:00:04.007611+0000","last_became_peered":"2024-09-21T04:00:04.007611+0000","last_unstale":"2024-09-21T04:00:30.139022+0000","last_undegraded":"2024-09-21T04:00:30.139022+0000","last_fullsized":"2024-09-21T04:00:30.139022+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:02.363722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.218758+0000","last_change":"2024-09-21T04:00:01.986011+0000","last_active":"2024-09-21T04:00:44.218758+0000","last_peered":"2024-09-21T04:00:44.218758+0000","last_clean":"2024-09-21T04:00:44.218758+0000","last_became_active":"2024-09-21T04:00:01.985637+0000","last_became_peered":"2024-09-21T04:00:01.985637+0000","last_unstale":"2024-09-21T04:00:44.218758+0000","last_undegraded":"2024-09-21T04:00:44.218758+0000","last_fullsized":"2024-09-21T04:00:44.218758+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:36.226063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348235+0000","last_change":"2024-09-21T04:00:11.067798+0000","last_active":"2024-09-21T04:00:30.348235+0000","last_peered":"2024-09-21T04:00:30.348235+0000","last_clean":"2024-09-21T04:00:30.348235+0000","last_became_active":"2024-09-21T04:00:11.067319+0000","last_became_peered":"2024-09-21T04:00:11.067319+0000","last_unstale":"2024-09-21T04:00:30.348235+0000","last_undegraded":"2024-09-21T04:00:30.348235+0000","last_fullsized":"2024-09-21T04:00:30.348235+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:37.118986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135482+0000","last_change":"2024-09-21T04:00:04.003222+0000","last_active":"2024-09-21T04:00:30.135482+0000","last_peered":"2024-09-21T04:00:30.135482+0000","last_clean":"2024-09-21T04:00:30.135482+0000","last_became_active":"2024-09-21T04:00:04.002893+0000","last_became_peered":"2024-09-21T04:00:04.002893+0000","last_unstale":"2024-09-21T04:00:30.135482+0000","last_undegraded":"2024-09-21T04:00:30.135482+0000","last_fullsized":"2024-09-21T04:00:30.135482+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:18.806695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":48,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:45.221978+0000","last_change":"2024-09-21T04:00:01.985978+0000","last_active":"2024-09-21T04:00:45.221978+0000","last_peered":"2024-09-21T04:00:45.221978+0000","last_clean":"2024-09-21T04:00:45.221978+0000","last_became_active":"2024-09-21T04:00:01.985607+0000","last_became_peered":"2024-09-21T04:00:01.985607+0000","last_unstale":"2024-09-21T04:00:45.221978+0000","last_undegraded":"2024-09-21T04:00:45.221978+0000","last_fullsized":"2024-09-21T04:00:45.221978+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:30.113727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132867+0000","last_change":"2024-09-21T04:00:11.069332+0000","last_active":"2024-09-21T04:00:30.132867+0000","last_peered":"2024-09-21T04:00:30.132867+0000","last_clean":"2024-09-21T04:00:30.132867+0000","last_became_active":"2024-09-21T04:00:11.068832+0000","last_became_peered":"2024-09-21T04:00:11.068832+0000","last_unstale":"2024-09-21T04:00:30.132867+0000","last_undegraded":"2024-09-21T04:00:30.132867+0000","last_fullsized":"2024-09-21T04:00:30.132867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:03.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.133277+0000","last_change":"2024-09-21T04:00:04.004234+0000","last_active":"2024-09-21T04:00:30.133277+0000","last_peered":"2024-09-21T04:00:30.133277+0000","last_clean":"2024-09-21T04:00:30.133277+0000","last_became_active":"2024-09-21T04:00:04.003839+0000","last_became_peered":"2024-09-21T04:00:04.003839+0000","last_unstale":"2024-09-21T04:00:30.133277+0000","last_undegraded":"2024-09-21T04:00:30.133277+0000","last_fullsized":"2024-09-21T04:00:30.133277+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.971580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'28","reported_seq":93,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:55.243744+0000","last_change":"2024-09-21T04:00:01.990623+0000","last_active":"2024-09-21T04:00:55.243744+0000","last_peered":"2024-09-21T04:00:55.243744+0000","last_clean":"2024-09-21T04:00:55.243744+0000","last_became_active":"2024-09-21T04:00:01.990030+0000","last_became_peered":"2024-09-21T04:00:01.990030+0000","last_unstale":"2024-09-21T04:00:55.243744+0000","last_undegraded":"2024-09-21T04:00:55.243744+0000","last_fullsized":"2024-09-21T04:00:55.243744+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:07.150261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53234,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":28,"num_read_kb":66,"num_write":30,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.130838+0000","last_change":"2024-09-21T04:00:11.064198+0000","last_active":"2024-09-21T04:00:30.130838+0000","last_peered":"2024-09-21T04:00:30.130838+0000","last_clean":"2024-09-21T04:00:30.130838+0000","last_became_active":"2024-09-21T04:00:11.063519+0000","last_became_peered":"2024-09-21T04:00:11.063519+0000","last_unstale":"2024-09-21T04:00:30.130838+0000","last_undegraded":"2024-09-21T04:00:30.130838+0000","last_fullsized":"2024-09-21T04:00:30.130838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:16.189027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181506+0000","last_change":"2024-09-21T04:00:04.009685+0000","last_active":"2024-09-21T04:00:30.181506+0000","last_peered":"2024-09-21T04:00:30.181506+0000","last_clean":"2024-09-21T04:00:30.181506+0000","last_became_active":"2024-09-21T04:00:04.009217+0000","last_became_peered":"2024-09-21T04:00:04.009217+0000","last_unstale":"2024-09-21T04:00:30.181506+0000","last_undegraded":"2024-09-21T04:00:30.181506+0000","last_fullsized":"2024-09-21T04:00:30.181506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:31.780399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":42,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:43.213491+0000","last_change":"2024-09-21T04:00:02.164467+0000","last_active":"2024-09-21T04:00:43.213491+0000","last_peered":"2024-09-21T04:00:43.213491+0000","last_clean":"2024-09-21T04:00:43.213491+0000","last_became_active":"2024-09-21T04:00:02.164091+0000","last_became_peered":"2024-09-21T04:00:02.164091+0000","last_unstale":"2024-09-21T04:00:43.213491+0000","last_undegraded":"2024-09-21T04:00:43.213491+0000","last_fullsized":"2024-09-21T04:00:43.213491+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:12.327745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132051+0000","last_change":"2024-09-21T04:00:11.058828+0000","last_active":"2024-09-21T04:00:30.132051+0000","last_peered":"2024-09-21T04:00:30.132051+0000","last_clean":"2024-09-21T04:00:30.132051+0000","last_became_active":"2024-09-21T04:00:11.058188+0000","last_became_peered":"2024-09-21T04:00:11.058188+0000","last_unstale":"2024-09-21T04:00:30.132051+0000","last_undegraded":"2024-09-21T04:00:30.132051+0000","last_fullsized":"2024-09-21T04:00:30.132051+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.767306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.133855+0000","last_change":"2024-09-21T04:00:04.004693+0000","last_active":"2024-09-21T04:00:30.133855+0000","last_peered":"2024-09-21T04:00:30.133855+0000","last_clean":"2024-09-21T04:00:30.133855+0000","last_became_active":"2024-09-21T04:00:04.004357+0000","last_became_peered":"2024-09-21T04:00:04.004357+0000","last_unstale":"2024-09-21T04:00:30.133855+0000","last_undegraded":"2024-09-21T04:00:30.133855+0000","last_fullsized":"2024-09-21T04:00:30.133855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.218860+0000","last_change":"2024-09-21T04:00:01.987319+0000","last_active":"2024-09-21T04:00:44.218860+0000","last_peered":"2024-09-21T04:00:44.218860+0000","last_clean":"2024-09-21T04:00:44.218860+0000","last_became_active":"2024-09-21T04:00:01.986012+0000","last_became_peered":"2024-09-21T04:00:01.986012+0000","last_unstale":"2024-09-21T04:00:44.218860+0000","last_undegraded":"2024-09-21T04:00:44.218860+0000","last_fullsized":"2024-09-21T04:00:44.218860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:03.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.139664+0000","last_change":"2024-09-21T04:00:30.139534+0000","last_active":"2024-09-21T04:00:30.139664+0000","last_peered":"2024-09-21T04:00:30.139664+0000","last_clean":"2024-09-21T04:00:30.139664+0000","last_became_active":"2024-09-21T04:00:30.138954+0000","last_became_peered":"2024-09-21T04:00:30.138954+0000","last_unstale":"2024-09-21T04:00:30.139664+0000","last_undegraded":"2024-09-21T04:00:30.139664+0000","last_fullsized":"2024-09-21T04:00:30.139664+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:21.368007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181590+0000","last_change":"2024-09-21T04:00:04.013737+0000","last_active":"2024-09-21T04:00:30.181590+0000","last_peered":"2024-09-21T04:00:30.181590+0000","last_clean":"2024-09-21T04:00:30.181590+0000","last_became_active":"2024-09-21T04:00:04.012901+0000","last_became_peered":"2024-09-21T04:00:04.012901+0000","last_unstale":"2024-09-21T04:00:30.181590+0000","last_undegraded":"2024-09-21T04:00:30.181590+0000","last_fullsized":"2024-09-21T04:00:30.181590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:50.952778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":63,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:55.242175+0000","last_change":"2024-09-21T04:00:01.987988+0000","last_active":"2024-09-21T04:00:55.242175+0000","last_peered":"2024-09-21T04:00:55.242175+0000","last_clean":"2024-09-21T04:00:55.242175+0000","last_became_active":"2024-09-21T04:00:01.986593+0000","last_became_peered":"2024-09-21T04:00:01.986593+0000","last_unstale":"2024-09-21T04:00:55.242175+0000","last_undegraded":"2024-09-21T04:00:55.242175+0000","last_fullsized":"2024-09-21T04:00:55.242175+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.256609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395293+0000","last_change":"2024-09-21T04:00:11.064937+0000","last_active":"2024-09-21T04:00:30.395293+0000","last_peered":"2024-09-21T04:00:30.395293+0000","last_clean":"2024-09-21T04:00:30.395293+0000","last_became_active":"2024-09-21T04:00:11.063809+0000","last_became_peered":"2024-09-21T04:00:11.063809+0000","last_unstale":"2024-09-21T04:00:30.395293+0000","last_undegraded":"2024-09-21T04:00:30.395293+0000","last_fullsized":"2024-09-21T04:00:30.395293+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:00.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132621+0000","last_change":"2024-09-21T04:00:11.068084+0000","last_active":"2024-09-21T04:00:30.132621+0000","last_peered":"2024-09-21T04:00:30.132621+0000","last_clean":"2024-09-21T04:00:30.132621+0000","last_became_active":"2024-09-21T04:00:11.067587+0000","last_became_peered":"2024-09-21T04:00:11.067587+0000","last_unstale":"2024-09-21T04:00:30.132621+0000","last_undegraded":"2024-09-21T04:00:30.132621+0000","last_fullsized":"2024-09-21T04:00:30.132621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:30.849467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131008+0000","last_change":"2024-09-21T04:00:03.997501+0000","last_active":"2024-09-21T04:00:30.131008+0000","last_peered":"2024-09-21T04:00:30.131008+0000","last_clean":"2024-09-21T04:00:30.131008+0000","last_became_active":"2024-09-21T04:00:03.997100+0000","last_became_peered":"2024-09-21T04:00:03.997100+0000","last_unstale":"2024-09-21T04:00:30.131008+0000","last_undegraded":"2024-09-21T04:00:30.131008+0000","last_fullsized":"2024-09-21T04:00:30.131008+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:31.813970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":40,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:44.218990+0000","last_change":"2024-09-21T04:00:01.986224+0000","last_active":"2024-09-21T04:00:44.218990+0000","last_peered":"2024-09-21T04:00:44.218990+0000","last_clean":"2024-09-21T04:00:44.218990+0000","last_became_active":"2024-09-21T04:00:01.985845+0000","last_became_peered":"2024-09-21T04:00:01.985845+0000","last_unstale":"2024-09-21T04:00:44.218990+0000","last_undegraded":"2024-09-21T04:00:44.218990+0000","last_fullsized":"2024-09-21T04:00:44.218990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:38.895288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348497+0000","last_change":"2024-09-21T04:00:11.067705+0000","last_active":"2024-09-21T04:00:30.348497+0000","last_peered":"2024-09-21T04:00:30.348497+0000","last_clean":"2024-09-21T04:00:30.348497+0000","last_became_active":"2024-09-21T04:00:11.067252+0000","last_became_peered":"2024-09-21T04:00:11.067252+0000","last_unstale":"2024-09-21T04:00:30.348497+0000","last_undegraded":"2024-09-21T04:00:30.348497+0000","last_fullsized":"2024-09-21T04:00:30.348497+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:47.003323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395044+0000","last_change":"2024-09-21T04:00:03.996067+0000","last_active":"2024-09-21T04:00:30.395044+0000","last_peered":"2024-09-21T04:00:30.395044+0000","last_clean":"2024-09-21T04:00:30.395044+0000","last_became_active":"2024-09-21T04:00:03.995603+0000","last_became_peered":"2024-09-21T04:00:03.995603+0000","last_unstale":"2024-09-21T04:00:30.395044+0000","last_undegraded":"2024-09-21T04:00:30.395044+0000","last_fullsized":"2024-09-21T04:00:30.395044+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:19.348461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:42.204354+0000","last_change":"2024-09-21T04:00:01.985283+0000","last_active":"2024-09-21T04:00:42.204354+0000","last_peered":"2024-09-21T04:00:42.204354+0000","last_clean":"2024-09-21T04:00:42.204354+0000","last_became_active":"2024-09-21T04:00:01.984860+0000","last_became_peered":"2024-09-21T04:00:01.984860+0000","last_unstale":"2024-09-21T04:00:42.204354+0000","last_undegraded":"2024-09-21T04:00:42.204354+0000","last_fullsized":"2024-09-21T04:00:42.204354+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:38.739987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":51,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:43.213271+0000","last_change":"2024-09-21T04:00:30.183241+0000","last_active":"2024-09-21T04:00:43.213271+0000","last_peered":"2024-09-21T04:00:43.213271+0000","last_clean":"2024-09-21T04:00:43.213271+0000","last_became_active":"2024-09-21T04:00:30.182788+0000","last_became_peered":"2024-09-21T04:00:30.182788+0000","last_unstale":"2024-09-21T04:00:43.213271+0000","last_undegraded":"2024-09-21T04:00:43.213271+0000","last_fullsized":"2024-09-21T04:00:43.213271+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:47.129478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132201+0000","last_change":"2024-09-21T04:00:04.004526+0000","last_active":"2024-09-21T04:00:30.132201+0000","last_peered":"2024-09-21T04:00:30.132201+0000","last_clean":"2024-09-21T04:00:30.132201+0000","last_became_active":"2024-09-21T04:00:04.004114+0000","last_became_peered":"2024-09-21T04:00:04.004114+0000","last_unstale":"2024-09-21T04:00:30.132201+0000","last_undegraded":"2024-09-21T04:00:30.132201+0000","last_fullsized":"2024-09-21T04:00:30.132201+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:50.212647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.136657+0000","last_change":"2024-09-21T04:00:11.067811+0000","last_active":"2024-09-21T04:00:30.136657+0000","last_peered":"2024-09-21T04:00:30.136657+0000","last_clean":"2024-09-21T04:00:30.136657+0000","last_became_active":"2024-09-21T04:00:11.067280+0000","last_became_peered":"2024-09-21T04:00:11.067280+0000","last_unstale":"2024-09-21T04:00:30.136657+0000","last_undegraded":"2024-09-21T04:00:30.136657+0000","last_fullsized":"2024-09-21T04:00:30.136657+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:08.152231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":56,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:56.244480+0000","last_change":"2024-09-21T04:00:01.987215+0000","last_active":"2024-09-21T04:00:56.244480+0000","last_peered":"2024-09-21T04:00:56.244480+0000","last_clean":"2024-09-21T04:00:56.244480+0000","last_became_active":"2024-09-21T04:00:01.986738+0000","last_became_peered":"2024-09-21T04:00:01.986738+0000","last_unstale":"2024-09-21T04:00:56.244480+0000","last_undegraded":"2024-09-21T04:00:56.244480+0000","last_fullsized":"2024-09-21T04:00:56.244480+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:16.204316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132688+0000","last_change":"2024-09-21T04:00:04.003232+0000","last_active":"2024-09-21T04:00:30.132688+0000","last_peered":"2024-09-21T04:00:30.132688+0000","last_clean":"2024-09-21T04:00:30.132688+0000","last_became_active":"2024-09-21T04:00:04.002865+0000","last_became_peered":"2024-09-21T04:00:04.002865+0000","last_unstale":"2024-09-21T04:00:30.132688+0000","last_undegraded":"2024-09-21T04:00:30.132688+0000","last_fullsized":"2024-09-21T04:00:30.132688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:29.298836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.137586+0000","last_change":"2024-09-21T04:00:11.057591+0000","last_active":"2024-09-21T04:00:30.137586+0000","last_peered":"2024-09-21T04:00:30.137586+0000","last_clean":"2024-09-21T04:00:30.137586+0000","last_became_active":"2024-09-21T04:00:11.057092+0000","last_became_peered":"2024-09-21T04:00:11.057092+0000","last_unstale":"2024-09-21T04:00:30.137586+0000","last_undegraded":"2024-09-21T04:00:30.137586+0000","last_fullsized":"2024-09-21T04:00:30.137586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:47.487649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.347982+0000","last_change":"2024-09-21T04:00:04.010297+0000","last_active":"2024-09-21T04:00:30.347982+0000","last_peered":"2024-09-21T04:00:30.347982+0000","last_clean":"2024-09-21T04:00:30.347982+0000","last_became_active":"2024-09-21T04:00:04.009948+0000","last_became_peered":"2024-09-21T04:00:04.009948+0000","last_unstale":"2024-09-21T04:00:30.347982+0000","last_undegraded":"2024-09-21T04:00:30.347982+0000","last_fullsized":"2024-09-21T04:00:30.347982+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:07.927430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.136744+0000","last_change":"2024-09-21T04:00:04.005564+0000","last_active":"2024-09-21T04:00:30.136744+0000","last_peered":"2024-09-21T04:00:30.136744+0000","last_clean":"2024-09-21T04:00:30.136744+0000","last_became_active":"2024-09-21T04:00:04.005119+0000","last_became_peered":"2024-09-21T04:00:04.005119+0000","last_unstale":"2024-09-21T04:00:30.136744+0000","last_undegraded":"2024-09-21T04:00:30.136744+0000","last_fullsized":"2024-09-21T04:00:30.136744+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:05.844333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.137110+0000","last_change":"2024-09-21T04:00:03.997004+0000","last_active":"2024-09-21T04:00:30.137110+0000","last_peered":"2024-09-21T04:00:30.137110+0000","last_clean":"2024-09-21T04:00:30.137110+0000","last_became_active":"2024-09-21T04:00:03.996570+0000","last_became_peered":"2024-09-21T04:00:03.996570+0000","last_unstale":"2024-09-21T04:00:30.137110+0000","last_undegraded":"2024-09-21T04:00:30.137110+0000","last_fullsized":"2024-09-21T04:00:30.137110+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.134182+0000","last_change":"2024-09-21T04:00:04.005794+0000","last_active":"2024-09-21T04:00:30.134182+0000","last_peered":"2024-09-21T04:00:30.134182+0000","last_clean":"2024-09-21T04:00:30.134182+0000","last_became_active":"2024-09-21T04:00:04.005345+0000","last_became_peered":"2024-09-21T04:00:04.005345+0000","last_unstale":"2024-09-21T04:00:30.134182+0000","last_undegraded":"2024-09-21T04:00:30.134182+0000","last_fullsized":"2024-09-21T04:00:30.134182+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:20.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135356+0000","last_change":"2024-09-21T04:00:03.992204+0000","last_active":"2024-09-21T04:00:30.135356+0000","last_peered":"2024-09-21T04:00:30.135356+0000","last_clean":"2024-09-21T04:00:30.135356+0000","last_became_active":"2024-09-21T04:00:03.991826+0000","last_became_peered":"2024-09-21T04:00:03.991826+0000","last_unstale":"2024-09-21T04:00:30.135356+0000","last_undegraded":"2024-09-21T04:00:30.135356+0000","last_fullsized":"2024-09-21T04:00:30.135356+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.443227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348543+0000","last_change":"2024-09-21T04:00:04.004401+0000","last_active":"2024-09-21T04:00:30.348543+0000","last_peered":"2024-09-21T04:00:30.348543+0000","last_clean":"2024-09-21T04:00:30.348543+0000","last_became_active":"2024-09-21T04:00:04.003983+0000","last_became_peered":"2024-09-21T04:00:04.003983+0000","last_unstale":"2024-09-21T04:00:30.348543+0000","last_undegraded":"2024-09-21T04:00:30.348543+0000","last_fullsized":"2024-09-21T04:00:30.348543+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:06.250069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.137447+0000","last_change":"2024-09-21T04:00:03.999692+0000","last_active":"2024-09-21T04:00:30.137447+0000","last_peered":"2024-09-21T04:00:30.137447+0000","last_clean":"2024-09-21T04:00:30.137447+0000","last_became_active":"2024-09-21T04:00:03.999282+0000","last_became_peered":"2024-09-21T04:00:03.999282+0000","last_unstale":"2024-09-21T04:00:30.137447+0000","last_undegraded":"2024-09-21T04:00:30.137447+0000","last_fullsized":"2024-09-21T04:00:30.137447+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.323350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395275+0000","last_change":"2024-09-21T04:00:04.002947+0000","last_active":"2024-09-21T04:00:30.395275+0000","last_peered":"2024-09-21T04:00:30.395275+0000","last_clean":"2024-09-21T04:00:30.395275+0000","last_became_active":"2024-09-21T04:00:04.002550+0000","last_became_peered":"2024-09-21T04:00:04.002550+0000","last_unstale":"2024-09-21T04:00:30.395275+0000","last_undegraded":"2024-09-21T04:00:30.395275+0000","last_fullsized":"2024-09-21T04:00:30.395275+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:17.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131820+0000","last_change":"2024-09-21T04:00:04.009700+0000","last_active":"2024-09-21T04:00:30.131820+0000","last_peered":"2024-09-21T04:00:30.131820+0000","last_clean":"2024-09-21T04:00:30.131820+0000","last_became_active":"2024-09-21T04:00:04.009311+0000","last_became_peered":"2024-09-21T04:00:04.009311+0000","last_unstale":"2024-09-21T04:00:30.131820+0000","last_undegraded":"2024-09-21T04:00:30.131820+0000","last_fullsized":"2024-09-21T04:00:30.131820+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.658543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.395001+0000","last_change":"2024-09-21T04:00:04.002975+0000","last_active":"2024-09-21T04:00:30.395001+0000","last_peered":"2024-09-21T04:00:30.395001+0000","last_clean":"2024-09-21T04:00:30.395001+0000","last_became_active":"2024-09-21T04:00:04.002608+0000","last_became_peered":"2024-09-21T04:00:04.002608+0000","last_unstale":"2024-09-21T04:00:30.395001+0000","last_undegraded":"2024-09-21T04:00:30.395001+0000","last_fullsized":"2024-09-21T04:00:30.395001+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:13.044615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181506+0000","last_change":"2024-09-21T04:00:04.010797+0000","last_active":"2024-09-21T04:00:30.181506+0000","last_peered":"2024-09-21T04:00:30.181506+0000","last_clean":"2024-09-21T04:00:30.181506+0000","last_became_active":"2024-09-21T04:00:04.010377+0000","last_became_peered":"2024-09-21T04:00:04.010377+0000","last_unstale":"2024-09-21T04:00:30.181506+0000","last_undegraded":"2024-09-21T04:00:30.181506+0000","last_fullsized":"2024-09-21T04:00:30.181506+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:58.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.135262+0000","last_change":"2024-09-21T04:00:04.002841+0000","last_active":"2024-09-21T04:00:30.135262+0000","last_peered":"2024-09-21T04:00:30.135262+0000","last_clean":"2024-09-21T04:00:30.135262+0000","last_became_active":"2024-09-21T04:00:04.002491+0000","last_became_peered":"2024-09-21T04:00:04.002491+0000","last_unstale":"2024-09-21T04:00:30.135262+0000","last_undegraded":"2024-09-21T04:00:30.135262+0000","last_fullsized":"2024-09-21T04:00:30.135262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:52.816860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348286+0000","last_change":"2024-09-21T04:00:04.007238+0000","last_active":"2024-09-21T04:00:30.348286+0000","last_peered":"2024-09-21T04:00:30.348286+0000","last_clean":"2024-09-21T04:00:30.348286+0000","last_became_active":"2024-09-21T04:00:04.006898+0000","last_became_peered":"2024-09-21T04:00:04.006898+0000","last_unstale":"2024-09-21T04:00:30.348286+0000","last_undegraded":"2024-09-21T04:00:30.348286+0000","last_fullsized":"2024-09-21T04:00:30.348286+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.957214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.137877+0000","last_change":"2024-09-21T04:00:03.997131+0000","last_active":"2024-09-21T04:00:30.137877+0000","last_peered":"2024-09-21T04:00:30.137877+0000","last_clean":"2024-09-21T04:00:30.137877+0000","last_became_active":"2024-09-21T04:00:03.996711+0000","last_became_peered":"2024-09-21T04:00:03.996711+0000","last_unstale":"2024-09-21T04:00:30.137877+0000","last_undegraded":"2024-09-21T04:00:30.137877+0000","last_fullsized":"2024-09-21T04:00:30.137877+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:25.373743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.131542+0000","last_change":"2024-09-21T04:00:04.004067+0000","last_active":"2024-09-21T04:00:30.131542+0000","last_peered":"2024-09-21T04:00:30.131542+0000","last_clean":"2024-09-21T04:00:30.131542+0000","last_became_active":"2024-09-21T04:00:04.003707+0000","last_became_peered":"2024-09-21T04:00:04.003707+0000","last_unstale":"2024-09-21T04:00:30.131542+0000","last_undegraded":"2024-09-21T04:00:30.131542+0000","last_fullsized":"2024-09-21T04:00:30.131542+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:24.148194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348770+0000","last_change":"2024-09-21T04:00:04.000068+0000","last_active":"2024-09-21T04:00:30.348770+0000","last_peered":"2024-09-21T04:00:30.348770+0000","last_clean":"2024-09-21T04:00:30.348770+0000","last_became_active":"2024-09-21T04:00:03.999709+0000","last_became_peered":"2024-09-21T04:00:03.999709+0000","last_unstale":"2024-09-21T04:00:30.348770+0000","last_undegraded":"2024-09-21T04:00:30.348770+0000","last_fullsized":"2024-09-21T04:00:30.348770+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:51.249309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.180986+0000","last_change":"2024-09-21T04:00:04.011884+0000","last_active":"2024-09-21T04:00:30.180986+0000","last_peered":"2024-09-21T04:00:30.180986+0000","last_clean":"2024-09-21T04:00:30.180986+0000","last_became_active":"2024-09-21T04:00:04.011449+0000","last_became_peered":"2024-09-21T04:00:04.011449+0000","last_unstale":"2024-09-21T04:00:30.180986+0000","last_undegraded":"2024-09-21T04:00:30.180986+0000","last_fullsized":"2024-09-21T04:00:30.180986+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:46.948465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132422+0000","last_change":"2024-09-21T04:00:03.992848+0000","last_active":"2024-09-21T04:00:30.132422+0000","last_peered":"2024-09-21T04:00:30.132422+0000","last_clean":"2024-09-21T04:00:30.132422+0000","last_became_active":"2024-09-21T04:00:03.991096+0000","last_became_peered":"2024-09-21T04:00:03.991096+0000","last_unstale":"2024-09-21T04:00:30.132422+0000","last_undegraded":"2024-09-21T04:00:30.132422+0000","last_fullsized":"2024-09-21T04:00:30.132422+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:19.599848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132458+0000","last_change":"2024-09-21T04:00:04.000380+0000","last_active":"2024-09-21T04:00:30.132458+0000","last_peered":"2024-09-21T04:00:30.132458+0000","last_clean":"2024-09-21T04:00:30.132458+0000","last_became_active":"2024-09-21T04:00:03.999918+0000","last_became_peered":"2024-09-21T04:00:03.999918+0000","last_unstale":"2024-09-21T04:00:30.132458+0000","last_undegraded":"2024-09-21T04:00:30.132458+0000","last_fullsized":"2024-09-21T04:00:30.132458+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:25.607882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.138159+0000","last_change":"2024-09-21T04:00:30.138053+0000","last_active":"2024-09-21T04:00:30.138159+0000","last_peered":"2024-09-21T04:00:30.138159+0000","last_clean":"2024-09-21T04:00:30.138159+0000","last_became_active":"2024-09-21T04:00:30.137682+0000","last_became_peered":"2024-09-21T04:00:30.137682+0000","last_unstale":"2024-09-21T04:00:30.138159+0000","last_undegraded":"2024-09-21T04:00:30.138159+0000","last_fullsized":"2024-09-21T04:00:30.138159+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.031655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132817+0000","last_change":"2024-09-21T04:00:04.004313+0000","last_active":"2024-09-21T04:00:30.132817+0000","last_peered":"2024-09-21T04:00:30.132817+0000","last_clean":"2024-09-21T04:00:30.132817+0000","last_became_active":"2024-09-21T04:00:04.003128+0000","last_became_peered":"2024-09-21T04:00:04.003128+0000","last_unstale":"2024-09-21T04:00:30.132817+0000","last_undegraded":"2024-09-21T04:00:30.132817+0000","last_fullsized":"2024-09-21T04:00:30.132817+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:43.469449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.139897+0000","last_change":"2024-09-21T04:00:04.017136+0000","last_active":"2024-09-21T04:00:30.139897+0000","last_peered":"2024-09-21T04:00:30.139897+0000","last_clean":"2024-09-21T04:00:30.139897+0000","last_became_active":"2024-09-21T04:00:04.016732+0000","last_became_peered":"2024-09-21T04:00:04.016732+0000","last_unstale":"2024-09-21T04:00:30.139897+0000","last_undegraded":"2024-09-21T04:00:30.139897+0000","last_fullsized":"2024-09-21T04:00:30.139897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:04.021078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.136071+0000","last_change":"2024-09-21T04:00:04.012098+0000","last_active":"2024-09-21T04:00:30.136071+0000","last_peered":"2024-09-21T04:00:30.136071+0000","last_clean":"2024-09-21T04:00:30.136071+0000","last_became_active":"2024-09-21T04:00:04.011681+0000","last_became_peered":"2024-09-21T04:00:04.011681+0000","last_unstale":"2024-09-21T04:00:30.136071+0000","last_undegraded":"2024-09-21T04:00:30.136071+0000","last_fullsized":"2024-09-21T04:00:30.136071+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:59.202312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.181838+0000","last_change":"2024-09-21T04:00:04.017056+0000","last_active":"2024-09-21T04:00:30.181838+0000","last_peered":"2024-09-21T04:00:30.181838+0000","last_clean":"2024-09-21T04:00:30.181838+0000","last_became_active":"2024-09-21T04:00:04.015950+0000","last_became_peered":"2024-09-21T04:00:04.015950+0000","last_unstale":"2024-09-21T04:00:30.181838+0000","last_undegraded":"2024-09-21T04:00:30.181838+0000","last_fullsized":"2024-09-21T04:00:30.181838+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:11.267161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.394931+0000","last_change":"2024-09-21T04:00:04.010314+0000","last_active":"2024-09-21T04:00:30.394931+0000","last_peered":"2024-09-21T04:00:30.394931+0000","last_clean":"2024-09-21T04:00:30.394931+0000","last_became_active":"2024-09-21T04:00:04.009917+0000","last_became_peered":"2024-09-21T04:00:04.009917+0000","last_unstale":"2024-09-21T04:00:30.394931+0000","last_undegraded":"2024-09-21T04:00:30.394931+0000","last_fullsized":"2024-09-21T04:00:30.394931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:32.947079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.138830+0000","last_change":"2024-09-21T04:00:04.007104+0000","last_active":"2024-09-21T04:00:30.138830+0000","last_peered":"2024-09-21T04:00:30.138830+0000","last_clean":"2024-09-21T04:00:30.138830+0000","last_became_active":"2024-09-21T04:00:04.006655+0000","last_became_peered":"2024-09-21T04:00:04.006655+0000","last_unstale":"2024-09-21T04:00:30.138830+0000","last_undegraded":"2024-09-21T04:00:30.138830+0000","last_fullsized":"2024-09-21T04:00:30.138830+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.834305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.134726+0000","last_change":"2024-09-21T04:00:04.007842+0000","last_active":"2024-09-21T04:00:30.134726+0000","last_peered":"2024-09-21T04:00:30.134726+0000","last_clean":"2024-09-21T04:00:30.134726+0000","last_became_active":"2024-09-21T04:00:04.007223+0000","last_became_peered":"2024-09-21T04:00:04.007223+0000","last_unstale":"2024-09-21T04:00:30.134726+0000","last_undegraded":"2024-09-21T04:00:30.134726+0000","last_fullsized":"2024-09-21T04:00:30.134726+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:01.501836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132353+0000","last_change":"2024-09-21T04:00:03.997390+0000","last_active":"2024-09-21T04:00:30.132353+0000","last_peered":"2024-09-21T04:00:30.132353+0000","last_clean":"2024-09-21T04:00:30.132353+0000","last_became_active":"2024-09-21T04:00:03.997075+0000","last_became_peered":"2024-09-21T04:00:03.997075+0000","last_unstale":"2024-09-21T04:00:30.132353+0000","last_undegraded":"2024-09-21T04:00:30.132353+0000","last_fullsized":"2024-09-21T04:00:30.132353+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:50.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132678+0000","last_change":"2024-09-21T04:00:04.006203+0000","last_active":"2024-09-21T04:00:30.132678+0000","last_peered":"2024-09-21T04:00:30.132678+0000","last_clean":"2024-09-21T04:00:30.132678+0000","last_became_active":"2024-09-21T04:00:04.005150+0000","last_became_peered":"2024-09-21T04:00:04.005150+0000","last_unstale":"2024-09-21T04:00:30.132678+0000","last_undegraded":"2024-09-21T04:00:30.132678+0000","last_fullsized":"2024-09-21T04:00:30.132678+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:17.635568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132931+0000","last_change":"2024-09-21T04:00:04.011843+0000","last_active":"2024-09-21T04:00:30.132931+0000","last_peered":"2024-09-21T04:00:30.132931+0000","last_clean":"2024-09-21T04:00:30.132931+0000","last_became_active":"2024-09-21T04:00:04.011570+0000","last_became_peered":"2024-09-21T04:00:04.011570+0000","last_unstale":"2024-09-21T04:00:30.132931+0000","last_undegraded":"2024-09-21T04:00:30.132931+0000","last_fullsized":"2024-09-21T04:00:30.132931+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:59.883217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":31,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.132743+0000","last_change":"2024-09-21T04:00:04.002111+0000","last_active":"2024-09-21T04:00:30.132743+0000","last_peered":"2024-09-21T04:00:30.132743+0000","last_clean":"2024-09-21T04:00:30.132743+0000","last_became_active":"2024-09-21T04:00:04.001723+0000","last_became_peered":"2024-09-21T04:00:04.001723+0000","last_unstale":"2024-09-21T04:00:30.132743+0000","last_undegraded":"2024-09-21T04:00:30.132743+0000","last_fullsized":"2024-09-21T04:00:30.132743+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:32.595150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-21T04:00:30.348687+0000","last_change":"2024-09-21T04:00:03.998822+0000","last_active":"2024-09-21T04:00:30.348687+0000","last_peered":"2024-09-21T04:00:30.348687+0000","last_clean":"2024-09-21T04:00:30.348687+0000","last_became_active":"2024-09-21T04:00:03.998445+0000","last_became_peered":"2024-09-21T04:00:03.998445+0000","last_unstale":"2024-09-21T04:00:30.348687+0000","last_undegraded":"2024-09-21T04:00:30.348687+0000","last_fullsized":"2024-09-21T04:00:30.348687+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.090570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":60047,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":151,"num_read_kb":140,"num_write":233,"num_write_kb":127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":540672,"data_stored":180141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":202,"ondisk_log_size":202,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282913,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776151,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32084,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713068,"statfs":{"total":95995035648,"available":95962181632,"internally_reserved":0,"allocated":921600,"data_stored":474769,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972380,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28060,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717092,"statfs":{"total":95995035648,"available":95966302208,"internally_reserved":0,"allocated":1060864,"data_stored":1114819,"data_compressed":62460,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135905,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27952,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717200,"statfs":{"total":95995035648,"available":95966412800,"internally_reserved":0,"allocated":950272,"data_stored":478795,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332134,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":942080,"data_stored":475077,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528364,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":1071574,"data_compressed":62460,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691889,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36244,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708908,"statfs":{"total":95995035648,"available":95957921792,"internally_reserved":0,"allocated":921600,"data_stored":470594,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888119,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36324,"kb_used_data":980,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708828,"statfs":{"total":95995035648,"available":95957839872,"internally_reserved":0,"allocated":1003520,"data_stored":1066765,"data_compressed":62460,"data_compressed_allocated":81920,"data_compressed_original":663552,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051643,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":929792,"data_stored":474277,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247873,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36256,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708896,"statfs":{"total":95995035648,"available":95957909504,"internally_reserved":0,"allocated":933888,"data_stored":469911,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444102,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32160,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712992,"statfs":{"total":95995035648,"available":95962103808,"internally_reserved":0,"allocated":999424,"data_stored":524687,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":978944,"data_stored":524858,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":471659,"data_compressed":26488,"data_compressed_allocated":36864,"data_compressed_original":73728,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":55377,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":55206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":54970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T04:01:01.580 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T04:01:01.581 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T04:01:01.581 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T04:01:01.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:01 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:01.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:01 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:01.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:01 smithi022 ceph-mon[31015]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:01.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:01 smithi022 ceph-mon[31015]: pgmap v329: 129 pgs: 129 active+clean; 643 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2024-09-21T04:01:01.852 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:01.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:01 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:01.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:01 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:01.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:01 smithi073 ceph-mon[34443]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:01.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:01 smithi073 ceph-mon[34443]: pgmap v329: 129 pgs: 129 active+clean; 643 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2024-09-21T04:01:01.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:01 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:01.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:01 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:01.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:01 smithi060 ceph-mon[33722]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:01.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:01 smithi060 ceph-mon[33722]: pgmap v329: 129 pgs: 129 active+clean; 643 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.9 KiB/s wr, 15 op/s 2024-09-21T04:01:02.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 -- 172.21.15.22:0/4108433383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ad0105180 msgr2=0x7f0ad010bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:02.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 --2- 172.21.15.22:0/4108433383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ad0105180 0x7f0ad010bb20 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f0ac8009ca0 tx=0x7f0ac802a950 comp rx=0 tx=0).stop 2024-09-21T04:01:02.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 -- 172.21.15.22:0/4108433383 shutdown_connections 2024-09-21T04:01:02.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 --2- 172.21.15.22:0/4108433383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ad0105180 0x7f0ad010bb20 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:02.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 --2- 172.21.15.22:0/4108433383 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad01047e0 0x7f0ad0104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 --2- 172.21.15.22:0/4108433383 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad0103750 0x7f0ad0103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 -- 172.21.15.22:0/4108433383 >> 172.21.15.22:0/4108433383 conn(0x7f0ad00ff0c0 msgr2=0x7f0ad0101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 -- 172.21.15.22:0/4108433383 shutdown_connections 2024-09-21T04:01:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 -- 172.21.15.22:0/4108433383 wait complete. 2024-09-21T04:01:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 Processor -- start 2024-09-21T04:01:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.406+0000 7f0ad7758640 1 -- start start 2024-09-21T04:01:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad7758640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad0103750 0x7f0ad0199eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:02.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad7758640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad01047e0 0x7f0ad019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad7758640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ad0105180 0x7f0ad019b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad7758640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad010f250 con 0x7f0ad0105180 2024-09-21T04:01:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad7758640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad010f0d0 con 0x7f0ad0103750 2024-09-21T04:01:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad7758640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0ad010f3d0 con 0x7f0ad01047e0 2024-09-21T04:01:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad5cf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ad0105180 0x7f0ad019b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad5cf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ad0105180 0x7f0ad019b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46602/0 (socket says 172.21.15.22:46602) 2024-09-21T04:01:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad5cf5640 1 -- 172.21.15.22:0/72376157 learned_addr learned my addr 172.21.15.22:0/72376157 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:02.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad4cf3640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad01047e0 0x7f0ad019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad54f4640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad0103750 0x7f0ad0199eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad5cf5640 1 -- 172.21.15.22:0/72376157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad01047e0 msgr2=0x7f0ad019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad5cf5640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad01047e0 0x7f0ad019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad5cf5640 1 -- 172.21.15.22:0/72376157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad0103750 msgr2=0x7f0ad0199eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad5cf5640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad0103750 0x7f0ad0199eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad5cf5640 1 -- 172.21.15.22:0/72376157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ad019b8e0 con 0x7f0ad0105180 2024-09-21T04:01:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.407+0000 7f0ad5cf5640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ad0105180 0x7f0ad019b0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0ac802f800 tx=0x7f0ac8003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:02.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.408+0000 7f0ac67fc640 1 -- 172.21.15.22:0/72376157 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8034040 con 0x7f0ad0105180 2024-09-21T04:01:02.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.408+0000 7f0ad7758640 1 -- 172.21.15.22:0/72376157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ad019bb70 con 0x7f0ad0105180 2024-09-21T04:01:02.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.408+0000 7f0ac67fc640 1 -- 172.21.15.22:0/72376157 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ac8030850 con 0x7f0ad0105180 2024-09-21T04:01:02.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.408+0000 7f0ac67fc640 1 -- 172.21.15.22:0/72376157 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ac8039430 con 0x7f0ad0105180 2024-09-21T04:01:02.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.408+0000 7f0ad7758640 1 -- 172.21.15.22:0/72376157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ad01a22d0 con 0x7f0ad0105180 2024-09-21T04:01:02.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.409+0000 7f0ad7758640 1 -- 172.21.15.22:0/72376157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ad0103bc0 con 0x7f0ad0105180 2024-09-21T04:01:02.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.411+0000 7f0ac67fc640 1 -- 172.21.15.22:0/72376157 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f0ac8037020 con 0x7f0ad0105180 2024-09-21T04:01:02.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.411+0000 7f0ac67fc640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0abc0b65a0 0x7f0abc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:02.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.411+0000 7f0ac67fc640 1 -- 172.21.15.22:0/72376157 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f0ac81088e0 con 0x7f0ad0105180 2024-09-21T04:01:02.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.411+0000 7f0ad54f4640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0abc0b65a0 0x7f0abc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:02.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.412+0000 7f0ad54f4640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0abc0b65a0 0x7f0abc0b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0acc005fd0 tx=0x7f0acc005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:02.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.414+0000 7f0ac67fc640 1 -- 172.21.15.22:0/72376157 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0ac80ced40 con 0x7f0ad0105180 2024-09-21T04:01:02.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.675+0000 7f0ad7758640 1 -- 172.21.15.22:0/72376157 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f0ad010a930 con 0x7f0ad0105180 2024-09-21T04:01:02.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.678+0000 7f0ac67fc640 1 -- 172.21.15.22:0/72376157 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f0ad010a930 con 0x7f0ad0105180 2024-09-21T04:01:02.681 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-09-21T04:01:02.681 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQD+RO5mQGRaKBAARLWbbboAwgYIBZcGU0GLzA== 2024-09-21T04:01:02.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 -- 172.21.15.22:0/72376157 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0abc0b65a0 msgr2=0x7f0abc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0abc0b65a0 0x7f0abc0b8ab0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0acc005fd0 tx=0x7f0acc005850 comp rx=0 tx=0).stop 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 -- 172.21.15.22:0/72376157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ad0105180 msgr2=0x7f0ad019b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ad0105180 0x7f0ad019b0c0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f0ac802f800 tx=0x7f0ac8003f90 comp rx=0 tx=0).stop 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 -- 172.21.15.22:0/72376157 shutdown_connections 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0abc0b65a0 0x7f0abc0b8ab0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0ad01047e0 0x7f0ad019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0ad0105180 0x7f0ad019b0c0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 --2- 172.21.15.22:0/72376157 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0ad0103750 0x7f0ad0199eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 -- 172.21.15.22:0/72376157 >> 172.21.15.22:0/72376157 conn(0x7f0ad00ff0c0 msgr2=0x7f0ad0107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 -- 172.21.15.22:0/72376157 shutdown_connections 2024-09-21T04:01:02.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:02.681+0000 7f0ad7758640 1 -- 172.21.15.22:0/72376157 wait complete. 2024-09-21T04:01:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:01:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:01:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:02 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/72376157' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T04:01:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:02 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/72376157' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T04:01:02.995 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:01:02.995 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:01:02.996 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:02.996 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:02 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/72376157' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T04:01:02.996 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:02 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/72376157' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T04:01:03.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:01:03.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:01:03.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:01:03.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:02 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/72376157' entity='client.admin' cmd={"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} : dispatch 2024-09-21T04:01:03.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:02 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/72376157' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T04:01:03.345 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T04:01:03.345 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T04:01:03.345 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T04:01:03.386 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T04:01:03.685 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:03.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:03 smithi060 ceph-mon[33722]: pgmap v330: 129 pgs: 129 active+clean; 643 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-09-21T04:01:03.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:03 smithi022 ceph-mon[31015]: pgmap v330: 129 pgs: 129 active+clean; 643 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-09-21T04:01:04.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:03 smithi073 ceph-mon[34443]: pgmap v330: 129 pgs: 129 active+clean; 643 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-09-21T04:01:04.194 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.192+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/3745997444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ea41083c0 msgr2=0x7f5ea41087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.192+0000 7f5ea8b2d640 1 --2- 172.21.15.22:0/3745997444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ea41083c0 0x7f5ea41087d0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f5e98009900 tx=0x7f5e9802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.192+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/3745997444 shutdown_connections 2024-09-21T04:01:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.192+0000 7f5ea8b2d640 1 --2- 172.21.15.22:0/3745997444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea4108d10 0x7f5ea410f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.192+0000 7f5ea8b2d640 1 --2- 172.21.15.22:0/3745997444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ea41083c0 0x7f5ea41087d0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.192+0000 7f5ea8b2d640 1 --2- 172.21.15.22:0/3745997444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea4102a80 0x7f5ea4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.192+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/3745997444 >> 172.21.15.22:0/3745997444 conn(0x7f5ea4079740 msgr2=0x7f5ea4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.192+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/3745997444 shutdown_connections 2024-09-21T04:01:04.195 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.192+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/3745997444 wait complete. 2024-09-21T04:01:04.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea8b2d640 1 Processor -- start 2024-09-21T04:01:04.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea8b2d640 1 -- start start 2024-09-21T04:01:04.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea8b2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ea4102a80 0x7f5ea40ff690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:04.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea8b2d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea41083c0 0x7f5ea40ffbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:04.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea8b2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea4108d10 0x7f5ea4100110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea8b2d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea4112830 con 0x7f5ea4102a80 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea8b2d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea41126b0 con 0x7f5ea41083c0 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea8b2d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea41129b0 con 0x7f5ea4108d10 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ea4102a80 0x7f5ea40ff690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ea4102a80 0x7f5ea40ff690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46616/0 (socket says 172.21.15.22:46616) 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.193+0000 7f5ea259c640 1 -- 172.21.15.22:0/2799744003 learned_addr learned my addr 172.21.15.22:0/2799744003 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea1d9b640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea41083c0 0x7f5ea40ffbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea2d9d640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea4108d10 0x7f5ea4100110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea259c640 1 -- 172.21.15.22:0/2799744003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea4108d10 msgr2=0x7f5ea4100110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea259c640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea4108d10 0x7f5ea4100110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea259c640 1 -- 172.21.15.22:0/2799744003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea41083c0 msgr2=0x7f5ea40ffbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea259c640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea41083c0 0x7f5ea40ffbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea259c640 1 -- 172.21.15.22:0/2799744003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea41a8670 con 0x7f5ea4102a80 2024-09-21T04:01:04.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea2d9d640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea4108d10 0x7f5ea4100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:04.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea1d9b640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea41083c0 0x7f5ea40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:04.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea259c640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ea4102a80 0x7f5ea40ff690 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400e9f0 tx=0x7f5e9400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:04.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5e937fe640 1 -- 172.21.15.22:0/2799744003 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e9400cd80 con 0x7f5ea4102a80 2024-09-21T04:01:04.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/2799744003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea41a8960 con 0x7f5ea4102a80 2024-09-21T04:01:04.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5e937fe640 1 -- 172.21.15.22:0/2799744003 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e940108c0 con 0x7f5ea4102a80 2024-09-21T04:01:04.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5e937fe640 1 -- 172.21.15.22:0/2799744003 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e940187c0 con 0x7f5ea4102a80 2024-09-21T04:01:04.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.194+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/2799744003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea41a8ec0 con 0x7f5ea4102a80 2024-09-21T04:01:04.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.195+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/2799744003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea4103d00 con 0x7f5ea4102a80 2024-09-21T04:01:04.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.197+0000 7f5e937fe640 1 -- 172.21.15.22:0/2799744003 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5e94010430 con 0x7f5ea4102a80 2024-09-21T04:01:04.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.198+0000 7f5e937fe640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5e8c0b65a0 0x7f5e8c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:04.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.198+0000 7f5ea1d9b640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5e8c0b65a0 0x7f5e8c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:04.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.198+0000 7f5e937fe640 1 -- 172.21.15.22:0/2799744003 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f5e940e8170 con 0x7f5ea4102a80 2024-09-21T04:01:04.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.198+0000 7f5ea1d9b640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5e8c0b65a0 0x7f5e8c0b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e98006010 tx=0x7f5e98005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:04.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.201+0000 7f5e937fe640 1 -- 172.21.15.22:0/2799744003 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5e940ae540 con 0x7f5ea4102a80 2024-09-21T04:01:04.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.391+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/2799744003 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f5ea4100990 con 0x7f5ea4102a80 2024-09-21T04:01:04.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.392+0000 7f5e937fe640 1 -- 172.21.15.22:0/2799744003 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v53) ==== 86+0+133 (secure 0 0 0) 0x7f5e940b2920 con 0x7f5ea4102a80 2024-09-21T04:01:04.394 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:04.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/2799744003 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5e8c0b65a0 msgr2=0x7f5e8c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:04.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5e8c0b65a0 0x7f5e8c0b8ab0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f5e98006010 tx=0x7f5e98005de0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/2799744003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ea4102a80 msgr2=0x7f5ea40ff690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ea4102a80 0x7f5ea40ff690 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f5e9400e9f0 tx=0x7f5e9400eeb0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/2799744003 shutdown_connections 2024-09-21T04:01:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5e8c0b65a0 0x7f5e8c0b8ab0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ea4108d10 0x7f5ea4100110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ea41083c0 0x7f5ea40ffbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 --2- 172.21.15.22:0/2799744003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ea4102a80 0x7f5ea40ff690 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/2799744003 >> 172.21.15.22:0/2799744003 conn(0x7f5ea4079740 msgr2=0x7f5ea406bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/2799744003 shutdown_connections 2024-09-21T04:01:04.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:04.394+0000 7f5ea8b2d640 1 -- 172.21.15.22:0/2799744003 wait complete. 2024-09-21T04:01:05.033 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:04 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2799744003' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T04:01:05.067 INFO:teuthology.orchestra.run.smithi022.stdout:[{"version":53,"timestamp":"2024-09-21T03:59:53.382456+0000","name":"","changes":[{"name":"mds.all/mds_join_fs","new_value":"all"}]}] 2024-09-21T04:01:05.067 INFO:tasks.ceph_manager:config epoch is 53 2024-09-21T04:01:05.067 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T04:01:05.068 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T04:01:05.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T04:01:05.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:04 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2799744003' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T04:01:05.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:04 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2799744003' entity='client.admin' cmd={"prefix": "config log", "num": 1, "format": "json"} : dispatch 2024-09-21T04:01:05.333 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:05.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.826+0000 7f30eae9f640 1 -- 172.21.15.22:0/3751452536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4103b60 msgr2=0x7f30e4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:05.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.826+0000 7f30eae9f640 1 --2- 172.21.15.22:0/3751452536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4103b60 0x7f30e4103f70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009900 tx=0x7f30d802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:05.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.826+0000 7f30eae9f640 1 -- 172.21.15.22:0/3751452536 shutdown_connections 2024-09-21T04:01:05.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.826+0000 7f30eae9f640 1 --2- 172.21.15.22:0/3751452536 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e41094a0 0x7f30e41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:05.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.826+0000 7f30eae9f640 1 --2- 172.21.15.22:0/3751452536 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e4109df0 0x7f30e4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:05.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.826+0000 7f30eae9f640 1 --2- 172.21.15.22:0/3751452536 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4103b60 0x7f30e4103f70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:05.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.826+0000 7f30eae9f640 1 -- 172.21.15.22:0/3751452536 >> 172.21.15.22:0/3751452536 conn(0x7f30e407b850 msgr2=0x7f30e407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:05.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.826+0000 7f30eae9f640 1 -- 172.21.15.22:0/3751452536 shutdown_connections 2024-09-21T04:01:05.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.826+0000 7f30eae9f640 1 -- 172.21.15.22:0/3751452536 wait complete. 2024-09-21T04:01:05.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.826+0000 7f30eae9f640 1 Processor -- start 2024-09-21T04:01:05.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30eae9f640 1 -- start start 2024-09-21T04:01:05.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30eae9f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4103b60 0x7f30e419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:05.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30eae9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e41094a0 0x7f30e419cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:05.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30eae9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4109df0 0x7f30e41a1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:05.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30eae9f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30e4113960 con 0x7f30e4103b60 2024-09-21T04:01:05.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30eae9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f30e41137e0 con 0x7f30e41094a0 2024-09-21T04:01:05.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30eae9f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f30e4113ae0 con 0x7f30e4109df0 2024-09-21T04:01:05.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e8c3b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4103b60 0x7f30e419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:05.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e8c3b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4103b60 0x7f30e419c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46620/0 (socket says 172.21.15.22:46620) 2024-09-21T04:01:05.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e8c3b640 1 -- 172.21.15.22:0/2306331591 learned_addr learned my addr 172.21.15.22:0/2306331591 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:05.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e3fff640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e41094a0 0x7f30e419cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:05.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e943c640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4109df0 0x7f30e41a1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:05.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e8c3b640 1 -- 172.21.15.22:0/2306331591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4109df0 msgr2=0x7f30e41a1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:05.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e8c3b640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4109df0 0x7f30e41a1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:05.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e8c3b640 1 -- 172.21.15.22:0/2306331591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e41094a0 msgr2=0x7f30e419cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:05.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e8c3b640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e41094a0 0x7f30e419cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:05.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e8c3b640 1 -- 172.21.15.22:0/2306331591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e41a25c0 con 0x7f30e4103b60 2024-09-21T04:01:05.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.827+0000 7f30e943c640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4109df0 0x7f30e41a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:05.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.828+0000 7f30e8c3b640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4103b60 0x7f30e419c650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009230 tx=0x7f30d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:05.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.828+0000 7f30e1ffb640 1 -- 172.21.15.22:0/2306331591 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d803f030 con 0x7f30e4103b60 2024-09-21T04:01:05.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.828+0000 7f30eae9f640 1 -- 172.21.15.22:0/2306331591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30e41a2850 con 0x7f30e4103b60 2024-09-21T04:01:05.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.828+0000 7f30e1ffb640 1 -- 172.21.15.22:0/2306331591 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30d8003a80 con 0x7f30e4103b60 2024-09-21T04:01:05.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.828+0000 7f30e1ffb640 1 -- 172.21.15.22:0/2306331591 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30d8035070 con 0x7f30e4103b60 2024-09-21T04:01:05.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.828+0000 7f30eae9f640 1 -- 172.21.15.22:0/2306331591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30e41a9010 con 0x7f30e4103b60 2024-09-21T04:01:05.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.829+0000 7f30eae9f640 1 -- 172.21.15.22:0/2306331591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30e4103f70 con 0x7f30e4103b60 2024-09-21T04:01:05.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.831+0000 7f30e1ffb640 1 -- 172.21.15.22:0/2306331591 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f30d8042030 con 0x7f30e4103b60 2024-09-21T04:01:05.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.831+0000 7f30e1ffb640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f30d40b65a0 0x7f30d40b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:05.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.832+0000 7f30e3fff640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f30d40b65a0 0x7f30d40b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:05.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.832+0000 7f30e1ffb640 1 -- 172.21.15.22:0/2306331591 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f30d8107d40 con 0x7f30e4103b60 2024-09-21T04:01:05.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.832+0000 7f30e3fff640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f30d40b65a0 0x7f30d40b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f30e4106530 tx=0x7f30d000b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:05.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:05.836+0000 7f30e1ffb640 1 -- 172.21.15.22:0/2306331591 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f30d80ce110 con 0x7f30e4103b60 2024-09-21T04:01:06.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.072+0000 7f30eae9f640 1 -- 172.21.15.22:0/2306331591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f30e41a9240 con 0x7f30e4103b60 2024-09-21T04:01:06.075 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:05 smithi022 ceph-mon[31015]: pgmap v331: 129 pgs: 129 active+clean; 643 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-09-21T04:01:06.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.078+0000 7f30e1ffb640 1 -- 172.21.15.22:0/2306331591 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+296437 (secure 0 0 0) 0x7f30d80d24f0 con 0x7f30e4103b60 2024-09-21T04:01:06.083 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 -- 172.21.15.22:0/2306331591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f30d40b65a0 msgr2=0x7f30d40b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f30d40b65a0 0x7f30d40b8ab0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f30e4106530 tx=0x7f30d000b410 comp rx=0 tx=0).stop 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 -- 172.21.15.22:0/2306331591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4103b60 msgr2=0x7f30e419c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4103b60 0x7f30e419c650 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f30d8009230 tx=0x7f30d8004270 comp rx=0 tx=0).stop 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 -- 172.21.15.22:0/2306331591 shutdown_connections 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f30d40b65a0 0x7f30d40b8ab0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f30e4109df0 0x7f30e41a1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f30e41094a0 0x7f30e419cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 --2- 172.21.15.22:0/2306331591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30e4103b60 0x7f30e419c650 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 -- 172.21.15.22:0/2306331591 >> 172.21.15.22:0/2306331591 conn(0x7f30e407b850 msgr2=0x7f30e41072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 -- 172.21.15.22:0/2306331591 shutdown_connections 2024-09-21T04:01:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:06.082+0000 7f30eae9f640 1 -- 172.21.15.22:0/2306331591 wait complete. 2024-09-21T04:01:06.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:05 smithi073 ceph-mon[34443]: pgmap v331: 129 pgs: 129 active+clean; 643 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-09-21T04:01:06.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:05 smithi060 ceph-mon[33722]: pgmap v331: 129 pgs: 129 active+clean; 643 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.6 KiB/s wr, 11 op/s 2024-09-21T04:01:06.722 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":3402236759},{"type":"v1","addr":"172.21.15.22:6801","nonce":3402236759}]},"active_addr":"172.21.15.22:6801/3402236759","active_change":"2024-09-21T03:52:28.809690+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":24116,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24118,"name":"z","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.8","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.22:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":2582871604}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1961608017}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":1374607005}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":110177566}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.22:0","nonce":2647222494}]}]} 2024-09-21T04:01:06.733 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T04:01:06.734 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T04:01:06.734 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:01:06.993 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:07.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:06 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2306331591' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T04:01:07.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2306331591' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T04:01:07.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:06 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2306331591' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json"} : dispatch 2024-09-21T04:01:07.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.487+0000 7f662f71d640 1 -- 172.21.15.22:0/2979896267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6628102b40 msgr2=0x7f6628102f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:07.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.487+0000 7f662f71d640 1 --2- 172.21.15.22:0/2979896267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6628102b40 0x7f6628102f50 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f6624009900 tx=0x7f662402a410 comp rx=0 tx=0).stop 2024-09-21T04:01:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.487+0000 7f662f71d640 1 -- 172.21.15.22:0/2979896267 shutdown_connections 2024-09-21T04:01:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.487+0000 7f662f71d640 1 --2- 172.21.15.22:0/2979896267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6628108dd0 0x7f662810f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.487+0000 7f662f71d640 1 --2- 172.21.15.22:0/2979896267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6628108480 0x7f6628108890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.487+0000 7f662f71d640 1 --2- 172.21.15.22:0/2979896267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6628102b40 0x7f6628102f50 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.487+0000 7f662f71d640 1 -- 172.21.15.22:0/2979896267 >> 172.21.15.22:0/2979896267 conn(0x7f6628079750 msgr2=0x7f6628079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.487+0000 7f662f71d640 1 -- 172.21.15.22:0/2979896267 shutdown_connections 2024-09-21T04:01:07.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.487+0000 7f662f71d640 1 -- 172.21.15.22:0/2979896267 wait complete. 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.487+0000 7f662f71d640 1 Processor -- start 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662f71d640 1 -- start start 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662f71d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6628102b40 0x7f662819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662f71d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6628108480 0x7f662819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662f71d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6628108dd0 0x7f662819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662f71d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6628112850 con 0x7f6628108480 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662f71d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f66281126d0 con 0x7f6628108dd0 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662f71d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f66281129d0 con 0x7f6628102b40 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662ccb8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6628108480 0x7f662819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662ccb8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6628108480 0x7f662819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46636/0 (socket says 172.21.15.22:46636) 2024-09-21T04:01:07.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662ccb8640 1 -- 172.21.15.22:0/1813821832 learned_addr learned my addr 172.21.15.22:0/1813821832 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662d4b9640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6628102b40 0x7f662819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662dcba640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6628108dd0 0x7f662819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662ccb8640 1 -- 172.21.15.22:0/1813821832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6628102b40 msgr2=0x7f662819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662ccb8640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6628102b40 0x7f662819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662ccb8640 1 -- 172.21.15.22:0/1813821832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6628108dd0 msgr2=0x7f662819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662ccb8640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6628108dd0 0x7f662819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662ccb8640 1 -- 172.21.15.22:0/1813821832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66281a02e0 con 0x7f6628108480 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.488+0000 7f662d4b9640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6628102b40 0x7f662819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.489+0000 7f662ccb8640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6628108480 0x7f662819a910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6618005fd0 tx=0x7f661800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.489+0000 7f661e7fc640 1 -- 172.21.15.22:0/1813821832 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618017070 con 0x7f6628108480 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.489+0000 7f662f71d640 1 -- 172.21.15.22:0/1813821832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66281a05d0 con 0x7f6628108480 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.489+0000 7f661e7fc640 1 -- 172.21.15.22:0/1813821832 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6618009c30 con 0x7f6628108480 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.489+0000 7f661e7fc640 1 -- 172.21.15.22:0/1813821832 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6618003c70 con 0x7f6628108480 2024-09-21T04:01:07.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.489+0000 7f662f71d640 1 -- 172.21.15.22:0/1813821832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66281a6d30 con 0x7f6628108480 2024-09-21T04:01:07.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.490+0000 7f662f71d640 1 -- 172.21.15.22:0/1813821832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6628103dc0 con 0x7f6628108480 2024-09-21T04:01:07.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.492+0000 7f661e7fc640 1 -- 172.21.15.22:0/1813821832 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6618003e10 con 0x7f6628108480 2024-09-21T04:01:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.492+0000 7f661e7fc640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66140b65a0 0x7f66140b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.492+0000 7f662d4b9640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66140b65a0 0x7f66140b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.492+0000 7f661e7fc640 1 -- 172.21.15.22:0/1813821832 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f66180e7d80 con 0x7f6628108480 2024-09-21T04:01:07.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.493+0000 7f662d4b9640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66140b65a0 0x7f66140b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6624006010 tx=0x7f6624000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:07.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.496+0000 7f661e7fc640 1 -- 172.21.15.22:0/1813821832 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6618020030 con 0x7f6628108480 2024-09-21T04:01:07.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.683+0000 7f662f71d640 1 -- 172.21.15.22:0/1813821832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f662819b4a0 con 0x7f6628108480 2024-09-21T04:01:07.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.685+0000 7f661e7fc640 1 -- 172.21.15.22:0/1813821832 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24592 (secure 0 0 0) 0x7f66180ae150 con 0x7f6628108480 2024-09-21T04:01:07.688 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:07.688 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:00:30.127586+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:01:07.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 -- 172.21.15.22:0/1813821832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66140b65a0 msgr2=0x7f66140b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:07.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66140b65a0 0x7f66140b8ab0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6624006010 tx=0x7f6624000bc0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 -- 172.21.15.22:0/1813821832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6628108480 msgr2=0x7f662819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:07.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6628108480 0x7f662819a910 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6618005fd0 tx=0x7f661800dde0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 -- 172.21.15.22:0/1813821832 shutdown_connections 2024-09-21T04:01:07.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66140b65a0 0x7f66140b8ab0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6628108dd0 0x7f662819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6628108480 0x7f662819a910 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 --2- 172.21.15.22:0/1813821832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6628102b40 0x7f662819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:07.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 -- 172.21.15.22:0/1813821832 >> 172.21.15.22:0/1813821832 conn(0x7f6628079750 msgr2=0x7f6628101b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:07.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 -- 172.21.15.22:0/1813821832 shutdown_connections 2024-09-21T04:01:07.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:07.687+0000 7f662f71d640 1 -- 172.21.15.22:0/1813821832 wait complete. 2024-09-21T04:01:08.001 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:07 smithi022 ceph-mon[31015]: pgmap v332: 129 pgs: 129 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-09-21T04:01:08.001 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:07 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1813821832' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:01:08.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:07 smithi073 ceph-mon[34443]: pgmap v332: 129 pgs: 129 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-09-21T04:01:08.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:07 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1813821832' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:01:08.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:07 smithi060 ceph-mon[33722]: pgmap v332: 129 pgs: 129 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 3.9 KiB/s wr, 12 op/s 2024-09-21T04:01:08.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:07 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1813821832' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:01:08.349 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T04:01:08.349 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:01:08.608 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:09.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.089+0000 7f4b80244640 1 -- 172.21.15.22:0/421030246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b78108cf0 msgr2=0x7f4b7810f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.089+0000 7f4b80244640 1 --2- 172.21.15.22:0/421030246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b78108cf0 0x7f4b7810f520 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f4b70009ca0 tx=0x7f4b7002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.089+0000 7f4b80244640 1 -- 172.21.15.22:0/421030246 shutdown_connections 2024-09-21T04:01:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.089+0000 7f4b80244640 1 --2- 172.21.15.22:0/421030246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b78108cf0 0x7f4b7810f520 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.089+0000 7f4b80244640 1 --2- 172.21.15.22:0/421030246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b781083a0 0x7f4b781087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.089+0000 7f4b80244640 1 --2- 172.21.15.22:0/421030246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b78102a60 0x7f4b78102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.089+0000 7f4b80244640 1 -- 172.21.15.22:0/421030246 >> 172.21.15.22:0/421030246 conn(0x7f4b78079730 msgr2=0x7f4b78079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.089+0000 7f4b80244640 1 -- 172.21.15.22:0/421030246 shutdown_connections 2024-09-21T04:01:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.090+0000 7f4b80244640 1 -- 172.21.15.22:0/421030246 wait complete. 2024-09-21T04:01:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.090+0000 7f4b80244640 1 Processor -- start 2024-09-21T04:01:09.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.090+0000 7f4b80244640 1 -- start start 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b80244640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b78102a60 0x7f4b7819a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b80244640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b781083a0 0x7f4b7819a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b80244640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b78108cf0 0x7f4b7819fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b80244640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4b78112860 con 0x7f4b781083a0 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b80244640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4b781126e0 con 0x7f4b78102a60 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b80244640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4b781129e0 con 0x7f4b78108cf0 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7d7df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b781083a0 0x7f4b7819a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7d7df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b781083a0 0x7f4b7819a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:46654/0 (socket says 172.21.15.22:46654) 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7d7df640 1 -- 172.21.15.22:0/3993922112 learned_addr learned my addr 172.21.15.22:0/3993922112 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7e7e1640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b78108cf0 0x7f4b7819fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:09.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7dfe0640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b78102a60 0x7f4b7819a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7d7df640 1 -- 172.21.15.22:0/3993922112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b78108cf0 msgr2=0x7f4b7819fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7d7df640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b78108cf0 0x7f4b7819fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7d7df640 1 -- 172.21.15.22:0/3993922112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b78102a60 msgr2=0x7f4b7819a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7d7df640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b78102a60 0x7f4b7819a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7d7df640 1 -- 172.21.15.22:0/3993922112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b781a01d0 con 0x7f4b781083a0 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7dfe0640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b78102a60 0x7f4b7819a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b7d7df640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b781083a0 0x7f4b7819a8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800d740 tx=0x7f4b6800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.091+0000 7f4b6effd640 1 -- 172.21.15.22:0/3993922112 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68017070 con 0x7f4b781083a0 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.092+0000 7f4b80244640 1 -- 172.21.15.22:0/3993922112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b781a04c0 con 0x7f4b781083a0 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.092+0000 7f4b6effd640 1 -- 172.21.15.22:0/3993922112 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4b6800de50 con 0x7f4b781083a0 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.092+0000 7f4b6effd640 1 -- 172.21.15.22:0/3993922112 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b68004c60 con 0x7f4b781083a0 2024-09-21T04:01:09.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.092+0000 7f4b80244640 1 -- 172.21.15.22:0/3993922112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b780ff550 con 0x7f4b781083a0 2024-09-21T04:01:09.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.093+0000 7f4b80244640 1 -- 172.21.15.22:0/3993922112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b78103ce0 con 0x7f4b781083a0 2024-09-21T04:01:09.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.094+0000 7f4b6effd640 1 -- 172.21.15.22:0/3993922112 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4b68004e00 con 0x7f4b781083a0 2024-09-21T04:01:09.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.095+0000 7f4b6effd640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4b640ba9e0 0x7f4b640bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:09.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.095+0000 7f4b7dfe0640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4b640ba9e0 0x7f4b640bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:09.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.096+0000 7f4b6effd640 1 -- 172.21.15.22:0/3993922112 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f4b680e75c0 con 0x7f4b781083a0 2024-09-21T04:01:09.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.096+0000 7f4b7dfe0640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4b640ba9e0 0x7f4b640bcef0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400baa0 tx=0x7f4b74005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:09.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.099+0000 7f4b6effd640 1 -- 172.21.15.22:0/3993922112 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b680ad990 con 0x7f4b781083a0 2024-09-21T04:01:09.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.291+0000 7f4b80244640 1 -- 172.21.15.22:0/3993922112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4b7810baf0 con 0x7f4b781083a0 2024-09-21T04:01:09.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.293+0000 7f4b6effd640 1 -- 172.21.15.22:0/3993922112 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+24592 (secure 0 0 0) 0x7f4b680b1d70 con 0x7f4b781083a0 2024-09-21T04:01:09.296 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:09.296 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":83,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:00:30.127586+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:01:09.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.295+0000 7f4b80244640 1 -- 172.21.15.22:0/3993922112 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4b640ba9e0 msgr2=0x7f4b640bcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:09.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4b640ba9e0 0x7f4b640bcef0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f4b7400baa0 tx=0x7f4b74005d90 comp rx=0 tx=0).stop 2024-09-21T04:01:09.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 -- 172.21.15.22:0/3993922112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b781083a0 msgr2=0x7f4b7819a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:09.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b781083a0 0x7f4b7819a8c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800d740 tx=0x7f4b6800dc00 comp rx=0 tx=0).stop 2024-09-21T04:01:09.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 -- 172.21.15.22:0/3993922112 shutdown_connections 2024-09-21T04:01:09.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4b640ba9e0 0x7f4b640bcef0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:09.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4b78108cf0 0x7f4b7819fb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:09.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b781083a0 0x7f4b7819a8c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:09.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 --2- 172.21.15.22:0/3993922112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4b78102a60 0x7f4b7819a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:09.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 -- 172.21.15.22:0/3993922112 >> 172.21.15.22:0/3993922112 conn(0x7f4b78079730 msgr2=0x7f4b7806b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:09.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 -- 172.21.15.22:0/3993922112 shutdown_connections 2024-09-21T04:01:09.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:09.296+0000 7f4b80244640 1 -- 172.21.15.22:0/3993922112 wait complete. 2024-09-21T04:01:09.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T04:01:09.960 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T04:01:09.961 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T04:01:09.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T04:01:09.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T04:01:09.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T04:01:09.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.6 flush_pg_stats 2024-09-21T04:01:09.964 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.7 flush_pg_stats 2024-09-21T04:01:09.964 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.8 flush_pg_stats 2024-09-21T04:01:09.964 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.9 flush_pg_stats 2024-09-21T04:01:09.965 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.10 flush_pg_stats 2024-09-21T04:01:09.965 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell osd.11 flush_pg_stats 2024-09-21T04:01:10.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:09 smithi022 ceph-mon[31015]: pgmap v333: 129 pgs: 129 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-21T04:01:10.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:09 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3993922112' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:01:10.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:09 smithi073 ceph-mon[34443]: pgmap v333: 129 pgs: 129 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-21T04:01:10.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:09 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3993922112' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:01:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:09 smithi060 ceph-mon[33722]: pgmap v333: 129 pgs: 129 active+clean; 647 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.3 KiB/s wr, 10 op/s 2024-09-21T04:01:10.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:09 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3993922112' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:01:10.618 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:10.732 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:10.738 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:10.738 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:10.761 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:10.762 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:10.765 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:10.766 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:11.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.729+0000 7f9d7b106640 1 -- 172.21.15.22:0/3579139931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d74109eb0 msgr2=0x7f9d741106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.729+0000 7f9d7b106640 1 --2- 172.21.15.22:0/3579139931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d74109eb0 0x7f9d741106e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f9d6c009ca0 tx=0x7f9d6c02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.729+0000 7f9d7b106640 1 -- 172.21.15.22:0/3579139931 shutdown_connections 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.729+0000 7f9d7b106640 1 --2- 172.21.15.22:0/3579139931 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d74109560 0x7f9d74109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.729+0000 7f9d7b106640 1 --2- 172.21.15.22:0/3579139931 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d74109eb0 0x7f9d741106e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.729+0000 7f9d7b106640 1 --2- 172.21.15.22:0/3579139931 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d74102080 0x7f9d74102490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.729+0000 7f9d7b106640 1 -- 172.21.15.22:0/3579139931 >> 172.21.15.22:0/3579139931 conn(0x7f9d74079ec0 msgr2=0x7f9d7407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.729+0000 7f9d7b106640 1 -- 172.21.15.22:0/3579139931 shutdown_connections 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.729+0000 7f9d7b106640 1 -- 172.21.15.22:0/3579139931 wait complete. 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d7b106640 1 Processor -- start 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d7b106640 1 -- start start 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d7b106640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d74102080 0x7f9d7419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:11.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d7b106640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d74109560 0x7f9d7419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:11.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d7b106640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d74109eb0 0x7f9d7419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:11.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d7b106640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74113a70 con 0x7f9d74102080 2024-09-21T04:01:11.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d7b106640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9d741138f0 con 0x7f9d74109560 2024-09-21T04:01:11.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d7b106640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9d74113bf0 con 0x7f9d74109eb0 2024-09-21T04:01:11.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d78ea2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d74102080 0x7f9d7419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:11.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d78ea2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d74102080 0x7f9d7419a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54592/0 (socket says 172.21.15.22:54592) 2024-09-21T04:01:11.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d78ea2640 1 -- 172.21.15.22:0/2503728608 learned_addr learned my addr 172.21.15.22:0/2503728608 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:11.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d73fff640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d74109560 0x7f9d7419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:11.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d796a3640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d74109eb0 0x7f9d7419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:11.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d78ea2640 1 -- 172.21.15.22:0/2503728608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d74109eb0 msgr2=0x7f9d7419fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:11.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d78ea2640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d74109eb0 0x7f9d7419fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:11.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d78ea2640 1 -- 172.21.15.22:0/2503728608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d74109560 msgr2=0x7f9d7419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:11.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d78ea2640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9d74109560 0x7f9d7419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:11.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d78ea2640 1 -- 172.21.15.22:0/2503728608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d741a0430 con 0x7f9d74102080 2024-09-21T04:01:11.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.730+0000 7f9d796a3640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9d74109eb0 0x7f9d7419fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:11.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.731+0000 7f9d78ea2640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d74102080 0x7f9d7419a4c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00d950 tx=0x7f9d5c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:11.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.731+0000 7f9d71ffb640 1 -- 172.21.15.22:0/2503728608 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c017070 con 0x7f9d74102080 2024-09-21T04:01:11.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.731+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d741a0720 con 0x7f9d74102080 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.731+0000 7f9d71ffb640 1 -- 172.21.15.22:0/2503728608 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d5c009c30 con 0x7f9d74102080 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.731+0000 7f9d71ffb640 1 -- 172.21.15.22:0/2503728608 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c00f620 con 0x7f9d74102080 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.731+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d741a6e80 con 0x7f9d74102080 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.732+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d74063ad0 con 0x7f9d74102080 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.734+0000 7f9d71ffb640 1 -- 172.21.15.22:0/2503728608 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9d5c010460 con 0x7f9d74102080 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.734+0000 7f9d71ffb640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9d600b65a0 0x7f9d600b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.735+0000 7f9d73fff640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9d600b65a0 0x7f9d600b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.735+0000 7f9d71ffb640 1 -- 172.21.15.22:0/2503728608 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f9d5c0e7820 con 0x7f9d74102080 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.735+0000 7f9d71ffb640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] conn(0x7f9d600c16b0 0x7f9d600c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.735+0000 7f9d71ffb640 1 -- 172.21.15.22:0/2503728608 --> [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d600c4270 con 0x7f9d600c16b0 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.735+0000 7f9d71ffb640 1 -- 172.21.15.22:0/2503728608 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f9d5c0e7c70 con 0x7f9d74102080 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.735+0000 7f9d73fff640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9d600b65a0 0x7f9d600b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9d74107140 tx=0x7f9d6400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:11.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.735+0000 7f9d796a3640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] conn(0x7f9d600c16b0 0x7f9d600c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.736+0000 7f9d796a3640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] conn(0x7f9d600c16b0 0x7f9d600c3ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.737+0000 7f9d71ffb640 1 -- 172.21.15.22:0/2503728608 <== osd.1 v2:172.21.15.60:6800/1805383565 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9d600c4270 con 0x7f9d600c16b0 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.750+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 --> [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9d74063ed0 con 0x7f9d600c16b0 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d71ffb640 1 -- 172.21.15.22:0/2503728608 <== osd.1 v2:172.21.15.60:6800/1805383565 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9d74063ed0 con 0x7f9d600c16b0 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 >> [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] conn(0x7f9d600c16b0 msgr2=0x7f9d600c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d7b106640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] conn(0x7f9d600c16b0 0x7f9d600c3ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9d600b65a0 msgr2=0x7f9d600b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d7b106640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9d600b65a0 0x7f9d600b8ab0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f9d74107140 tx=0x7f9d6400b390 comp rx=0 tx=0).stop 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d74102080 msgr2=0x7f9d7419a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d7b106640 1 --2- 172.21.15.22:0/2503728608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9d74102080 0x7f9d7419a4c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c00d950 tx=0x7f9d5c00de10 comp rx=0 tx=0).stop 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d796a3640 1 -- 172.21.15.22:0/2503728608 reap_dead start 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 shutdown_connections 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 >> 172.21.15.22:0/2503728608 conn(0x7f9d74079ec0 msgr2=0x7f9d741075f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:11.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 shutdown_connections 2024-09-21T04:01:11.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:11.751+0000 7f9d7b106640 1 -- 172.21.15.22:0/2503728608 wait complete. 2024-09-21T04:01:12.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.174+0000 7f6b9f765640 1 -- 172.21.15.22:0/2013829034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98104860 msgr2=0x7f6b98104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.174+0000 7f6b9f765640 1 --2- 172.21.15.22:0/2013829034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98104860 0x7f6b98104c70 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f6b94009900 tx=0x7f6b9402a410 comp rx=0 tx=0).stop 2024-09-21T04:01:12.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.174+0000 7f6b9f765640 1 -- 172.21.15.22:0/2013829034 shutdown_connections 2024-09-21T04:01:12.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.174+0000 7f6b9f765640 1 --2- 172.21.15.22:0/2013829034 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b9810de10 0x7f6b981102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.174+0000 7f6b9f765640 1 --2- 172.21.15.22:0/2013829034 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b98105290 0x7f6b9810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.174+0000 7f6b9f765640 1 --2- 172.21.15.22:0/2013829034 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b98104860 0x7f6b98104c70 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.174+0000 7f6b9f765640 1 -- 172.21.15.22:0/2013829034 >> 172.21.15.22:0/2013829034 conn(0x7f6b98079730 msgr2=0x7f6b98079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:12.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.174+0000 7f6b9f765640 1 -- 172.21.15.22:0/2013829034 shutdown_connections 2024-09-21T04:01:12.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.174+0000 7f6b9f765640 1 -- 172.21.15.22:0/2013829034 wait complete. 2024-09-21T04:01:12.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9f765640 1 Processor -- start 2024-09-21T04:01:12.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9f765640 1 -- start start 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9f765640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b98104860 0x7f6b9819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9f765640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b98105290 0x7f6b9819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9f765640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9810de10 0x7f6b9819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9f765640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b98113910 con 0x7f6b9810de10 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9f765640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6b98113790 con 0x7f6b98105290 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9f765640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6b98113a90 con 0x7f6b98104860 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9dd02640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9810de10 0x7f6b9819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9dd02640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9810de10 0x7f6b9819fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54598/0 (socket says 172.21.15.22:54598) 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9dd02640 1 -- 172.21.15.22:0/860628164 learned_addr learned my addr 172.21.15.22:0/860628164 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9d501640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b98104860 0x7f6b9819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.175+0000 7f6b9cd00640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b98105290 0x7f6b9819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b9dd02640 1 -- 172.21.15.22:0/860628164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b98104860 msgr2=0x7f6b9819a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b9dd02640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6b98104860 0x7f6b9819a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b9dd02640 1 -- 172.21.15.22:0/860628164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b98105290 msgr2=0x7f6b9819a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b9dd02640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6b98105290 0x7f6b9819a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b9dd02640 1 -- 172.21.15.22:0/860628164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b981a02d0 con 0x7f6b9810de10 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b9dd02640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9810de10 0x7f6b9819fba0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000eaa0 tx=0x7f6b9000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b8e7fc640 1 -- 172.21.15.22:0/860628164 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b9000cdb0 con 0x7f6b9810de10 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b8e7fc640 1 -- 172.21.15.22:0/860628164 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b90005020 con 0x7f6b9810de10 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b981a05c0 con 0x7f6b9810de10 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b8e7fc640 1 -- 172.21.15.22:0/860628164 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b900116d0 con 0x7f6b9810de10 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.176+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b981a6d20 con 0x7f6b9810de10 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.177+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6b98063b50 con 0x7f6b9810de10 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.179+0000 7f6b8e7fc640 1 -- 172.21.15.22:0/860628164 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6b900051d0 con 0x7f6b9810de10 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.180+0000 7f6b8e7fc640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6b840b6620 0x7f6b840b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.180+0000 7f6b9d501640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6b840b6620 0x7f6b840b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:12.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.180+0000 7f6b8e7fc640 1 -- 172.21.15.22:0/860628164 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f6b900e7cd0 con 0x7f6b9810de10 2024-09-21T04:01:12.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.180+0000 7f6b8e7fc640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] conn(0x7f6b840c1730 0x7f6b840c3c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:12.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.180+0000 7f6b8e7fc640 1 -- 172.21.15.22:0/860628164 --> [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b90018ec0 con 0x7f6b840c1730 2024-09-21T04:01:12.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.180+0000 7f6b8e7fc640 1 -- 172.21.15.22:0/860628164 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f6b900e8120 con 0x7f6b9810de10 2024-09-21T04:01:12.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.180+0000 7f6b9cd00640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] conn(0x7f6b840c1730 0x7f6b840c3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:12.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.180+0000 7f6b9d501640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6b840b6620 0x7f6b840b8b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6b940057c0 tx=0x7f6b940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:12.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.181+0000 7f6b9cd00640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] conn(0x7f6b840c1730 0x7f6b840c3c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:12.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.181+0000 7f6b8e7fc640 1 -- 172.21.15.22:0/860628164 <== osd.3 v2:172.21.15.22:6810/2768755547 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6b90018ec0 con 0x7f6b840c1730 2024-09-21T04:01:12.198 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:12.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.196+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 --> [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6b98063fd0 con 0x7f6b840c1730 2024-09-21T04:01:12.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.197+0000 7f6b8e7fc640 1 -- 172.21.15.22:0/860628164 <== osd.3 v2:172.21.15.22:6810/2768755547 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6b98063fd0 con 0x7f6b840c1730 2024-09-21T04:01:12.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.197+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] conn(0x7f6b840c1730 msgr2=0x7f6b840c3c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.197+0000 7f6b9f765640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] conn(0x7f6b840c1730 0x7f6b840c3c20 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.198+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6b840b6620 msgr2=0x7f6b840b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.198+0000 7f6b9f765640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6b840b6620 0x7f6b840b8b30 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6b940057c0 tx=0x7f6b940058d0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.198+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9810de10 msgr2=0x7f6b9819fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.198+0000 7f6b9f765640 1 --2- 172.21.15.22:0/860628164 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9810de10 0x7f6b9819fba0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6b9000eaa0 tx=0x7f6b9000ef60 comp rx=0 tx=0).stop 2024-09-21T04:01:12.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.198+0000 7f6b9dd02640 1 -- 172.21.15.22:0/860628164 reap_dead start 2024-09-21T04:01:12.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.198+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 shutdown_connections 2024-09-21T04:01:12.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.198+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 >> 172.21.15.22:0/860628164 conn(0x7f6b98079730 msgr2=0x7f6b981008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:12.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.198+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 shutdown_connections 2024-09-21T04:01:12.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.199+0000 7f6b9f765640 1 -- 172.21.15.22:0/860628164 wait complete. 2024-09-21T04:01:12.209 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:12.209 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:12.213 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:12.254 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:11 smithi060 ceph-mon[33722]: pgmap v334: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T04:01:12.299 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:11 smithi022 ceph-mon[31015]: pgmap v334: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T04:01:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:11 smithi073 ceph-mon[34443]: pgmap v334: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 1.4 KiB/s wr, 12 op/s 2024-09-21T04:01:12.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.511+0000 7f7834b5b640 1 -- 172.21.15.22:0/3667979628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78301049d0 msgr2=0x7f7830104de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.511+0000 7f7834b5b640 1 --2- 172.21.15.22:0/3667979628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78301049d0 0x7f7830104de0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f7820009ca0 tx=0x7f782002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.511+0000 7f7834b5b640 1 -- 172.21.15.22:0/3667979628 shutdown_connections 2024-09-21T04:01:12.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.511+0000 7f7834b5b640 1 --2- 172.21.15.22:0/3667979628 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f783010de30 0x7f7830110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.511+0000 7f7834b5b640 1 --2- 172.21.15.22:0/3667979628 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7830105320 0x7f783010d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.511+0000 7f7834b5b640 1 --2- 172.21.15.22:0/3667979628 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f78301049d0 0x7f7830104de0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.511+0000 7f7834b5b640 1 -- 172.21.15.22:0/3667979628 >> 172.21.15.22:0/3667979628 conn(0x7f7830079740 msgr2=0x7f7830079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.511+0000 7f7834b5b640 1 -- 172.21.15.22:0/3667979628 shutdown_connections 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.511+0000 7f7834b5b640 1 -- 172.21.15.22:0/3667979628 wait complete. 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.512+0000 7f7834b5b640 1 Processor -- start 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.512+0000 7f7834b5b640 1 -- start start 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.512+0000 7f7834b5b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78301049d0 0x7f783019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.512+0000 7f7834b5b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7830105320 0x7f783019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.512+0000 7f7834b5b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783010de30 0x7f783019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.512+0000 7f7834b5b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7830113990 con 0x7f783010de30 2024-09-21T04:01:12.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.512+0000 7f7834b5b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7830113810 con 0x7f7830105320 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.512+0000 7f7834b5b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7830113b10 con 0x7f78301049d0 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783010de30 0x7f783019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783010de30 0x7f783019fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54630/0 (socket says 172.21.15.22:54630) 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782ed9d640 1 -- 172.21.15.22:0/3285806674 learned_addr learned my addr 172.21.15.22:0/3285806674 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782e59c640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78301049d0 0x7f783019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782dd9b640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7830105320 0x7f783019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782ed9d640 1 -- 172.21.15.22:0/3285806674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78301049d0 msgr2=0x7f783019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782ed9d640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f78301049d0 0x7f783019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782ed9d640 1 -- 172.21.15.22:0/3285806674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7830105320 msgr2=0x7f783019a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782ed9d640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7830105320 0x7f783019a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782ed9d640 1 -- 172.21.15.22:0/3285806674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78301a0370 con 0x7f783010de30 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782dd9b640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7830105320 0x7f783019a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:12.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f782ed9d640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783010de30 0x7f783019fc40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f782800d750 tx=0x7f782800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f781f7fe640 1 -- 172.21.15.22:0/3285806674 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828017070 con 0x7f783010de30 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f781f7fe640 1 -- 172.21.15.22:0/3285806674 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f78280054b0 con 0x7f783010de30 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78301a0660 con 0x7f783010de30 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f781f7fe640 1 -- 172.21.15.22:0/3285806674 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7828004b90 con 0x7f783010de30 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.513+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78301a6dc0 con 0x7f783010de30 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.514+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7830063b50 con 0x7f783010de30 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.516+0000 7f781f7fe640 1 -- 172.21.15.22:0/3285806674 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7828004d30 con 0x7f783010de30 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.517+0000 7f781f7fe640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f78180b65a0 0x7f78180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.517+0000 7f782e59c640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f78180b65a0 0x7f78180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.517+0000 7f781f7fe640 1 -- 172.21.15.22:0/3285806674 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f78280e7700 con 0x7f783010de30 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.517+0000 7f781f7fe640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] conn(0x7f78180c16b0 0x7f78180c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.517+0000 7f781f7fe640 1 -- 172.21.15.22:0/3285806674 --> [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7828021e50 con 0x7f78180c16b0 2024-09-21T04:01:12.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.517+0000 7f781f7fe640 1 -- 172.21.15.22:0/3285806674 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f78280e7ab0 con 0x7f783010de30 2024-09-21T04:01:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.517+0000 7f782e59c640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f78180b65a0 0x7f78180b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7820006010 tx=0x7f7820031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.517+0000 7f782dd9b640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] conn(0x7f78180c16b0 0x7f78180c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.518+0000 7f782dd9b640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] conn(0x7f78180c16b0 0x7f78180c3ba0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:12.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.519+0000 7f781f7fe640 1 -- 172.21.15.22:0/3285806674 <== osd.5 v2:172.21.15.73:6808/1537788628 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7828021e50 con 0x7f78180c16b0 2024-09-21T04:01:12.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.532+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 --> [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7830063fd0 con 0x7f78180c16b0 2024-09-21T04:01:12.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.533+0000 7f781f7fe640 1 -- 172.21.15.22:0/3285806674 <== osd.5 v2:172.21.15.73:6808/1537788628 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f7830063fd0 con 0x7f78180c16b0 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 >> [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] conn(0x7f78180c16b0 msgr2=0x7f78180c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f7834b5b640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] conn(0x7f78180c16b0 0x7f78180c3ba0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f78180b65a0 msgr2=0x7f78180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f7834b5b640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f78180b65a0 0x7f78180b8ab0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7820006010 tx=0x7f7820031000 comp rx=0 tx=0).stop 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783010de30 msgr2=0x7f783019fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f7834b5b640 1 --2- 172.21.15.22:0/3285806674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783010de30 0x7f783019fc40 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f782800d750 tx=0x7f782800dc10 comp rx=0 tx=0).stop 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f782ed9d640 1 -- 172.21.15.22:0/3285806674 reap_dead start 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 shutdown_connections 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 >> 172.21.15.22:0/3285806674 conn(0x7f7830079740 msgr2=0x7f78300ff750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 shutdown_connections 2024-09-21T04:01:12.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:12.534+0000 7f7834b5b640 1 -- 172.21.15.22:0/3285806674 wait complete. 2024-09-21T04:01:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.470+0000 7fae49723640 1 -- 172.21.15.22:0/2756166486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae44109e10 msgr2=0x7fae44110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.470+0000 7fae49723640 1 --2- 172.21.15.22:0/2756166486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae44109e10 0x7fae44110640 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fae34009900 tx=0x7fae3402a410 comp rx=0 tx=0).stop 2024-09-21T04:01:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.470+0000 7fae49723640 1 -- 172.21.15.22:0/2756166486 shutdown_connections 2024-09-21T04:01:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.470+0000 7fae49723640 1 --2- 172.21.15.22:0/2756166486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae441094c0 0x7fae441098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.470+0000 7fae49723640 1 --2- 172.21.15.22:0/2756166486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae44109e10 0x7fae44110640 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.470+0000 7fae49723640 1 --2- 172.21.15.22:0/2756166486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae44103b80 0x7fae44103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.470+0000 7fae49723640 1 -- 172.21.15.22:0/2756166486 >> 172.21.15.22:0/2756166486 conn(0x7fae440ff590 msgr2=0x7fae441019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:13.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.470+0000 7fae49723640 1 -- 172.21.15.22:0/2756166486 shutdown_connections 2024-09-21T04:01:13.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.470+0000 7fae49723640 1 -- 172.21.15.22:0/2756166486 wait complete. 2024-09-21T04:01:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.471+0000 7fae49723640 1 Processor -- start 2024-09-21T04:01:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.471+0000 7fae49723640 1 -- start start 2024-09-21T04:01:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.471+0000 7fae49723640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae44103b80 0x7fae4419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.471+0000 7fae49723640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae441094c0 0x7fae4419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.471+0000 7fae49723640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae44109e10 0x7fae4419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.471+0000 7fae49723640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fae44113980 con 0x7fae44109e10 2024-09-21T04:01:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.471+0000 7fae49723640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fae44113800 con 0x7fae44103b80 2024-09-21T04:01:13.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.471+0000 7fae49723640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fae44113b00 con 0x7fae441094c0 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae44109e10 0x7fae4419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae44109e10 0x7fae4419fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54654/0 (socket says 172.21.15.22:54654) 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae437fe640 1 -- 172.21.15.22:0/3028739147 learned_addr learned my addr 172.21.15.22:0/3028739147 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae427fc640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae441094c0 0x7fae4419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae42ffd640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae44103b80 0x7fae4419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae437fe640 1 -- 172.21.15.22:0/3028739147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae441094c0 msgr2=0x7fae4419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae437fe640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fae441094c0 0x7fae4419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae437fe640 1 -- 172.21.15.22:0/3028739147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae44103b80 msgr2=0x7fae4419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae437fe640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fae44103b80 0x7fae4419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae437fe640 1 -- 172.21.15.22:0/3028739147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae441a03a0 con 0x7fae44109e10 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae437fe640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae44109e10 0x7fae4419fc70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae34005ab0 tx=0x7fae340040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.472+0000 7fae3bfff640 1 -- 172.21.15.22:0/3028739147 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae3403f030 con 0x7fae44109e10 2024-09-21T04:01:13.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.473+0000 7fae3bfff640 1 -- 172.21.15.22:0/3028739147 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae34003a80 con 0x7fae44109e10 2024-09-21T04:01:13.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.473+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae441a0630 con 0x7fae44109e10 2024-09-21T04:01:13.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.473+0000 7fae3bfff640 1 -- 172.21.15.22:0/3028739147 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34035070 con 0x7fae44109e10 2024-09-21T04:01:13.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.473+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae441a6df0 con 0x7fae44109e10 2024-09-21T04:01:13.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.474+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fae441086f0 con 0x7fae44109e10 2024-09-21T04:01:13.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.476+0000 7fae3bfff640 1 -- 172.21.15.22:0/3028739147 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fae34042030 con 0x7fae44109e10 2024-09-21T04:01:13.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.476+0000 7fae3bfff640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fae300b65a0 0x7fae300b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.476+0000 7fae42ffd640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fae300b65a0 0x7fae300b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.476+0000 7fae3bfff640 1 -- 172.21.15.22:0/3028739147 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fae34108150 con 0x7fae44109e10 2024-09-21T04:01:13.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.477+0000 7fae3bfff640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] conn(0x7fae300c16b0 0x7fae300c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:13.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.477+0000 7fae3bfff640 1 -- 172.21.15.22:0/3028739147 --> [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae300c4270 con 0x7fae300c16b0 2024-09-21T04:01:13.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.477+0000 7fae3bfff640 1 -- 172.21.15.22:0/3028739147 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fae341085a0 con 0x7fae44109e10 2024-09-21T04:01:13.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.477+0000 7fae42ffd640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fae300b65a0 0x7fae300b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fae3c005fd0 tx=0x7fae3c009760 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:13.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.477+0000 7fae427fc640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] conn(0x7fae300c16b0 0x7fae300c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:13.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.478+0000 7fae427fc640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] conn(0x7fae300c16b0 0x7fae300c3ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:13.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.478+0000 7fae3bfff640 1 -- 172.21.15.22:0/3028739147 <== osd.11 v2:172.21.15.73:6824/2116186038 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fae300c4270 con 0x7fae300c16b0 2024-09-21T04:01:13.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.492+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 --> [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fae44104e00 con 0x7fae300c16b0 2024-09-21T04:01:13.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.493+0000 7fae3bfff640 1 -- 172.21.15.22:0/3028739147 <== osd.11 v2:172.21.15.73:6824/2116186038 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fae44104e00 con 0x7fae300c16b0 2024-09-21T04:01:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.493+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 >> [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] conn(0x7fae300c16b0 msgr2=0x7fae300c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.493+0000 7fae49723640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] conn(0x7fae300c16b0 0x7fae300c3ba0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.493+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fae300b65a0 msgr2=0x7fae300b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.493+0000 7fae49723640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fae300b65a0 0x7fae300b8ab0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fae3c005fd0 tx=0x7fae3c009760 comp rx=0 tx=0).stop 2024-09-21T04:01:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.493+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae44109e10 msgr2=0x7fae4419fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:13.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.493+0000 7fae49723640 1 --2- 172.21.15.22:0/3028739147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae44109e10 0x7fae4419fc70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fae34005ab0 tx=0x7fae340040e0 comp rx=0 tx=0).stop 2024-09-21T04:01:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.493+0000 7fae437fe640 1 -- 172.21.15.22:0/3028739147 reap_dead start 2024-09-21T04:01:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.493+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 shutdown_connections 2024-09-21T04:01:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.493+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 >> 172.21.15.22:0/3028739147 conn(0x7fae440ff590 msgr2=0x7fae44107c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.494+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 shutdown_connections 2024-09-21T04:01:13.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:13.494+0000 7fae49723640 1 -- 172.21.15.22:0/3028739147 wait complete. 2024-09-21T04:01:14.151 INFO:teuthology.orchestra.run.smithi022.stdout:146028888122 2024-09-21T04:01:14.151 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T04:01:14.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:13 smithi022 ceph-mon[31015]: pgmap v335: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T04:01:14.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:13 smithi073 ceph-mon[34443]: pgmap v335: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T04:01:14.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:13 smithi060 ceph-mon[33722]: pgmap v335: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T04:01:14.802 INFO:teuthology.orchestra.run.smithi022.stdout:292057776155 2024-09-21T04:01:14.803 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.11 2024-09-21T04:01:15.261 INFO:teuthology.orchestra.run.smithi022.stdout:55834574927 2024-09-21T04:01:15.261 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T04:01:15.870 INFO:teuthology.orchestra.run.smithi022.stdout:98784247877 2024-09-21T04:01:15.871 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T04:01:16.095 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:15 smithi022 ceph-mon[31015]: pgmap v336: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T04:01:16.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.057+0000 7ff70153c640 1 -- 172.21.15.22:0/2755117599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6fc108d00 msgr2=0x7ff6fc10f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.057+0000 7ff70153c640 1 --2- 172.21.15.22:0/2755117599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6fc108d00 0x7ff6fc10f530 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009ca0 tx=0x7ff6f402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.057+0000 7ff70153c640 1 -- 172.21.15.22:0/2755117599 shutdown_connections 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.057+0000 7ff70153c640 1 --2- 172.21.15.22:0/2755117599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6fc108d00 0x7ff6fc10f530 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.057+0000 7ff70153c640 1 --2- 172.21.15.22:0/2755117599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc1083b0 0x7ff6fc1087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.057+0000 7ff70153c640 1 --2- 172.21.15.22:0/2755117599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6fc102ac0 0x7ff6fc102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.057+0000 7ff70153c640 1 -- 172.21.15.22:0/2755117599 >> 172.21.15.22:0/2755117599 conn(0x7ff6fc079720 msgr2=0x7ff6fc079b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.058+0000 7ff70153c640 1 -- 172.21.15.22:0/2755117599 shutdown_connections 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.058+0000 7ff70153c640 1 -- 172.21.15.22:0/2755117599 wait complete. 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.058+0000 7ff70153c640 1 Processor -- start 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.058+0000 7ff70153c640 1 -- start start 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff70153c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6fc102ac0 0x7ff6fc199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff70153c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6fc1083b0 0x7ff6fc199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff70153c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc108d00 0x7ff6fc19eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff70153c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1128c0 con 0x7ff6fc102ac0 2024-09-21T04:01:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff70153c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc112740 con 0x7ff6fc108d00 2024-09-21T04:01:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff70153c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc112a40 con 0x7ff6fc1083b0 2024-09-21T04:01:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6fc102ac0 0x7ff6fc199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6faffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6fc102ac0 0x7ff6fc199270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54682/0 (socket says 172.21.15.22:54682) 2024-09-21T04:01:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6faffd640 1 -- 172.21.15.22:0/3315649100 learned_addr learned my addr 172.21.15.22:0/3315649100 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6fa7fc640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6fc1083b0 0x7ff6fc199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6fb7fe640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc108d00 0x7ff6fc19eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6faffd640 1 -- 172.21.15.22:0/3315649100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6fc1083b0 msgr2=0x7ff6fc199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6faffd640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff6fc1083b0 0x7ff6fc199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6faffd640 1 -- 172.21.15.22:0/3315649100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc108d00 msgr2=0x7ff6fc19eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6faffd640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc108d00 0x7ff6fc19eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6faffd640 1 -- 172.21.15.22:0/3315649100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc19f120 con 0x7ff6fc102ac0 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.059+0000 7ff6fb7fe640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff6fc108d00 0x7ff6fc19eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.060+0000 7ff6faffd640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6fc102ac0 0x7ff6fc199270 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009860 tx=0x7ff6ec009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.060+0000 7ff6e3fff640 1 -- 172.21.15.22:0/3315649100 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec005020 con 0x7ff6fc102ac0 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.060+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc19f410 con 0x7ff6fc102ac0 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.060+0000 7ff6e3fff640 1 -- 172.21.15.22:0/3315649100 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6ec0047a0 con 0x7ff6fc102ac0 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.060+0000 7ff6e3fff640 1 -- 172.21.15.22:0/3315649100 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec007a00 con 0x7ff6fc102ac0 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.060+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc06b820 con 0x7ff6fc102ac0 2024-09-21T04:01:16.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.061+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff6fc06bdd0 con 0x7ff6fc102ac0 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.063+0000 7ff6e3fff640 1 -- 172.21.15.22:0/3315649100 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff6ec004950 con 0x7ff6fc102ac0 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.064+0000 7ff6e3fff640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff6e40b6650 0x7ff6e40b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.064+0000 7ff6fa7fc640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff6e40b6650 0x7ff6e40b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.064+0000 7ff6e3fff640 1 -- 172.21.15.22:0/3315649100 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7ff6ec0e9890 con 0x7ff6fc102ac0 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.064+0000 7ff6e3fff640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] conn(0x7ff6e40c1760 0x7ff6e40c3c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.064+0000 7ff6e3fff640 1 -- 172.21.15.22:0/3315649100 --> [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff6e40c4320 con 0x7ff6e40c1760 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.064+0000 7ff6e3fff640 1 -- 172.21.15.22:0/3315649100 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7ff6ec0e9c80 con 0x7ff6fc102ac0 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.065+0000 7ff6fa7fc640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff6e40b6650 0x7ff6e40b8b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc079d20 tx=0x7ff6f000a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.065+0000 7ff6fb7fe640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] conn(0x7ff6e40c1760 0x7ff6e40c3c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.065+0000 7ff6fb7fe640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] conn(0x7ff6e40c1760 0x7ff6e40c3c50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.066+0000 7ff6e3fff640 1 -- 172.21.15.22:0/3315649100 <== osd.4 v2:172.21.15.60:6808/1223928144 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff6e40c4320 con 0x7ff6e40c1760 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.082+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 --> [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff6fc06c1d0 con 0x7ff6e40c1760 2024-09-21T04:01:16.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.082+0000 7ff6e3fff640 1 -- 172.21.15.22:0/3315649100 <== osd.4 v2:172.21.15.60:6808/1223928144 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff6fc06c1d0 con 0x7ff6e40c1760 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 >> [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] conn(0x7ff6e40c1760 msgr2=0x7ff6e40c3c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff70153c640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] conn(0x7ff6e40c1760 0x7ff6e40c3c50 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff6e40b6650 msgr2=0x7ff6e40b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff70153c640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff6e40b6650 0x7ff6e40b8b60 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc079d20 tx=0x7ff6f000a2d0 comp rx=0 tx=0).stop 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6fc102ac0 msgr2=0x7ff6fc199270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff70153c640 1 --2- 172.21.15.22:0/3315649100 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6fc102ac0 0x7ff6fc199270 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec009860 tx=0x7ff6ec009c60 comp rx=0 tx=0).stop 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff6fb7fe640 1 -- 172.21.15.22:0/3315649100 reap_dead start 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 shutdown_connections 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 >> 172.21.15.22:0/3315649100 conn(0x7ff6fc079720 msgr2=0x7ff6fc1043c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 shutdown_connections 2024-09-21T04:01:16.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:16.083+0000 7ff70153c640 1 -- 172.21.15.22:0/3315649100 wait complete. 2024-09-21T04:01:16.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:15 smithi073 ceph-mon[34443]: pgmap v336: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T04:01:16.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:15 smithi060 ceph-mon[33722]: pgmap v336: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 597 B/s wr, 9 op/s 2024-09-21T04:01:16.875 INFO:teuthology.orchestra.run.smithi022.stdout:124554051647 2024-09-21T04:01:16.876 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T04:01:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.369+0000 7fbb35834640 1 -- 172.21.15.22:0/4180357561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb30109e40 msgr2=0x7fbb30110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.369+0000 7fbb35834640 1 --2- 172.21.15.22:0/4180357561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb30109e40 0x7fbb30110670 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fbb28009ca0 tx=0x7fbb2802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.369+0000 7fbb35834640 1 -- 172.21.15.22:0/4180357561 shutdown_connections 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.369+0000 7fbb35834640 1 --2- 172.21.15.22:0/4180357561 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb301094f0 0x7fbb30109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.369+0000 7fbb35834640 1 --2- 172.21.15.22:0/4180357561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb30109e40 0x7fbb30110670 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.369+0000 7fbb35834640 1 --2- 172.21.15.22:0/4180357561 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb30103bb0 0x7fbb30103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.369+0000 7fbb35834640 1 -- 172.21.15.22:0/4180357561 >> 172.21.15.22:0/4180357561 conn(0x7fbb300ff600 msgr2=0x7fbb30101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.369+0000 7fbb35834640 1 -- 172.21.15.22:0/4180357561 shutdown_connections 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.369+0000 7fbb35834640 1 -- 172.21.15.22:0/4180357561 wait complete. 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.370+0000 7fbb35834640 1 Processor -- start 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.370+0000 7fbb35834640 1 -- start start 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.370+0000 7fbb35834640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb30103bb0 0x7fbb30075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.370+0000 7fbb35834640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb301094f0 0x7fbb30075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.370+0000 7fbb35834640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb30109e40 0x7fbb30076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.370+0000 7fbb35834640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30113a00 con 0x7fbb301094f0 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.370+0000 7fbb35834640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30113880 con 0x7fbb30103bb0 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.370+0000 7fbb35834640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbb30113b80 con 0x7fbb30109e40 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb301094f0 0x7fbb30075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb301094f0 0x7fbb30075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54700/0 (socket says 172.21.15.22:54700) 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2e7fc640 1 -- 172.21.15.22:0/3087964770 learned_addr learned my addr 172.21.15.22:0/3087964770 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2effd640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb30103bb0 0x7fbb30075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2f7fe640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb30109e40 0x7fbb30076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2e7fc640 1 -- 172.21.15.22:0/3087964770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb30109e40 msgr2=0x7fbb30076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2e7fc640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb30109e40 0x7fbb30076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2e7fc640 1 -- 172.21.15.22:0/3087964770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb30103bb0 msgr2=0x7fbb30075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2e7fc640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbb30103bb0 0x7fbb30075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2e7fc640 1 -- 172.21.15.22:0/3087964770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb301a8650 con 0x7fbb301094f0 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2f7fe640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbb30109e40 0x7fbb30076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:17.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb2e7fc640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb301094f0 0x7fbb30075c50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400c970 tx=0x7fbb2400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb34832640 1 -- 172.21.15.22:0/3087964770 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb24004220 con 0x7fbb301094f0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb301a8940 con 0x7fbb301094f0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb34832640 1 -- 172.21.15.22:0/3087964770 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb24007e40 con 0x7fbb301094f0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb34832640 1 -- 172.21.15.22:0/3087964770 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb240047a0 con 0x7fbb301094f0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.371+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb301a8e80 con 0x7fbb301094f0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.372+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fbb30063b50 con 0x7fbb301094f0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.374+0000 7fbb34832640 1 -- 172.21.15.22:0/3087964770 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fbb240079b0 con 0x7fbb301094f0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.375+0000 7fbb34832640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbb180b65a0 0x7fbb180b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.375+0000 7fbb2effd640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbb180b65a0 0x7fbb180b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.375+0000 7fbb34832640 1 -- 172.21.15.22:0/3087964770 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fbb240e78c0 con 0x7fbb301094f0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.375+0000 7fbb34832640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] conn(0x7fbb180c16b0 0x7fbb180c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.375+0000 7fbb34832640 1 -- 172.21.15.22:0/3087964770 --> [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb180c4270 con 0x7fbb180c16b0 2024-09-21T04:01:17.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.375+0000 7fbb34832640 1 -- 172.21.15.22:0/3087964770 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fbb240e7d10 con 0x7fbb301094f0 2024-09-21T04:01:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.375+0000 7fbb2f7fe640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] conn(0x7fbb180c16b0 0x7fbb180c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.375+0000 7fbb2effd640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbb180b65a0 0x7fbb180b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb30077160 tx=0x7fbb2000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.376+0000 7fbb2f7fe640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] conn(0x7fbb180c16b0 0x7fbb180c3ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:17.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.376+0000 7fbb34832640 1 -- 172.21.15.22:0/3087964770 <== osd.9 v2:172.21.15.22:6826/672345828 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fbb180c4270 con 0x7fbb180c16b0 2024-09-21T04:01:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.392+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 --> [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fbb30063f50 con 0x7fbb180c16b0 2024-09-21T04:01:17.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.392+0000 7fbb34832640 1 -- 172.21.15.22:0/3087964770 <== osd.9 v2:172.21.15.22:6826/672345828 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fbb30063f50 con 0x7fbb180c16b0 2024-09-21T04:01:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.393+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] conn(0x7fbb180c16b0 msgr2=0x7fbb180c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.393+0000 7fbb35834640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] conn(0x7fbb180c16b0 0x7fbb180c3ba0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.393+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbb180b65a0 msgr2=0x7fbb180b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.393+0000 7fbb35834640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbb180b65a0 0x7fbb180b8ab0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb30077160 tx=0x7fbb2000b390 comp rx=0 tx=0).stop 2024-09-21T04:01:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.393+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb301094f0 msgr2=0x7fbb30075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.393+0000 7fbb35834640 1 --2- 172.21.15.22:0/3087964770 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbb301094f0 0x7fbb30075c50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400c970 tx=0x7fbb2400ce30 comp rx=0 tx=0).stop 2024-09-21T04:01:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.393+0000 7fbb2f7fe640 1 -- 172.21.15.22:0/3087964770 reap_dead start 2024-09-21T04:01:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.393+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 shutdown_connections 2024-09-21T04:01:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.393+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 >> 172.21.15.22:0/3087964770 conn(0x7fbb300ff600 msgr2=0x7fbb30101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.393+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 shutdown_connections 2024-09-21T04:01:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:17.394+0000 7fbb35834640 1 -- 172.21.15.22:0/3087964770 wait complete. 2024-09-21T04:01:18.219 INFO:teuthology.orchestra.run.smithi022.stdout:244813135910 2024-09-21T04:01:18.219 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.9 2024-09-21T04:01:18.247 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:17 smithi022 ceph-mon[31015]: pgmap v337: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T04:01:18.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:17 smithi073 ceph-mon[34443]: pgmap v337: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T04:01:18.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.389+0000 7fcace9e7640 1 -- 172.21.15.22:0/1469801837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac8104840 msgr2=0x7fcac8104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.389+0000 7fcace9e7640 1 --2- 172.21.15.22:0/1469801837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac8104840 0x7fcac8104c50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fcab8009900 tx=0x7fcab802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.389+0000 7fcace9e7640 1 -- 172.21.15.22:0/1469801837 shutdown_connections 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.389+0000 7fcace9e7640 1 --2- 172.21.15.22:0/1469801837 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac8105270 0x7fcac810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.389+0000 7fcace9e7640 1 --2- 172.21.15.22:0/1469801837 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac810ddf0 0x7fcac8110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.389+0000 7fcace9e7640 1 --2- 172.21.15.22:0/1469801837 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac8104840 0x7fcac8104c50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.389+0000 7fcace9e7640 1 -- 172.21.15.22:0/1469801837 >> 172.21.15.22:0/1469801837 conn(0x7fcac8079730 msgr2=0x7fcac8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.389+0000 7fcace9e7640 1 -- 172.21.15.22:0/1469801837 shutdown_connections 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.389+0000 7fcace9e7640 1 -- 172.21.15.22:0/1469801837 wait complete. 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.390+0000 7fcace9e7640 1 Processor -- start 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.390+0000 7fcace9e7640 1 -- start start 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.390+0000 7fcace9e7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac8104840 0x7fcac819a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:18.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.390+0000 7fcace9e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac8105270 0x7fcac819a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.390+0000 7fcace9e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac810ddf0 0x7fcac819fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.390+0000 7fcace9e7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fcac8113940 con 0x7fcac8105270 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.390+0000 7fcace9e7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fcac81137c0 con 0x7fcac8104840 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.390+0000 7fcace9e7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fcac8113ac0 con 0x7fcac810ddf0 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.390+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac8105270 0x7fcac819a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac8105270 0x7fcac819a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54728/0 (socket says 172.21.15.22:54728) 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac77fe640 1 -- 172.21.15.22:0/639044258 learned_addr learned my addr 172.21.15.22:0/639044258 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac7fff640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac8104840 0x7fcac819a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcaccf84640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac810ddf0 0x7fcac819fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac77fe640 1 -- 172.21.15.22:0/639044258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac810ddf0 msgr2=0x7fcac819fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac77fe640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac810ddf0 0x7fcac819fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:18.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac77fe640 1 -- 172.21.15.22:0/639044258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac8104840 msgr2=0x7fcac819a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac77fe640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fcac8104840 0x7fcac819a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac77fe640 1 -- 172.21.15.22:0/639044258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac81a0320 con 0x7fcac8105270 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcaccf84640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fcac810ddf0 0x7fcac819fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac77fe640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac8105270 0x7fcac819a950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e9c0 tx=0x7fcabc00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac57fa640 1 -- 172.21.15.22:0/639044258 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00ccc0 con 0x7fcac8105270 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac57fa640 1 -- 172.21.15.22:0/639044258 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fcabc0054b0 con 0x7fcac8105270 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac81a0610 con 0x7fcac8105270 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcac57fa640 1 -- 172.21.15.22:0/639044258 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcabc010430 con 0x7fcac8105270 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.391+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac81a6d70 con 0x7fcac8105270 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.392+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcac8063b10 con 0x7fcac8105270 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.395+0000 7fcac57fa640 1 -- 172.21.15.22:0/639044258 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fcabc004f00 con 0x7fcac8105270 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.396+0000 7fcac57fa640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcab00b65a0 0x7fcab00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:18.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.396+0000 7fcac7fff640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcab00b65a0 0x7fcab00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:18.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.396+0000 7fcac57fa640 1 -- 172.21.15.22:0/639044258 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fcabc0e7ff0 con 0x7fcac8105270 2024-09-21T04:01:18.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.396+0000 7fcac57fa640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] conn(0x7fcab00c16b0 0x7fcab00c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:18.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.396+0000 7fcac57fa640 1 -- 172.21.15.22:0/639044258 --> [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcabc01aec0 con 0x7fcab00c16b0 2024-09-21T04:01:18.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.396+0000 7fcac57fa640 1 -- 172.21.15.22:0/639044258 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fcabc0e8420 con 0x7fcac8105270 2024-09-21T04:01:18.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.397+0000 7fcaccf84640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] conn(0x7fcab00c16b0 0x7fcab00c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:18.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.397+0000 7fcac7fff640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcab00b65a0 0x7fcab00b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcab8004770 tx=0x7fcab80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:18.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.397+0000 7fcaccf84640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] conn(0x7fcab00c16b0 0x7fcab00c3ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:18.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.398+0000 7fcac57fa640 1 -- 172.21.15.22:0/639044258 <== osd.7 v2:172.21.15.60:6816/1887420372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcabc01aec0 con 0x7fcab00c16b0 2024-09-21T04:01:18.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.414+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 --> [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fcac8063f10 con 0x7fcab00c16b0 2024-09-21T04:01:18.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcac57fa640 1 -- 172.21.15.22:0/639044258 <== osd.7 v2:172.21.15.60:6816/1887420372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fcac8063f10 con 0x7fcab00c16b0 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 >> [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] conn(0x7fcab00c16b0 msgr2=0x7fcab00c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcace9e7640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] conn(0x7fcab00c16b0 0x7fcab00c3ba0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcab00b65a0 msgr2=0x7fcab00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcace9e7640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fcab00b65a0 0x7fcab00b8ab0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fcab8004770 tx=0x7fcab80058d0 comp rx=0 tx=0).stop 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac8105270 msgr2=0x7fcac819a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcace9e7640 1 --2- 172.21.15.22:0/639044258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fcac8105270 0x7fcac819a950 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00e9c0 tx=0x7fcabc00ee80 comp rx=0 tx=0).stop 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcaccf84640 1 -- 172.21.15.22:0/639044258 reap_dead start 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 shutdown_connections 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 >> 172.21.15.22:0/639044258 conn(0x7fcac8079730 msgr2=0x7fcac81008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 shutdown_connections 2024-09-21T04:01:18.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.415+0000 7fcace9e7640 1 -- 172.21.15.22:0/639044258 wait complete. 2024-09-21T04:01:18.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:17 smithi060 ceph-mon[33722]: pgmap v337: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T04:01:19.209 INFO:teuthology.orchestra.run.smithi022.stdout:193273528368 2024-09-21T04:01:19.210 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.7 2024-09-21T04:01:20.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.625+0000 7f423a8cd640 1 -- 172.21.15.22:0/3730832876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f423410de10 msgr2=0x7f4234110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.625+0000 7f423a8cd640 1 --2- 172.21.15.22:0/3730832876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f423410de10 0x7f4234110300 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f422c009ca0 tx=0x7f422c02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.625+0000 7f423a8cd640 1 -- 172.21.15.22:0/3730832876 shutdown_connections 2024-09-21T04:01:20.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.625+0000 7f423a8cd640 1 --2- 172.21.15.22:0/3730832876 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f423410de10 0x7f4234110300 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.625+0000 7f423a8cd640 1 --2- 172.21.15.22:0/3730832876 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4234105300 0x7f423410d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.625+0000 7f423a8cd640 1 --2- 172.21.15.22:0/3730832876 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42341049b0 0x7f4234104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.625+0000 7f423a8cd640 1 -- 172.21.15.22:0/3730832876 >> 172.21.15.22:0/3730832876 conn(0x7f4234079730 msgr2=0x7f4234079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.625+0000 7f423a8cd640 1 -- 172.21.15.22:0/3730832876 shutdown_connections 2024-09-21T04:01:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.625+0000 7f423a8cd640 1 -- 172.21.15.22:0/3730832876 wait complete. 2024-09-21T04:01:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.626+0000 7f423a8cd640 1 Processor -- start 2024-09-21T04:01:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.626+0000 7f423a8cd640 1 -- start start 2024-09-21T04:01:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.626+0000 7f423a8cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42341049b0 0x7f423419a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.626+0000 7f423a8cd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4234105300 0x7f423419a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.626+0000 7f423a8cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423410de10 0x7f423419fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.626+0000 7f423a8cd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4234113990 con 0x7f4234105300 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.626+0000 7f423a8cd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4234113810 con 0x7f423410de10 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.626+0000 7f423a8cd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4234113b10 con 0x7f42341049b0 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f422bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4234105300 0x7f423419a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f422bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4234105300 0x7f423419a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54742/0 (socket says 172.21.15.22:54742) 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f422bfff640 1 -- 172.21.15.22:0/2274156165 learned_addr learned my addr 172.21.15.22:0/2274156165 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f4233fff640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42341049b0 0x7f423419a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f4238e6a640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423410de10 0x7f423419fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f422bfff640 1 -- 172.21.15.22:0/2274156165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42341049b0 msgr2=0x7f423419a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f422bfff640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42341049b0 0x7f423419a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f422bfff640 1 -- 172.21.15.22:0/2274156165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423410de10 msgr2=0x7f423419fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f422bfff640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f423410de10 0x7f423419fb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f422bfff640 1 -- 172.21.15.22:0/2274156165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42341a0290 con 0x7f4234105300 2024-09-21T04:01:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f422bfff640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4234105300 0x7f423419a8c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f421c00d740 tx=0x7f421c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f4231ffb640 1 -- 172.21.15.22:0/2274156165 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c017070 con 0x7f4234105300 2024-09-21T04:01:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f4231ffb640 1 -- 172.21.15.22:0/2274156165 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f421c00de50 con 0x7f4234105300 2024-09-21T04:01:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42341a0580 con 0x7f4234105300 2024-09-21T04:01:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f4231ffb640 1 -- 172.21.15.22:0/2274156165 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f421c00f620 con 0x7f4234105300 2024-09-21T04:01:20.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.627+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42341a6ce0 con 0x7f4234105300 2024-09-21T04:01:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.628+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4234101fc0 con 0x7f4234105300 2024-09-21T04:01:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.630+0000 7f4231ffb640 1 -- 172.21.15.22:0/2274156165 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f421c01a070 con 0x7f4234105300 2024-09-21T04:01:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.631+0000 7f4231ffb640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42200b65a0 0x7f42200b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.631+0000 7f4233fff640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42200b65a0 0x7f42200b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.631+0000 7f4231ffb640 1 -- 172.21.15.22:0/2274156165 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f421c0e75f0 con 0x7f4234105300 2024-09-21T04:01:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.631+0000 7f4231ffb640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] conn(0x7f42200c16b0 0x7f42200c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:20.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.631+0000 7f4231ffb640 1 -- 172.21.15.22:0/2274156165 --> [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42200c4270 con 0x7f42200c16b0 2024-09-21T04:01:20.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.631+0000 7f4231ffb640 1 -- 172.21.15.22:0/2274156165 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f421c0e7a40 con 0x7f4234105300 2024-09-21T04:01:20.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.631+0000 7f4233fff640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42200b65a0 0x7f42200b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4224005fd0 tx=0x7f422400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:20.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.631+0000 7f4238e6a640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] conn(0x7f42200c16b0 0x7f42200c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:20.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.632+0000 7f4238e6a640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] conn(0x7f42200c16b0 0x7f42200c3ba0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:20.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.633+0000 7f4231ffb640 1 -- 172.21.15.22:0/2274156165 <== osd.10 v2:172.21.15.60:6824/1905936274 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f42200c4270 con 0x7f42200c16b0 2024-09-21T04:01:20.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.646+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 --> [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f423406b560 con 0x7f42200c16b0 2024-09-21T04:01:20.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f4231ffb640 1 -- 172.21.15.22:0/2274156165 <== osd.10 v2:172.21.15.60:6824/1905936274 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f423406b560 con 0x7f42200c16b0 2024-09-21T04:01:20.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 >> [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] conn(0x7f42200c16b0 msgr2=0x7f42200c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f423a8cd640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] conn(0x7f42200c16b0 0x7f42200c3ba0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:20.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42200b65a0 msgr2=0x7f42200b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f423a8cd640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42200b65a0 0x7f42200b8ab0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4224005fd0 tx=0x7f422400b390 comp rx=0 tx=0).stop 2024-09-21T04:01:20.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4234105300 msgr2=0x7f423419a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:20.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f423a8cd640 1 --2- 172.21.15.22:0/2274156165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4234105300 0x7f423419a8c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f421c00d740 tx=0x7f421c00dc00 comp rx=0 tx=0).stop 2024-09-21T04:01:20.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f4238e6a640 1 -- 172.21.15.22:0/2274156165 reap_dead start 2024-09-21T04:01:20.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 shutdown_connections 2024-09-21T04:01:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 >> 172.21.15.22:0/2274156165 conn(0x7f4234079730 msgr2=0x7f4234101560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 shutdown_connections 2024-09-21T04:01:20.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:18.647+0000 7f423a8cd640 1 -- 172.21.15.22:0/2274156165 wait complete. 2024-09-21T04:01:20.271 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:19 smithi022 ceph-mon[31015]: pgmap v338: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T04:01:20.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:19 smithi073 ceph-mon[34443]: pgmap v338: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T04:01:20.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:19 smithi060 ceph-mon[33722]: pgmap v338: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 170 B/s wr, 10 op/s 2024-09-21T04:01:20.961 INFO:teuthology.orchestra.run.smithi022.stdout:266287972385 2024-09-21T04:01:20.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.10 2024-09-21T04:01:21.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.128+0000 7f462a4c9640 1 -- 172.21.15.22:0/2132223791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4624102fa0 msgr2=0x7f462410fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.128+0000 7f462a4c9640 1 --2- 172.21.15.22:0/2132223791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4624102fa0 0x7f462410fcc0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f460c009900 tx=0x7f460c02a480 comp rx=0 tx=0).stop 2024-09-21T04:01:21.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.128+0000 7f462a4c9640 1 -- 172.21.15.22:0/2132223791 shutdown_connections 2024-09-21T04:01:21.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.128+0000 7f462a4c9640 1 --2- 172.21.15.22:0/2132223791 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4624110200 0x7f4624112620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.128+0000 7f462a4c9640 1 --2- 172.21.15.22:0/2132223791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4624102fa0 0x7f462410fcc0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.128+0000 7f462a4c9640 1 --2- 172.21.15.22:0/2132223791 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4624102650 0x7f4624102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.128+0000 7f462a4c9640 1 -- 172.21.15.22:0/2132223791 >> 172.21.15.22:0/2132223791 conn(0x7f4624079730 msgr2=0x7f4624079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:21.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.128+0000 7f462a4c9640 1 -- 172.21.15.22:0/2132223791 shutdown_connections 2024-09-21T04:01:21.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.128+0000 7f462a4c9640 1 -- 172.21.15.22:0/2132223791 wait complete. 2024-09-21T04:01:21.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.129+0000 7f462a4c9640 1 Processor -- start 2024-09-21T04:01:21.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.129+0000 7f462a4c9640 1 -- start start 2024-09-21T04:01:21.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f462a4c9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4624102650 0x7f462419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:21.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f462a4c9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4624102fa0 0x7f462419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f462a4c9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4624110200 0x7f46241a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f462a4c9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4624115b20 con 0x7f4624110200 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f462a4c9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46241159a0 con 0x7f4624102650 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f462a4c9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4624115ca0 con 0x7f4624102fa0 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f4628a66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4624110200 0x7f46241a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f4628a66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4624110200 0x7f46241a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44136/0 (socket says 172.21.15.22:44136) 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f4628a66640 1 -- 172.21.15.22:0/2173244185 learned_addr learned my addr 172.21.15.22:0/2173244185 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f46237fe640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4624102fa0 0x7f462419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f4623fff640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4624102650 0x7f462419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f4628a66640 1 -- 172.21.15.22:0/2173244185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4624102fa0 msgr2=0x7f462419cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f4628a66640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4624102fa0 0x7f462419cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f4628a66640 1 -- 172.21.15.22:0/2173244185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4624102650 msgr2=0x7f462419c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f4628a66640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4624102650 0x7f462419c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.130+0000 7f4628a66640 1 -- 172.21.15.22:0/2173244185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46241a2500 con 0x7f4624110200 2024-09-21T04:01:21.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.131+0000 7f4628a66640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4624110200 0x7f46241a1dd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f461c00eb10 tx=0x7f461c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:21.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.131+0000 7f46217fa640 1 -- 172.21.15.22:0/2173244185 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c004b20 con 0x7f4624110200 2024-09-21T04:01:21.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.131+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46241a27f0 con 0x7f4624110200 2024-09-21T04:01:21.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.131+0000 7f46217fa640 1 -- 172.21.15.22:0/2173244185 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f461c004cc0 con 0x7f4624110200 2024-09-21T04:01:21.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.131+0000 7f46217fa640 1 -- 172.21.15.22:0/2173244185 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f461c010690 con 0x7f4624110200 2024-09-21T04:01:21.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.131+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46241a8f50 con 0x7f4624110200 2024-09-21T04:01:21.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.132+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4624063ad0 con 0x7f4624110200 2024-09-21T04:01:21.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.134+0000 7f46217fa640 1 -- 172.21.15.22:0/2173244185 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f461c005000 con 0x7f4624110200 2024-09-21T04:01:21.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.135+0000 7f46217fa640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f46100b65a0 0x7f46100b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:21.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.135+0000 7f4623fff640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f46100b65a0 0x7f46100b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:21.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.135+0000 7f46217fa640 1 -- 172.21.15.22:0/2173244185 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f461c0e81e0 con 0x7f4624110200 2024-09-21T04:01:21.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.135+0000 7f46217fa640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] conn(0x7f46100c16b0 0x7f46100c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:21.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.135+0000 7f46217fa640 1 -- 172.21.15.22:0/2173244185 --> [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46100c4270 con 0x7f46100c16b0 2024-09-21T04:01:21.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.135+0000 7f46217fa640 1 -- 172.21.15.22:0/2173244185 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f461c0e8590 con 0x7f4624110200 2024-09-21T04:01:21.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.136+0000 7f4623fff640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f46100b65a0 0x7f46100b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f461400bbe0 tx=0x7f461400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:21.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.136+0000 7f46237fe640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] conn(0x7f46100c16b0 0x7f46100c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:21.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.136+0000 7f46237fe640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] conn(0x7f46100c16b0 0x7f46100c3ba0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:21.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.137+0000 7f46217fa640 1 -- 172.21.15.22:0/2173244185 <== osd.8 v2:172.21.15.73:6816/3798177718 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f46100c4270 con 0x7f46100c16b0 2024-09-21T04:01:21.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.151+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 --> [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4624063f00 con 0x7f46100c16b0 2024-09-21T04:01:21.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.151+0000 7f46217fa640 1 -- 172.21.15.22:0/2173244185 <== osd.8 v2:172.21.15.73:6816/3798177718 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f4624063f00 con 0x7f46100c16b0 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 >> [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] conn(0x7f46100c16b0 msgr2=0x7f46100c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f462a4c9640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] conn(0x7f46100c16b0 0x7f46100c3ba0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f46100b65a0 msgr2=0x7f46100b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f462a4c9640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f46100b65a0 0x7f46100b8ab0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f461400bbe0 tx=0x7f461400b390 comp rx=0 tx=0).stop 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4624110200 msgr2=0x7f46241a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f462a4c9640 1 --2- 172.21.15.22:0/2173244185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4624110200 0x7f46241a1dd0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f461c00eb10 tx=0x7f461c00c2d0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f4628a66640 1 -- 172.21.15.22:0/2173244185 reap_dead start 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 shutdown_connections 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 >> 172.21.15.22:0/2173244185 conn(0x7f4624079730 msgr2=0x7f4624111730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 shutdown_connections 2024-09-21T04:01:21.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.152+0000 7f462a4c9640 1 -- 172.21.15.22:0/2173244185 wait complete. 2024-09-21T04:01:21.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.911+0000 7f3cbc056640 1 -- 172.21.15.22:0/3273271033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cb4102a60 msgr2=0x7f3cb4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.911+0000 7f3cbc056640 1 --2- 172.21.15.22:0/3273271033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cb4102a60 0x7f3cb4102e70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009900 tx=0x7f3cb002a410 comp rx=0 tx=0).stop 2024-09-21T04:01:21.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.911+0000 7f3cbc056640 1 -- 172.21.15.22:0/3273271033 shutdown_connections 2024-09-21T04:01:21.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.911+0000 7f3cbc056640 1 --2- 172.21.15.22:0/3273271033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb41083a0 0x7f3cb41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.911+0000 7f3cbc056640 1 --2- 172.21.15.22:0/3273271033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb4108cf0 0x7f3cb410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.911+0000 7f3cbc056640 1 --2- 172.21.15.22:0/3273271033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cb4102a60 0x7f3cb4102e70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.911+0000 7f3cbc056640 1 -- 172.21.15.22:0/3273271033 >> 172.21.15.22:0/3273271033 conn(0x7f3cb4079730 msgr2=0x7f3cb4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.911+0000 7f3cbc056640 1 -- 172.21.15.22:0/3273271033 shutdown_connections 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.911+0000 7f3cbc056640 1 -- 172.21.15.22:0/3273271033 wait complete. 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.912+0000 7f3cbc056640 1 Processor -- start 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.912+0000 7f3cbc056640 1 -- start start 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.912+0000 7f3cbc056640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cb4102a60 0x7f3cb419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.912+0000 7f3cbc056640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb41083a0 0x7f3cb419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.912+0000 7f3cbc056640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb4108cf0 0x7f3cb419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.912+0000 7f3cbc056640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4113920 con 0x7f3cb4102a60 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.912+0000 7f3cbc056640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb41137a0 con 0x7f3cb4108cf0 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.912+0000 7f3cbc056640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4113aa0 con 0x7f3cb41083a0 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb9df2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cb4102a60 0x7f3cb419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb9df2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cb4102a60 0x7f3cb419a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44176/0 (socket says 172.21.15.22:44176) 2024-09-21T04:01:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb9df2640 1 -- 172.21.15.22:0/402770033 learned_addr learned my addr 172.21.15.22:0/402770033 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cba5f3640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb4108cf0 0x7f3cb419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb95f1640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb41083a0 0x7f3cb419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb9df2640 1 -- 172.21.15.22:0/402770033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb41083a0 msgr2=0x7f3cb419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb9df2640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb41083a0 0x7f3cb419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb9df2640 1 -- 172.21.15.22:0/402770033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb4108cf0 msgr2=0x7f3cb419fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb9df2640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3cb4108cf0 0x7f3cb419fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb9df2640 1 -- 172.21.15.22:0/402770033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb41a0200 con 0x7f3cb4102a60 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb95f1640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3cb41083a0 0x7f3cb419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cb9df2640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cb4102a60 0x7f3cb419a350 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009230 tx=0x7f3cb0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3caaffd640 1 -- 172.21.15.22:0/402770033 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb003f030 con 0x7f3cb4102a60 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3caaffd640 1 -- 172.21.15.22:0/402770033 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3cb0003a80 con 0x7f3cb4102a60 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb41a0490 con 0x7f3cb4102a60 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.913+0000 7f3caaffd640 1 -- 172.21.15.22:0/402770033 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cb0035070 con 0x7f3cb4102a60 2024-09-21T04:01:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.914+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb41a0970 con 0x7f3cb4102a60 2024-09-21T04:01:21.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.914+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3cb4063b10 con 0x7f3cb4102a60 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.917+0000 7f3caaffd640 1 -- 172.21.15.22:0/402770033 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f3cb0042030 con 0x7f3cb4102a60 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.918+0000 7f3caaffd640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3ca00b65d0 0x7f3ca00b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.918+0000 7f3caaffd640 1 -- 172.21.15.22:0/402770033 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f3cb0108470 con 0x7f3cb4102a60 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.918+0000 7f3cb95f1640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3ca00b65d0 0x7f3ca00b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.918+0000 7f3caaffd640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] conn(0x7f3ca00c16e0 0x7f3ca00c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.918+0000 7f3caaffd640 1 -- 172.21.15.22:0/402770033 --> [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3ca00c42a0 con 0x7f3ca00c16e0 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.918+0000 7f3caaffd640 1 -- 172.21.15.22:0/402770033 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f3cb01088c0 con 0x7f3cb4102a60 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.918+0000 7f3cba5f3640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] conn(0x7f3ca00c16e0 0x7f3ca00c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.919+0000 7f3cb95f1640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3ca00b65d0 0x7f3ca00b8ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4100cc0 tx=0x7f3ca4005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.919+0000 7f3cba5f3640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] conn(0x7f3ca00c16e0 0x7f3ca00c3bd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:21.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.920+0000 7f3caaffd640 1 -- 172.21.15.22:0/402770033 <== osd.6 v2:172.21.15.22:6818/998386094 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3ca00c42a0 con 0x7f3ca00c16e0 2024-09-21T04:01:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.933+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 --> [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3cb4063f10 con 0x7f3ca00c16e0 2024-09-21T04:01:21.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3caaffd640 1 -- 172.21.15.22:0/402770033 <== osd.6 v2:172.21.15.22:6818/998386094 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3cb4063f10 con 0x7f3ca00c16e0 2024-09-21T04:01:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] conn(0x7f3ca00c16e0 msgr2=0x7f3ca00c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cbc056640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] conn(0x7f3ca00c16e0 0x7f3ca00c3bd0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3ca00b65d0 msgr2=0x7f3ca00b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cbc056640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3ca00b65d0 0x7f3ca00b8ae0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3cb4100cc0 tx=0x7f3ca4005d90 comp rx=0 tx=0).stop 2024-09-21T04:01:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cb4102a60 msgr2=0x7f3cb419a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cbc056640 1 --2- 172.21.15.22:0/402770033 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3cb4102a60 0x7f3cb419a350 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3cb0009230 tx=0x7f3cb0004270 comp rx=0 tx=0).stop 2024-09-21T04:01:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cba5f3640 1 -- 172.21.15.22:0/402770033 reap_dead start 2024-09-21T04:01:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 shutdown_connections 2024-09-21T04:01:21.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 >> 172.21.15.22:0/402770033 conn(0x7f3cb4079730 msgr2=0x7f3cb41014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 shutdown_connections 2024-09-21T04:01:21.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.934+0000 7f3cbc056640 1 -- 172.21.15.22:0/402770033 wait complete. 2024-09-21T04:01:22.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.805+0000 7f970aaa1640 1 -- 172.21.15.22:0/2950042397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9704103b60 msgr2=0x7f9704103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:22.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.805+0000 7f970aaa1640 1 --2- 172.21.15.22:0/2950042397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9704103b60 0x7f9704103f70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f96f4009900 tx=0x7f96f402a410 comp rx=0 tx=0).stop 2024-09-21T04:01:22.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.805+0000 7f970aaa1640 1 -- 172.21.15.22:0/2950042397 shutdown_connections 2024-09-21T04:01:22.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.805+0000 7f970aaa1640 1 --2- 172.21.15.22:0/2950042397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97041094a0 0x7f97041098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:22.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.805+0000 7f970aaa1640 1 --2- 172.21.15.22:0/2950042397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9704109df0 0x7f9704110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:22.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.805+0000 7f970aaa1640 1 --2- 172.21.15.22:0/2950042397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9704103b60 0x7f9704103f70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:22.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.805+0000 7f970aaa1640 1 -- 172.21.15.22:0/2950042397 >> 172.21.15.22:0/2950042397 conn(0x7f970407b850 msgr2=0x7f970407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:22.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.805+0000 7f970aaa1640 1 -- 172.21.15.22:0/2950042397 shutdown_connections 2024-09-21T04:01:22.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.805+0000 7f970aaa1640 1 -- 172.21.15.22:0/2950042397 wait complete. 2024-09-21T04:01:22.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.805+0000 7f970aaa1640 1 Processor -- start 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970aaa1640 1 -- start start 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970aaa1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9704103b60 0x7f970419a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970aaa1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97041094a0 0x7f970419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970aaa1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9704109df0 0x7f970419fc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970aaa1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9704113960 con 0x7f9704109df0 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970aaa1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f97041137e0 con 0x7f9704103b60 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970aaa1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9704113ae0 con 0x7f97041094a0 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970903e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9704109df0 0x7f970419fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970903e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9704109df0 0x7f970419fc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44168/0 (socket says 172.21.15.22:44168) 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970903e640 1 -- 172.21.15.22:0/1732867397 learned_addr learned my addr 172.21.15.22:0/1732867397 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f9703fff640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97041094a0 0x7f970419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970883d640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9704103b60 0x7f970419a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:22.237 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970903e640 1 -- 172.21.15.22:0/1732867397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97041094a0 msgr2=0x7f970419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970903e640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97041094a0 0x7f970419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970903e640 1 -- 172.21.15.22:0/1732867397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9704103b60 msgr2=0x7f970419a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970903e640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9704103b60 0x7f970419a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970903e640 1 -- 172.21.15.22:0/1732867397 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97041a03c0 con 0x7f9704109df0 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f9703fff640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f97041094a0 0x7f970419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.806+0000 7f970883d640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9704103b60 0x7f970419a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.807+0000 7f970903e640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9704109df0 0x7f970419fc90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009fd0 tx=0x7f96fc00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.807+0000 7f9701ffb640 1 -- 172.21.15.22:0/1732867397 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc017070 con 0x7f9704109df0 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.807+0000 7f9701ffb640 1 -- 172.21.15.22:0/1732867397 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96fc003e00 con 0x7f9704109df0 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.807+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97041a06b0 con 0x7f9704109df0 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.807+0000 7f9701ffb640 1 -- 172.21.15.22:0/1732867397 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96fc010460 con 0x7f9704109df0 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.807+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97041a6e10 con 0x7f9704109df0 2024-09-21T04:01:22.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.808+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9704063b50 con 0x7f9704109df0 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.810+0000 7f9701ffb640 1 -- 172.21.15.22:0/1732867397 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f96fc003970 con 0x7f9704109df0 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.810+0000 7f9701ffb640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96ec0b65a0 0x7f96ec0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.811+0000 7f970883d640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96ec0b65a0 0x7f96ec0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.811+0000 7f9701ffb640 1 -- 172.21.15.22:0/1732867397 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f96fc0e7a40 con 0x7f9704109df0 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.811+0000 7f9701ffb640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] conn(0x7f96ec0c16b0 0x7f96ec0c3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.811+0000 7f9701ffb640 1 -- 172.21.15.22:0/1732867397 --> [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f96fc018ec0 con 0x7f96ec0c16b0 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.811+0000 7f9701ffb640 1 -- 172.21.15.22:0/1732867397 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f96fc0e7e90 con 0x7f9704109df0 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.811+0000 7f9703fff640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] conn(0x7f96ec0c16b0 0x7f96ec0c3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.811+0000 7f970883d640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96ec0b65a0 0x7f96ec0b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96f4006010 tx=0x7f96f4000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.811+0000 7f9703fff640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] conn(0x7f96ec0c16b0 0x7f96ec0c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.812+0000 7f9701ffb640 1 -- 172.21.15.22:0/1732867397 <== osd.0 v2:172.21.15.22:6802/360746726 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f96fc018ec0 con 0x7f96ec0c16b0 2024-09-21T04:01:22.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.826+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 --> [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9704063fd0 con 0x7f96ec0c16b0 2024-09-21T04:01:22.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.826+0000 7f9701ffb640 1 -- 172.21.15.22:0/1732867397 <== osd.0 v2:172.21.15.22:6802/360746726 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9704063fd0 con 0x7f96ec0c16b0 2024-09-21T04:01:22.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] conn(0x7f96ec0c16b0 msgr2=0x7f96ec0c3ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:22.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970aaa1640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] conn(0x7f96ec0c16b0 0x7f96ec0c3ba0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:22.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96ec0b65a0 msgr2=0x7f96ec0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:22.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970aaa1640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96ec0b65a0 0x7f96ec0b8ab0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f96f4006010 tx=0x7f96f4000bc0 comp rx=0 tx=0).stop 2024-09-21T04:01:22.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9704109df0 msgr2=0x7f970419fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:22.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970aaa1640 1 --2- 172.21.15.22:0/1732867397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9704109df0 0x7f970419fc90 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f96fc009fd0 tx=0x7f96fc00b260 comp rx=0 tx=0).stop 2024-09-21T04:01:22.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970903e640 1 -- 172.21.15.22:0/1732867397 reap_dead start 2024-09-21T04:01:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 shutdown_connections 2024-09-21T04:01:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 >> 172.21.15.22:0/1732867397 conn(0x7f970407b850 msgr2=0x7f9704107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 shutdown_connections 2024-09-21T04:01:22.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.827+0000 7f970aaa1640 1 -- 172.21.15.22:0/1732867397 wait complete. 2024-09-21T04:01:22.241 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:21 smithi022 ceph-mon[31015]: pgmap v339: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T04:01:22.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:21 smithi073 ceph-mon[34443]: pgmap v339: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T04:01:22.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:21 smithi060 ceph-mon[33722]: pgmap v339: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 170 B/s wr, 11 op/s 2024-09-21T04:01:22.917 INFO:teuthology.orchestra.run.smithi022.stdout:34359738453 2024-09-21T04:01:22.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T04:01:23.457 INFO:teuthology.orchestra.run.smithi022.stdout:219043332140 2024-09-21T04:01:23.458 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.8 2024-09-21T04:01:23.875 INFO:teuthology.orchestra.run.smithi022.stdout:171798691895 2024-09-21T04:01:23.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.6 2024-09-21T04:01:24.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.335+0000 7f03d958c640 1 -- 172.21.15.22:0/193793488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4106330 msgr2=0x7f03d4106740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:24.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.335+0000 7f03d958c640 1 --2- 172.21.15.22:0/193793488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4106330 0x7f03d4106740 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f03c8009900 tx=0x7f03c802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.335+0000 7f03d958c640 1 -- 172.21.15.22:0/193793488 shutdown_connections 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.335+0000 7f03d958c640 1 --2- 172.21.15.22:0/193793488 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d4106c80 0x7f03d41106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.335+0000 7f03d958c640 1 --2- 172.21.15.22:0/193793488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4106330 0x7f03d4106740 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.335+0000 7f03d958c640 1 --2- 172.21.15.22:0/193793488 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03d4102140 0x7f03d4102550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.335+0000 7f03d958c640 1 -- 172.21.15.22:0/193793488 >> 172.21.15.22:0/193793488 conn(0x7f03d4079ea0 msgr2=0x7f03d407a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.335+0000 7f03d958c640 1 -- 172.21.15.22:0/193793488 shutdown_connections 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.335+0000 7f03d958c640 1 -- 172.21.15.22:0/193793488 wait complete. 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.336+0000 7f03d958c640 1 Processor -- start 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.336+0000 7f03d958c640 1 -- start start 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d958c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03d4102140 0x7f03d419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:24.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d958c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4106330 0x7f03d419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d958c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d4106c80 0x7f03d419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d958c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f03d41139d0 con 0x7f03d4106330 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d958c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4113850 con 0x7f03d4106c80 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d958c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f03d4113b50 con 0x7f03d4102140 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4106330 0x7f03d419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4106330 0x7f03d419aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44150/0 (socket says 172.21.15.22:44150) 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d27fc640 1 -- 172.21.15.22:0/394995231 learned_addr learned my addr 172.21.15.22:0/394995231 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d37fe640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d4106c80 0x7f03d419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d2ffd640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03d4102140 0x7f03d419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d27fc640 1 -- 172.21.15.22:0/394995231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03d4102140 msgr2=0x7f03d419a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d27fc640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f03d4102140 0x7f03d419a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:24.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d27fc640 1 -- 172.21.15.22:0/394995231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d4106c80 msgr2=0x7f03d419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d27fc640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d4106c80 0x7f03d419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d27fc640 1 -- 172.21.15.22:0/394995231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03d41a0310 con 0x7f03d4106330 2024-09-21T04:01:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d37fe640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f03d4106c80 0x7f03d419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.337+0000 7f03d27fc640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4106330 0x7f03d419aa00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f03c8005940 tx=0x7f03c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.338+0000 7f03bbfff640 1 -- 172.21.15.22:0/394995231 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c803f030 con 0x7f03d4106330 2024-09-21T04:01:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.338+0000 7f03bbfff640 1 -- 172.21.15.22:0/394995231 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f03c8003c90 con 0x7f03d4106330 2024-09-21T04:01:24.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.338+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03d41a05a0 con 0x7f03d4106330 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.338+0000 7f03bbfff640 1 -- 172.21.15.22:0/394995231 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03c8035070 con 0x7f03d4106330 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.338+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03d41a0a80 con 0x7f03d4106330 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.338+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f03d4063ad0 con 0x7f03d4106330 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.341+0000 7f03bbfff640 1 -- 172.21.15.22:0/394995231 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f03c8042030 con 0x7f03d4106330 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.341+0000 7f03bbfff640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f03bc0b65d0 0x7f03bc0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.341+0000 7f03d2ffd640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f03bc0b65d0 0x7f03bc0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.341+0000 7f03bbfff640 1 -- 172.21.15.22:0/394995231 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f03c8108230 con 0x7f03d4106330 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.342+0000 7f03bbfff640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] conn(0x7f03bc0c16e0 0x7f03bc0c3bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.342+0000 7f03bbfff640 1 -- 172.21.15.22:0/394995231 --> [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f03bc0c42a0 con 0x7f03bc0c16e0 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.342+0000 7f03bbfff640 1 -- 172.21.15.22:0/394995231 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f03c8108680 con 0x7f03d4106330 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.342+0000 7f03d2ffd640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f03bc0b65d0 0x7f03bc0b8ae0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f03c400abe0 tx=0x7f03c400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:24.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.342+0000 7f03d37fe640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] conn(0x7f03bc0c16e0 0x7f03bc0c3bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.342+0000 7f03d37fe640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] conn(0x7f03bc0c16e0 0x7f03bc0c3bd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.343+0000 7f03bbfff640 1 -- 172.21.15.22:0/394995231 <== osd.2 v2:172.21.15.73:6800/3937108185 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f03bc0c42a0 con 0x7f03bc0c16e0 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.357+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 --> [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f03d4063ed0 con 0x7f03bc0c16e0 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03bbfff640 1 -- 172.21.15.22:0/394995231 <== osd.2 v2:172.21.15.73:6800/3937108185 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f03d4063ed0 con 0x7f03bc0c16e0 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 >> [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] conn(0x7f03bc0c16e0 msgr2=0x7f03bc0c3bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d958c640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] conn(0x7f03bc0c16e0 0x7f03bc0c3bd0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f03bc0b65d0 msgr2=0x7f03bc0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d958c640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f03bc0b65d0 0x7f03bc0b8ae0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f03c400abe0 tx=0x7f03c400a2d0 comp rx=0 tx=0).stop 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4106330 msgr2=0x7f03d419aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d958c640 1 --2- 172.21.15.22:0/394995231 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f03d4106330 0x7f03d419aa00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f03c8005940 tx=0x7f03c80042f0 comp rx=0 tx=0).stop 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d37fe640 1 -- 172.21.15.22:0/394995231 reap_dead start 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 shutdown_connections 2024-09-21T04:01:24.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 >> 172.21.15.22:0/394995231 conn(0x7f03d4079ea0 msgr2=0x7f03d4107660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:24.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 shutdown_connections 2024-09-21T04:01:24.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:21.358+0000 7f03d958c640 1 -- 172.21.15.22:0/394995231 wait complete. 2024-09-21T04:01:24.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:24 smithi022 ceph-mon[31015]: pgmap v340: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-21T04:01:24.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:24 smithi073 ceph-mon[34443]: pgmap v340: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-21T04:01:24.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:24 smithi060 ceph-mon[33722]: pgmap v340: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-09-21T04:01:24.631 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:24.633 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:24.633 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:24.677 INFO:teuthology.orchestra.run.smithi022.stdout:73014444108 2024-09-21T04:01:24.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T04:01:24.950 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:24.953 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:25.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.217+0000 7fdefcfc6640 1 -- 172.21.15.22:0/389246776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef8102a60 msgr2=0x7fdef8102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:25.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.217+0000 7fdefcfc6640 1 --2- 172.21.15.22:0/389246776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef8102a60 0x7fdef8102e70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdee8009900 tx=0x7fdee802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:25.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.217+0000 7fdefcfc6640 1 -- 172.21.15.22:0/389246776 shutdown_connections 2024-09-21T04:01:25.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.217+0000 7fdefcfc6640 1 --2- 172.21.15.22:0/389246776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef8108cf0 0x7fdef810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.217+0000 7fdefcfc6640 1 --2- 172.21.15.22:0/389246776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdef81083a0 0x7fdef81087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.217+0000 7fdefcfc6640 1 --2- 172.21.15.22:0/389246776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef8102a60 0x7fdef8102e70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.217+0000 7fdefcfc6640 1 -- 172.21.15.22:0/389246776 >> 172.21.15.22:0/389246776 conn(0x7fdef8079730 msgr2=0x7fdef8079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:25.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.217+0000 7fdefcfc6640 1 -- 172.21.15.22:0/389246776 shutdown_connections 2024-09-21T04:01:25.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.218+0000 7fdefcfc6640 1 -- 172.21.15.22:0/389246776 wait complete. 2024-09-21T04:01:25.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.218+0000 7fdefcfc6640 1 Processor -- start 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdefcfc6640 1 -- start start 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdefcfc6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdef8102a60 0x7fdef819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdefcfc6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef81083a0 0x7fdef819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdefcfc6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef8108cf0 0x7fdef819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdefcfc6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdef8112810 con 0x7fdef81083a0 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdefcfc6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdef8112690 con 0x7fdef8102a60 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdefcfc6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdef8112990 con 0x7fdef8108cf0 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdef5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef81083a0 0x7fdef819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdef659c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdef8102a60 0x7fdef819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdef5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef81083a0 0x7fdef819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44198/0 (socket says 172.21.15.22:44198) 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdef5d9b640 1 -- 172.21.15.22:0/3897320584 learned_addr learned my addr 172.21.15.22:0/3897320584 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:25.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdef6d9d640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef8108cf0 0x7fdef819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdef5d9b640 1 -- 172.21.15.22:0/3897320584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef8108cf0 msgr2=0x7fdef819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdef5d9b640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef8108cf0 0x7fdef819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdef5d9b640 1 -- 172.21.15.22:0/3897320584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdef8102a60 msgr2=0x7fdef819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdef5d9b640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdef8102a60 0x7fdef819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.219+0000 7fdef5d9b640 1 -- 172.21.15.22:0/3897320584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdef81a0340 con 0x7fdef81083a0 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.220+0000 7fdef5d9b640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef81083a0 0x7fdef819a970 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00c970 tx=0x7fdeec00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.220+0000 7fdee77fe640 1 -- 172.21.15.22:0/3897320584 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec007bb0 con 0x7fdef81083a0 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.220+0000 7fdefcfc6640 1 -- 172.21.15.22:0/3897320584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdef81a0630 con 0x7fdef81083a0 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.220+0000 7fdee77fe640 1 -- 172.21.15.22:0/3897320584 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdeec007d50 con 0x7fdef81083a0 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.220+0000 7fdee77fe640 1 -- 172.21.15.22:0/3897320584 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeec004db0 con 0x7fdef81083a0 2024-09-21T04:01:25.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.220+0000 7fdefcfc6640 1 -- 172.21.15.22:0/3897320584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdef81a6d90 con 0x7fdef81083a0 2024-09-21T04:01:25.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.221+0000 7fdefcfc6640 1 -- 172.21.15.22:0/3897320584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdef8102e70 con 0x7fdef81083a0 2024-09-21T04:01:25.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.223+0000 7fdee77fe640 1 -- 172.21.15.22:0/3897320584 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fdeec004f70 con 0x7fdef81083a0 2024-09-21T04:01:25.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.223+0000 7fdee77fe640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdee00b65a0 0x7fdee00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:25.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.224+0000 7fdee77fe640 1 -- 172.21.15.22:0/3897320584 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7fdeec0e77b0 con 0x7fdef81083a0 2024-09-21T04:01:25.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.224+0000 7fdef659c640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdee00b65a0 0x7fdee00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:25.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.224+0000 7fdef659c640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdee00b65a0 0x7fdee00b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdee80057c0 tx=0x7fdee80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:25.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.227+0000 7fdee77fe640 1 -- 172.21.15.22:0/3897320584 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdeec014030 con 0x7fdef81083a0 2024-09-21T04:01:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.419+0000 7fdefcfc6640 1 -- 172.21.15.22:0/3897320584 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fdef81044c0 con 0x7fdef81083a0 2024-09-21T04:01:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.420+0000 7fdee77fe640 1 -- 172.21.15.22:0/3897320584 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fdeec0b1f60 con 0x7fdef81083a0 2024-09-21T04:01:25.423 INFO:teuthology.orchestra.run.smithi022.stdout:146028888125 2024-09-21T04:01:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 -- 172.21.15.22:0/3897320584 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdee00b65a0 msgr2=0x7fdee00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdee00b65a0 0x7fdee00b8ab0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fdee80057c0 tx=0x7fdee80058d0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 -- 172.21.15.22:0/3897320584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef81083a0 msgr2=0x7fdef819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef81083a0 0x7fdef819a970 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fdeec00c970 tx=0x7fdeec00ce30 comp rx=0 tx=0).stop 2024-09-21T04:01:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 -- 172.21.15.22:0/3897320584 shutdown_connections 2024-09-21T04:01:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdee00b65a0 0x7fdee00b8ab0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdef8108cf0 0x7fdef819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdef81083a0 0x7fdef819a970 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 --2- 172.21.15.22:0/3897320584 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdef8102a60 0x7fdef819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 -- 172.21.15.22:0/3897320584 >> 172.21.15.22:0/3897320584 conn(0x7fdef8079730 msgr2=0x7fdef81067f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:25.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 -- 172.21.15.22:0/3897320584 shutdown_connections 2024-09-21T04:01:25.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.422+0000 7fdefcfc6640 1 -- 172.21.15.22:0/3897320584 wait complete. 2024-09-21T04:01:25.664 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:25.665 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.855+0000 7f8ee6f69640 1 -- 172.21.15.22:0/2250434898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ee01031c0 msgr2=0x7f8ee01035d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.855+0000 7f8ee6f69640 1 --2- 172.21.15.22:0/2250434898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ee01031c0 0x7f8ee01035d0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8009900 tx=0x7f8ed802a3f0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.855+0000 7f8ee6f69640 1 -- 172.21.15.22:0/2250434898 shutdown_connections 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.855+0000 7f8ee6f69640 1 --2- 172.21.15.22:0/2250434898 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee0105190 0x7f8ee01055a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.855+0000 7f8ee6f69640 1 --2- 172.21.15.22:0/2250434898 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ee0105ae0 0x7f8ee010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.855+0000 7f8ee6f69640 1 --2- 172.21.15.22:0/2250434898 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ee01031c0 0x7f8ee01035d0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.855+0000 7f8ee6f69640 1 -- 172.21.15.22:0/2250434898 >> 172.21.15.22:0/2250434898 conn(0x7f8ee0077c60 msgr2=0x7f8ee00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.855+0000 7f8ee6f69640 1 -- 172.21.15.22:0/2250434898 shutdown_connections 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.855+0000 7f8ee6f69640 1 -- 172.21.15.22:0/2250434898 wait complete. 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.856+0000 7f8ee6f69640 1 Processor -- start 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.856+0000 7f8ee6f69640 1 -- start start 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.856+0000 7f8ee6f69640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ee01031c0 0x7f8ee019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.856+0000 7f8ee6f69640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ee0105190 0x7f8ee019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.856+0000 7f8ee6f69640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee0105ae0 0x7f8ee019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.856+0000 7f8ee6f69640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0113950 con 0x7f8ee0105190 2024-09-21T04:01:25.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.856+0000 7f8ee6f69640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee01137d0 con 0x7f8ee01031c0 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.856+0000 7f8ee6f69640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee0113ad0 con 0x7f8ee0105ae0 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8edffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ee0105190 0x7f8ee019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8edffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ee0105190 0x7f8ee019a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44220/0 (socket says 172.21.15.22:44220) 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8edffff640 1 -- 172.21.15.22:0/1834007223 learned_addr learned my addr 172.21.15.22:0/1834007223 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8ee5506640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee0105ae0 0x7f8ee019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8ee4d05640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ee01031c0 0x7f8ee019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8edffff640 1 -- 172.21.15.22:0/1834007223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee0105ae0 msgr2=0x7f8ee019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8edffff640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee0105ae0 0x7f8ee019fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8edffff640 1 -- 172.21.15.22:0/1834007223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ee01031c0 msgr2=0x7f8ee019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8edffff640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ee01031c0 0x7f8ee019a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8edffff640 1 -- 172.21.15.22:0/1834007223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee01a0250 con 0x7f8ee0105190 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8edffff640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ee0105190 0x7f8ee019a940 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800c970 tx=0x7f8ec800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:25.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8eddffb640 1 -- 172.21.15.22:0/1834007223 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8014070 con 0x7f8ee0105190 2024-09-21T04:01:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8eddffb640 1 -- 172.21.15.22:0/1834007223 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ec8004440 con 0x7f8ee0105190 2024-09-21T04:01:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8eddffb640 1 -- 172.21.15.22:0/1834007223 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8003d40 con 0x7f8ee0105190 2024-09-21T04:01:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.857+0000 7f8ee6f69640 1 -- 172.21.15.22:0/1834007223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee01a0540 con 0x7f8ee0105190 2024-09-21T04:01:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.858+0000 7f8ee6f69640 1 -- 172.21.15.22:0/1834007223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee01a6d60 con 0x7f8ee0105190 2024-09-21T04:01:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.858+0000 7f8ee6f69640 1 -- 172.21.15.22:0/1834007223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee019b4d0 con 0x7f8ee0105190 2024-09-21T04:01:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.860+0000 7f8eddffb640 1 -- 172.21.15.22:0/1834007223 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f8ec8017070 con 0x7f8ee0105190 2024-09-21T04:01:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.861+0000 7f8eddffb640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8ecc0b65d0 0x7f8ecc0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.861+0000 7f8ee4d05640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8ecc0b65d0 0x7f8ecc0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.861+0000 7f8eddffb640 1 -- 172.21.15.22:0/1834007223 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f8ec80e7b80 con 0x7f8ee0105190 2024-09-21T04:01:25.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.861+0000 7f8ee4d05640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8ecc0b65d0 0x7f8ecc0b8ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8005f70 tx=0x7f8ed8000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:25.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:25.864+0000 7f8eddffb640 1 -- 172.21.15.22:0/1834007223 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8ec801e030 con 0x7f8ee0105190 2024-09-21T04:01:26.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.053+0000 7f8ee6f69640 1 -- 172.21.15.22:0/1834007223 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8ee002e640 con 0x7f8ee0105190 2024-09-21T04:01:26.056 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:26 smithi022 ceph-mon[31015]: pgmap v341: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:01:26.057 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:26 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3897320584' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T04:01:26.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.054+0000 7f8eddffb640 1 -- 172.21.15.22:0/1834007223 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8ec80adf50 con 0x7f8ee0105190 2024-09-21T04:01:26.057 INFO:teuthology.orchestra.run.smithi022.stdout:55834574929 2024-09-21T04:01:26.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.056+0000 7f8ee6f69640 1 -- 172.21.15.22:0/1834007223 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8ecc0b65d0 msgr2=0x7f8ecc0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:26.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.056+0000 7f8ee6f69640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8ecc0b65d0 0x7f8ecc0b8ae0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ed8005f70 tx=0x7f8ed8000bc0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.056+0000 7f8ee6f69640 1 -- 172.21.15.22:0/1834007223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ee0105190 msgr2=0x7f8ee019a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:26.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.056+0000 7f8ee6f69640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ee0105190 0x7f8ee019a940 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f8ec800c970 tx=0x7f8ec800ce30 comp rx=0 tx=0).stop 2024-09-21T04:01:26.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.056+0000 7f8ee6f69640 1 -- 172.21.15.22:0/1834007223 shutdown_connections 2024-09-21T04:01:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.056+0000 7f8ee6f69640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8ecc0b65d0 0x7f8ecc0b8ae0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.056+0000 7f8ee6f69640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8ee0105ae0 0x7f8ee019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.056+0000 7f8ee6f69640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8ee0105190 0x7f8ee019a940 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.056+0000 7f8ee6f69640 1 --2- 172.21.15.22:0/1834007223 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8ee01031c0 0x7f8ee019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.057+0000 7f8ee6f69640 1 -- 172.21.15.22:0/1834007223 >> 172.21.15.22:0/1834007223 conn(0x7f8ee0077c60 msgr2=0x7f8ee01070e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.057+0000 7f8ee6f69640 1 -- 172.21.15.22:0/1834007223 shutdown_connections 2024-09-21T04:01:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.057+0000 7f8ee6f69640 1 -- 172.21.15.22:0/1834007223 wait complete. 2024-09-21T04:01:26.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:26 smithi073 ceph-mon[34443]: pgmap v341: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:01:26.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:26 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3897320584' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T04:01:26.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:26 smithi060 ceph-mon[33722]: pgmap v341: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:01:26.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:26 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3897320584' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 5} : dispatch 2024-09-21T04:01:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.873+0000 7f07a97e7640 1 -- 172.21.15.22:0/2359389958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a41048c0 msgr2=0x7f07a4104cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.873+0000 7f07a97e7640 1 --2- 172.21.15.22:0/2359389958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a41048c0 0x7f07a4104cd0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0794009900 tx=0x7f079402a3f0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.873+0000 7f07a97e7640 1 -- 172.21.15.22:0/2359389958 shutdown_connections 2024-09-21T04:01:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.873+0000 7f07a97e7640 1 --2- 172.21.15.22:0/2359389958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a41052a0 0x7f07a410d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.873+0000 7f07a97e7640 1 --2- 172.21.15.22:0/2359389958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a410de70 0x7f07a4110340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.873+0000 7f07a97e7640 1 --2- 172.21.15.22:0/2359389958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a41048c0 0x7f07a4104cd0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.873+0000 7f07a97e7640 1 -- 172.21.15.22:0/2359389958 >> 172.21.15.22:0/2359389958 conn(0x7f07a4079760 msgr2=0x7f07a4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.873+0000 7f07a97e7640 1 -- 172.21.15.22:0/2359389958 shutdown_connections 2024-09-21T04:01:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.873+0000 7f07a97e7640 1 -- 172.21.15.22:0/2359389958 wait complete. 2024-09-21T04:01:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.874+0000 7f07a97e7640 1 Processor -- start 2024-09-21T04:01:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.874+0000 7f07a97e7640 1 -- start start 2024-09-21T04:01:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.874+0000 7f07a97e7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a41048c0 0x7f07a41027d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.874+0000 7f07a97e7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a41052a0 0x7f07a4102d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a97e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a410de70 0x7f07a4103250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a97e7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07a4113960 con 0x7f07a410de70 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a97e7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07a41137e0 con 0x7f07a41048c0 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a97e7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07a4113ae0 con 0x7f07a41052a0 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a410de70 0x7f07a4103250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a410de70 0x7f07a4103250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44228/0 (socket says 172.21.15.22:44228) 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a37fe640 1 -- 172.21.15.22:0/2429877640 learned_addr learned my addr 172.21.15.22:0/2429877640 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a2ffd640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a41048c0 0x7f07a41027d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a27fc640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a41052a0 0x7f07a4102d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a37fe640 1 -- 172.21.15.22:0/2429877640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a41052a0 msgr2=0x7f07a4102d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a37fe640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a41052a0 0x7f07a4102d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a37fe640 1 -- 172.21.15.22:0/2429877640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a41048c0 msgr2=0x7f07a41027d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a37fe640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a41048c0 0x7f07a41027d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a37fe640 1 -- 172.21.15.22:0/2429877640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07a41a8720 con 0x7f07a410de70 2024-09-21T04:01:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f07a37fe640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a410de70 0x7f07a4103250 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f079c009fd0 tx=0x7f079c00def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.875+0000 7f079bfff640 1 -- 172.21.15.22:0/2429877640 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c017070 con 0x7f07a410de70 2024-09-21T04:01:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.876+0000 7f07a97e7640 1 -- 172.21.15.22:0/2429877640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07a41a8a10 con 0x7f07a410de70 2024-09-21T04:01:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.876+0000 7f079bfff640 1 -- 172.21.15.22:0/2429877640 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f079c003e00 con 0x7f07a410de70 2024-09-21T04:01:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.876+0000 7f079bfff640 1 -- 172.21.15.22:0/2429877640 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f079c010460 con 0x7f07a410de70 2024-09-21T04:01:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.876+0000 7f07a97e7640 1 -- 172.21.15.22:0/2429877640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07a41a8f20 con 0x7f07a410de70 2024-09-21T04:01:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.877+0000 7f07a97e7640 1 -- 172.21.15.22:0/2429877640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07a406c1b0 con 0x7f07a410de70 2024-09-21T04:01:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.878+0000 7f079bfff640 1 -- 172.21.15.22:0/2429877640 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f079c003970 con 0x7f07a410de70 2024-09-21T04:01:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.879+0000 7f079bfff640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07900b65a0 0x7f07900b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.879+0000 7f07a2ffd640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07900b65a0 0x7f07900b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.879+0000 7f079bfff640 1 -- 172.21.15.22:0/2429877640 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f079c0e7340 con 0x7f07a410de70 2024-09-21T04:01:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.880+0000 7f07a2ffd640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07900b65a0 0x7f07900b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0794004770 tx=0x7f07940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:26.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:26.882+0000 7f079bfff640 1 -- 172.21.15.22:0/2429877640 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f079c0ad7b0 con 0x7f07a410de70 2024-09-21T04:01:27.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.074+0000 7f07a97e7640 1 -- 172.21.15.22:0/2429877640 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f07a4104cd0 con 0x7f07a410de70 2024-09-21T04:01:27.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.074+0000 7f079bfff640 1 -- 172.21.15.22:0/2429877640 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f079c0b1b90 con 0x7f07a410de70 2024-09-21T04:01:27.077 INFO:teuthology.orchestra.run.smithi022.stdout:219043332141 2024-09-21T04:01:27.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.076+0000 7f07a97e7640 1 -- 172.21.15.22:0/2429877640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07900b65a0 msgr2=0x7f07900b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:27.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.076+0000 7f07a97e7640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07900b65a0 0x7f07900b8ab0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f0794004770 tx=0x7f07940058d0 comp rx=0 tx=0).stop 2024-09-21T04:01:27.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.076+0000 7f07a97e7640 1 -- 172.21.15.22:0/2429877640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a410de70 msgr2=0x7f07a4103250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.076+0000 7f07a97e7640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a410de70 0x7f07a4103250 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f079c009fd0 tx=0x7f079c00def0 comp rx=0 tx=0).stop 2024-09-21T04:01:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.077+0000 7f07a97e7640 1 -- 172.21.15.22:0/2429877640 shutdown_connections 2024-09-21T04:01:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.077+0000 7f07a97e7640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07900b65a0 0x7f07900b8ab0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.077+0000 7f07a97e7640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07a41052a0 0x7f07a4102d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.077+0000 7f07a97e7640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07a410de70 0x7f07a4103250 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.077+0000 7f07a97e7640 1 --2- 172.21.15.22:0/2429877640 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07a41048c0 0x7f07a41027d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.077+0000 7f07a97e7640 1 -- 172.21.15.22:0/2429877640 >> 172.21.15.22:0/2429877640 conn(0x7f07a4079760 msgr2=0x7f07a4100990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.077+0000 7f07a97e7640 1 -- 172.21.15.22:0/2429877640 shutdown_connections 2024-09-21T04:01:27.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:27.077+0000 7f07a97e7640 1 -- 172.21.15.22:0/2429877640 wait complete. 2024-09-21T04:01:27.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:27 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1834007223' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T04:01:27.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:27 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1834007223' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T04:01:27.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:27 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1834007223' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 1} : dispatch 2024-09-21T04:01:27.732 INFO:tasks.cephadm.ceph_manager.ceph:need seq 219043332140 got 219043332141 for osd.8 2024-09-21T04:01:27.732 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:28.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.273+0000 7ff9044ac640 1 -- 172.21.15.22:0/3319213514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc1021f0 msgr2=0x7ff8fc102600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.273+0000 7ff9044ac640 1 --2- 172.21.15.22:0/3319213514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc1021f0 0x7ff8fc102600 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff8f4009860 tx=0x7ff8f402a340 comp rx=0 tx=0).stop 2024-09-21T04:01:28.276 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:28 smithi022 ceph-mon[31015]: pgmap v342: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:01:28.276 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:28 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2429877640' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T04:01:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.273+0000 7ff9044ac640 1 -- 172.21.15.22:0/3319213514 shutdown_connections 2024-09-21T04:01:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.273+0000 7ff9044ac640 1 --2- 172.21.15.22:0/3319213514 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8fc108480 0x7ff8fc10ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.273+0000 7ff9044ac640 1 --2- 172.21.15.22:0/3319213514 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8fc107b30 0x7ff8fc107f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.273+0000 7ff9044ac640 1 --2- 172.21.15.22:0/3319213514 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc1021f0 0x7ff8fc102600 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.273+0000 7ff9044ac640 1 -- 172.21.15.22:0/3319213514 >> 172.21.15.22:0/3319213514 conn(0x7ff8fc077c60 msgr2=0x7ff8fc0780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.273+0000 7ff9044ac640 1 -- 172.21.15.22:0/3319213514 shutdown_connections 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.273+0000 7ff9044ac640 1 -- 172.21.15.22:0/3319213514 wait complete. 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.274+0000 7ff9044ac640 1 Processor -- start 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff9044ac640 1 -- start start 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff9044ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8fc1021f0 0x7ff8fc19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff9044ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc107b30 0x7ff8fc19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff9044ac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8fc108480 0x7ff8fc19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff9044ac640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc111fe0 con 0x7ff8fc108480 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff9044ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc111e60 con 0x7ff8fc107b30 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff9044ac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8fc112160 con 0x7ff8fc1021f0 2024-09-21T04:01:28.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff902a49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8fc108480 0x7ff8fc19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff902a49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8fc108480 0x7ff8fc19fc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44268/0 (socket says 172.21.15.22:44268) 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff902a49640 1 -- 172.21.15.22:0/1948296147 learned_addr learned my addr 172.21.15.22:0/1948296147 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff901a47640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc107b30 0x7ff8fc19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.275+0000 7ff902248640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8fc1021f0 0x7ff8fc19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff902a49640 1 -- 172.21.15.22:0/1948296147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8fc1021f0 msgr2=0x7ff8fc19a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff902a49640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8fc1021f0 0x7ff8fc19a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff902a49640 1 -- 172.21.15.22:0/1948296147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc107b30 msgr2=0x7ff8fc19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff902a49640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc107b30 0x7ff8fc19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff902a49640 1 -- 172.21.15.22:0/1948296147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8fc1a0360 con 0x7ff8fc108480 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff901a47640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc107b30 0x7ff8fc19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:28.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff902a49640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8fc108480 0x7ff8fc19fc30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800eb10 tx=0x7ff8f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:28.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff8ef7fe640 1 -- 172.21.15.22:0/1948296147 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8004b20 con 0x7ff8fc108480 2024-09-21T04:01:28.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff8ef7fe640 1 -- 172.21.15.22:0/1948296147 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8f8004cc0 con 0x7ff8fc108480 2024-09-21T04:01:28.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff8ef7fe640 1 -- 172.21.15.22:0/1948296147 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8f8010690 con 0x7ff8fc108480 2024-09-21T04:01:28.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff9044ac640 1 -- 172.21.15.22:0/1948296147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8fc1a0650 con 0x7ff8fc108480 2024-09-21T04:01:28.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.276+0000 7ff9044ac640 1 -- 172.21.15.22:0/1948296147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8fc1a6db0 con 0x7ff8fc108480 2024-09-21T04:01:28.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.278+0000 7ff9044ac640 1 -- 172.21.15.22:0/1948296147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8fc102600 con 0x7ff8fc108480 2024-09-21T04:01:28.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.280+0000 7ff8ef7fe640 1 -- 172.21.15.22:0/1948296147 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff8f8005000 con 0x7ff8fc108480 2024-09-21T04:01:28.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.281+0000 7ff8ef7fe640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8e80b65a0 0x7ff8e80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.281+0000 7ff902248640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8e80b65a0 0x7ff8e80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.282+0000 7ff8ef7fe640 1 -- 172.21.15.22:0/1948296147 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7ff8f80e7fa0 con 0x7ff8fc108480 2024-09-21T04:01:28.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.282+0000 7ff902248640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8e80b65a0 0x7ff8e80b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40057c0 tx=0x7ff8f40058b0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:28.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.284+0000 7ff8ef7fe640 1 -- 172.21.15.22:0/1948296147 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff8f8056710 con 0x7ff8fc108480 2024-09-21T04:01:28.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:28 smithi073 ceph-mon[34443]: pgmap v342: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:01:28.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:28 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2429877640' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T04:01:28.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.154+0000 7f7304c3d640 1 -- 172.21.15.22:0/2908968352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7300102a60 msgr2=0x7f7300102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.154+0000 7f7304c3d640 1 --2- 172.21.15.22:0/2908968352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7300102a60 0x7f7300102e70 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f72f0009900 tx=0x7f72f002a410 comp rx=0 tx=0).stop 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.154+0000 7f7304c3d640 1 -- 172.21.15.22:0/2908968352 shutdown_connections 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.154+0000 7f7304c3d640 1 --2- 172.21.15.22:0/2908968352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73001083a0 0x7f73001087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.154+0000 7f7304c3d640 1 --2- 172.21.15.22:0/2908968352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7300108cf0 0x7f730010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.154+0000 7f7304c3d640 1 --2- 172.21.15.22:0/2908968352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7300102a60 0x7f7300102e70 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.154+0000 7f7304c3d640 1 -- 172.21.15.22:0/2908968352 >> 172.21.15.22:0/2908968352 conn(0x7f7300079730 msgr2=0x7f7300079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.154+0000 7f7304c3d640 1 -- 172.21.15.22:0/2908968352 shutdown_connections 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.154+0000 7f7304c3d640 1 -- 172.21.15.22:0/2908968352 wait complete. 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f7304c3d640 1 Processor -- start 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f7304c3d640 1 -- start start 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f7304c3d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7300102a60 0x7f730019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f7304c3d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73001083a0 0x7f730019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f7304c3d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7300108cf0 0x7f730019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f7304c3d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7300113930 con 0x7f7300108cf0 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f7304c3d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f73001137b0 con 0x7f7300102a60 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f7304c3d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7300113ab0 con 0x7f73001083a0 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f72fed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7300108cf0 0x7f730019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f72fed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7300108cf0 0x7f730019fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44264/0 (socket says 172.21.15.22:44264) 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.155+0000 7f72fed9d640 1 -- 172.21.15.22:0/2913929559 learned_addr learned my addr 172.21.15.22:0/2913929559 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f72fdd9b640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73001083a0 0x7f730019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f72fe59c640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7300102a60 0x7f730019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f72fed9d640 1 -- 172.21.15.22:0/2913929559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73001083a0 msgr2=0x7f730019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f72fed9d640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73001083a0 0x7f730019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f72fed9d640 1 -- 172.21.15.22:0/2913929559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7300102a60 msgr2=0x7f730019a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f72fed9d640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7300102a60 0x7f730019a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f72fed9d640 1 -- 172.21.15.22:0/2913929559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73001a0350 con 0x7f7300108cf0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f72fed9d640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7300108cf0 0x7f730019fc20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f72f800eb10 tx=0x7f72f800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f72ef7fe640 1 -- 172.21.15.22:0/2913929559 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8004b20 con 0x7f7300108cf0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f7304c3d640 1 -- 172.21.15.22:0/2913929559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73001a0640 con 0x7f7300108cf0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.156+0000 7f72ef7fe640 1 -- 172.21.15.22:0/2913929559 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72f8004cc0 con 0x7f7300108cf0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.157+0000 7f72ef7fe640 1 -- 172.21.15.22:0/2913929559 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8010690 con 0x7f7300108cf0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.157+0000 7f7304c3d640 1 -- 172.21.15.22:0/2913929559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73001a6da0 con 0x7f7300108cf0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.158+0000 7f7304c3d640 1 -- 172.21.15.22:0/2913929559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7300102e70 con 0x7f7300108cf0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.160+0000 7f72ef7fe640 1 -- 172.21.15.22:0/2913929559 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f72f8005000 con 0x7f7300108cf0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.161+0000 7f72ef7fe640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f72e80b65a0 0x7f72e80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.161+0000 7f72fe59c640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f72e80b65a0 0x7f72e80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.161+0000 7f72ef7fe640 1 -- 172.21.15.22:0/2913929559 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f72f80e7e10 con 0x7f7300108cf0 2024-09-21T04:01:28.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.162+0000 7f72fe59c640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f72e80b65a0 0x7f72e80b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72f00057c0 tx=0x7f72f00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:28.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.165+0000 7f72ef7fe640 1 -- 172.21.15.22:0/2913929559 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72f80eb030 con 0x7f7300108cf0 2024-09-21T04:01:28.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.393+0000 7f7304c3d640 1 -- 172.21.15.22:0/2913929559 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f730010a530 con 0x7f7300108cf0 2024-09-21T04:01:28.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.394+0000 7f72ef7fe640 1 -- 172.21.15.22:0/2913929559 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f72f80ae180 con 0x7f7300108cf0 2024-09-21T04:01:28.396 INFO:teuthology.orchestra.run.smithi022.stdout:292057776158 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 -- 172.21.15.22:0/2913929559 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f72e80b65a0 msgr2=0x7f72e80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f72e80b65a0 0x7f72e80b8ab0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f72f00057c0 tx=0x7f72f00058d0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 -- 172.21.15.22:0/2913929559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7300108cf0 msgr2=0x7f730019fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7300108cf0 0x7f730019fc20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f72f800eb10 tx=0x7f72f800c2d0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 -- 172.21.15.22:0/2913929559 shutdown_connections 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f72e80b65a0 0x7f72e80b8ab0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f73001083a0 0x7f730019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7300108cf0 0x7f730019fc20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 --2- 172.21.15.22:0/2913929559 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7300102a60 0x7f730019a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 -- 172.21.15.22:0/2913929559 >> 172.21.15.22:0/2913929559 conn(0x7f7300079730 msgr2=0x7f7300101590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 -- 172.21.15.22:0/2913929559 shutdown_connections 2024-09-21T04:01:28.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.396+0000 7f7304c3d640 1 -- 172.21.15.22:0/2913929559 wait complete. 2024-09-21T04:01:28.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:28 smithi060 ceph-mon[33722]: pgmap v342: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:01:28.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:28 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2429877640' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 8} : dispatch 2024-09-21T04:01:28.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.036+0000 7f3901c7e640 1 -- 172.21.15.22:0/2522469547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc105380 msgr2=0x7f38fc10d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.036+0000 7f3901c7e640 1 --2- 172.21.15.22:0/2522469547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc105380 0x7f38fc10d8d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f38f0009900 tx=0x7f38f002a3f0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.036+0000 7f3901c7e640 1 -- 172.21.15.22:0/2522469547 shutdown_connections 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.036+0000 7f3901c7e640 1 --2- 172.21.15.22:0/2522469547 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38fc10de60 0x7f38fc110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.036+0000 7f3901c7e640 1 --2- 172.21.15.22:0/2522469547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc105380 0x7f38fc10d8d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.036+0000 7f3901c7e640 1 --2- 172.21.15.22:0/2522469547 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc104a30 0x7f38fc104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.036+0000 7f3901c7e640 1 -- 172.21.15.22:0/2522469547 >> 172.21.15.22:0/2522469547 conn(0x7f38fc079760 msgr2=0x7f38fc079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.036+0000 7f3901c7e640 1 -- 172.21.15.22:0/2522469547 shutdown_connections 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.036+0000 7f3901c7e640 1 -- 172.21.15.22:0/2522469547 wait complete. 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.036+0000 7f3901c7e640 1 Processor -- start 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f3901c7e640 1 -- start start 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f3901c7e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc104a30 0x7f38fc19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f3901c7e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38fc105380 0x7f38fc19aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f3901c7e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc10de60 0x7f38fc19fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f3901c7e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc1139e0 con 0x7f38fc10de60 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f3901c7e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc113860 con 0x7f38fc104a30 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f3901c7e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f38fc113b60 con 0x7f38fc105380 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc10de60 0x7f38fc19fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f38fbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc10de60 0x7f38fc19fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44248/0 (socket says 172.21.15.22:44248) 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f38fbfff640 1 -- 172.21.15.22:0/450155530 learned_addr learned my addr 172.21.15.22:0/450155530 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f38fb7fe640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc104a30 0x7f38fc19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f38faffd640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38fc105380 0x7f38fc19aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f38fbfff640 1 -- 172.21.15.22:0/450155530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38fc105380 msgr2=0x7f38fc19aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f38fbfff640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38fc105380 0x7f38fc19aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f38fbfff640 1 -- 172.21.15.22:0/450155530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc104a30 msgr2=0x7f38fc19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f38fbfff640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc104a30 0x7f38fc19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.037+0000 7f38fbfff640 1 -- 172.21.15.22:0/450155530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38fc1a0320 con 0x7f38fc10de60 2024-09-21T04:01:28.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.038+0000 7f38fbfff640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc10de60 0x7f38fc19fcb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f38f400b970 tx=0x7f38f400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:28.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.038+0000 7f38f8ff9640 1 -- 172.21.15.22:0/450155530 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f4019070 con 0x7f38fc10de60 2024-09-21T04:01:28.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.038+0000 7f38f8ff9640 1 -- 172.21.15.22:0/450155530 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38f4014440 con 0x7f38fc10de60 2024-09-21T04:01:28.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.038+0000 7f3901c7e640 1 -- 172.21.15.22:0/450155530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38fc1a0610 con 0x7f38fc10de60 2024-09-21T04:01:28.484 INFO:teuthology.orchestra.run.smithi022.stdout:171798691896 2024-09-21T04:01:28.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.038+0000 7f38f8ff9640 1 -- 172.21.15.22:0/450155530 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38f40075d0 con 0x7f38fc10de60 2024-09-21T04:01:28.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.038+0000 7f3901c7e640 1 -- 172.21.15.22:0/450155530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38fc1a6e30 con 0x7f38fc10de60 2024-09-21T04:01:28.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.039+0000 7f3901c7e640 1 -- 172.21.15.22:0/450155530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38fc06c1f0 con 0x7f38fc10de60 2024-09-21T04:01:28.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.040+0000 7f38f8ff9640 1 -- 172.21.15.22:0/450155530 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f38f401c070 con 0x7f38fc10de60 2024-09-21T04:01:28.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.041+0000 7f38f8ff9640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f38e40b65d0 0x7f38e40b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:28.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.041+0000 7f38fb7fe640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f38e40b65d0 0x7f38e40b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:28.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.041+0000 7f38f8ff9640 1 -- 172.21.15.22:0/450155530 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 9092+0+0 (secure 0 0 0) 0x7f38f40e6d80 con 0x7f38fc10de60 2024-09-21T04:01:28.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.042+0000 7f38fb7fe640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f38e40b65d0 0x7f38e40b8ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0058c0 tx=0x7f38ec005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:28.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.046+0000 7f38f8ff9640 1 -- 172.21.15.22:0/450155530 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f38f40ad0f0 con 0x7f38fc10de60 2024-09-21T04:01:28.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.244+0000 7f3901c7e640 1 -- 172.21.15.22:0/450155530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f38fc104e40 con 0x7f38fc10de60 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.244+0000 7f38f8ff9640 1 -- 172.21.15.22:0/450155530 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f38fc104e40 con 0x7f38fc10de60 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.246+0000 7f3901c7e640 1 -- 172.21.15.22:0/450155530 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f38e40b65d0 msgr2=0x7f38e40b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.246+0000 7f3901c7e640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f38e40b65d0 0x7f38e40b8ae0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f38ec0058c0 tx=0x7f38ec005850 comp rx=0 tx=0).stop 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.246+0000 7f3901c7e640 1 -- 172.21.15.22:0/450155530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc10de60 msgr2=0x7f38fc19fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.246+0000 7f3901c7e640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc10de60 0x7f38fc19fcb0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f38f400b970 tx=0x7f38f400be30 comp rx=0 tx=0).stop 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.247+0000 7f3901c7e640 1 -- 172.21.15.22:0/450155530 shutdown_connections 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.247+0000 7f3901c7e640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f38e40b65d0 0x7f38e40b8ae0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.247+0000 7f3901c7e640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f38fc105380 0x7f38fc19aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.247+0000 7f3901c7e640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f38fc10de60 0x7f38fc19fcb0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.247+0000 7f3901c7e640 1 --2- 172.21.15.22:0/450155530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f38fc104a30 0x7f38fc19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.247+0000 7f3901c7e640 1 -- 172.21.15.22:0/450155530 >> 172.21.15.22:0/450155530 conn(0x7f38fc079760 msgr2=0x7f38fc100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.247+0000 7f3901c7e640 1 -- 172.21.15.22:0/450155530 shutdown_connections 2024-09-21T04:01:28.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.247+0000 7f3901c7e640 1 -- 172.21.15.22:0/450155530 wait complete. 2024-09-21T04:01:28.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.505+0000 7ff9044ac640 1 -- 172.21.15.22:0/1948296147 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7ff8fc02e640 con 0x7ff8fc108480 2024-09-21T04:01:28.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.505+0000 7ff8ef7fe640 1 -- 172.21.15.22:0/1948296147 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7ff8f80ae310 con 0x7ff8fc108480 2024-09-21T04:01:28.508 INFO:teuthology.orchestra.run.smithi022.stdout:193273528370 2024-09-21T04:01:28.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.507+0000 7ff9044ac640 1 -- 172.21.15.22:0/1948296147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8e80b65a0 msgr2=0x7ff8e80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.507+0000 7ff9044ac640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8e80b65a0 0x7ff8e80b8ab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7ff8f40057c0 tx=0x7ff8f40058b0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.507+0000 7ff9044ac640 1 -- 172.21.15.22:0/1948296147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8fc108480 msgr2=0x7ff8fc19fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:28.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.507+0000 7ff9044ac640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8fc108480 0x7ff8fc19fc30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff8f800eb10 tx=0x7ff8f800c2d0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.507+0000 7ff9044ac640 1 -- 172.21.15.22:0/1948296147 shutdown_connections 2024-09-21T04:01:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.508+0000 7ff9044ac640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8e80b65a0 0x7ff8e80b8ab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.508+0000 7ff9044ac640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8fc108480 0x7ff8fc19fc30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.508+0000 7ff9044ac640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8fc107b30 0x7ff8fc19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.508+0000 7ff9044ac640 1 --2- 172.21.15.22:0/1948296147 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8fc1021f0 0x7ff8fc19a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.508+0000 7ff9044ac640 1 -- 172.21.15.22:0/1948296147 >> 172.21.15.22:0/1948296147 conn(0x7ff8fc077c60 msgr2=0x7ff8fc100ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.508+0000 7ff9044ac640 1 -- 172.21.15.22:0/1948296147 shutdown_connections 2024-09-21T04:01:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:28.508+0000 7ff9044ac640 1 -- 172.21.15.22:0/1948296147 wait complete. 2024-09-21T04:01:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:29 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/450155530' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T04:01:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:29 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2913929559' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T04:01:29.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:29 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1948296147' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T04:01:29.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:29 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/450155530' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T04:01:29.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:29 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2913929559' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T04:01:29.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:29 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1948296147' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T04:01:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:29 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/450155530' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 6} : dispatch 2024-09-21T04:01:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:29 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2913929559' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 11} : dispatch 2024-09-21T04:01:29.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:29 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1948296147' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 7} : dispatch 2024-09-21T04:01:29.589 INFO:tasks.cephadm.ceph_manager.ceph:need seq 193273528368 got 193273528370 for osd.7 2024-09-21T04:01:29.590 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.093+0000 7f2db02df640 1 -- 172.21.15.22:0/1352494384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da81094a0 msgr2=0x7f2da81098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.093+0000 7f2db02df640 1 --2- 172.21.15.22:0/1352494384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da81094a0 0x7f2da81098b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f2d98009900 tx=0x7f2d9802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.094+0000 7f2db02df640 1 -- 172.21.15.22:0/1352494384 shutdown_connections 2024-09-21T04:01:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.094+0000 7f2db02df640 1 --2- 172.21.15.22:0/1352494384 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da8109df0 0x7f2da8110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.094+0000 7f2db02df640 1 --2- 172.21.15.22:0/1352494384 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da81094a0 0x7f2da81098b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.094+0000 7f2db02df640 1 --2- 172.21.15.22:0/1352494384 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2da8103b60 0x7f2da8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.094+0000 7f2db02df640 1 -- 172.21.15.22:0/1352494384 >> 172.21.15.22:0/1352494384 conn(0x7f2da807b850 msgr2=0x7f2da807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.094+0000 7f2db02df640 1 -- 172.21.15.22:0/1352494384 shutdown_connections 2024-09-21T04:01:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.094+0000 7f2db02df640 1 -- 172.21.15.22:0/1352494384 wait complete. 2024-09-21T04:01:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.094+0000 7f2db02df640 1 Processor -- start 2024-09-21T04:01:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.094+0000 7f2db02df640 1 -- start start 2024-09-21T04:01:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2db02df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8103b60 0x7f2da819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2db02df640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2da81094a0 0x7f2da819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2db02df640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da8109df0 0x7f2da819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2db02df640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2da8113960 con 0x7f2da8103b60 2024-09-21T04:01:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2db02df640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2da81137e0 con 0x7f2da81094a0 2024-09-21T04:01:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2db02df640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2da8113ae0 con 0x7f2da8109df0 2024-09-21T04:01:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae07b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8103b60 0x7f2da819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae07b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8103b60 0x7f2da819a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44290/0 (socket says 172.21.15.22:44290) 2024-09-21T04:01:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae07b640 1 -- 172.21.15.22:0/3173195830 learned_addr learned my addr 172.21.15.22:0/3173195830 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dad87a640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2da81094a0 0x7f2da819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae87c640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da8109df0 0x7f2da819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae07b640 1 -- 172.21.15.22:0/3173195830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da8109df0 msgr2=0x7f2da819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae07b640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da8109df0 0x7f2da819fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae07b640 1 -- 172.21.15.22:0/3173195830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2da81094a0 msgr2=0x7f2da819a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae07b640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2da81094a0 0x7f2da819a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae07b640 1 -- 172.21.15.22:0/3173195830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da81a0380 con 0x7f2da8103b60 2024-09-21T04:01:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae87c640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da8109df0 0x7f2da819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.095+0000 7f2dae07b640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8103b60 0x7f2da819a410 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c890 tx=0x7f2da400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.096+0000 7f2d9f7fe640 1 -- 172.21.15.22:0/3173195830 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da4004220 con 0x7f2da8103b60 2024-09-21T04:01:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.096+0000 7f2d9f7fe640 1 -- 172.21.15.22:0/3173195830 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2da4007e40 con 0x7f2da8103b60 2024-09-21T04:01:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.096+0000 7f2db02df640 1 -- 172.21.15.22:0/3173195830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da81a0670 con 0x7f2da8103b60 2024-09-21T04:01:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.096+0000 7f2d9f7fe640 1 -- 172.21.15.22:0/3173195830 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2da4004a00 con 0x7f2da8103b60 2024-09-21T04:01:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.096+0000 7f2db02df640 1 -- 172.21.15.22:0/3173195830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da81a6dd0 con 0x7f2da8103b60 2024-09-21T04:01:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.097+0000 7f2db02df640 1 -- 172.21.15.22:0/3173195830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2da8103f70 con 0x7f2da8103b60 2024-09-21T04:01:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.098+0000 7f2d9f7fe640 1 -- 172.21.15.22:0/3173195830 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f2da40079b0 con 0x7f2da8103b60 2024-09-21T04:01:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.099+0000 7f2d9f7fe640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2d940b6620 0x7f2d940b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.099+0000 7f2dad87a640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2d940b6620 0x7f2d940b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.099+0000 7f2d9f7fe640 1 -- 172.21.15.22:0/3173195830 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9187+0+0 (secure 0 0 0) 0x7f2da40e7900 con 0x7f2da8103b60 2024-09-21T04:01:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.100+0000 7f2dad87a640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2d940b6620 0x7f2d940b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2d98005940 tx=0x7f2d980058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.102+0000 7f2d9f7fe640 1 -- 172.21.15.22:0/3173195830 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2da4014030 con 0x7f2da8103b60 2024-09-21T04:01:30.257 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:30 smithi022 ceph-mon[31015]: pgmap v343: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:01:30.257 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11, 5, 6]} : dispatch 2024-09-21T04:01:30.257 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T04:01:30.257 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:30 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-21T04:01:30.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.295+0000 7f2db02df640 1 -- 172.21.15.22:0/3173195830 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f2da819b540 con 0x7f2da8103b60 2024-09-21T04:01:30.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.296+0000 7f2d9f7fe640 1 -- 172.21.15.22:0/3173195830 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f2da40adcf0 con 0x7f2da8103b60 2024-09-21T04:01:30.299 INFO:teuthology.orchestra.run.smithi022.stdout:244813135912 2024-09-21T04:01:30.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 -- 172.21.15.22:0/3173195830 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2d940b6620 msgr2=0x7f2d940b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:30.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2d940b6620 0x7f2d940b8b30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2d98005940 tx=0x7f2d980058d0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 -- 172.21.15.22:0/3173195830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8103b60 msgr2=0x7f2da819a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:30.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8103b60 0x7f2da819a410 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f2da400c890 tx=0x7f2da400cd50 comp rx=0 tx=0).stop 2024-09-21T04:01:30.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 -- 172.21.15.22:0/3173195830 shutdown_connections 2024-09-21T04:01:30.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2d940b6620 0x7f2d940b8b30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2da8109df0 0x7f2da819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2da81094a0 0x7f2da819a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 --2- 172.21.15.22:0/3173195830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2da8103b60 0x7f2da819a410 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 -- 172.21.15.22:0/3173195830 >> 172.21.15.22:0/3173195830 conn(0x7f2da807b850 msgr2=0x7f2da8107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:30.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 -- 172.21.15.22:0/3173195830 shutdown_connections 2024-09-21T04:01:30.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.298+0000 7f2db02df640 1 -- 172.21.15.22:0/3173195830 wait complete. 2024-09-21T04:01:30.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:30 smithi073 ceph-mon[34443]: pgmap v343: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:01:30.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11, 5, 6]} : dispatch 2024-09-21T04:01:30.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T04:01:30.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:30 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-21T04:01:30.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:30 smithi060 ceph-mon[33722]: pgmap v343: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:01:30.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11, 5, 6]} : dispatch 2024-09-21T04:01:30.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]} : dispatch 2024-09-21T04:01:30.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:30 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]} : dispatch 2024-09-21T04:01:30.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.995+0000 7f9e68012640 1 -- 172.21.15.22:0/914782990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e601094c0 msgr2=0x7f9e601098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:30.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.995+0000 7f9e68012640 1 --2- 172.21.15.22:0/914782990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e601094c0 0x7f9e601098d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f9e54009900 tx=0x7f9e5402a410 comp rx=0 tx=0).stop 2024-09-21T04:01:30.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.995+0000 7f9e68012640 1 -- 172.21.15.22:0/914782990 shutdown_connections 2024-09-21T04:01:30.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.995+0000 7f9e68012640 1 --2- 172.21.15.22:0/914782990 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e60109e10 0x7f9e60110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.995+0000 7f9e68012640 1 --2- 172.21.15.22:0/914782990 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e601094c0 0x7f9e601098d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.995+0000 7f9e68012640 1 --2- 172.21.15.22:0/914782990 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e60103b80 0x7f9e60103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:30.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.995+0000 7f9e68012640 1 -- 172.21.15.22:0/914782990 >> 172.21.15.22:0/914782990 conn(0x7f9e600ff610 msgr2=0x7f9e60101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:30.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.995+0000 7f9e68012640 1 -- 172.21.15.22:0/914782990 shutdown_connections 2024-09-21T04:01:30.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.996+0000 7f9e68012640 1 -- 172.21.15.22:0/914782990 wait complete. 2024-09-21T04:01:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.996+0000 7f9e68012640 1 Processor -- start 2024-09-21T04:01:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.996+0000 7f9e68012640 1 -- start start 2024-09-21T04:01:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e68012640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e60103b80 0x7f9e6019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e68012640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e601094c0 0x7f9e6019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e68012640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e60109e10 0x7f9e6019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e68012640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9e60113980 con 0x7f9e601094c0 2024-09-21T04:01:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e68012640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9e60113800 con 0x7f9e60109e10 2024-09-21T04:01:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e68012640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9e60113b00 con 0x7f9e60103b80 2024-09-21T04:01:31.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e655ad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e601094c0 0x7f9e6019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e655ad640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e601094c0 0x7f9e6019a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58908/0 (socket says 172.21.15.22:58908) 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e655ad640 1 -- 172.21.15.22:0/733221010 learned_addr learned my addr 172.21.15.22:0/733221010 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e65dae640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e60103b80 0x7f9e6019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e665af640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e60109e10 0x7f9e6019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e655ad640 1 -- 172.21.15.22:0/733221010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e60103b80 msgr2=0x7f9e6019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e655ad640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e60103b80 0x7f9e6019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e655ad640 1 -- 172.21.15.22:0/733221010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e60109e10 msgr2=0x7f9e6019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e655ad640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e60109e10 0x7f9e6019fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e655ad640 1 -- 172.21.15.22:0/733221010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e601a0320 con 0x7f9e601094c0 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e665af640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e60109e10 0x7f9e6019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.997+0000 7f9e655ad640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e601094c0 0x7f9e6019a950 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9e54005940 tx=0x7f9e540040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.998+0000 7f9e5effd640 1 -- 172.21.15.22:0/733221010 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e5403f030 con 0x7f9e601094c0 2024-09-21T04:01:31.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.998+0000 7f9e5effd640 1 -- 172.21.15.22:0/733221010 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e54003a80 con 0x7f9e601094c0 2024-09-21T04:01:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.998+0000 7f9e68012640 1 -- 172.21.15.22:0/733221010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e601a05b0 con 0x7f9e601094c0 2024-09-21T04:01:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.998+0000 7f9e5effd640 1 -- 172.21.15.22:0/733221010 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e54035070 con 0x7f9e601094c0 2024-09-21T04:01:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.998+0000 7f9e68012640 1 -- 172.21.15.22:0/733221010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e601a6d70 con 0x7f9e601094c0 2024-09-21T04:01:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:30.999+0000 7f9e68012640 1 -- 172.21.15.22:0/733221010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e60104e00 con 0x7f9e601094c0 2024-09-21T04:01:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.000+0000 7f9e5effd640 1 -- 172.21.15.22:0/733221010 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f9e54042030 con 0x7f9e601094c0 2024-09-21T04:01:31.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.001+0000 7f9e5effd640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9e480b65a0 0x7f9e480b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:31.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.001+0000 7f9e65dae640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9e480b65a0 0x7f9e480b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:31.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.001+0000 7f9e5effd640 1 -- 172.21.15.22:0/733221010 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 9187+0+0 (secure 0 0 0) 0x7f9e541081c0 con 0x7f9e601094c0 2024-09-21T04:01:31.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.002+0000 7f9e65dae640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9e480b65a0 0x7f9e480b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9e50005c40 tx=0x7f9e5000a590 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:31.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.004+0000 7f9e5effd640 1 -- 172.21.15.22:0/733221010 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9e540ce530 con 0x7f9e601094c0 2024-09-21T04:01:31.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.206+0000 7f9e68012640 1 -- 172.21.15.22:0/733221010 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f9e60103f90 con 0x7f9e601094c0 2024-09-21T04:01:31.209 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11, 5, 6]}]': finished 2024-09-21T04:01:31.209 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T04:01:31.209 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:31 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-21T04:01:31.209 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:31 smithi022 ceph-mon[31015]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T04:01:31.209 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:31 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3173195830' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T04:01:31.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.206+0000 7f9e5effd640 1 -- 172.21.15.22:0/733221010 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9e540d2910 con 0x7f9e601094c0 2024-09-21T04:01:31.210 INFO:teuthology.orchestra.run.smithi022.stdout:34359738455 2024-09-21T04:01:31.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 -- 172.21.15.22:0/733221010 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9e480b65a0 msgr2=0x7f9e480b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9e480b65a0 0x7f9e480b8ab0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9e50005c40 tx=0x7f9e5000a590 comp rx=0 tx=0).stop 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 -- 172.21.15.22:0/733221010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e601094c0 msgr2=0x7f9e6019a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e601094c0 0x7f9e6019a950 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f9e54005940 tx=0x7f9e540040e0 comp rx=0 tx=0).stop 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 -- 172.21.15.22:0/733221010 shutdown_connections 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9e480b65a0 0x7f9e480b8ab0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9e60109e10 0x7f9e6019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e601094c0 0x7f9e6019a950 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 --2- 172.21.15.22:0/733221010 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9e60103b80 0x7f9e6019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 -- 172.21.15.22:0/733221010 >> 172.21.15.22:0/733221010 conn(0x7f9e600ff610 msgr2=0x7f9e60101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 -- 172.21.15.22:0/733221010 shutdown_connections 2024-09-21T04:01:31.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:31.209+0000 7f9e68012640 1 -- 172.21.15.22:0/733221010 wait complete. 2024-09-21T04:01:31.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11, 5, 6]}]': finished 2024-09-21T04:01:31.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T04:01:31.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:31 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-21T04:01:31.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:31 smithi073 ceph-mon[34443]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T04:01:31.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:31 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3173195830' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T04:01:31.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.0", "id": [7, 11, 5, 6]}]': finished 2024-09-21T04:01:31.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.6", "id": [8, 11]}]': finished 2024-09-21T04:01:31.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:31 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-09-21T04:01:31.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:31 smithi060 ceph-mon[33722]: osdmap e84: 12 total, 12 up, 12 in 2024-09-21T04:01:31.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:31 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3173195830' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 9} : dispatch 2024-09-21T04:01:31.531 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574927 got 55834574929 for osd.1 2024-09-21T04:01:31.531 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:32.007 INFO:tasks.cephadm.ceph_manager.ceph:need seq 244813135910 got 244813135912 for osd.9 2024-09-21T04:01:32.007 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:32.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.174+0000 7fc7db9fb640 1 -- 172.21.15.22:0/1838482526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7d4105270 msgr2=0x7fc7d410d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.174+0000 7fc7db9fb640 1 --2- 172.21.15.22:0/1838482526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7d4105270 0x7fc7d410d8b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fc7c4009900 tx=0x7fc7c402a410 comp rx=0 tx=0).stop 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.174+0000 7fc7db9fb640 1 -- 172.21.15.22:0/1838482526 shutdown_connections 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.174+0000 7fc7db9fb640 1 --2- 172.21.15.22:0/1838482526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7d410ddf0 0x7fc7d4110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.174+0000 7fc7db9fb640 1 --2- 172.21.15.22:0/1838482526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7d4105270 0x7fc7d410d8b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.174+0000 7fc7db9fb640 1 --2- 172.21.15.22:0/1838482526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7d4104840 0x7fc7d4104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.174+0000 7fc7db9fb640 1 -- 172.21.15.22:0/1838482526 >> 172.21.15.22:0/1838482526 conn(0x7fc7d4079730 msgr2=0x7fc7d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.174+0000 7fc7db9fb640 1 -- 172.21.15.22:0/1838482526 shutdown_connections 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.174+0000 7fc7db9fb640 1 -- 172.21.15.22:0/1838482526 wait complete. 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7db9fb640 1 Processor -- start 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7db9fb640 1 -- start start 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7db9fb640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7d4104840 0x7fc7d419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:32.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7db9fb640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7d4105270 0x7fc7d419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7db9fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7d410ddf0 0x7fc7d419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7db9fb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4113920 con 0x7fc7d410ddf0 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7db9fb640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d41137a0 con 0x7fc7d4104840 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7db9fb640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d4113aa0 con 0x7fc7d4105270 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7d9f98640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7d410ddf0 0x7fc7d419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7d9f98640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7d410ddf0 0x7fc7d419fbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58926/0 (socket says 172.21.15.22:58926) 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.175+0000 7fc7d9f98640 1 -- 172.21.15.22:0/255403029 learned_addr learned my addr 172.21.15.22:0/255403029 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7d9797640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7d4104840 0x7fc7d419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7d8f96640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7d4105270 0x7fc7d419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7d9f98640 1 -- 172.21.15.22:0/255403029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7d4105270 msgr2=0x7fc7d419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7d9f98640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7d4105270 0x7fc7d419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7d9f98640 1 -- 172.21.15.22:0/255403029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7d4104840 msgr2=0x7fc7d419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:32.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7d9f98640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7d4104840 0x7fc7d419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7d9f98640 1 -- 172.21.15.22:0/255403029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d41a0220 con 0x7fc7d410ddf0 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7d8f96640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7d4105270 0x7fc7d419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7d9f98640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7d410ddf0 0x7fc7d419fbb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00eaa0 tx=0x7fc7cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7ca7fc640 1 -- 172.21.15.22:0/255403029 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc00cdb0 con 0x7fc7d410ddf0 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7ca7fc640 1 -- 172.21.15.22:0/255403029 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7cc005020 con 0x7fc7d410ddf0 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7ca7fc640 1 -- 172.21.15.22:0/255403029 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7cc0116d0 con 0x7fc7d410ddf0 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7db9fb640 1 -- 172.21.15.22:0/255403029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d41a0510 con 0x7fc7d410ddf0 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.176+0000 7fc7db9fb640 1 -- 172.21.15.22:0/255403029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d41a09d0 con 0x7fc7d410ddf0 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.177+0000 7fc7db9fb640 1 -- 172.21.15.22:0/255403029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d4104c50 con 0x7fc7d410ddf0 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.179+0000 7fc7ca7fc640 1 -- 172.21.15.22:0/255403029 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc7cc0051d0 con 0x7fc7d410ddf0 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.180+0000 7fc7ca7fc640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc7c00b6650 0x7fc7c00b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.180+0000 7fc7ca7fc640 1 -- 172.21.15.22:0/255403029 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fc7cc0e7dc0 con 0x7fc7d410ddf0 2024-09-21T04:01:32.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.180+0000 7fc7d9797640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc7c00b6650 0x7fc7c00b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:32.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.180+0000 7fc7d9797640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc7c00b6650 0x7fc7c00b8b60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc7d406bc00 tx=0x7fc7d0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:32.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.183+0000 7fc7ca7fc640 1 -- 172.21.15.22:0/255403029 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc7cc016030 con 0x7fc7d410ddf0 2024-09-21T04:01:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:32 smithi022 ceph-mon[31015]: pgmap v345: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T04:01:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:32 smithi022 ceph-mon[31015]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T04:01:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:32 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/733221010' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T04:01:32.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:32 smithi073 ceph-mon[34443]: pgmap v345: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T04:01:32.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:32 smithi073 ceph-mon[34443]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T04:01:32.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:32 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/733221010' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T04:01:32.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.375+0000 7fc7db9fb640 1 -- 172.21.15.22:0/255403029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7fc7d419b4a0 con 0x7fc7d410ddf0 2024-09-21T04:01:32.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.376+0000 7fc7ca7fc640 1 -- 172.21.15.22:0/255403029 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fc7cc0ae150 con 0x7fc7d410ddf0 2024-09-21T04:01:32.379 INFO:teuthology.orchestra.run.smithi022.stdout:266287972388 2024-09-21T04:01:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 -- 172.21.15.22:0/255403029 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc7c00b6650 msgr2=0x7fc7c00b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc7c00b6650 0x7fc7c00b8b60 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fc7d406bc00 tx=0x7fc7d0005f90 comp rx=0 tx=0).stop 2024-09-21T04:01:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 -- 172.21.15.22:0/255403029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7d410ddf0 msgr2=0x7fc7d419fbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7d410ddf0 0x7fc7d419fbb0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fc7cc00eaa0 tx=0x7fc7cc00ef60 comp rx=0 tx=0).stop 2024-09-21T04:01:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 -- 172.21.15.22:0/255403029 shutdown_connections 2024-09-21T04:01:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc7c00b6650 0x7fc7c00b8b60 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc7d4105270 0x7fc7d419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc7d410ddf0 0x7fc7d419fbb0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:32.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 --2- 172.21.15.22:0/255403029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc7d4104840 0x7fc7d419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:32.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 -- 172.21.15.22:0/255403029 >> 172.21.15.22:0/255403029 conn(0x7fc7d4079730 msgr2=0x7fc7d41008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:32.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 -- 172.21.15.22:0/255403029 shutdown_connections 2024-09-21T04:01:32.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:32.378+0000 7fc7db9fb640 1 -- 172.21.15.22:0/255403029 wait complete. 2024-09-21T04:01:32.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:32 smithi060 ceph-mon[33722]: pgmap v345: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T04:01:32.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:32 smithi060 ceph-mon[33722]: osdmap e85: 12 total, 12 up, 12 in 2024-09-21T04:01:32.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:32 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/733221010' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 0} : dispatch 2024-09-21T04:01:33.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:33 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/255403029' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T04:01:33.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:33 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/255403029' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T04:01:33.383 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972385 got 266287972388 for osd.10 2024-09-21T04:01:33.383 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:33.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:33 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/255403029' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 10} : dispatch 2024-09-21T04:01:34.020 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738453 got 34359738455 for osd.0 2024-09-21T04:01:34.021 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:34.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:34 smithi022 ceph-mon[31015]: pgmap v347: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:01:34.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:34 smithi073 ceph-mon[34443]: pgmap v347: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:01:34.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:34 smithi060 ceph-mon[33722]: pgmap v347: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s; 0 B/s, 0 objects/s recovering 2024-09-21T04:01:34.535 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888122 got 146028888125 for osd.5 2024-09-21T04:01:34.535 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:34.660 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691895 got 171798691896 for osd.6 2024-09-21T04:01:34.660 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:34.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.884+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/3529156904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca4105330 msgr2=0x7f5ca410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:34.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.884+0000 7f5ca9a3f640 1 --2- 172.21.15.22:0/3529156904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca4105330 0x7f5ca410d880 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5c98009900 tx=0x7f5c9802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:34.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.884+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/3529156904 shutdown_connections 2024-09-21T04:01:34.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.884+0000 7f5ca9a3f640 1 --2- 172.21.15.22:0/3529156904 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ca410de40 0x7f5ca4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:34.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.884+0000 7f5ca9a3f640 1 --2- 172.21.15.22:0/3529156904 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca4105330 0x7f5ca410d880 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:34.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.884+0000 7f5ca9a3f640 1 --2- 172.21.15.22:0/3529156904 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca41049e0 0x7f5ca4104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.885+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/3529156904 >> 172.21.15.22:0/3529156904 conn(0x7f5ca4079750 msgr2=0x7f5ca4079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.885+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/3529156904 shutdown_connections 2024-09-21T04:01:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.885+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/3529156904 wait complete. 2024-09-21T04:01:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.885+0000 7f5ca9a3f640 1 Processor -- start 2024-09-21T04:01:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.885+0000 7f5ca9a3f640 1 -- start start 2024-09-21T04:01:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca9a3f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca41049e0 0x7f5ca4102720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca9a3f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca4105330 0x7f5ca4102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca9a3f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ca410de40 0x7f5ca41031a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca9a3f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4113950 con 0x7f5ca4105330 2024-09-21T04:01:34.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca9a3f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca41137d0 con 0x7f5ca410de40 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca9a3f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ca4113ad0 con 0x7f5ca41049e0 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca4105330 0x7f5ca4102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca4105330 0x7f5ca4102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58946/0 (socket says 172.21.15.22:58946) 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca27fc640 1 -- 172.21.15.22:0/2651087237 learned_addr learned my addr 172.21.15.22:0/2651087237 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca37fe640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ca410de40 0x7f5ca41031a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca2ffd640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca41049e0 0x7f5ca4102720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca27fc640 1 -- 172.21.15.22:0/2651087237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca41049e0 msgr2=0x7f5ca4102720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca27fc640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca41049e0 0x7f5ca4102720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca27fc640 1 -- 172.21.15.22:0/2651087237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ca410de40 msgr2=0x7f5ca41031a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca27fc640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ca410de40 0x7f5ca41031a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca27fc640 1 -- 172.21.15.22:0/2651087237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ca41a86a0 con 0x7f5ca4105330 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.886+0000 7f5ca27fc640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca4105330 0x7f5ca4102c60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5c98005940 tx=0x7f5c980040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:34.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.887+0000 7f5ca8a3d640 1 -- 172.21.15.22:0/2651087237 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9803f030 con 0x7f5ca4105330 2024-09-21T04:01:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.887+0000 7f5ca8a3d640 1 -- 172.21.15.22:0/2651087237 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c98003a80 con 0x7f5ca4105330 2024-09-21T04:01:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.887+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/2651087237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ca41a8930 con 0x7f5ca4105330 2024-09-21T04:01:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.887+0000 7f5ca8a3d640 1 -- 172.21.15.22:0/2651087237 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c98035070 con 0x7f5ca4105330 2024-09-21T04:01:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.887+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/2651087237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ca41a8e10 con 0x7f5ca4105330 2024-09-21T04:01:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.888+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/2651087237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ca406c280 con 0x7f5ca4105330 2024-09-21T04:01:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.889+0000 7f5ca8a3d640 1 -- 172.21.15.22:0/2651087237 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5c98042030 con 0x7f5ca4105330 2024-09-21T04:01:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.891+0000 7f5ca8a3d640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5c8c0b65a0 0x7f5c8c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.891+0000 7f5ca2ffd640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5c8c0b65a0 0x7f5c8c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.891+0000 7f5ca8a3d640 1 -- 172.21.15.22:0/2651087237 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f5c98108180 con 0x7f5ca4105330 2024-09-21T04:01:34.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.891+0000 7f5ca2ffd640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5c8c0b65a0 0x7f5c8c0b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5c94005fd0 tx=0x7f5c94005e40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:34.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:34.894+0000 7f5ca8a3d640 1 -- 172.21.15.22:0/2651087237 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5c980ce4f0 con 0x7f5ca4105330 2024-09-21T04:01:34.935 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:35.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.092+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/2651087237 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f5ca4104df0 con 0x7f5ca4105330 2024-09-21T04:01:35.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.093+0000 7f5ca8a3d640 1 -- 172.21.15.22:0/2651087237 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5c980d28d0 con 0x7f5ca4105330 2024-09-21T04:01:35.095 INFO:teuthology.orchestra.run.smithi022.stdout:98784247881 2024-09-21T04:01:35.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/2651087237 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5c8c0b65a0 msgr2=0x7f5c8c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:35.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5c8c0b65a0 0x7f5c8c0b8ab0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f5c94005fd0 tx=0x7f5c94005e40 comp rx=0 tx=0).stop 2024-09-21T04:01:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/2651087237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca4105330 msgr2=0x7f5ca4102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca4105330 0x7f5ca4102c60 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f5c98005940 tx=0x7f5c980040e0 comp rx=0 tx=0).stop 2024-09-21T04:01:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/2651087237 shutdown_connections 2024-09-21T04:01:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5c8c0b65a0 0x7f5c8c0b8ab0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ca410de40 0x7f5ca41031a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ca4105330 0x7f5ca4102c60 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 --2- 172.21.15.22:0/2651087237 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ca41049e0 0x7f5ca4102720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/2651087237 >> 172.21.15.22:0/2651087237 conn(0x7f5ca4079750 msgr2=0x7f5ca4100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/2651087237 shutdown_connections 2024-09-21T04:01:35.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:35.095+0000 7f5ca9a3f640 1 -- 172.21.15.22:0/2651087237 wait complete. 2024-09-21T04:01:35.453 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776155 got 292057776158 for osd.11 2024-09-21T04:01:35.453 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:36.071 INFO:tasks.cephadm.ceph_manager.ceph:need seq 98784247877 got 98784247881 for osd.3 2024-09-21T04:01:36.071 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:36.101 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:36.331 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:36 smithi022 ceph-mon[31015]: pgmap v348: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T04:01:36.332 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:36 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2651087237' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T04:01:36.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:36 smithi073 ceph-mon[34443]: pgmap v348: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T04:01:36.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:36 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2651087237' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T04:01:36.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:36 smithi060 ceph-mon[33722]: pgmap v348: 129 pgs: 1 peering, 128 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T04:01:36.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:36 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2651087237' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 3} : dispatch 2024-09-21T04:01:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.564+0000 7f1c11aba640 1 -- 172.21.15.22:0/2313818356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c1031b0 msgr2=0x7f1c0c1035c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.564+0000 7f1c11aba640 1 --2- 172.21.15.22:0/2313818356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c1031b0 0x7f1c0c1035c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009900 tx=0x7f1bfc02a3f0 comp rx=0 tx=0).stop 2024-09-21T04:01:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.564+0000 7f1c11aba640 1 -- 172.21.15.22:0/2313818356 shutdown_connections 2024-09-21T04:01:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.564+0000 7f1c11aba640 1 --2- 172.21.15.22:0/2313818356 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c0c105b10 0x7f1c0c10f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.564+0000 7f1c11aba640 1 --2- 172.21.15.22:0/2313818356 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c0c1051c0 0x7f1c0c1055d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.564+0000 7f1c11aba640 1 --2- 172.21.15.22:0/2313818356 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c1031b0 0x7f1c0c1035c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.564+0000 7f1c11aba640 1 -- 172.21.15.22:0/2313818356 >> 172.21.15.22:0/2313818356 conn(0x7f1c0c079f90 msgr2=0x7f1c0c07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.564+0000 7f1c11aba640 1 -- 172.21.15.22:0/2313818356 shutdown_connections 2024-09-21T04:01:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.564+0000 7f1c11aba640 1 -- 172.21.15.22:0/2313818356 wait complete. 2024-09-21T04:01:36.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.565+0000 7f1c11aba640 1 Processor -- start 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.565+0000 7f1c11aba640 1 -- start start 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.565+0000 7f1c11aba640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c1031b0 0x7f1c0c19c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.565+0000 7f1c11aba640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c0c1051c0 0x7f1c0c19cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.565+0000 7f1c11aba640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c0c105b10 0x7f1c0c1a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.565+0000 7f1c11aba640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c1128c0 con 0x7f1c0c1031b0 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.565+0000 7f1c11aba640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c112740 con 0x7f1c0c105b10 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.565+0000 7f1c11aba640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1c0c112a40 con 0x7f1c0c1051c0 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c1031b0 0x7f1c0c19c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c1031b0 0x7f1c0c19c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58968/0 (socket says 172.21.15.22:58968) 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0b7fe640 1 -- 172.21.15.22:0/4026427586 learned_addr learned my addr 172.21.15.22:0/4026427586 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:36.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0affd640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c0c1051c0 0x7f1c0c19cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0bfff640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c0c105b10 0x7f1c0c1a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0b7fe640 1 -- 172.21.15.22:0/4026427586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c0c1051c0 msgr2=0x7f1c0c19cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0b7fe640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c0c1051c0 0x7f1c0c19cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0b7fe640 1 -- 172.21.15.22:0/4026427586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c0c105b10 msgr2=0x7f1c0c1a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0b7fe640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c0c105b10 0x7f1c0c1a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0b7fe640 1 -- 172.21.15.22:0/4026427586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c0c1a2470 con 0x7f1c0c1031b0 2024-09-21T04:01:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0affd640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c0c1051c0 0x7f1c0c19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c0b7fe640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c1031b0 0x7f1c0c19c5c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009230 tx=0x7f1bfc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:36.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c08ff9640 1 -- 172.21.15.22:0/4026427586 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc03f030 con 0x7f1c0c1031b0 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c11aba640 1 -- 172.21.15.22:0/4026427586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c0c1a2700 con 0x7f1c0c1031b0 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c08ff9640 1 -- 172.21.15.22:0/4026427586 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1bfc003a80 con 0x7f1c0c1031b0 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c08ff9640 1 -- 172.21.15.22:0/4026427586 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bfc035070 con 0x7f1c0c1031b0 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.566+0000 7f1c11aba640 1 -- 172.21.15.22:0/4026427586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c0c1a2be0 con 0x7f1c0c1031b0 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.567+0000 7f1c11aba640 1 -- 172.21.15.22:0/4026427586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c0c1035c0 con 0x7f1c0c1031b0 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.569+0000 7f1c08ff9640 1 -- 172.21.15.22:0/4026427586 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f1bfc042030 con 0x7f1c0c1031b0 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.570+0000 7f1c08ff9640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1bf80b65d0 0x7f1bf80b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.570+0000 7f1c0affd640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1bf80b65d0 0x7f1bf80b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.570+0000 7f1c08ff9640 1 -- 172.21.15.22:0/4026427586 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f1bfc1084f0 con 0x7f1c0c1031b0 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.571+0000 7f1c0affd640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1bf80b65d0 0x7f1bf80b8ae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c104c40 tx=0x7f1bf4005d90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:36.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.573+0000 7f1c08ff9640 1 -- 172.21.15.22:0/4026427586 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1bfc0ce800 con 0x7f1c0c1031b0 2024-09-21T04:01:36.813 INFO:teuthology.orchestra.run.smithi022.stdout:124554051651 2024-09-21T04:01:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.777+0000 7f1c11aba640 1 -- 172.21.15.22:0/4026427586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f1c0c10d920 con 0x7f1c0c1031b0 2024-09-21T04:01:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.777+0000 7f1c08ff9640 1 -- 172.21.15.22:0/4026427586 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f1bfc0d2be0 con 0x7f1c0c1031b0 2024-09-21T04:01:36.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 -- 172.21.15.22:0/4026427586 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1bf80b65d0 msgr2=0x7f1bf80b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1bf80b65d0 0x7f1bf80b8ae0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c104c40 tx=0x7f1bf4005d90 comp rx=0 tx=0).stop 2024-09-21T04:01:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 -- 172.21.15.22:0/4026427586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c1031b0 msgr2=0x7f1c0c19c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c1031b0 0x7f1c0c19c5c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc009230 tx=0x7f1bfc004270 comp rx=0 tx=0).stop 2024-09-21T04:01:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 -- 172.21.15.22:0/4026427586 shutdown_connections 2024-09-21T04:01:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1bf80b65d0 0x7f1bf80b8ae0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c0c1051c0 0x7f1c0c19cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c0c105b10 0x7f1c0c1a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 --2- 172.21.15.22:0/4026427586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c0c1031b0 0x7f1c0c19c5c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 -- 172.21.15.22:0/4026427586 >> 172.21.15.22:0/4026427586 conn(0x7f1c0c079f90 msgr2=0x7f1c0c101240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:36.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 -- 172.21.15.22:0/4026427586 shutdown_connections 2024-09-21T04:01:36.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:36.779+0000 7f1c11aba640 1 -- 172.21.15.22:0/4026427586 wait complete. 2024-09-21T04:01:37.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:37 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/4026427586' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T04:01:37.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:37 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/4026427586' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T04:01:37.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:37 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/4026427586' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 4} : dispatch 2024-09-21T04:01:37.599 INFO:tasks.cephadm.ceph_manager.ceph:need seq 124554051647 got 124554051651 for osd.4 2024-09-21T04:01:37.599 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.779+0000 7fa9c9c42640 1 -- 172.21.15.22:0/3270427674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9c41094a0 msgr2=0x7fa9c41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.779+0000 7fa9c9c42640 1 --2- 172.21.15.22:0/3270427674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9c41094a0 0x7fa9c41098b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac009900 tx=0x7fa9ac02a410 comp rx=0 tx=0).stop 2024-09-21T04:01:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.779+0000 7fa9c9c42640 1 -- 172.21.15.22:0/3270427674 shutdown_connections 2024-09-21T04:01:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.779+0000 7fa9c9c42640 1 --2- 172.21.15.22:0/3270427674 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9c4109df0 0x7fa9c4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.779+0000 7fa9c9c42640 1 --2- 172.21.15.22:0/3270427674 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9c41094a0 0x7fa9c41098b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:37.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.779+0000 7fa9c9c42640 1 --2- 172.21.15.22:0/3270427674 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9c4103b60 0x7fa9c4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:37.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.779+0000 7fa9c9c42640 1 -- 172.21.15.22:0/3270427674 >> 172.21.15.22:0/3270427674 conn(0x7fa9c407b850 msgr2=0x7fa9c407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:37.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.779+0000 7fa9c9c42640 1 -- 172.21.15.22:0/3270427674 shutdown_connections 2024-09-21T04:01:37.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.779+0000 7fa9c9c42640 1 -- 172.21.15.22:0/3270427674 wait complete. 2024-09-21T04:01:37.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.780+0000 7fa9c9c42640 1 Processor -- start 2024-09-21T04:01:37.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.780+0000 7fa9c9c42640 1 -- start start 2024-09-21T04:01:37.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.780+0000 7fa9c9c42640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9c4103b60 0x7fa9c419a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:37.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.780+0000 7fa9c9c42640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9c41094a0 0x7fa9c419aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:37.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.780+0000 7fa9c9c42640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9c4109df0 0x7fa9c419fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.780+0000 7fa9c9c42640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4113960 con 0x7fa9c41094a0 2024-09-21T04:01:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.780+0000 7fa9c9c42640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c41137e0 con 0x7fa9c4103b60 2024-09-21T04:01:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.780+0000 7fa9c9c42640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa9c4113ae0 con 0x7fa9c4109df0 2024-09-21T04:01:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9c41094a0 0x7fa9c419aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9c41094a0 0x7fa9c419aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58990/0 (socket says 172.21.15.22:58990) 2024-09-21T04:01:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9bbfff640 1 -- 172.21.15.22:0/35786849 learned_addr learned my addr 172.21.15.22:0/35786849 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9c37fe640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9c4103b60 0x7fa9c419a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9c3fff640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9c4109df0 0x7fa9c419fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9bbfff640 1 -- 172.21.15.22:0/35786849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9c4109df0 msgr2=0x7fa9c419fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9bbfff640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9c4109df0 0x7fa9c419fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9bbfff640 1 -- 172.21.15.22:0/35786849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9c4103b60 msgr2=0x7fa9c419a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9bbfff640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9c4103b60 0x7fa9c419a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9bbfff640 1 -- 172.21.15.22:0/35786849 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9c41a03e0 con 0x7fa9c41094a0 2024-09-21T04:01:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9bbfff640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9c41094a0 0x7fa9c419aa10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac005940 tx=0x7fa9ac0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9c17fa640 1 -- 172.21.15.22:0/35786849 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac03f030 con 0x7fa9c41094a0 2024-09-21T04:01:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9c17fa640 1 -- 172.21.15.22:0/35786849 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa9ac003a80 con 0x7fa9c41094a0 2024-09-21T04:01:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.781+0000 7fa9c9c42640 1 -- 172.21.15.22:0/35786849 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9c41a0670 con 0x7fa9c41094a0 2024-09-21T04:01:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.782+0000 7fa9c17fa640 1 -- 172.21.15.22:0/35786849 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9ac035070 con 0x7fa9c41094a0 2024-09-21T04:01:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.782+0000 7fa9c9c42640 1 -- 172.21.15.22:0/35786849 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9c41a6e30 con 0x7fa9c41094a0 2024-09-21T04:01:37.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.783+0000 7fa9c9c42640 1 -- 172.21.15.22:0/35786849 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa9c4104de0 con 0x7fa9c41094a0 2024-09-21T04:01:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.784+0000 7fa9c17fa640 1 -- 172.21.15.22:0/35786849 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa9ac042030 con 0x7fa9c41094a0 2024-09-21T04:01:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.785+0000 7fa9c17fa640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa9b00b6620 0x7fa9b00b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.785+0000 7fa9c37fe640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa9b00b6620 0x7fa9b00b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.785+0000 7fa9c17fa640 1 -- 172.21.15.22:0/35786849 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa9ac1080b0 con 0x7fa9c41094a0 2024-09-21T04:01:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.786+0000 7fa9c37fe640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa9b00b6620 0x7fa9b00b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4005d00 tx=0x7fa9b400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.789+0000 7fa9c17fa640 1 -- 172.21.15.22:0/35786849 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa9ac0d2800 con 0x7fa9c41094a0 2024-09-21T04:01:37.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.980+0000 7fa9c9c42640 1 -- 172.21.15.22:0/35786849 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fa9c4103f70 con 0x7fa9c41094a0 2024-09-21T04:01:37.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.980+0000 7fa9c17fa640 1 -- 172.21.15.22:0/35786849 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa9c4103f70 con 0x7fa9c41094a0 2024-09-21T04:01:37.991 INFO:teuthology.orchestra.run.smithi022.stdout:73014444111 2024-09-21T04:01:37.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 -- 172.21.15.22:0/35786849 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa9b00b6620 msgr2=0x7fa9b00b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:37.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa9b00b6620 0x7fa9b00b8b30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fa9b4005d00 tx=0x7fa9b400b410 comp rx=0 tx=0).stop 2024-09-21T04:01:37.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 -- 172.21.15.22:0/35786849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9c41094a0 msgr2=0x7fa9c419aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:37.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9c41094a0 0x7fa9c419aa10 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fa9ac005940 tx=0x7fa9ac0040e0 comp rx=0 tx=0).stop 2024-09-21T04:01:37.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 -- 172.21.15.22:0/35786849 shutdown_connections 2024-09-21T04:01:37.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa9b00b6620 0x7fa9b00b8b30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:37.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa9c4109df0 0x7fa9c419fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:37.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa9c41094a0 0x7fa9c419aa10 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:37.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 --2- 172.21.15.22:0/35786849 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa9c4103b60 0x7fa9c419a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:37.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 -- 172.21.15.22:0/35786849 >> 172.21.15.22:0/35786849 conn(0x7fa9c407b850 msgr2=0x7fa9c4107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:37.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 -- 172.21.15.22:0/35786849 shutdown_connections 2024-09-21T04:01:37.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:37.982+0000 7fa9c9c42640 1 -- 172.21.15.22:0/35786849 wait complete. 2024-09-21T04:01:38.309 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:38 smithi022 ceph-mon[31015]: pgmap v349: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 0 B/s, 2 keys/s, 1 objects/s recovering 2024-09-21T04:01:38.309 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:38 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/35786849' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T04:01:38.360 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:38 smithi073 ceph-mon[34443]: pgmap v349: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 0 B/s, 2 keys/s, 1 objects/s recovering 2024-09-21T04:01:38.360 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:38 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/35786849' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T04:01:38.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:38 smithi060 ceph-mon[33722]: pgmap v349: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 10 op/s; 0 B/s, 2 keys/s, 1 objects/s recovering 2024-09-21T04:01:38.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:38 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/35786849' entity='client.admin' cmd={"prefix": "osd last-stat-seq", "id": 2} : dispatch 2024-09-21T04:01:38.676 INFO:tasks.cephadm.ceph_manager.ceph:need seq 73014444108 got 73014444111 for osd.2 2024-09-21T04:01:38.677 DEBUG:teuthology.parallel:result is None 2024-09-21T04:01:38.677 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T04:01:38.677 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T04:01:38.939 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:39.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.438+0000 7fc44a12e640 1 -- 172.21.15.22:0/840026870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4441083a0 msgr2=0x7fc4441087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:39.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.438+0000 7fc44a12e640 1 --2- 172.21.15.22:0/840026870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4441083a0 0x7fc4441087b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc438009900 tx=0x7fc43802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:39.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.438+0000 7fc44a12e640 1 -- 172.21.15.22:0/840026870 shutdown_connections 2024-09-21T04:01:39.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.438+0000 7fc44a12e640 1 --2- 172.21.15.22:0/840026870 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc444108cf0 0x7fc44410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.438+0000 7fc44a12e640 1 --2- 172.21.15.22:0/840026870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc4441083a0 0x7fc4441087b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.438+0000 7fc44a12e640 1 --2- 172.21.15.22:0/840026870 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc444102a60 0x7fc444102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.438+0000 7fc44a12e640 1 -- 172.21.15.22:0/840026870 >> 172.21.15.22:0/840026870 conn(0x7fc444079730 msgr2=0x7fc444079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:39.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.438+0000 7fc44a12e640 1 -- 172.21.15.22:0/840026870 shutdown_connections 2024-09-21T04:01:39.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.438+0000 7fc44a12e640 1 -- 172.21.15.22:0/840026870 wait complete. 2024-09-21T04:01:39.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.438+0000 7fc44a12e640 1 Processor -- start 2024-09-21T04:01:39.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc44a12e640 1 -- start start 2024-09-21T04:01:39.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc44a12e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc444102a60 0x7fc44419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:39.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc44a12e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441083a0 0x7fc44419a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc44a12e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc444108cf0 0x7fc44419fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc44a12e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc444113960 con 0x7fc444102a60 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc44a12e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc4441137e0 con 0x7fc444108cf0 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc44a12e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc444113ae0 con 0x7fc4441083a0 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc4437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc444102a60 0x7fc44419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc4437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc444102a60 0x7fc44419a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59002/0 (socket says 172.21.15.22:59002) 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc4437fe640 1 -- 172.21.15.22:0/4205604906 learned_addr learned my addr 172.21.15.22:0/4205604906 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc443fff640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc444108cf0 0x7fc44419fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc442ffd640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441083a0 0x7fc44419a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc4437fe640 1 -- 172.21.15.22:0/4205604906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441083a0 msgr2=0x7fc44419a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:39.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc4437fe640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441083a0 0x7fc44419a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc4437fe640 1 -- 172.21.15.22:0/4205604906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc444108cf0 msgr2=0x7fc44419fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:39.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.439+0000 7fc4437fe640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc444108cf0 0x7fc44419fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.440+0000 7fc4437fe640 1 -- 172.21.15.22:0/4205604906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4441a0380 con 0x7fc444102a60 2024-09-21T04:01:39.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.440+0000 7fc4437fe640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc444102a60 0x7fc44419a410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc43400eb90 tx=0x7fc43400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:39.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.440+0000 7fc440ff9640 1 -- 172.21.15.22:0/4205604906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434004d20 con 0x7fc444102a60 2024-09-21T04:01:39.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.440+0000 7fc44a12e640 1 -- 172.21.15.22:0/4205604906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4441a0670 con 0x7fc444102a60 2024-09-21T04:01:39.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.440+0000 7fc440ff9640 1 -- 172.21.15.22:0/4205604906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc43400ee90 con 0x7fc444102a60 2024-09-21T04:01:39.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.440+0000 7fc440ff9640 1 -- 172.21.15.22:0/4205604906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc434010690 con 0x7fc444102a60 2024-09-21T04:01:39.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.440+0000 7fc44a12e640 1 -- 172.21.15.22:0/4205604906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4441a6dd0 con 0x7fc444102a60 2024-09-21T04:01:39.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.441+0000 7fc44a12e640 1 -- 172.21.15.22:0/4205604906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc444102e70 con 0x7fc444102a60 2024-09-21T04:01:39.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.443+0000 7fc440ff9640 1 -- 172.21.15.22:0/4205604906 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fc434010830 con 0x7fc444102a60 2024-09-21T04:01:39.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.444+0000 7fc440ff9640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc42c0b65e0 0x7fc42c0b8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:39.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.444+0000 7fc442ffd640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc42c0b65e0 0x7fc42c0b8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:39.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.444+0000 7fc440ff9640 1 -- 172.21.15.22:0/4205604906 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fc4340e80e0 con 0x7fc444102a60 2024-09-21T04:01:39.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.444+0000 7fc442ffd640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc42c0b65e0 0x7fc42c0b8af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4380057c0 tx=0x7fc438000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:39.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.447+0000 7fc440ff9640 1 -- 172.21.15.22:0/4205604906 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc434056710 con 0x7fc444102a60 2024-09-21T04:01:39.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.632+0000 7fc44a12e640 1 -- 172.21.15.22:0/4205604906 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc444063800 con 0x7fc42c0b65e0 2024-09-21T04:01:39.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.638+0000 7fc440ff9640 1 -- 172.21.15.22:0/4205604906 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340667 (secure 0 0 0) 0x7fc444063800 con 0x7fc42c0b65e0 2024-09-21T04:01:39.640 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:39.645 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-21T04:01:39.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 -- 172.21.15.22:0/4205604906 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc42c0b65e0 msgr2=0x7fc42c0b8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc42c0b65e0 0x7fc42c0b8af0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fc4380057c0 tx=0x7fc438000bc0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 -- 172.21.15.22:0/4205604906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc444102a60 msgr2=0x7fc44419a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc444102a60 0x7fc44419a410 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fc43400eb90 tx=0x7fc43400c6a0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 -- 172.21.15.22:0/4205604906 shutdown_connections 2024-09-21T04:01:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc42c0b65e0 0x7fc42c0b8af0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc4441083a0 0x7fc44419a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc444108cf0 0x7fc44419fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 --2- 172.21.15.22:0/4205604906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc444102a60 0x7fc44419a410 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:39.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 -- 172.21.15.22:0/4205604906 >> 172.21.15.22:0/4205604906 conn(0x7fc444079730 msgr2=0x7fc4441044c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:39.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 -- 172.21.15.22:0/4205604906 shutdown_connections 2024-09-21T04:01:39.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:39.642+0000 7fc44a12e640 1 -- 172.21.15.22:0/4205604906 wait complete. 2024-09-21T04:01:40.277 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:40 smithi022 ceph-mon[31015]: pgmap v350: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T04:01:40.277 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:40 smithi022 ceph-mon[31015]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:40.308 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":350,"stamp":"2024-09-21T04:01:38.938073+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663627,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":630,"num_read_kb":418,"num_write":370,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951840,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":420,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385932,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555892,"statfs":{"total":1151940427776,"available":1151545233408,"internally_reserved":0,"allocated":11927552,"data_stored":7883435,"data_compressed":496992,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":45,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.912169"},"pg_stats":[{"pgid":"2.1f","version":"83'13","reported_seq":106,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:34.295237+0000","last_change":"2024-09-21T04:00:01.985519+0000","last_active":"2024-09-21T04:01:34.295237+0000","last_peered":"2024-09-21T04:01:34.295237+0000","last_clean":"2024-09-21T04:01:34.295237+0000","last_became_active":"2024-09-21T04:00:01.984904+0000","last_became_peered":"2024-09-21T04:00:01.984904+0000","last_unstale":"2024-09-21T04:01:34.295237+0000","last_undegraded":"2024-09-21T04:01:34.295237+0000","last_fullsized":"2024-09-21T04:01:34.295237+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:20.596034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039337+0000","last_change":"2024-09-21T04:00:04.007864+0000","last_active":"2024-09-21T04:01:31.039337+0000","last_peered":"2024-09-21T04:01:31.039337+0000","last_clean":"2024-09-21T04:01:31.039337+0000","last_became_active":"2024-09-21T04:00:04.007470+0000","last_became_peered":"2024-09-21T04:00:04.007470+0000","last_unstale":"2024-09-21T04:01:31.039337+0000","last_undegraded":"2024-09-21T04:01:31.039337+0000","last_fullsized":"2024-09-21T04:01:31.039337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:11.452170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042202+0000","last_change":"2024-09-21T04:00:11.068152+0000","last_active":"2024-09-21T04:01:31.042202+0000","last_peered":"2024-09-21T04:01:31.042202+0000","last_clean":"2024-09-21T04:01:31.042202+0000","last_became_active":"2024-09-21T04:00:11.067647+0000","last_became_peered":"2024-09-21T04:00:11.067647+0000","last_unstale":"2024-09-21T04:01:31.042202+0000","last_undegraded":"2024-09-21T04:01:31.042202+0000","last_fullsized":"2024-09-21T04:01:31.042202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:35.652827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039655+0000","last_change":"2024-09-21T04:00:02.162198+0000","last_active":"2024-09-21T04:01:31.039655+0000","last_peered":"2024-09-21T04:01:31.039655+0000","last_clean":"2024-09-21T04:01:31.039655+0000","last_became_active":"2024-09-21T04:00:02.161840+0000","last_became_peered":"2024-09-21T04:00:02.161840+0000","last_unstale":"2024-09-21T04:01:31.039655+0000","last_undegraded":"2024-09-21T04:01:31.039655+0000","last_fullsized":"2024-09-21T04:01:31.039655+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:31.353273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108679+0000","last_change":"2024-09-21T04:00:03.997274+0000","last_active":"2024-09-21T04:01:31.108679+0000","last_peered":"2024-09-21T04:01:31.108679+0000","last_clean":"2024-09-21T04:01:31.108679+0000","last_became_active":"2024-09-21T04:00:03.996917+0000","last_became_peered":"2024-09-21T04:00:03.996917+0000","last_unstale":"2024-09-21T04:01:31.108679+0000","last_undegraded":"2024-09-21T04:01:31.108679+0000","last_fullsized":"2024-09-21T04:01:31.108679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:05.700703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293556+0000","last_change":"2024-09-21T04:00:11.058687+0000","last_active":"2024-09-21T04:01:31.293556+0000","last_peered":"2024-09-21T04:01:31.293556+0000","last_clean":"2024-09-21T04:01:31.293556+0000","last_became_active":"2024-09-21T04:00:11.058099+0000","last_became_peered":"2024-09-21T04:00:11.058099+0000","last_unstale":"2024-09-21T04:01:31.293556+0000","last_undegraded":"2024-09-21T04:01:31.293556+0000","last_fullsized":"2024-09-21T04:01:31.293556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:50.332295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.307558+0000","last_change":"2024-09-21T04:01:31.307478+0000","last_active":"2024-09-21T04:01:31.307558+0000","last_peered":"2024-09-21T04:01:31.307558+0000","last_clean":"2024-09-21T04:01:31.307558+0000","last_became_active":"2024-09-21T04:01:31.296040+0000","last_became_peered":"2024-09-21T04:01:31.296040+0000","last_unstale":"2024-09-21T04:01:31.307558+0000","last_undegraded":"2024-09-21T04:01:31.307558+0000","last_fullsized":"2024-09-21T04:01:31.307558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:16.547730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303551+0000","last_change":"2024-09-21T04:00:04.012120+0000","last_active":"2024-09-21T04:01:31.303551+0000","last_peered":"2024-09-21T04:01:31.303551+0000","last_clean":"2024-09-21T04:01:31.303551+0000","last_became_active":"2024-09-21T04:00:04.011648+0000","last_became_peered":"2024-09-21T04:00:04.011648+0000","last_unstale":"2024-09-21T04:01:31.303551+0000","last_undegraded":"2024-09-21T04:01:31.303551+0000","last_fullsized":"2024-09-21T04:01:31.303551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.716845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293922+0000","last_change":"2024-09-21T04:00:11.059509+0000","last_active":"2024-09-21T04:01:31.293922+0000","last_peered":"2024-09-21T04:01:31.293922+0000","last_clean":"2024-09-21T04:01:31.293922+0000","last_became_active":"2024-09-21T04:00:11.058674+0000","last_became_peered":"2024-09-21T04:00:11.058674+0000","last_unstale":"2024-09-21T04:01:31.293922+0000","last_undegraded":"2024-09-21T04:01:31.293922+0000","last_fullsized":"2024-09-21T04:01:31.293922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:13.078117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039158+0000","last_change":"2024-09-21T04:00:01.987624+0000","last_active":"2024-09-21T04:01:31.039158+0000","last_peered":"2024-09-21T04:01:31.039158+0000","last_clean":"2024-09-21T04:01:31.039158+0000","last_became_active":"2024-09-21T04:00:01.987212+0000","last_became_peered":"2024-09-21T04:00:01.987212+0000","last_unstale":"2024-09-21T04:01:31.039158+0000","last_undegraded":"2024-09-21T04:01:31.039158+0000","last_fullsized":"2024-09-21T04:01:31.039158+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:18.554590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035243+0000","last_change":"2024-09-21T04:00:04.017507+0000","last_active":"2024-09-21T04:01:31.035243+0000","last_peered":"2024-09-21T04:01:31.035243+0000","last_clean":"2024-09-21T04:01:31.035243+0000","last_became_active":"2024-09-21T04:00:04.017120+0000","last_became_peered":"2024-09-21T04:00:04.017120+0000","last_unstale":"2024-09-21T04:01:31.035243+0000","last_undegraded":"2024-09-21T04:01:31.035243+0000","last_fullsized":"2024-09-21T04:01:31.035243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:19.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293558+0000","last_change":"2024-09-21T04:00:11.055047+0000","last_active":"2024-09-21T04:01:31.293558+0000","last_peered":"2024-09-21T04:01:31.293558+0000","last_clean":"2024-09-21T04:01:31.293558+0000","last_became_active":"2024-09-21T04:00:11.054504+0000","last_became_peered":"2024-09-21T04:00:11.054504+0000","last_unstale":"2024-09-21T04:01:31.293558+0000","last_undegraded":"2024-09-21T04:01:31.293558+0000","last_fullsized":"2024-09-21T04:01:31.293558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.963011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040080+0000","last_change":"2024-09-21T04:00:04.012633+0000","last_active":"2024-09-21T04:01:31.040080+0000","last_peered":"2024-09-21T04:01:31.040080+0000","last_clean":"2024-09-21T04:01:31.040080+0000","last_became_active":"2024-09-21T04:00:04.012246+0000","last_became_peered":"2024-09-21T04:00:04.012246+0000","last_unstale":"2024-09-21T04:01:31.040080+0000","last_undegraded":"2024-09-21T04:01:31.040080+0000","last_fullsized":"2024-09-21T04:01:31.040080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:58.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039156+0000","last_change":"2024-09-21T04:00:30.144195+0000","last_active":"2024-09-21T04:01:31.039156+0000","last_peered":"2024-09-21T04:01:31.039156+0000","last_clean":"2024-09-21T04:01:31.039156+0000","last_became_active":"2024-09-21T04:00:30.140690+0000","last_became_peered":"2024-09-21T04:00:30.140690+0000","last_unstale":"2024-09-21T04:01:31.039156+0000","last_undegraded":"2024-09-21T04:01:31.039156+0000","last_fullsized":"2024-09-21T04:01:31.039156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:42.686216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295085+0000","last_change":"2024-09-21T04:00:11.333935+0000","last_active":"2024-09-21T04:01:31.295085+0000","last_peered":"2024-09-21T04:01:31.295085+0000","last_clean":"2024-09-21T04:01:31.295085+0000","last_became_active":"2024-09-21T04:00:11.333336+0000","last_became_peered":"2024-09-21T04:00:11.333336+0000","last_unstale":"2024-09-21T04:01:31.295085+0000","last_undegraded":"2024-09-21T04:01:31.295085+0000","last_fullsized":"2024-09-21T04:01:31.295085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:23.890845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039312+0000","last_change":"2024-09-21T04:00:04.002579+0000","last_active":"2024-09-21T04:01:31.039312+0000","last_peered":"2024-09-21T04:01:31.039312+0000","last_clean":"2024-09-21T04:01:31.039312+0000","last_became_active":"2024-09-21T04:00:04.001926+0000","last_became_peered":"2024-09-21T04:00:04.001926+0000","last_unstale":"2024-09-21T04:01:31.039312+0000","last_undegraded":"2024-09-21T04:01:31.039312+0000","last_fullsized":"2024-09-21T04:01:31.039312+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:11.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042372+0000","last_change":"2024-09-21T04:00:01.983276+0000","last_active":"2024-09-21T04:01:31.042372+0000","last_peered":"2024-09-21T04:01:31.042372+0000","last_clean":"2024-09-21T04:01:31.042372+0000","last_became_active":"2024-09-21T04:00:01.982828+0000","last_became_peered":"2024-09-21T04:00:01.982828+0000","last_unstale":"2024-09-21T04:01:31.042372+0000","last_undegraded":"2024-09-21T04:01:31.042372+0000","last_fullsized":"2024-09-21T04:01:31.042372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:52.266947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293626+0000","last_change":"2024-09-21T04:00:11.067529+0000","last_active":"2024-09-21T04:01:31.293626+0000","last_peered":"2024-09-21T04:01:31.293626+0000","last_clean":"2024-09-21T04:01:31.293626+0000","last_became_active":"2024-09-21T04:00:11.066975+0000","last_became_peered":"2024-09-21T04:00:11.066975+0000","last_unstale":"2024-09-21T04:01:31.293626+0000","last_undegraded":"2024-09-21T04:01:31.293626+0000","last_fullsized":"2024-09-21T04:01:31.293626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:09.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038325+0000","last_change":"2024-09-21T04:00:04.005822+0000","last_active":"2024-09-21T04:01:31.038325+0000","last_peered":"2024-09-21T04:01:31.038325+0000","last_clean":"2024-09-21T04:01:31.038325+0000","last_became_active":"2024-09-21T04:00:04.005468+0000","last_became_peered":"2024-09-21T04:00:04.005468+0000","last_unstale":"2024-09-21T04:01:31.038325+0000","last_undegraded":"2024-09-21T04:01:31.038325+0000","last_fullsized":"2024-09-21T04:01:31.038325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:08.863103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039860+0000","last_change":"2024-09-21T04:00:01.984489+0000","last_active":"2024-09-21T04:01:31.039860+0000","last_peered":"2024-09-21T04:01:31.039860+0000","last_clean":"2024-09-21T04:01:31.039860+0000","last_became_active":"2024-09-21T04:00:01.983873+0000","last_became_peered":"2024-09-21T04:00:01.983873+0000","last_unstale":"2024-09-21T04:01:31.039860+0000","last_undegraded":"2024-09-21T04:01:31.039860+0000","last_fullsized":"2024-09-21T04:01:31.039860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:22.717693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036806+0000","last_change":"2024-09-21T04:00:11.069148+0000","last_active":"2024-09-21T04:01:31.036806+0000","last_peered":"2024-09-21T04:01:31.036806+0000","last_clean":"2024-09-21T04:01:31.036806+0000","last_became_active":"2024-09-21T04:00:11.068723+0000","last_became_peered":"2024-09-21T04:00:11.068723+0000","last_unstale":"2024-09-21T04:01:31.036806+0000","last_undegraded":"2024-09-21T04:01:31.036806+0000","last_fullsized":"2024-09-21T04:01:31.036806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:42.822525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038648+0000","last_change":"2024-09-21T04:00:04.000526+0000","last_active":"2024-09-21T04:01:31.038648+0000","last_peered":"2024-09-21T04:01:31.038648+0000","last_clean":"2024-09-21T04:01:31.038648+0000","last_became_active":"2024-09-21T04:00:04.000137+0000","last_became_peered":"2024-09-21T04:00:04.000137+0000","last_unstale":"2024-09-21T04:01:31.038648+0000","last_undegraded":"2024-09-21T04:01:31.038648+0000","last_fullsized":"2024-09-21T04:01:31.038648+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:12.055499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303309+0000","last_change":"2024-09-21T04:00:02.162359+0000","last_active":"2024-09-21T04:01:31.303309+0000","last_peered":"2024-09-21T04:01:31.303309+0000","last_clean":"2024-09-21T04:01:31.303309+0000","last_became_active":"2024-09-21T04:00:02.161946+0000","last_became_peered":"2024-09-21T04:00:02.161946+0000","last_unstale":"2024-09-21T04:01:31.303309+0000","last_undegraded":"2024-09-21T04:01:31.303309+0000","last_fullsized":"2024-09-21T04:01:31.303309+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:18.841278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294670+0000","last_change":"2024-09-21T04:00:30.138669+0000","last_active":"2024-09-21T04:01:31.294670+0000","last_peered":"2024-09-21T04:01:31.294670+0000","last_clean":"2024-09-21T04:01:31.294670+0000","last_became_active":"2024-09-21T04:00:30.137548+0000","last_became_peered":"2024-09-21T04:00:30.137548+0000","last_unstale":"2024-09-21T04:01:31.294670+0000","last_undegraded":"2024-09-21T04:01:31.294670+0000","last_fullsized":"2024-09-21T04:01:31.294670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:56.867964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108454+0000","last_change":"2024-09-21T04:00:30.396672+0000","last_active":"2024-09-21T04:01:31.108454+0000","last_peered":"2024-09-21T04:01:31.108454+0000","last_clean":"2024-09-21T04:01:31.108454+0000","last_became_active":"2024-09-21T04:00:30.396066+0000","last_became_peered":"2024-09-21T04:00:30.396066+0000","last_unstale":"2024-09-21T04:01:31.108454+0000","last_undegraded":"2024-09-21T04:01:31.108454+0000","last_fullsized":"2024-09-21T04:01:31.108454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:01.582768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294999+0000","last_change":"2024-09-21T04:00:02.213481+0000","last_active":"2024-09-21T04:01:31.294999+0000","last_peered":"2024-09-21T04:01:31.294999+0000","last_clean":"2024-09-21T04:01:31.294999+0000","last_became_active":"2024-09-21T04:00:02.213093+0000","last_became_peered":"2024-09-21T04:00:02.213093+0000","last_unstale":"2024-09-21T04:01:31.294999+0000","last_undegraded":"2024-09-21T04:01:31.294999+0000","last_fullsized":"2024-09-21T04:01:31.294999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:20.700406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042238+0000","last_change":"2024-09-21T04:00:11.058780+0000","last_active":"2024-09-21T04:01:31.042238+0000","last_peered":"2024-09-21T04:01:31.042238+0000","last_clean":"2024-09-21T04:01:31.042238+0000","last_became_active":"2024-09-21T04:00:11.058309+0000","last_became_peered":"2024-09-21T04:00:11.058309+0000","last_unstale":"2024-09-21T04:01:31.042238+0000","last_undegraded":"2024-09-21T04:01:31.042238+0000","last_fullsized":"2024-09-21T04:01:31.042238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:31.134604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039531+0000","last_change":"2024-09-21T04:00:04.005954+0000","last_active":"2024-09-21T04:01:31.039531+0000","last_peered":"2024-09-21T04:01:31.039531+0000","last_clean":"2024-09-21T04:01:31.039531+0000","last_became_active":"2024-09-21T04:00:04.005609+0000","last_became_peered":"2024-09-21T04:00:04.005609+0000","last_unstale":"2024-09-21T04:01:31.039531+0000","last_undegraded":"2024-09-21T04:01:31.039531+0000","last_fullsized":"2024-09-21T04:01:31.039531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:52.596627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":72,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.047746+0000","last_change":"2024-09-21T04:01:31.047655+0000","last_active":"2024-09-21T04:01:31.047746+0000","last_peered":"2024-09-21T04:01:31.047746+0000","last_clean":"2024-09-21T04:01:31.047746+0000","last_became_active":"2024-09-21T04:01:31.040521+0000","last_became_peered":"2024-09-21T04:01:31.040521+0000","last_unstale":"2024-09-21T04:01:31.047746+0000","last_undegraded":"2024-09-21T04:01:31.047746+0000","last_fullsized":"2024-09-21T04:01:31.047746+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:32.316804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039077+0000","last_change":"2024-09-21T04:00:11.334127+0000","last_active":"2024-09-21T04:01:31.039077+0000","last_peered":"2024-09-21T04:01:31.039077+0000","last_clean":"2024-09-21T04:01:31.039077+0000","last_became_active":"2024-09-21T04:00:11.333601+0000","last_became_peered":"2024-09-21T04:00:11.333601+0000","last_unstale":"2024-09-21T04:01:31.039077+0000","last_undegraded":"2024-09-21T04:01:31.039077+0000","last_fullsized":"2024-09-21T04:01:31.039077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.114185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033123+0000","last_change":"2024-09-21T04:00:03.988967+0000","last_active":"2024-09-21T04:01:31.033123+0000","last_peered":"2024-09-21T04:01:31.033123+0000","last_clean":"2024-09-21T04:01:31.033123+0000","last_became_active":"2024-09-21T04:00:03.988617+0000","last_became_peered":"2024-09-21T04:00:03.988617+0000","last_unstale":"2024-09-21T04:01:31.033123+0000","last_undegraded":"2024-09-21T04:01:31.033123+0000","last_fullsized":"2024-09-21T04:01:31.033123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040146+0000","last_change":"2024-09-21T04:00:02.162698+0000","last_active":"2024-09-21T04:01:31.040146+0000","last_peered":"2024-09-21T04:01:31.040146+0000","last_clean":"2024-09-21T04:01:31.040146+0000","last_became_active":"2024-09-21T04:00:02.162254+0000","last_became_peered":"2024-09-21T04:00:02.162254+0000","last_unstale":"2024-09-21T04:01:31.040146+0000","last_undegraded":"2024-09-21T04:01:31.040146+0000","last_fullsized":"2024-09-21T04:01:31.040146+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:07.409718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037070+0000","last_change":"2024-09-21T04:00:11.057825+0000","last_active":"2024-09-21T04:01:31.037070+0000","last_peered":"2024-09-21T04:01:31.037070+0000","last_clean":"2024-09-21T04:01:31.037070+0000","last_became_active":"2024-09-21T04:00:11.057308+0000","last_became_peered":"2024-09-21T04:00:11.057308+0000","last_unstale":"2024-09-21T04:01:31.037070+0000","last_undegraded":"2024-09-21T04:01:31.037070+0000","last_fullsized":"2024-09-21T04:01:31.037070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.925835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033771+0000","last_change":"2024-09-21T04:00:03.996631+0000","last_active":"2024-09-21T04:01:31.033771+0000","last_peered":"2024-09-21T04:01:31.033771+0000","last_clean":"2024-09-21T04:01:31.033771+0000","last_became_active":"2024-09-21T04:00:03.996264+0000","last_became_peered":"2024-09-21T04:00:03.996264+0000","last_unstale":"2024-09-21T04:01:31.033771+0000","last_undegraded":"2024-09-21T04:01:31.033771+0000","last_fullsized":"2024-09-21T04:01:31.033771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:27.270843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036902+0000","last_change":"2024-09-21T04:00:02.162450+0000","last_active":"2024-09-21T04:01:31.036902+0000","last_peered":"2024-09-21T04:01:31.036902+0000","last_clean":"2024-09-21T04:01:31.036902+0000","last_became_active":"2024-09-21T04:00:02.161991+0000","last_became_peered":"2024-09-21T04:00:02.161991+0000","last_unstale":"2024-09-21T04:01:31.036902+0000","last_undegraded":"2024-09-21T04:01:31.036902+0000","last_fullsized":"2024-09-21T04:01:31.036902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:09.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038947+0000","last_change":"2024-09-21T04:00:11.333873+0000","last_active":"2024-09-21T04:01:31.038947+0000","last_peered":"2024-09-21T04:01:31.038947+0000","last_clean":"2024-09-21T04:01:31.038947+0000","last_became_active":"2024-09-21T04:00:11.333368+0000","last_became_peered":"2024-09-21T04:00:11.333368+0000","last_unstale":"2024-09-21T04:01:31.038947+0000","last_undegraded":"2024-09-21T04:01:31.038947+0000","last_fullsized":"2024-09-21T04:01:31.038947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:53.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033676+0000","last_change":"2024-09-21T04:00:30.138320+0000","last_active":"2024-09-21T04:01:31.033676+0000","last_peered":"2024-09-21T04:01:31.033676+0000","last_clean":"2024-09-21T04:01:31.033676+0000","last_became_active":"2024-09-21T04:00:30.137866+0000","last_became_peered":"2024-09-21T04:00:30.137866+0000","last_unstale":"2024-09-21T04:01:31.033676+0000","last_undegraded":"2024-09-21T04:01:31.033676+0000","last_fullsized":"2024-09-21T04:01:31.033676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:39.992746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":102,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:37.300662+0000","last_change":"2024-09-21T04:00:01.986355+0000","last_active":"2024-09-21T04:01:37.300662+0000","last_peered":"2024-09-21T04:01:37.300662+0000","last_clean":"2024-09-21T04:01:37.300662+0000","last_became_active":"2024-09-21T04:00:01.985960+0000","last_became_peered":"2024-09-21T04:00:01.985960+0000","last_unstale":"2024-09-21T04:01:37.300662+0000","last_undegraded":"2024-09-21T04:01:37.300662+0000","last_fullsized":"2024-09-21T04:01:37.300662+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:08.417218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032943+0000","last_change":"2024-09-21T04:00:11.066363+0000","last_active":"2024-09-21T04:01:31.032943+0000","last_peered":"2024-09-21T04:01:31.032943+0000","last_clean":"2024-09-21T04:01:31.032943+0000","last_became_active":"2024-09-21T04:00:11.065923+0000","last_became_peered":"2024-09-21T04:00:11.065923+0000","last_unstale":"2024-09-21T04:01:31.032943+0000","last_undegraded":"2024-09-21T04:01:31.032943+0000","last_fullsized":"2024-09-21T04:01:31.032943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:49.720377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034769+0000","last_change":"2024-09-21T04:00:04.010139+0000","last_active":"2024-09-21T04:01:31.034769+0000","last_peered":"2024-09-21T04:01:31.034769+0000","last_clean":"2024-09-21T04:01:31.034769+0000","last_became_active":"2024-09-21T04:00:04.009764+0000","last_became_peered":"2024-09-21T04:00:04.009764+0000","last_unstale":"2024-09-21T04:01:31.034769+0000","last_undegraded":"2024-09-21T04:01:31.034769+0000","last_fullsized":"2024-09-21T04:01:31.034769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:08.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:33.297357+0000","last_change":"2024-09-21T04:00:02.162297+0000","last_active":"2024-09-21T04:01:33.297357+0000","last_peered":"2024-09-21T04:01:33.297357+0000","last_clean":"2024-09-21T04:01:33.297357+0000","last_became_active":"2024-09-21T04:00:02.161884+0000","last_became_peered":"2024-09-21T04:00:02.161884+0000","last_unstale":"2024-09-21T04:01:33.297357+0000","last_undegraded":"2024-09-21T04:01:33.297357+0000","last_fullsized":"2024-09-21T04:01:33.297357+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:21.108188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033132+0000","last_change":"2024-09-21T04:00:11.335000+0000","last_active":"2024-09-21T04:01:31.033132+0000","last_peered":"2024-09-21T04:01:31.033132+0000","last_clean":"2024-09-21T04:01:31.033132+0000","last_became_active":"2024-09-21T04:00:11.334529+0000","last_became_peered":"2024-09-21T04:00:11.334529+0000","last_unstale":"2024-09-21T04:01:31.033132+0000","last_undegraded":"2024-09-21T04:01:31.033132+0000","last_fullsized":"2024-09-21T04:01:31.033132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:54.148883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032590+0000","last_change":"2024-09-21T04:00:03.988089+0000","last_active":"2024-09-21T04:01:31.032590+0000","last_peered":"2024-09-21T04:01:31.032590+0000","last_clean":"2024-09-21T04:01:31.032590+0000","last_became_active":"2024-09-21T04:00:03.987641+0000","last_became_peered":"2024-09-21T04:00:03.987641+0000","last_unstale":"2024-09-21T04:01:31.032590+0000","last_undegraded":"2024-09-21T04:01:31.032590+0000","last_fullsized":"2024-09-21T04:01:31.032590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:46.249510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.047436+0000","last_change":"2024-09-21T04:01:31.046744+0000","last_active":"2024-09-21T04:01:31.047436+0000","last_peered":"2024-09-21T04:01:31.047436+0000","last_clean":"2024-09-21T04:01:31.047436+0000","last_became_active":"2024-09-21T04:01:31.041093+0000","last_became_peered":"2024-09-21T04:01:31.041093+0000","last_unstale":"2024-09-21T04:01:31.047436+0000","last_undegraded":"2024-09-21T04:01:31.047436+0000","last_fullsized":"2024-09-21T04:01:31.047436+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:14.159990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,8],"acting":[11,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035066+0000","last_change":"2024-09-21T04:00:30.349715+0000","last_active":"2024-09-21T04:01:31.035066+0000","last_peered":"2024-09-21T04:01:31.035066+0000","last_clean":"2024-09-21T04:01:31.035066+0000","last_became_active":"2024-09-21T04:00:30.349233+0000","last_became_peered":"2024-09-21T04:00:30.349233+0000","last_unstale":"2024-09-21T04:01:31.035066+0000","last_undegraded":"2024-09-21T04:01:31.035066+0000","last_fullsized":"2024-09-21T04:01:31.035066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.933082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039614+0000","last_change":"2024-09-21T04:00:04.005025+0000","last_active":"2024-09-21T04:01:31.039614+0000","last_peered":"2024-09-21T04:01:31.039614+0000","last_clean":"2024-09-21T04:01:31.039614+0000","last_became_active":"2024-09-21T04:00:04.004697+0000","last_became_peered":"2024-09-21T04:00:04.004697+0000","last_unstale":"2024-09-21T04:01:31.039614+0000","last_undegraded":"2024-09-21T04:01:31.039614+0000","last_fullsized":"2024-09-21T04:01:31.039614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:30.663231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294990+0000","last_change":"2024-09-21T04:00:01.987438+0000","last_active":"2024-09-21T04:01:31.294990+0000","last_peered":"2024-09-21T04:01:31.294990+0000","last_clean":"2024-09-21T04:01:31.294990+0000","last_became_active":"2024-09-21T04:00:01.986995+0000","last_became_peered":"2024-09-21T04:00:01.986995+0000","last_unstale":"2024-09-21T04:01:31.294990+0000","last_undegraded":"2024-09-21T04:01:31.294990+0000","last_fullsized":"2024-09-21T04:01:31.294990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:16.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040093+0000","last_change":"2024-09-21T03:58:47.597000+0000","last_active":"2024-09-21T04:01:31.040093+0000","last_peered":"2024-09-21T04:01:31.040093+0000","last_clean":"2024-09-21T04:01:31.040093+0000","last_became_active":"2024-09-21T03:58:47.590826+0000","last_became_peered":"2024-09-21T03:58:47.590826+0000","last_unstale":"2024-09-21T04:01:31.040093+0000","last_undegraded":"2024-09-21T04:01:31.040093+0000","last_fullsized":"2024-09-21T04:01:31.040093+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_clean_scrub_stamp":"2024-09-21T03:55:20.271286+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:53.813660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040149+0000","last_change":"2024-09-21T04:00:11.057229+0000","last_active":"2024-09-21T04:01:31.040149+0000","last_peered":"2024-09-21T04:01:31.040149+0000","last_clean":"2024-09-21T04:01:31.040149+0000","last_became_active":"2024-09-21T04:00:11.056722+0000","last_became_peered":"2024-09-21T04:00:11.056722+0000","last_unstale":"2024-09-21T04:01:31.040149+0000","last_undegraded":"2024-09-21T04:01:31.040149+0000","last_fullsized":"2024-09-21T04:01:31.040149+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:53.311589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040346+0000","last_change":"2024-09-21T04:00:04.013650+0000","last_active":"2024-09-21T04:01:31.040346+0000","last_peered":"2024-09-21T04:01:31.040346+0000","last_clean":"2024-09-21T04:01:31.040346+0000","last_became_active":"2024-09-21T04:00:04.013284+0000","last_became_peered":"2024-09-21T04:00:04.013284+0000","last_unstale":"2024-09-21T04:01:31.040346+0000","last_undegraded":"2024-09-21T04:01:31.040346+0000","last_fullsized":"2024-09-21T04:01:31.040346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:53.098998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:33.295759+0000","last_change":"2024-09-21T04:00:02.213332+0000","last_active":"2024-09-21T04:01:33.295759+0000","last_peered":"2024-09-21T04:01:33.295759+0000","last_clean":"2024-09-21T04:01:33.295759+0000","last_became_active":"2024-09-21T04:00:02.212853+0000","last_became_peered":"2024-09-21T04:00:02.212853+0000","last_unstale":"2024-09-21T04:01:33.295759+0000","last_undegraded":"2024-09-21T04:01:33.295759+0000","last_fullsized":"2024-09-21T04:01:33.295759+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:52.923489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":52,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.302989+0000","last_change":"2024-09-21T04:00:11.057139+0000","last_active":"2024-09-21T04:01:31.302989+0000","last_peered":"2024-09-21T04:01:31.302989+0000","last_clean":"2024-09-21T04:01:31.302989+0000","last_became_active":"2024-09-21T04:00:11.056549+0000","last_became_peered":"2024-09-21T04:00:11.056549+0000","last_unstale":"2024-09-21T04:01:31.302989+0000","last_undegraded":"2024-09-21T04:01:31.302989+0000","last_fullsized":"2024-09-21T04:01:31.302989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:28.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040134+0000","last_change":"2024-09-21T04:00:30.141278+0000","last_active":"2024-09-21T04:01:31.040134+0000","last_peered":"2024-09-21T04:01:31.040134+0000","last_clean":"2024-09-21T04:01:31.040134+0000","last_became_active":"2024-09-21T04:00:30.140692+0000","last_became_peered":"2024-09-21T04:00:30.140692+0000","last_unstale":"2024-09-21T04:01:31.040134+0000","last_undegraded":"2024-09-21T04:01:31.040134+0000","last_fullsized":"2024-09-21T04:01:31.040134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:15.600486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035447+0000","last_change":"2024-09-21T04:00:01.990532+0000","last_active":"2024-09-21T04:01:31.035447+0000","last_peered":"2024-09-21T04:01:31.035447+0000","last_clean":"2024-09-21T04:01:31.035447+0000","last_became_active":"2024-09-21T04:00:01.990114+0000","last_became_peered":"2024-09-21T04:00:01.990114+0000","last_unstale":"2024-09-21T04:01:31.035447+0000","last_undegraded":"2024-09-21T04:01:31.035447+0000","last_fullsized":"2024-09-21T04:01:31.035447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:51.313576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108124+0000","last_change":"2024-09-21T04:00:30.182161+0000","last_active":"2024-09-21T04:01:31.108124+0000","last_peered":"2024-09-21T04:01:31.108124+0000","last_clean":"2024-09-21T04:01:31.108124+0000","last_became_active":"2024-09-21T04:00:30.181777+0000","last_became_peered":"2024-09-21T04:00:30.181777+0000","last_unstale":"2024-09-21T04:01:31.108124+0000","last_undegraded":"2024-09-21T04:01:31.108124+0000","last_fullsized":"2024-09-21T04:01:31.108124+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:35.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040102+0000","last_change":"2024-09-21T04:00:04.006784+0000","last_active":"2024-09-21T04:01:31.040102+0000","last_peered":"2024-09-21T04:01:31.040102+0000","last_clean":"2024-09-21T04:01:31.040102+0000","last_became_active":"2024-09-21T04:00:04.003841+0000","last_became_peered":"2024-09-21T04:00:04.003841+0000","last_unstale":"2024-09-21T04:01:31.040102+0000","last_undegraded":"2024-09-21T04:01:31.040102+0000","last_fullsized":"2024-09-21T04:01:31.040102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:50.088980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033275+0000","last_change":"2024-09-21T04:00:01.986202+0000","last_active":"2024-09-21T04:01:31.033275+0000","last_peered":"2024-09-21T04:01:31.033275+0000","last_clean":"2024-09-21T04:01:31.033275+0000","last_became_active":"2024-09-21T04:00:01.985812+0000","last_became_peered":"2024-09-21T04:00:01.985812+0000","last_unstale":"2024-09-21T04:01:31.033275+0000","last_undegraded":"2024-09-21T04:01:31.033275+0000","last_fullsized":"2024-09-21T04:01:31.033275+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:05.777175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034490+0000","last_change":"2024-09-21T04:00:11.057253+0000","last_active":"2024-09-21T04:01:31.034490+0000","last_peered":"2024-09-21T04:01:31.034490+0000","last_clean":"2024-09-21T04:01:31.034490+0000","last_became_active":"2024-09-21T04:00:11.056721+0000","last_became_peered":"2024-09-21T04:00:11.056721+0000","last_unstale":"2024-09-21T04:01:31.034490+0000","last_undegraded":"2024-09-21T04:01:31.034490+0000","last_fullsized":"2024-09-21T04:01:31.034490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:19.202714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037328+0000","last_change":"2024-09-21T04:00:04.003674+0000","last_active":"2024-09-21T04:01:31.037328+0000","last_peered":"2024-09-21T04:01:31.037328+0000","last_clean":"2024-09-21T04:01:31.037328+0000","last_became_active":"2024-09-21T04:00:04.003297+0000","last_became_peered":"2024-09-21T04:00:04.003297+0000","last_unstale":"2024-09-21T04:01:31.037328+0000","last_undegraded":"2024-09-21T04:01:31.037328+0000","last_fullsized":"2024-09-21T04:01:31.037328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.063721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039482+0000","last_change":"2024-09-21T04:00:01.986007+0000","last_active":"2024-09-21T04:01:31.039482+0000","last_peered":"2024-09-21T04:01:31.039482+0000","last_clean":"2024-09-21T04:01:31.039482+0000","last_became_active":"2024-09-21T04:00:01.985582+0000","last_became_peered":"2024-09-21T04:00:01.985582+0000","last_unstale":"2024-09-21T04:01:31.039482+0000","last_undegraded":"2024-09-21T04:01:31.039482+0000","last_fullsized":"2024-09-21T04:01:31.039482+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:48.429307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034681+0000","last_change":"2024-09-21T04:00:11.061522+0000","last_active":"2024-09-21T04:01:31.034681+0000","last_peered":"2024-09-21T04:01:31.034681+0000","last_clean":"2024-09-21T04:01:31.034681+0000","last_became_active":"2024-09-21T04:00:11.060984+0000","last_became_peered":"2024-09-21T04:00:11.060984+0000","last_unstale":"2024-09-21T04:01:31.034681+0000","last_undegraded":"2024-09-21T04:01:31.034681+0000","last_fullsized":"2024-09-21T04:01:31.034681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:51.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034769+0000","last_change":"2024-09-21T04:00:04.016468+0000","last_active":"2024-09-21T04:01:31.034769+0000","last_peered":"2024-09-21T04:01:31.034769+0000","last_clean":"2024-09-21T04:01:31.034769+0000","last_became_active":"2024-09-21T04:00:04.016177+0000","last_became_peered":"2024-09-21T04:00:04.016177+0000","last_unstale":"2024-09-21T04:01:31.034769+0000","last_undegraded":"2024-09-21T04:01:31.034769+0000","last_fullsized":"2024-09-21T04:01:31.034769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:58.670552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039193+0000","last_change":"2024-09-21T04:00:02.162746+0000","last_active":"2024-09-21T04:01:31.039193+0000","last_peered":"2024-09-21T04:01:31.039193+0000","last_clean":"2024-09-21T04:01:31.039193+0000","last_became_active":"2024-09-21T04:00:02.162121+0000","last_became_peered":"2024-09-21T04:00:02.162121+0000","last_unstale":"2024-09-21T04:01:31.039193+0000","last_undegraded":"2024-09-21T04:01:31.039193+0000","last_fullsized":"2024-09-21T04:01:31.039193+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:02.798790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033264+0000","last_change":"2024-09-21T04:00:11.068043+0000","last_active":"2024-09-21T04:01:31.033264+0000","last_peered":"2024-09-21T04:01:31.033264+0000","last_clean":"2024-09-21T04:01:31.033264+0000","last_became_active":"2024-09-21T04:00:11.067553+0000","last_became_peered":"2024-09-21T04:00:11.067553+0000","last_unstale":"2024-09-21T04:01:31.033264+0000","last_undegraded":"2024-09-21T04:01:31.033264+0000","last_fullsized":"2024-09-21T04:01:31.033264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:34.095708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039685+0000","last_change":"2024-09-21T04:00:04.010725+0000","last_active":"2024-09-21T04:01:31.039685+0000","last_peered":"2024-09-21T04:01:31.039685+0000","last_clean":"2024-09-21T04:01:31.039685+0000","last_became_active":"2024-09-21T04:00:04.010295+0000","last_became_peered":"2024-09-21T04:00:04.010295+0000","last_unstale":"2024-09-21T04:01:31.039685+0000","last_undegraded":"2024-09-21T04:01:31.039685+0000","last_fullsized":"2024-09-21T04:01:31.039685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:40.417814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:35.301072+0000","last_change":"2024-09-21T04:00:01.985123+0000","last_active":"2024-09-21T04:01:35.301072+0000","last_peered":"2024-09-21T04:01:35.301072+0000","last_clean":"2024-09-21T04:01:35.301072+0000","last_became_active":"2024-09-21T04:00:01.984686+0000","last_became_peered":"2024-09-21T04:00:01.984686+0000","last_unstale":"2024-09-21T04:01:35.301072+0000","last_undegraded":"2024-09-21T04:01:35.301072+0000","last_fullsized":"2024-09-21T04:01:35.301072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:18.825567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036813+0000","last_change":"2024-09-21T04:00:11.068045+0000","last_active":"2024-09-21T04:01:31.036813+0000","last_peered":"2024-09-21T04:01:31.036813+0000","last_clean":"2024-09-21T04:01:31.036813+0000","last_became_active":"2024-09-21T04:00:11.067528+0000","last_became_peered":"2024-09-21T04:00:11.067528+0000","last_unstale":"2024-09-21T04:01:31.036813+0000","last_undegraded":"2024-09-21T04:01:31.036813+0000","last_fullsized":"2024-09-21T04:01:31.036813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:54.054763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039746+0000","last_change":"2024-09-21T04:00:04.008068+0000","last_active":"2024-09-21T04:01:31.039746+0000","last_peered":"2024-09-21T04:01:31.039746+0000","last_clean":"2024-09-21T04:01:31.039746+0000","last_became_active":"2024-09-21T04:00:04.007611+0000","last_became_peered":"2024-09-21T04:00:04.007611+0000","last_unstale":"2024-09-21T04:01:31.039746+0000","last_undegraded":"2024-09-21T04:01:31.039746+0000","last_fullsized":"2024-09-21T04:01:31.039746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:02.363722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034956+0000","last_change":"2024-09-21T04:00:01.986011+0000","last_active":"2024-09-21T04:01:31.034956+0000","last_peered":"2024-09-21T04:01:31.034956+0000","last_clean":"2024-09-21T04:01:31.034956+0000","last_became_active":"2024-09-21T04:00:01.985637+0000","last_became_peered":"2024-09-21T04:00:01.985637+0000","last_unstale":"2024-09-21T04:01:31.034956+0000","last_undegraded":"2024-09-21T04:01:31.034956+0000","last_fullsized":"2024-09-21T04:01:31.034956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:36.226063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037322+0000","last_change":"2024-09-21T04:00:11.067798+0000","last_active":"2024-09-21T04:01:31.037322+0000","last_peered":"2024-09-21T04:01:31.037322+0000","last_clean":"2024-09-21T04:01:31.037322+0000","last_became_active":"2024-09-21T04:00:11.067319+0000","last_became_peered":"2024-09-21T04:00:11.067319+0000","last_unstale":"2024-09-21T04:01:31.037322+0000","last_undegraded":"2024-09-21T04:01:31.037322+0000","last_fullsized":"2024-09-21T04:01:31.037322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:37.118986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032840+0000","last_change":"2024-09-21T04:00:04.003222+0000","last_active":"2024-09-21T04:01:31.032840+0000","last_peered":"2024-09-21T04:01:31.032840+0000","last_clean":"2024-09-21T04:01:31.032840+0000","last_became_active":"2024-09-21T04:00:04.002893+0000","last_became_peered":"2024-09-21T04:00:04.002893+0000","last_unstale":"2024-09-21T04:01:31.032840+0000","last_undegraded":"2024-09-21T04:01:31.032840+0000","last_fullsized":"2024-09-21T04:01:31.032840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:18.806695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042596+0000","last_change":"2024-09-21T04:00:01.985978+0000","last_active":"2024-09-21T04:01:31.042596+0000","last_peered":"2024-09-21T04:01:31.042596+0000","last_clean":"2024-09-21T04:01:31.042596+0000","last_became_active":"2024-09-21T04:00:01.985607+0000","last_became_peered":"2024-09-21T04:00:01.985607+0000","last_unstale":"2024-09-21T04:01:31.042596+0000","last_undegraded":"2024-09-21T04:01:31.042596+0000","last_fullsized":"2024-09-21T04:01:31.042596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:30.113727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035195+0000","last_change":"2024-09-21T04:00:11.069332+0000","last_active":"2024-09-21T04:01:31.035195+0000","last_peered":"2024-09-21T04:01:31.035195+0000","last_clean":"2024-09-21T04:01:31.035195+0000","last_became_active":"2024-09-21T04:00:11.068832+0000","last_became_peered":"2024-09-21T04:00:11.068832+0000","last_unstale":"2024-09-21T04:01:31.035195+0000","last_undegraded":"2024-09-21T04:01:31.035195+0000","last_fullsized":"2024-09-21T04:01:31.035195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:03.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039676+0000","last_change":"2024-09-21T04:00:04.004234+0000","last_active":"2024-09-21T04:01:31.039676+0000","last_peered":"2024-09-21T04:01:31.039676+0000","last_clean":"2024-09-21T04:01:31.039676+0000","last_became_active":"2024-09-21T04:00:04.003839+0000","last_became_peered":"2024-09-21T04:00:04.003839+0000","last_unstale":"2024-09-21T04:01:31.039676+0000","last_undegraded":"2024-09-21T04:01:31.039676+0000","last_fullsized":"2024-09-21T04:01:31.039676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.971580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":186,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:35.297828+0000","last_change":"2024-09-21T04:00:01.990623+0000","last_active":"2024-09-21T04:01:35.297828+0000","last_peered":"2024-09-21T04:01:35.297828+0000","last_clean":"2024-09-21T04:01:35.297828+0000","last_became_active":"2024-09-21T04:00:01.990030+0000","last_became_peered":"2024-09-21T04:00:01.990030+0000","last_unstale":"2024-09-21T04:01:35.297828+0000","last_undegraded":"2024-09-21T04:01:35.297828+0000","last_fullsized":"2024-09-21T04:01:35.297828+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:07.150261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66212,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":111,"num_read_kb":120,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036459+0000","last_change":"2024-09-21T04:00:11.064198+0000","last_active":"2024-09-21T04:01:31.036459+0000","last_peered":"2024-09-21T04:01:31.036459+0000","last_clean":"2024-09-21T04:01:31.036459+0000","last_became_active":"2024-09-21T04:00:11.063519+0000","last_became_peered":"2024-09-21T04:00:11.063519+0000","last_unstale":"2024-09-21T04:01:31.036459+0000","last_undegraded":"2024-09-21T04:01:31.036459+0000","last_fullsized":"2024-09-21T04:01:31.036459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:16.189027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303706+0000","last_change":"2024-09-21T04:00:04.009685+0000","last_active":"2024-09-21T04:01:31.303706+0000","last_peered":"2024-09-21T04:01:31.303706+0000","last_clean":"2024-09-21T04:01:31.303706+0000","last_became_active":"2024-09-21T04:00:04.009217+0000","last_became_peered":"2024-09-21T04:00:04.009217+0000","last_unstale":"2024-09-21T04:01:31.303706+0000","last_undegraded":"2024-09-21T04:01:31.303706+0000","last_fullsized":"2024-09-21T04:01:31.303706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:31.780399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035384+0000","last_change":"2024-09-21T04:00:02.164467+0000","last_active":"2024-09-21T04:01:31.035384+0000","last_peered":"2024-09-21T04:01:31.035384+0000","last_clean":"2024-09-21T04:01:31.035384+0000","last_became_active":"2024-09-21T04:00:02.164091+0000","last_became_peered":"2024-09-21T04:00:02.164091+0000","last_unstale":"2024-09-21T04:01:31.035384+0000","last_undegraded":"2024-09-21T04:01:31.035384+0000","last_fullsized":"2024-09-21T04:01:31.035384+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:12.327745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293696+0000","last_change":"2024-09-21T04:00:11.058828+0000","last_active":"2024-09-21T04:01:31.293696+0000","last_peered":"2024-09-21T04:01:31.293696+0000","last_clean":"2024-09-21T04:01:31.293696+0000","last_became_active":"2024-09-21T04:00:11.058188+0000","last_became_peered":"2024-09-21T04:00:11.058188+0000","last_unstale":"2024-09-21T04:01:31.293696+0000","last_undegraded":"2024-09-21T04:01:31.293696+0000","last_fullsized":"2024-09-21T04:01:31.293696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.767306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108722+0000","last_change":"2024-09-21T04:00:04.004693+0000","last_active":"2024-09-21T04:01:31.108722+0000","last_peered":"2024-09-21T04:01:31.108722+0000","last_clean":"2024-09-21T04:01:31.108722+0000","last_became_active":"2024-09-21T04:00:04.004357+0000","last_became_peered":"2024-09-21T04:00:04.004357+0000","last_unstale":"2024-09-21T04:01:31.108722+0000","last_undegraded":"2024-09-21T04:01:31.108722+0000","last_fullsized":"2024-09-21T04:01:31.108722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040035+0000","last_change":"2024-09-21T04:00:01.987319+0000","last_active":"2024-09-21T04:01:31.040035+0000","last_peered":"2024-09-21T04:01:31.040035+0000","last_clean":"2024-09-21T04:01:31.040035+0000","last_became_active":"2024-09-21T04:00:01.986012+0000","last_became_peered":"2024-09-21T04:00:01.986012+0000","last_unstale":"2024-09-21T04:01:31.040035+0000","last_undegraded":"2024-09-21T04:01:31.040035+0000","last_fullsized":"2024-09-21T04:01:31.040035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:03.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038535+0000","last_change":"2024-09-21T04:00:30.139534+0000","last_active":"2024-09-21T04:01:31.038535+0000","last_peered":"2024-09-21T04:01:31.038535+0000","last_clean":"2024-09-21T04:01:31.038535+0000","last_became_active":"2024-09-21T04:00:30.138954+0000","last_became_peered":"2024-09-21T04:00:30.138954+0000","last_unstale":"2024-09-21T04:01:31.038535+0000","last_undegraded":"2024-09-21T04:01:31.038535+0000","last_fullsized":"2024-09-21T04:01:31.038535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:21.368007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303926+0000","last_change":"2024-09-21T04:00:04.013737+0000","last_active":"2024-09-21T04:01:31.303926+0000","last_peered":"2024-09-21T04:01:31.303926+0000","last_clean":"2024-09-21T04:01:31.303926+0000","last_became_active":"2024-09-21T04:00:04.012901+0000","last_became_peered":"2024-09-21T04:00:04.012901+0000","last_unstale":"2024-09-21T04:01:31.303926+0000","last_undegraded":"2024-09-21T04:01:31.303926+0000","last_fullsized":"2024-09-21T04:01:31.303926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:50.952778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:35.297926+0000","last_change":"2024-09-21T04:00:01.987988+0000","last_active":"2024-09-21T04:01:35.297926+0000","last_peered":"2024-09-21T04:01:35.297926+0000","last_clean":"2024-09-21T04:01:35.297926+0000","last_became_active":"2024-09-21T04:00:01.986593+0000","last_became_peered":"2024-09-21T04:00:01.986593+0000","last_unstale":"2024-09-21T04:01:35.297926+0000","last_undegraded":"2024-09-21T04:01:35.297926+0000","last_fullsized":"2024-09-21T04:01:35.297926+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.256609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039250+0000","last_change":"2024-09-21T04:00:11.064937+0000","last_active":"2024-09-21T04:01:31.039250+0000","last_peered":"2024-09-21T04:01:31.039250+0000","last_clean":"2024-09-21T04:01:31.039250+0000","last_became_active":"2024-09-21T04:00:11.063809+0000","last_became_peered":"2024-09-21T04:00:11.063809+0000","last_unstale":"2024-09-21T04:01:31.039250+0000","last_undegraded":"2024-09-21T04:01:31.039250+0000","last_fullsized":"2024-09-21T04:01:31.039250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:00.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.107717+0000","last_change":"2024-09-21T04:00:11.068084+0000","last_active":"2024-09-21T04:01:31.107717+0000","last_peered":"2024-09-21T04:01:31.107717+0000","last_clean":"2024-09-21T04:01:31.107717+0000","last_became_active":"2024-09-21T04:00:11.067587+0000","last_became_peered":"2024-09-21T04:00:11.067587+0000","last_unstale":"2024-09-21T04:01:31.107717+0000","last_undegraded":"2024-09-21T04:01:31.107717+0000","last_fullsized":"2024-09-21T04:01:31.107717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:30.849467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036446+0000","last_change":"2024-09-21T04:00:03.997501+0000","last_active":"2024-09-21T04:01:31.036446+0000","last_peered":"2024-09-21T04:01:31.036446+0000","last_clean":"2024-09-21T04:01:31.036446+0000","last_became_active":"2024-09-21T04:00:03.997100+0000","last_became_peered":"2024-09-21T04:00:03.997100+0000","last_unstale":"2024-09-21T04:01:31.036446+0000","last_undegraded":"2024-09-21T04:01:31.036446+0000","last_fullsized":"2024-09-21T04:01:31.036446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:31.813970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034964+0000","last_change":"2024-09-21T04:00:01.986224+0000","last_active":"2024-09-21T04:01:31.034964+0000","last_peered":"2024-09-21T04:01:31.034964+0000","last_clean":"2024-09-21T04:01:31.034964+0000","last_became_active":"2024-09-21T04:00:01.985845+0000","last_became_peered":"2024-09-21T04:00:01.985845+0000","last_unstale":"2024-09-21T04:01:31.034964+0000","last_undegraded":"2024-09-21T04:01:31.034964+0000","last_fullsized":"2024-09-21T04:01:31.034964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:38.895288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037441+0000","last_change":"2024-09-21T04:00:11.067705+0000","last_active":"2024-09-21T04:01:31.037441+0000","last_peered":"2024-09-21T04:01:31.037441+0000","last_clean":"2024-09-21T04:01:31.037441+0000","last_became_active":"2024-09-21T04:00:11.067252+0000","last_became_peered":"2024-09-21T04:00:11.067252+0000","last_unstale":"2024-09-21T04:01:31.037441+0000","last_undegraded":"2024-09-21T04:01:31.037441+0000","last_fullsized":"2024-09-21T04:01:31.037441+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:47.003323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039261+0000","last_change":"2024-09-21T04:00:03.996067+0000","last_active":"2024-09-21T04:01:31.039261+0000","last_peered":"2024-09-21T04:01:31.039261+0000","last_clean":"2024-09-21T04:01:31.039261+0000","last_became_active":"2024-09-21T04:00:03.995603+0000","last_became_peered":"2024-09-21T04:00:03.995603+0000","last_unstale":"2024-09-21T04:01:31.039261+0000","last_undegraded":"2024-09-21T04:01:31.039261+0000","last_fullsized":"2024-09-21T04:01:31.039261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:19.348461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032601+0000","last_change":"2024-09-21T04:00:01.985283+0000","last_active":"2024-09-21T04:01:31.032601+0000","last_peered":"2024-09-21T04:01:31.032601+0000","last_clean":"2024-09-21T04:01:31.032601+0000","last_became_active":"2024-09-21T04:00:01.984860+0000","last_became_peered":"2024-09-21T04:00:01.984860+0000","last_unstale":"2024-09-21T04:01:31.032601+0000","last_undegraded":"2024-09-21T04:01:31.032601+0000","last_fullsized":"2024-09-21T04:01:31.032601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:38.739987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033620+0000","last_change":"2024-09-21T04:00:30.183241+0000","last_active":"2024-09-21T04:01:31.033620+0000","last_peered":"2024-09-21T04:01:31.033620+0000","last_clean":"2024-09-21T04:01:31.033620+0000","last_became_active":"2024-09-21T04:00:30.182788+0000","last_became_peered":"2024-09-21T04:00:30.182788+0000","last_unstale":"2024-09-21T04:01:31.033620+0000","last_undegraded":"2024-09-21T04:01:31.033620+0000","last_fullsized":"2024-09-21T04:01:31.033620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:47.129478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035060+0000","last_change":"2024-09-21T04:00:04.004526+0000","last_active":"2024-09-21T04:01:31.035060+0000","last_peered":"2024-09-21T04:01:31.035060+0000","last_clean":"2024-09-21T04:01:31.035060+0000","last_became_active":"2024-09-21T04:00:04.004114+0000","last_became_peered":"2024-09-21T04:00:04.004114+0000","last_unstale":"2024-09-21T04:01:31.035060+0000","last_undegraded":"2024-09-21T04:01:31.035060+0000","last_fullsized":"2024-09-21T04:01:31.035060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:50.212647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042439+0000","last_change":"2024-09-21T04:00:11.067811+0000","last_active":"2024-09-21T04:01:31.042439+0000","last_peered":"2024-09-21T04:01:31.042439+0000","last_clean":"2024-09-21T04:01:31.042439+0000","last_became_active":"2024-09-21T04:00:11.067280+0000","last_became_peered":"2024-09-21T04:00:11.067280+0000","last_unstale":"2024-09-21T04:01:31.042439+0000","last_undegraded":"2024-09-21T04:01:31.042439+0000","last_fullsized":"2024-09-21T04:01:31.042439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:08.152231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:36.300122+0000","last_change":"2024-09-21T04:00:01.987215+0000","last_active":"2024-09-21T04:01:36.300122+0000","last_peered":"2024-09-21T04:01:36.300122+0000","last_clean":"2024-09-21T04:01:36.300122+0000","last_became_active":"2024-09-21T04:00:01.986738+0000","last_became_peered":"2024-09-21T04:00:01.986738+0000","last_unstale":"2024-09-21T04:01:36.300122+0000","last_undegraded":"2024-09-21T04:01:36.300122+0000","last_fullsized":"2024-09-21T04:01:36.300122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:16.204316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039407+0000","last_change":"2024-09-21T04:00:04.003232+0000","last_active":"2024-09-21T04:01:31.039407+0000","last_peered":"2024-09-21T04:01:31.039407+0000","last_clean":"2024-09-21T04:01:31.039407+0000","last_became_active":"2024-09-21T04:00:04.002865+0000","last_became_peered":"2024-09-21T04:00:04.002865+0000","last_unstale":"2024-09-21T04:01:31.039407+0000","last_undegraded":"2024-09-21T04:01:31.039407+0000","last_fullsized":"2024-09-21T04:01:31.039407+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:29.298836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042636+0000","last_change":"2024-09-21T04:00:11.057591+0000","last_active":"2024-09-21T04:01:31.042636+0000","last_peered":"2024-09-21T04:01:31.042636+0000","last_clean":"2024-09-21T04:01:31.042636+0000","last_became_active":"2024-09-21T04:00:11.057092+0000","last_became_peered":"2024-09-21T04:00:11.057092+0000","last_unstale":"2024-09-21T04:01:31.042636+0000","last_undegraded":"2024-09-21T04:01:31.042636+0000","last_fullsized":"2024-09-21T04:01:31.042636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:47.487649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038247+0000","last_change":"2024-09-21T04:00:04.010297+0000","last_active":"2024-09-21T04:01:31.038247+0000","last_peered":"2024-09-21T04:01:31.038247+0000","last_clean":"2024-09-21T04:01:31.038247+0000","last_became_active":"2024-09-21T04:00:04.009948+0000","last_became_peered":"2024-09-21T04:00:04.009948+0000","last_unstale":"2024-09-21T04:01:31.038247+0000","last_undegraded":"2024-09-21T04:01:31.038247+0000","last_fullsized":"2024-09-21T04:01:31.038247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:07.927430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042735+0000","last_change":"2024-09-21T04:00:04.005564+0000","last_active":"2024-09-21T04:01:31.042735+0000","last_peered":"2024-09-21T04:01:31.042735+0000","last_clean":"2024-09-21T04:01:31.042735+0000","last_became_active":"2024-09-21T04:00:04.005119+0000","last_became_peered":"2024-09-21T04:00:04.005119+0000","last_unstale":"2024-09-21T04:01:31.042735+0000","last_undegraded":"2024-09-21T04:01:31.042735+0000","last_fullsized":"2024-09-21T04:01:31.042735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:05.844333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042358+0000","last_change":"2024-09-21T04:00:03.997004+0000","last_active":"2024-09-21T04:01:31.042358+0000","last_peered":"2024-09-21T04:01:31.042358+0000","last_clean":"2024-09-21T04:01:31.042358+0000","last_became_active":"2024-09-21T04:00:03.996570+0000","last_became_peered":"2024-09-21T04:00:03.996570+0000","last_unstale":"2024-09-21T04:01:31.042358+0000","last_undegraded":"2024-09-21T04:01:31.042358+0000","last_fullsized":"2024-09-21T04:01:31.042358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108172+0000","last_change":"2024-09-21T04:00:04.005794+0000","last_active":"2024-09-21T04:01:31.108172+0000","last_peered":"2024-09-21T04:01:31.108172+0000","last_clean":"2024-09-21T04:01:31.108172+0000","last_became_active":"2024-09-21T04:00:04.005345+0000","last_became_peered":"2024-09-21T04:00:04.005345+0000","last_unstale":"2024-09-21T04:01:31.108172+0000","last_undegraded":"2024-09-21T04:01:31.108172+0000","last_fullsized":"2024-09-21T04:01:31.108172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:20.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033079+0000","last_change":"2024-09-21T04:00:03.992204+0000","last_active":"2024-09-21T04:01:31.033079+0000","last_peered":"2024-09-21T04:01:31.033079+0000","last_clean":"2024-09-21T04:01:31.033079+0000","last_became_active":"2024-09-21T04:00:03.991826+0000","last_became_peered":"2024-09-21T04:00:03.991826+0000","last_unstale":"2024-09-21T04:01:31.033079+0000","last_undegraded":"2024-09-21T04:01:31.033079+0000","last_fullsized":"2024-09-21T04:01:31.033079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.443227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037550+0000","last_change":"2024-09-21T04:00:04.004401+0000","last_active":"2024-09-21T04:01:31.037550+0000","last_peered":"2024-09-21T04:01:31.037550+0000","last_clean":"2024-09-21T04:01:31.037550+0000","last_became_active":"2024-09-21T04:00:04.003983+0000","last_became_peered":"2024-09-21T04:00:04.003983+0000","last_unstale":"2024-09-21T04:01:31.037550+0000","last_undegraded":"2024-09-21T04:01:31.037550+0000","last_fullsized":"2024-09-21T04:01:31.037550+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:06.250069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042967+0000","last_change":"2024-09-21T04:00:03.999692+0000","last_active":"2024-09-21T04:01:31.042967+0000","last_peered":"2024-09-21T04:01:31.042967+0000","last_clean":"2024-09-21T04:01:31.042967+0000","last_became_active":"2024-09-21T04:00:03.999282+0000","last_became_peered":"2024-09-21T04:00:03.999282+0000","last_unstale":"2024-09-21T04:01:31.042967+0000","last_undegraded":"2024-09-21T04:01:31.042967+0000","last_fullsized":"2024-09-21T04:01:31.042967+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.323350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039401+0000","last_change":"2024-09-21T04:00:04.002947+0000","last_active":"2024-09-21T04:01:31.039401+0000","last_peered":"2024-09-21T04:01:31.039401+0000","last_clean":"2024-09-21T04:01:31.039401+0000","last_became_active":"2024-09-21T04:00:04.002550+0000","last_became_peered":"2024-09-21T04:00:04.002550+0000","last_unstale":"2024-09-21T04:01:31.039401+0000","last_undegraded":"2024-09-21T04:01:31.039401+0000","last_fullsized":"2024-09-21T04:01:31.039401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:17.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034680+0000","last_change":"2024-09-21T04:00:04.009700+0000","last_active":"2024-09-21T04:01:31.034680+0000","last_peered":"2024-09-21T04:01:31.034680+0000","last_clean":"2024-09-21T04:01:31.034680+0000","last_became_active":"2024-09-21T04:00:04.009311+0000","last_became_peered":"2024-09-21T04:00:04.009311+0000","last_unstale":"2024-09-21T04:01:31.034680+0000","last_undegraded":"2024-09-21T04:01:31.034680+0000","last_fullsized":"2024-09-21T04:01:31.034680+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.658543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039855+0000","last_change":"2024-09-21T04:00:04.002975+0000","last_active":"2024-09-21T04:01:31.039855+0000","last_peered":"2024-09-21T04:01:31.039855+0000","last_clean":"2024-09-21T04:01:31.039855+0000","last_became_active":"2024-09-21T04:00:04.002608+0000","last_became_peered":"2024-09-21T04:00:04.002608+0000","last_unstale":"2024-09-21T04:01:31.039855+0000","last_undegraded":"2024-09-21T04:01:31.039855+0000","last_fullsized":"2024-09-21T04:01:31.039855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:13.044615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303499+0000","last_change":"2024-09-21T04:00:04.010797+0000","last_active":"2024-09-21T04:01:31.303499+0000","last_peered":"2024-09-21T04:01:31.303499+0000","last_clean":"2024-09-21T04:01:31.303499+0000","last_became_active":"2024-09-21T04:00:04.010377+0000","last_became_peered":"2024-09-21T04:00:04.010377+0000","last_unstale":"2024-09-21T04:01:31.303499+0000","last_undegraded":"2024-09-21T04:01:31.303499+0000","last_fullsized":"2024-09-21T04:01:31.303499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:58.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033037+0000","last_change":"2024-09-21T04:00:04.002841+0000","last_active":"2024-09-21T04:01:31.033037+0000","last_peered":"2024-09-21T04:01:31.033037+0000","last_clean":"2024-09-21T04:01:31.033037+0000","last_became_active":"2024-09-21T04:00:04.002491+0000","last_became_peered":"2024-09-21T04:00:04.002491+0000","last_unstale":"2024-09-21T04:01:31.033037+0000","last_undegraded":"2024-09-21T04:01:31.033037+0000","last_fullsized":"2024-09-21T04:01:31.033037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:52.816860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037284+0000","last_change":"2024-09-21T04:00:04.007238+0000","last_active":"2024-09-21T04:01:31.037284+0000","last_peered":"2024-09-21T04:01:31.037284+0000","last_clean":"2024-09-21T04:01:31.037284+0000","last_became_active":"2024-09-21T04:00:04.006898+0000","last_became_peered":"2024-09-21T04:00:04.006898+0000","last_unstale":"2024-09-21T04:01:31.037284+0000","last_undegraded":"2024-09-21T04:01:31.037284+0000","last_fullsized":"2024-09-21T04:01:31.037284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.957214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042854+0000","last_change":"2024-09-21T04:00:03.997131+0000","last_active":"2024-09-21T04:01:31.042854+0000","last_peered":"2024-09-21T04:01:31.042854+0000","last_clean":"2024-09-21T04:01:31.042854+0000","last_became_active":"2024-09-21T04:00:03.996711+0000","last_became_peered":"2024-09-21T04:00:03.996711+0000","last_unstale":"2024-09-21T04:01:31.042854+0000","last_undegraded":"2024-09-21T04:01:31.042854+0000","last_fullsized":"2024-09-21T04:01:31.042854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:25.373743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036883+0000","last_change":"2024-09-21T04:00:04.004067+0000","last_active":"2024-09-21T04:01:31.036883+0000","last_peered":"2024-09-21T04:01:31.036883+0000","last_clean":"2024-09-21T04:01:31.036883+0000","last_became_active":"2024-09-21T04:00:04.003707+0000","last_became_peered":"2024-09-21T04:00:04.003707+0000","last_unstale":"2024-09-21T04:01:31.036883+0000","last_undegraded":"2024-09-21T04:01:31.036883+0000","last_fullsized":"2024-09-21T04:01:31.036883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:24.148194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037758+0000","last_change":"2024-09-21T04:00:04.000068+0000","last_active":"2024-09-21T04:01:31.037758+0000","last_peered":"2024-09-21T04:01:31.037758+0000","last_clean":"2024-09-21T04:01:31.037758+0000","last_became_active":"2024-09-21T04:00:03.999709+0000","last_became_peered":"2024-09-21T04:00:03.999709+0000","last_unstale":"2024-09-21T04:01:31.037758+0000","last_undegraded":"2024-09-21T04:01:31.037758+0000","last_fullsized":"2024-09-21T04:01:31.037758+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:51.249309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303179+0000","last_change":"2024-09-21T04:00:04.011884+0000","last_active":"2024-09-21T04:01:31.303179+0000","last_peered":"2024-09-21T04:01:31.303179+0000","last_clean":"2024-09-21T04:01:31.303179+0000","last_became_active":"2024-09-21T04:00:04.011449+0000","last_became_peered":"2024-09-21T04:00:04.011449+0000","last_unstale":"2024-09-21T04:01:31.303179+0000","last_undegraded":"2024-09-21T04:01:31.303179+0000","last_fullsized":"2024-09-21T04:01:31.303179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:46.948465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108311+0000","last_change":"2024-09-21T04:00:03.992848+0000","last_active":"2024-09-21T04:01:31.108311+0000","last_peered":"2024-09-21T04:01:31.108311+0000","last_clean":"2024-09-21T04:01:31.108311+0000","last_became_active":"2024-09-21T04:00:03.991096+0000","last_became_peered":"2024-09-21T04:00:03.991096+0000","last_unstale":"2024-09-21T04:01:31.108311+0000","last_undegraded":"2024-09-21T04:01:31.108311+0000","last_fullsized":"2024-09-21T04:01:31.108311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:19.599848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.107952+0000","last_change":"2024-09-21T04:00:04.000380+0000","last_active":"2024-09-21T04:01:31.107952+0000","last_peered":"2024-09-21T04:01:31.107952+0000","last_clean":"2024-09-21T04:01:31.107952+0000","last_became_active":"2024-09-21T04:00:03.999918+0000","last_became_peered":"2024-09-21T04:00:03.999918+0000","last_unstale":"2024-09-21T04:01:31.107952+0000","last_undegraded":"2024-09-21T04:01:31.107952+0000","last_fullsized":"2024-09-21T04:01:31.107952+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:25.607882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032905+0000","last_change":"2024-09-21T04:00:30.138053+0000","last_active":"2024-09-21T04:01:31.032905+0000","last_peered":"2024-09-21T04:01:31.032905+0000","last_clean":"2024-09-21T04:01:31.032905+0000","last_became_active":"2024-09-21T04:00:30.137682+0000","last_became_peered":"2024-09-21T04:00:30.137682+0000","last_unstale":"2024-09-21T04:01:31.032905+0000","last_undegraded":"2024-09-21T04:01:31.032905+0000","last_fullsized":"2024-09-21T04:01:31.032905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.031655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294860+0000","last_change":"2024-09-21T04:00:04.004313+0000","last_active":"2024-09-21T04:01:31.294860+0000","last_peered":"2024-09-21T04:01:31.294860+0000","last_clean":"2024-09-21T04:01:31.294860+0000","last_became_active":"2024-09-21T04:00:04.003128+0000","last_became_peered":"2024-09-21T04:00:04.003128+0000","last_unstale":"2024-09-21T04:01:31.294860+0000","last_undegraded":"2024-09-21T04:01:31.294860+0000","last_fullsized":"2024-09-21T04:01:31.294860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:43.469449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040339+0000","last_change":"2024-09-21T04:00:04.017136+0000","last_active":"2024-09-21T04:01:31.040339+0000","last_peered":"2024-09-21T04:01:31.040339+0000","last_clean":"2024-09-21T04:01:31.040339+0000","last_became_active":"2024-09-21T04:00:04.016732+0000","last_became_peered":"2024-09-21T04:00:04.016732+0000","last_unstale":"2024-09-21T04:01:31.040339+0000","last_undegraded":"2024-09-21T04:01:31.040339+0000","last_fullsized":"2024-09-21T04:01:31.040339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:04.021078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034120+0000","last_change":"2024-09-21T04:00:04.012098+0000","last_active":"2024-09-21T04:01:31.034120+0000","last_peered":"2024-09-21T04:01:31.034120+0000","last_clean":"2024-09-21T04:01:31.034120+0000","last_became_active":"2024-09-21T04:00:04.011681+0000","last_became_peered":"2024-09-21T04:00:04.011681+0000","last_unstale":"2024-09-21T04:01:31.034120+0000","last_undegraded":"2024-09-21T04:01:31.034120+0000","last_fullsized":"2024-09-21T04:01:31.034120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:59.202312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.304059+0000","last_change":"2024-09-21T04:00:04.017056+0000","last_active":"2024-09-21T04:01:31.304059+0000","last_peered":"2024-09-21T04:01:31.304059+0000","last_clean":"2024-09-21T04:01:31.304059+0000","last_became_active":"2024-09-21T04:00:04.015950+0000","last_became_peered":"2024-09-21T04:00:04.015950+0000","last_unstale":"2024-09-21T04:01:31.304059+0000","last_undegraded":"2024-09-21T04:01:31.304059+0000","last_fullsized":"2024-09-21T04:01:31.304059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:11.267161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039220+0000","last_change":"2024-09-21T04:00:04.010314+0000","last_active":"2024-09-21T04:01:31.039220+0000","last_peered":"2024-09-21T04:01:31.039220+0000","last_clean":"2024-09-21T04:01:31.039220+0000","last_became_active":"2024-09-21T04:00:04.009917+0000","last_became_peered":"2024-09-21T04:00:04.009917+0000","last_unstale":"2024-09-21T04:01:31.039220+0000","last_undegraded":"2024-09-21T04:01:31.039220+0000","last_fullsized":"2024-09-21T04:01:31.039220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:32.947079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039882+0000","last_change":"2024-09-21T04:00:04.007104+0000","last_active":"2024-09-21T04:01:31.039882+0000","last_peered":"2024-09-21T04:01:31.039882+0000","last_clean":"2024-09-21T04:01:31.039882+0000","last_became_active":"2024-09-21T04:00:04.006655+0000","last_became_peered":"2024-09-21T04:00:04.006655+0000","last_unstale":"2024-09-21T04:01:31.039882+0000","last_undegraded":"2024-09-21T04:01:31.039882+0000","last_fullsized":"2024-09-21T04:01:31.039882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.834305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033563+0000","last_change":"2024-09-21T04:00:04.007842+0000","last_active":"2024-09-21T04:01:31.033563+0000","last_peered":"2024-09-21T04:01:31.033563+0000","last_clean":"2024-09-21T04:01:31.033563+0000","last_became_active":"2024-09-21T04:00:04.007223+0000","last_became_peered":"2024-09-21T04:00:04.007223+0000","last_unstale":"2024-09-21T04:01:31.033563+0000","last_undegraded":"2024-09-21T04:01:31.033563+0000","last_fullsized":"2024-09-21T04:01:31.033563+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:01.501836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039034+0000","last_change":"2024-09-21T04:00:03.997390+0000","last_active":"2024-09-21T04:01:31.039034+0000","last_peered":"2024-09-21T04:01:31.039034+0000","last_clean":"2024-09-21T04:01:31.039034+0000","last_became_active":"2024-09-21T04:00:03.997075+0000","last_became_peered":"2024-09-21T04:00:03.997075+0000","last_unstale":"2024-09-21T04:01:31.039034+0000","last_undegraded":"2024-09-21T04:01:31.039034+0000","last_fullsized":"2024-09-21T04:01:31.039034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:50.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294706+0000","last_change":"2024-09-21T04:00:04.006203+0000","last_active":"2024-09-21T04:01:31.294706+0000","last_peered":"2024-09-21T04:01:31.294706+0000","last_clean":"2024-09-21T04:01:31.294706+0000","last_became_active":"2024-09-21T04:00:04.005150+0000","last_became_peered":"2024-09-21T04:00:04.005150+0000","last_unstale":"2024-09-21T04:01:31.294706+0000","last_undegraded":"2024-09-21T04:01:31.294706+0000","last_fullsized":"2024-09-21T04:01:31.294706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:17.635568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108148+0000","last_change":"2024-09-21T04:00:04.011843+0000","last_active":"2024-09-21T04:01:31.108148+0000","last_peered":"2024-09-21T04:01:31.108148+0000","last_clean":"2024-09-21T04:01:31.108148+0000","last_became_active":"2024-09-21T04:00:04.011570+0000","last_became_peered":"2024-09-21T04:00:04.011570+0000","last_unstale":"2024-09-21T04:01:31.108148+0000","last_undegraded":"2024-09-21T04:01:31.108148+0000","last_fullsized":"2024-09-21T04:01:31.108148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:59.883217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108444+0000","last_change":"2024-09-21T04:00:04.002111+0000","last_active":"2024-09-21T04:01:31.108444+0000","last_peered":"2024-09-21T04:01:31.108444+0000","last_clean":"2024-09-21T04:01:31.108444+0000","last_became_active":"2024-09-21T04:00:04.001723+0000","last_became_peered":"2024-09-21T04:00:04.001723+0000","last_unstale":"2024-09-21T04:01:31.108444+0000","last_undegraded":"2024-09-21T04:01:31.108444+0000","last_fullsized":"2024-09-21T04:01:31.108444+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:32.595150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037637+0000","last_change":"2024-09-21T04:00:03.998822+0000","last_active":"2024-09-21T04:01:31.037637+0000","last_peered":"2024-09-21T04:01:31.037637+0000","last_clean":"2024-09-21T04:01:31.037637+0000","last_became_active":"2024-09-21T04:00:03.998445+0000","last_became_peered":"2024-09-21T04:00:03.998445+0000","last_unstale":"2024-09-21T04:01:31.037637+0000","last_undegraded":"2024-09-21T04:01:31.037637+0000","last_fullsized":"2024-09-21T04:01:31.037637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.090570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73025,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":554,"num_read_kb":354,"num_write":245,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":219075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282913,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776160,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":946176,"data_stored":493662,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972389,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1101824,"data_stored":1146690,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135914,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":974848,"data_stored":497688,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332143,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":493970,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528373,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1019904,"data_stored":1090467,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691898,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":946176,"data_stored":489487,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888128,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1028096,"data_stored":1085658,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051652,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":954368,"data_stored":493170,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":958464,"data_stored":488804,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444111,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1040384,"data_stored":556558,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":556729,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":970752,"data_stored":490552,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":67948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T04:01:40.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T04:01:40.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:40 smithi073 ceph-mon[34443]: pgmap v350: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T04:01:40.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:40 smithi073 ceph-mon[34443]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:40.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:40 smithi060 ceph-mon[33722]: pgmap v350: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 10 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T04:01:40.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:40 smithi060 ceph-mon[33722]: from='client.15201 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:40.573 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.030+0000 7f7390922640 1 -- 172.21.15.22:0/1993196812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f738c102ae0 msgr2=0x7f738c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.030+0000 7f7390922640 1 --2- 172.21.15.22:0/1993196812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f738c102ae0 0x7f738c102ef0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f737c009900 tx=0x7f737c02a410 comp rx=0 tx=0).stop 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.030+0000 7f7390922640 1 -- 172.21.15.22:0/1993196812 shutdown_connections 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.030+0000 7f7390922640 1 --2- 172.21.15.22:0/1993196812 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f738c108420 0x7f738c108830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.030+0000 7f7390922640 1 --2- 172.21.15.22:0/1993196812 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f738c108d70 0x7f738c10f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.030+0000 7f7390922640 1 --2- 172.21.15.22:0/1993196812 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f738c102ae0 0x7f738c102ef0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.030+0000 7f7390922640 1 -- 172.21.15.22:0/1993196812 >> 172.21.15.22:0/1993196812 conn(0x7f738c079770 msgr2=0x7f738c079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.030+0000 7f7390922640 1 -- 172.21.15.22:0/1993196812 shutdown_connections 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.030+0000 7f7390922640 1 -- 172.21.15.22:0/1993196812 wait complete. 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.031+0000 7f7390922640 1 Processor -- start 2024-09-21T04:01:41.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.031+0000 7f7390922640 1 -- start start 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.031+0000 7f7390922640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f738c102ae0 0x7f738c19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.031+0000 7f7390922640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f738c108420 0x7f738c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.031+0000 7f7390922640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f738c108d70 0x7f738c19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.031+0000 7f7390922640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f738c112930 con 0x7f738c108420 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.031+0000 7f7390922640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f738c1127b0 con 0x7f738c102ae0 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.031+0000 7f7390922640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f738c112ab0 con 0x7f738c108d70 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f7383fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f738c108420 0x7f738c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f7383fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f738c108420 0x7f738c19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40976/0 (socket says 172.21.15.22:40976) 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f7383fff640 1 -- 172.21.15.22:0/1660691734 learned_addr learned my addr 172.21.15.22:0/1660691734 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f738a59c640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f738c102ae0 0x7f738c19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f738ad9d640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f738c108d70 0x7f738c19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f7383fff640 1 -- 172.21.15.22:0/1660691734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f738c108d70 msgr2=0x7f738c19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:41.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f7383fff640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f738c108d70 0x7f738c19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:41.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f7383fff640 1 -- 172.21.15.22:0/1660691734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f738c102ae0 msgr2=0x7f738c19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:41.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f7383fff640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f738c102ae0 0x7f738c19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:41.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f7383fff640 1 -- 172.21.15.22:0/1660691734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f738c1a02e0 con 0x7f738c108420 2024-09-21T04:01:41.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f7383fff640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f738c108420 0x7f738c19a9d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f737400c8c0 tx=0x7f737400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:41.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f73837fe640 1 -- 172.21.15.22:0/1660691734 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7374007bb0 con 0x7f738c108420 2024-09-21T04:01:41.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f73837fe640 1 -- 172.21.15.22:0/1660691734 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7374007d50 con 0x7f738c108420 2024-09-21T04:01:41.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f7390922640 1 -- 172.21.15.22:0/1660691734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f738c1a05d0 con 0x7f738c108420 2024-09-21T04:01:41.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.032+0000 7f73837fe640 1 -- 172.21.15.22:0/1660691734 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73740186a0 con 0x7f738c108420 2024-09-21T04:01:41.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.033+0000 7f7390922640 1 -- 172.21.15.22:0/1660691734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f738c1a6df0 con 0x7f738c108420 2024-09-21T04:01:41.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.034+0000 7f7390922640 1 -- 172.21.15.22:0/1660691734 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f738c103d60 con 0x7f738c108420 2024-09-21T04:01:41.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.035+0000 7f73837fe640 1 -- 172.21.15.22:0/1660691734 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f737400fa00 con 0x7f738c108420 2024-09-21T04:01:41.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.036+0000 7f73837fe640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f73780b6650 0x7f73780b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:41.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.036+0000 7f738a59c640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f73780b6650 0x7f73780b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:41.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.036+0000 7f73837fe640 1 -- 172.21.15.22:0/1660691734 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f73740e7870 con 0x7f738c108420 2024-09-21T04:01:41.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.036+0000 7f738a59c640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f73780b6650 0x7f73780b8b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f737c006010 tx=0x7f737c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:41.042 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.040+0000 7f73837fe640 1 -- 172.21.15.22:0/1660691734 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7374014030 con 0x7f738c108420 2024-09-21T04:01:41.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.227+0000 7f7390922640 1 -- 172.21.15.22:0/1660691734 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f738c063800 con 0x7f73780b6650 2024-09-21T04:01:41.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.233+0000 7f73837fe640 1 -- 172.21.15.22:0/1660691734 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340671 (secure 0 0 0) 0x7f738c063800 con 0x7f73780b6650 2024-09-21T04:01:41.237 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:41.239 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-21T04:01:41.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 -- 172.21.15.22:0/1660691734 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f73780b6650 msgr2=0x7f73780b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:41.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f73780b6650 0x7f73780b8b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f737c006010 tx=0x7f737c000bc0 comp rx=0 tx=0).stop 2024-09-21T04:01:41.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 -- 172.21.15.22:0/1660691734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f738c108420 msgr2=0x7f738c19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:41.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f738c108420 0x7f738c19a9d0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f737400c8c0 tx=0x7f737400cd80 comp rx=0 tx=0).stop 2024-09-21T04:01:41.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 -- 172.21.15.22:0/1660691734 shutdown_connections 2024-09-21T04:01:41.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f73780b6650 0x7f73780b8b60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:41.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f738c108d70 0x7f738c19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:41.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f738c108420 0x7f738c19a9d0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:41.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 --2- 172.21.15.22:0/1660691734 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f738c102ae0 0x7f738c19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:41.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 -- 172.21.15.22:0/1660691734 >> 172.21.15.22:0/1660691734 conn(0x7f738c079770 msgr2=0x7f738c101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:41.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 -- 172.21.15.22:0/1660691734 shutdown_connections 2024-09-21T04:01:41.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:41.236+0000 7f7390922640 1 -- 172.21.15.22:0/1660691734 wait complete. 2024-09-21T04:01:41.960 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":351,"stamp":"2024-09-21T04:01:40.938767+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":663627,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":665,"num_read_kb":443,"num_write":370,"num_write_kb":2296,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951840,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":305,"ondisk_log_size":305,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385932,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":373997,"kb_avail":1124555892,"statfs":{"total":1151940427776,"available":1151545233408,"internally_reserved":0,"allocated":11927552,"data_stored":7883435,"data_compressed":496992,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":382973241},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003038"},"pg_stats":[{"pgid":"2.1f","version":"83'13","reported_seq":111,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:39.303299+0000","last_change":"2024-09-21T04:00:01.985519+0000","last_active":"2024-09-21T04:01:39.303299+0000","last_peered":"2024-09-21T04:01:39.303299+0000","last_clean":"2024-09-21T04:01:39.303299+0000","last_became_active":"2024-09-21T04:00:01.984904+0000","last_became_peered":"2024-09-21T04:00:01.984904+0000","last_unstale":"2024-09-21T04:01:39.303299+0000","last_undegraded":"2024-09-21T04:01:39.303299+0000","last_fullsized":"2024-09-21T04:01:39.303299+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:20.596034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":57,"num_read_kb":57,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039337+0000","last_change":"2024-09-21T04:00:04.007864+0000","last_active":"2024-09-21T04:01:31.039337+0000","last_peered":"2024-09-21T04:01:31.039337+0000","last_clean":"2024-09-21T04:01:31.039337+0000","last_became_active":"2024-09-21T04:00:04.007470+0000","last_became_peered":"2024-09-21T04:00:04.007470+0000","last_unstale":"2024-09-21T04:01:31.039337+0000","last_undegraded":"2024-09-21T04:01:31.039337+0000","last_fullsized":"2024-09-21T04:01:31.039337+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:11.452170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042202+0000","last_change":"2024-09-21T04:00:11.068152+0000","last_active":"2024-09-21T04:01:31.042202+0000","last_peered":"2024-09-21T04:01:31.042202+0000","last_clean":"2024-09-21T04:01:31.042202+0000","last_became_active":"2024-09-21T04:00:11.067647+0000","last_became_peered":"2024-09-21T04:00:11.067647+0000","last_unstale":"2024-09-21T04:01:31.042202+0000","last_undegraded":"2024-09-21T04:01:31.042202+0000","last_fullsized":"2024-09-21T04:01:31.042202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:35.652827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039655+0000","last_change":"2024-09-21T04:00:02.162198+0000","last_active":"2024-09-21T04:01:31.039655+0000","last_peered":"2024-09-21T04:01:31.039655+0000","last_clean":"2024-09-21T04:01:31.039655+0000","last_became_active":"2024-09-21T04:00:02.161840+0000","last_became_peered":"2024-09-21T04:00:02.161840+0000","last_unstale":"2024-09-21T04:01:31.039655+0000","last_undegraded":"2024-09-21T04:01:31.039655+0000","last_fullsized":"2024-09-21T04:01:31.039655+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:31.353273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108679+0000","last_change":"2024-09-21T04:00:03.997274+0000","last_active":"2024-09-21T04:01:31.108679+0000","last_peered":"2024-09-21T04:01:31.108679+0000","last_clean":"2024-09-21T04:01:31.108679+0000","last_became_active":"2024-09-21T04:00:03.996917+0000","last_became_peered":"2024-09-21T04:00:03.996917+0000","last_unstale":"2024-09-21T04:01:31.108679+0000","last_undegraded":"2024-09-21T04:01:31.108679+0000","last_fullsized":"2024-09-21T04:01:31.108679+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:05.700703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293556+0000","last_change":"2024-09-21T04:00:11.058687+0000","last_active":"2024-09-21T04:01:31.293556+0000","last_peered":"2024-09-21T04:01:31.293556+0000","last_clean":"2024-09-21T04:01:31.293556+0000","last_became_active":"2024-09-21T04:00:11.058099+0000","last_became_peered":"2024-09-21T04:00:11.058099+0000","last_unstale":"2024-09-21T04:01:31.293556+0000","last_undegraded":"2024-09-21T04:01:31.293556+0000","last_fullsized":"2024-09-21T04:01:31.293556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:50.332295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.307558+0000","last_change":"2024-09-21T04:01:31.307478+0000","last_active":"2024-09-21T04:01:31.307558+0000","last_peered":"2024-09-21T04:01:31.307558+0000","last_clean":"2024-09-21T04:01:31.307558+0000","last_became_active":"2024-09-21T04:01:31.296040+0000","last_became_peered":"2024-09-21T04:01:31.296040+0000","last_unstale":"2024-09-21T04:01:31.307558+0000","last_undegraded":"2024-09-21T04:01:31.307558+0000","last_fullsized":"2024-09-21T04:01:31.307558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:16.547730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303551+0000","last_change":"2024-09-21T04:00:04.012120+0000","last_active":"2024-09-21T04:01:31.303551+0000","last_peered":"2024-09-21T04:01:31.303551+0000","last_clean":"2024-09-21T04:01:31.303551+0000","last_became_active":"2024-09-21T04:00:04.011648+0000","last_became_peered":"2024-09-21T04:00:04.011648+0000","last_unstale":"2024-09-21T04:01:31.303551+0000","last_undegraded":"2024-09-21T04:01:31.303551+0000","last_fullsized":"2024-09-21T04:01:31.303551+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.716845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293922+0000","last_change":"2024-09-21T04:00:11.059509+0000","last_active":"2024-09-21T04:01:31.293922+0000","last_peered":"2024-09-21T04:01:31.293922+0000","last_clean":"2024-09-21T04:01:31.293922+0000","last_became_active":"2024-09-21T04:00:11.058674+0000","last_became_peered":"2024-09-21T04:00:11.058674+0000","last_unstale":"2024-09-21T04:01:31.293922+0000","last_undegraded":"2024-09-21T04:01:31.293922+0000","last_fullsized":"2024-09-21T04:01:31.293922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:13.078117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039158+0000","last_change":"2024-09-21T04:00:01.987624+0000","last_active":"2024-09-21T04:01:31.039158+0000","last_peered":"2024-09-21T04:01:31.039158+0000","last_clean":"2024-09-21T04:01:31.039158+0000","last_became_active":"2024-09-21T04:00:01.987212+0000","last_became_peered":"2024-09-21T04:00:01.987212+0000","last_unstale":"2024-09-21T04:01:31.039158+0000","last_undegraded":"2024-09-21T04:01:31.039158+0000","last_fullsized":"2024-09-21T04:01:31.039158+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:18.554590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035243+0000","last_change":"2024-09-21T04:00:04.017507+0000","last_active":"2024-09-21T04:01:31.035243+0000","last_peered":"2024-09-21T04:01:31.035243+0000","last_clean":"2024-09-21T04:01:31.035243+0000","last_became_active":"2024-09-21T04:00:04.017120+0000","last_became_peered":"2024-09-21T04:00:04.017120+0000","last_unstale":"2024-09-21T04:01:31.035243+0000","last_undegraded":"2024-09-21T04:01:31.035243+0000","last_fullsized":"2024-09-21T04:01:31.035243+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:19.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293558+0000","last_change":"2024-09-21T04:00:11.055047+0000","last_active":"2024-09-21T04:01:31.293558+0000","last_peered":"2024-09-21T04:01:31.293558+0000","last_clean":"2024-09-21T04:01:31.293558+0000","last_became_active":"2024-09-21T04:00:11.054504+0000","last_became_peered":"2024-09-21T04:00:11.054504+0000","last_unstale":"2024-09-21T04:01:31.293558+0000","last_undegraded":"2024-09-21T04:01:31.293558+0000","last_fullsized":"2024-09-21T04:01:31.293558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.963011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040080+0000","last_change":"2024-09-21T04:00:04.012633+0000","last_active":"2024-09-21T04:01:31.040080+0000","last_peered":"2024-09-21T04:01:31.040080+0000","last_clean":"2024-09-21T04:01:31.040080+0000","last_became_active":"2024-09-21T04:00:04.012246+0000","last_became_peered":"2024-09-21T04:00:04.012246+0000","last_unstale":"2024-09-21T04:01:31.040080+0000","last_undegraded":"2024-09-21T04:01:31.040080+0000","last_fullsized":"2024-09-21T04:01:31.040080+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:58.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":57,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039156+0000","last_change":"2024-09-21T04:00:30.144195+0000","last_active":"2024-09-21T04:01:31.039156+0000","last_peered":"2024-09-21T04:01:31.039156+0000","last_clean":"2024-09-21T04:01:31.039156+0000","last_became_active":"2024-09-21T04:00:30.140690+0000","last_became_peered":"2024-09-21T04:00:30.140690+0000","last_unstale":"2024-09-21T04:01:31.039156+0000","last_undegraded":"2024-09-21T04:01:31.039156+0000","last_fullsized":"2024-09-21T04:01:31.039156+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:42.686216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295085+0000","last_change":"2024-09-21T04:00:11.333935+0000","last_active":"2024-09-21T04:01:31.295085+0000","last_peered":"2024-09-21T04:01:31.295085+0000","last_clean":"2024-09-21T04:01:31.295085+0000","last_became_active":"2024-09-21T04:00:11.333336+0000","last_became_peered":"2024-09-21T04:00:11.333336+0000","last_unstale":"2024-09-21T04:01:31.295085+0000","last_undegraded":"2024-09-21T04:01:31.295085+0000","last_fullsized":"2024-09-21T04:01:31.295085+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:23.890845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039312+0000","last_change":"2024-09-21T04:00:04.002579+0000","last_active":"2024-09-21T04:01:31.039312+0000","last_peered":"2024-09-21T04:01:31.039312+0000","last_clean":"2024-09-21T04:01:31.039312+0000","last_became_active":"2024-09-21T04:00:04.001926+0000","last_became_peered":"2024-09-21T04:00:04.001926+0000","last_unstale":"2024-09-21T04:01:31.039312+0000","last_undegraded":"2024-09-21T04:01:31.039312+0000","last_fullsized":"2024-09-21T04:01:31.039312+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:11.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042372+0000","last_change":"2024-09-21T04:00:01.983276+0000","last_active":"2024-09-21T04:01:31.042372+0000","last_peered":"2024-09-21T04:01:31.042372+0000","last_clean":"2024-09-21T04:01:31.042372+0000","last_became_active":"2024-09-21T04:00:01.982828+0000","last_became_peered":"2024-09-21T04:00:01.982828+0000","last_unstale":"2024-09-21T04:01:31.042372+0000","last_undegraded":"2024-09-21T04:01:31.042372+0000","last_fullsized":"2024-09-21T04:01:31.042372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:52.266947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293626+0000","last_change":"2024-09-21T04:00:11.067529+0000","last_active":"2024-09-21T04:01:31.293626+0000","last_peered":"2024-09-21T04:01:31.293626+0000","last_clean":"2024-09-21T04:01:31.293626+0000","last_became_active":"2024-09-21T04:00:11.066975+0000","last_became_peered":"2024-09-21T04:00:11.066975+0000","last_unstale":"2024-09-21T04:01:31.293626+0000","last_undegraded":"2024-09-21T04:01:31.293626+0000","last_fullsized":"2024-09-21T04:01:31.293626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:09.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038325+0000","last_change":"2024-09-21T04:00:04.005822+0000","last_active":"2024-09-21T04:01:31.038325+0000","last_peered":"2024-09-21T04:01:31.038325+0000","last_clean":"2024-09-21T04:01:31.038325+0000","last_became_active":"2024-09-21T04:00:04.005468+0000","last_became_peered":"2024-09-21T04:00:04.005468+0000","last_unstale":"2024-09-21T04:01:31.038325+0000","last_undegraded":"2024-09-21T04:01:31.038325+0000","last_fullsized":"2024-09-21T04:01:31.038325+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:08.863103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039860+0000","last_change":"2024-09-21T04:00:01.984489+0000","last_active":"2024-09-21T04:01:31.039860+0000","last_peered":"2024-09-21T04:01:31.039860+0000","last_clean":"2024-09-21T04:01:31.039860+0000","last_became_active":"2024-09-21T04:00:01.983873+0000","last_became_peered":"2024-09-21T04:00:01.983873+0000","last_unstale":"2024-09-21T04:01:31.039860+0000","last_undegraded":"2024-09-21T04:01:31.039860+0000","last_fullsized":"2024-09-21T04:01:31.039860+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:22.717693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036806+0000","last_change":"2024-09-21T04:00:11.069148+0000","last_active":"2024-09-21T04:01:31.036806+0000","last_peered":"2024-09-21T04:01:31.036806+0000","last_clean":"2024-09-21T04:01:31.036806+0000","last_became_active":"2024-09-21T04:00:11.068723+0000","last_became_peered":"2024-09-21T04:00:11.068723+0000","last_unstale":"2024-09-21T04:01:31.036806+0000","last_undegraded":"2024-09-21T04:01:31.036806+0000","last_fullsized":"2024-09-21T04:01:31.036806+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:42.822525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038648+0000","last_change":"2024-09-21T04:00:04.000526+0000","last_active":"2024-09-21T04:01:31.038648+0000","last_peered":"2024-09-21T04:01:31.038648+0000","last_clean":"2024-09-21T04:01:31.038648+0000","last_became_active":"2024-09-21T04:00:04.000137+0000","last_became_peered":"2024-09-21T04:00:04.000137+0000","last_unstale":"2024-09-21T04:01:31.038648+0000","last_undegraded":"2024-09-21T04:01:31.038648+0000","last_fullsized":"2024-09-21T04:01:31.038648+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:12.055499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303309+0000","last_change":"2024-09-21T04:00:02.162359+0000","last_active":"2024-09-21T04:01:31.303309+0000","last_peered":"2024-09-21T04:01:31.303309+0000","last_clean":"2024-09-21T04:01:31.303309+0000","last_became_active":"2024-09-21T04:00:02.161946+0000","last_became_peered":"2024-09-21T04:00:02.161946+0000","last_unstale":"2024-09-21T04:01:31.303309+0000","last_undegraded":"2024-09-21T04:01:31.303309+0000","last_fullsized":"2024-09-21T04:01:31.303309+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:18.841278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294670+0000","last_change":"2024-09-21T04:00:30.138669+0000","last_active":"2024-09-21T04:01:31.294670+0000","last_peered":"2024-09-21T04:01:31.294670+0000","last_clean":"2024-09-21T04:01:31.294670+0000","last_became_active":"2024-09-21T04:00:30.137548+0000","last_became_peered":"2024-09-21T04:00:30.137548+0000","last_unstale":"2024-09-21T04:01:31.294670+0000","last_undegraded":"2024-09-21T04:01:31.294670+0000","last_fullsized":"2024-09-21T04:01:31.294670+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:56.867964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108454+0000","last_change":"2024-09-21T04:00:30.396672+0000","last_active":"2024-09-21T04:01:31.108454+0000","last_peered":"2024-09-21T04:01:31.108454+0000","last_clean":"2024-09-21T04:01:31.108454+0000","last_became_active":"2024-09-21T04:00:30.396066+0000","last_became_peered":"2024-09-21T04:00:30.396066+0000","last_unstale":"2024-09-21T04:01:31.108454+0000","last_undegraded":"2024-09-21T04:01:31.108454+0000","last_fullsized":"2024-09-21T04:01:31.108454+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:01.582768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294999+0000","last_change":"2024-09-21T04:00:02.213481+0000","last_active":"2024-09-21T04:01:31.294999+0000","last_peered":"2024-09-21T04:01:31.294999+0000","last_clean":"2024-09-21T04:01:31.294999+0000","last_became_active":"2024-09-21T04:00:02.213093+0000","last_became_peered":"2024-09-21T04:00:02.213093+0000","last_unstale":"2024-09-21T04:01:31.294999+0000","last_undegraded":"2024-09-21T04:01:31.294999+0000","last_fullsized":"2024-09-21T04:01:31.294999+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:20.700406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042238+0000","last_change":"2024-09-21T04:00:11.058780+0000","last_active":"2024-09-21T04:01:31.042238+0000","last_peered":"2024-09-21T04:01:31.042238+0000","last_clean":"2024-09-21T04:01:31.042238+0000","last_became_active":"2024-09-21T04:00:11.058309+0000","last_became_peered":"2024-09-21T04:00:11.058309+0000","last_unstale":"2024-09-21T04:01:31.042238+0000","last_undegraded":"2024-09-21T04:01:31.042238+0000","last_fullsized":"2024-09-21T04:01:31.042238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:31.134604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039531+0000","last_change":"2024-09-21T04:00:04.005954+0000","last_active":"2024-09-21T04:01:31.039531+0000","last_peered":"2024-09-21T04:01:31.039531+0000","last_clean":"2024-09-21T04:01:31.039531+0000","last_became_active":"2024-09-21T04:00:04.005609+0000","last_became_peered":"2024-09-21T04:00:04.005609+0000","last_unstale":"2024-09-21T04:01:31.039531+0000","last_undegraded":"2024-09-21T04:01:31.039531+0000","last_fullsized":"2024-09-21T04:01:31.039531+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:52.596627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"83'14","reported_seq":72,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.047746+0000","last_change":"2024-09-21T04:01:31.047655+0000","last_active":"2024-09-21T04:01:31.047746+0000","last_peered":"2024-09-21T04:01:31.047746+0000","last_clean":"2024-09-21T04:01:31.047746+0000","last_became_active":"2024-09-21T04:01:31.040521+0000","last_became_peered":"2024-09-21T04:01:31.040521+0000","last_unstale":"2024-09-21T04:01:31.047746+0000","last_undegraded":"2024-09-21T04:01:31.047746+0000","last_fullsized":"2024-09-21T04:01:31.047746+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:32.316804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039077+0000","last_change":"2024-09-21T04:00:11.334127+0000","last_active":"2024-09-21T04:01:31.039077+0000","last_peered":"2024-09-21T04:01:31.039077+0000","last_clean":"2024-09-21T04:01:31.039077+0000","last_became_active":"2024-09-21T04:00:11.333601+0000","last_became_peered":"2024-09-21T04:00:11.333601+0000","last_unstale":"2024-09-21T04:01:31.039077+0000","last_undegraded":"2024-09-21T04:01:31.039077+0000","last_fullsized":"2024-09-21T04:01:31.039077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.114185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033123+0000","last_change":"2024-09-21T04:00:03.988967+0000","last_active":"2024-09-21T04:01:31.033123+0000","last_peered":"2024-09-21T04:01:31.033123+0000","last_clean":"2024-09-21T04:01:31.033123+0000","last_became_active":"2024-09-21T04:00:03.988617+0000","last_became_peered":"2024-09-21T04:00:03.988617+0000","last_unstale":"2024-09-21T04:01:31.033123+0000","last_undegraded":"2024-09-21T04:01:31.033123+0000","last_fullsized":"2024-09-21T04:01:31.033123+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040146+0000","last_change":"2024-09-21T04:00:02.162698+0000","last_active":"2024-09-21T04:01:31.040146+0000","last_peered":"2024-09-21T04:01:31.040146+0000","last_clean":"2024-09-21T04:01:31.040146+0000","last_became_active":"2024-09-21T04:00:02.162254+0000","last_became_peered":"2024-09-21T04:00:02.162254+0000","last_unstale":"2024-09-21T04:01:31.040146+0000","last_undegraded":"2024-09-21T04:01:31.040146+0000","last_fullsized":"2024-09-21T04:01:31.040146+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:07.409718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037070+0000","last_change":"2024-09-21T04:00:11.057825+0000","last_active":"2024-09-21T04:01:31.037070+0000","last_peered":"2024-09-21T04:01:31.037070+0000","last_clean":"2024-09-21T04:01:31.037070+0000","last_became_active":"2024-09-21T04:00:11.057308+0000","last_became_peered":"2024-09-21T04:00:11.057308+0000","last_unstale":"2024-09-21T04:01:31.037070+0000","last_undegraded":"2024-09-21T04:01:31.037070+0000","last_fullsized":"2024-09-21T04:01:31.037070+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.925835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033771+0000","last_change":"2024-09-21T04:00:03.996631+0000","last_active":"2024-09-21T04:01:31.033771+0000","last_peered":"2024-09-21T04:01:31.033771+0000","last_clean":"2024-09-21T04:01:31.033771+0000","last_became_active":"2024-09-21T04:00:03.996264+0000","last_became_peered":"2024-09-21T04:00:03.996264+0000","last_unstale":"2024-09-21T04:01:31.033771+0000","last_undegraded":"2024-09-21T04:01:31.033771+0000","last_fullsized":"2024-09-21T04:01:31.033771+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:27.270843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036902+0000","last_change":"2024-09-21T04:00:02.162450+0000","last_active":"2024-09-21T04:01:31.036902+0000","last_peered":"2024-09-21T04:01:31.036902+0000","last_clean":"2024-09-21T04:01:31.036902+0000","last_became_active":"2024-09-21T04:00:02.161991+0000","last_became_peered":"2024-09-21T04:00:02.161991+0000","last_unstale":"2024-09-21T04:01:31.036902+0000","last_undegraded":"2024-09-21T04:01:31.036902+0000","last_fullsized":"2024-09-21T04:01:31.036902+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:09.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038947+0000","last_change":"2024-09-21T04:00:11.333873+0000","last_active":"2024-09-21T04:01:31.038947+0000","last_peered":"2024-09-21T04:01:31.038947+0000","last_clean":"2024-09-21T04:01:31.038947+0000","last_became_active":"2024-09-21T04:00:11.333368+0000","last_became_peered":"2024-09-21T04:00:11.333368+0000","last_unstale":"2024-09-21T04:01:31.038947+0000","last_undegraded":"2024-09-21T04:01:31.038947+0000","last_fullsized":"2024-09-21T04:01:31.038947+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:53.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033676+0000","last_change":"2024-09-21T04:00:30.138320+0000","last_active":"2024-09-21T04:01:31.033676+0000","last_peered":"2024-09-21T04:01:31.033676+0000","last_clean":"2024-09-21T04:01:31.033676+0000","last_became_active":"2024-09-21T04:00:30.137866+0000","last_became_peered":"2024-09-21T04:00:30.137866+0000","last_unstale":"2024-09-21T04:01:31.033676+0000","last_undegraded":"2024-09-21T04:01:31.033676+0000","last_fullsized":"2024-09-21T04:01:31.033676+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:39.992746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"83'6","reported_seq":102,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:37.300662+0000","last_change":"2024-09-21T04:00:01.986355+0000","last_active":"2024-09-21T04:01:37.300662+0000","last_peered":"2024-09-21T04:01:37.300662+0000","last_clean":"2024-09-21T04:01:37.300662+0000","last_became_active":"2024-09-21T04:00:01.985960+0000","last_became_peered":"2024-09-21T04:00:01.985960+0000","last_unstale":"2024-09-21T04:01:37.300662+0000","last_undegraded":"2024-09-21T04:01:37.300662+0000","last_fullsized":"2024-09-21T04:01:37.300662+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:08.417218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032943+0000","last_change":"2024-09-21T04:00:11.066363+0000","last_active":"2024-09-21T04:01:31.032943+0000","last_peered":"2024-09-21T04:01:31.032943+0000","last_clean":"2024-09-21T04:01:31.032943+0000","last_became_active":"2024-09-21T04:00:11.065923+0000","last_became_peered":"2024-09-21T04:00:11.065923+0000","last_unstale":"2024-09-21T04:01:31.032943+0000","last_undegraded":"2024-09-21T04:01:31.032943+0000","last_fullsized":"2024-09-21T04:01:31.032943+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:49.720377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034769+0000","last_change":"2024-09-21T04:00:04.010139+0000","last_active":"2024-09-21T04:01:31.034769+0000","last_peered":"2024-09-21T04:01:31.034769+0000","last_clean":"2024-09-21T04:01:31.034769+0000","last_became_active":"2024-09-21T04:00:04.009764+0000","last_became_peered":"2024-09-21T04:00:04.009764+0000","last_unstale":"2024-09-21T04:01:31.034769+0000","last_undegraded":"2024-09-21T04:01:31.034769+0000","last_fullsized":"2024-09-21T04:01:31.034769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:08.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":101,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:38.304580+0000","last_change":"2024-09-21T04:00:02.162297+0000","last_active":"2024-09-21T04:01:38.304580+0000","last_peered":"2024-09-21T04:01:38.304580+0000","last_clean":"2024-09-21T04:01:38.304580+0000","last_became_active":"2024-09-21T04:00:02.161884+0000","last_became_peered":"2024-09-21T04:00:02.161884+0000","last_unstale":"2024-09-21T04:01:38.304580+0000","last_undegraded":"2024-09-21T04:01:38.304580+0000","last_fullsized":"2024-09-21T04:01:38.304580+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:21.108188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":56,"num_read_kb":56,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033132+0000","last_change":"2024-09-21T04:00:11.335000+0000","last_active":"2024-09-21T04:01:31.033132+0000","last_peered":"2024-09-21T04:01:31.033132+0000","last_clean":"2024-09-21T04:01:31.033132+0000","last_became_active":"2024-09-21T04:00:11.334529+0000","last_became_peered":"2024-09-21T04:00:11.334529+0000","last_unstale":"2024-09-21T04:01:31.033132+0000","last_undegraded":"2024-09-21T04:01:31.033132+0000","last_fullsized":"2024-09-21T04:01:31.033132+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:54.148883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032590+0000","last_change":"2024-09-21T04:00:03.988089+0000","last_active":"2024-09-21T04:01:31.032590+0000","last_peered":"2024-09-21T04:01:31.032590+0000","last_clean":"2024-09-21T04:01:31.032590+0000","last_became_active":"2024-09-21T04:00:03.987641+0000","last_became_peered":"2024-09-21T04:00:03.987641+0000","last_unstale":"2024-09-21T04:01:31.032590+0000","last_undegraded":"2024-09-21T04:01:31.032590+0000","last_fullsized":"2024-09-21T04:01:31.032590+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:46.249510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.047436+0000","last_change":"2024-09-21T04:01:31.046744+0000","last_active":"2024-09-21T04:01:31.047436+0000","last_peered":"2024-09-21T04:01:31.047436+0000","last_clean":"2024-09-21T04:01:31.047436+0000","last_became_active":"2024-09-21T04:01:31.041093+0000","last_became_peered":"2024-09-21T04:01:31.041093+0000","last_unstale":"2024-09-21T04:01:31.047436+0000","last_undegraded":"2024-09-21T04:01:31.047436+0000","last_fullsized":"2024-09-21T04:01:31.047436+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:14.159990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,8],"acting":[11,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035066+0000","last_change":"2024-09-21T04:00:30.349715+0000","last_active":"2024-09-21T04:01:31.035066+0000","last_peered":"2024-09-21T04:01:31.035066+0000","last_clean":"2024-09-21T04:01:31.035066+0000","last_became_active":"2024-09-21T04:00:30.349233+0000","last_became_peered":"2024-09-21T04:00:30.349233+0000","last_unstale":"2024-09-21T04:01:31.035066+0000","last_undegraded":"2024-09-21T04:01:31.035066+0000","last_fullsized":"2024-09-21T04:01:31.035066+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.933082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039614+0000","last_change":"2024-09-21T04:00:04.005025+0000","last_active":"2024-09-21T04:01:31.039614+0000","last_peered":"2024-09-21T04:01:31.039614+0000","last_clean":"2024-09-21T04:01:31.039614+0000","last_became_active":"2024-09-21T04:00:04.004697+0000","last_became_peered":"2024-09-21T04:00:04.004697+0000","last_unstale":"2024-09-21T04:01:31.039614+0000","last_undegraded":"2024-09-21T04:01:31.039614+0000","last_fullsized":"2024-09-21T04:01:31.039614+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:30.663231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294990+0000","last_change":"2024-09-21T04:00:01.987438+0000","last_active":"2024-09-21T04:01:31.294990+0000","last_peered":"2024-09-21T04:01:31.294990+0000","last_clean":"2024-09-21T04:01:31.294990+0000","last_became_active":"2024-09-21T04:00:01.986995+0000","last_became_peered":"2024-09-21T04:00:01.986995+0000","last_unstale":"2024-09-21T04:01:31.294990+0000","last_undegraded":"2024-09-21T04:01:31.294990+0000","last_fullsized":"2024-09-21T04:01:31.294990+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:16.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040093+0000","last_change":"2024-09-21T03:58:47.597000+0000","last_active":"2024-09-21T04:01:31.040093+0000","last_peered":"2024-09-21T04:01:31.040093+0000","last_clean":"2024-09-21T04:01:31.040093+0000","last_became_active":"2024-09-21T03:58:47.590826+0000","last_became_peered":"2024-09-21T03:58:47.590826+0000","last_unstale":"2024-09-21T04:01:31.040093+0000","last_undegraded":"2024-09-21T04:01:31.040093+0000","last_fullsized":"2024-09-21T04:01:31.040093+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_clean_scrub_stamp":"2024-09-21T03:55:20.271286+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:53.813660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040149+0000","last_change":"2024-09-21T04:00:11.057229+0000","last_active":"2024-09-21T04:01:31.040149+0000","last_peered":"2024-09-21T04:01:31.040149+0000","last_clean":"2024-09-21T04:01:31.040149+0000","last_became_active":"2024-09-21T04:00:11.056722+0000","last_became_peered":"2024-09-21T04:00:11.056722+0000","last_unstale":"2024-09-21T04:01:31.040149+0000","last_undegraded":"2024-09-21T04:01:31.040149+0000","last_fullsized":"2024-09-21T04:01:31.040149+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:53.311589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040346+0000","last_change":"2024-09-21T04:00:04.013650+0000","last_active":"2024-09-21T04:01:31.040346+0000","last_peered":"2024-09-21T04:01:31.040346+0000","last_clean":"2024-09-21T04:01:31.040346+0000","last_became_active":"2024-09-21T04:00:04.013284+0000","last_became_peered":"2024-09-21T04:00:04.013284+0000","last_unstale":"2024-09-21T04:01:31.040346+0000","last_undegraded":"2024-09-21T04:01:31.040346+0000","last_fullsized":"2024-09-21T04:01:31.040346+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:53.098998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":103,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:38.303201+0000","last_change":"2024-09-21T04:00:02.213332+0000","last_active":"2024-09-21T04:01:38.303201+0000","last_peered":"2024-09-21T04:01:38.303201+0000","last_clean":"2024-09-21T04:01:38.303201+0000","last_became_active":"2024-09-21T04:00:02.212853+0000","last_became_peered":"2024-09-21T04:00:02.212853+0000","last_unstale":"2024-09-21T04:01:38.303201+0000","last_undegraded":"2024-09-21T04:01:38.303201+0000","last_fullsized":"2024-09-21T04:01:38.303201+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:52.923489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":57,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.302989+0000","last_change":"2024-09-21T04:00:11.057139+0000","last_active":"2024-09-21T04:01:31.302989+0000","last_peered":"2024-09-21T04:01:31.302989+0000","last_clean":"2024-09-21T04:01:31.302989+0000","last_became_active":"2024-09-21T04:00:11.056549+0000","last_became_peered":"2024-09-21T04:00:11.056549+0000","last_unstale":"2024-09-21T04:01:31.302989+0000","last_undegraded":"2024-09-21T04:01:31.302989+0000","last_fullsized":"2024-09-21T04:01:31.302989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:28.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040134+0000","last_change":"2024-09-21T04:00:30.141278+0000","last_active":"2024-09-21T04:01:31.040134+0000","last_peered":"2024-09-21T04:01:31.040134+0000","last_clean":"2024-09-21T04:01:31.040134+0000","last_became_active":"2024-09-21T04:00:30.140692+0000","last_became_peered":"2024-09-21T04:00:30.140692+0000","last_unstale":"2024-09-21T04:01:31.040134+0000","last_undegraded":"2024-09-21T04:01:31.040134+0000","last_fullsized":"2024-09-21T04:01:31.040134+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:15.600486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035447+0000","last_change":"2024-09-21T04:00:01.990532+0000","last_active":"2024-09-21T04:01:31.035447+0000","last_peered":"2024-09-21T04:01:31.035447+0000","last_clean":"2024-09-21T04:01:31.035447+0000","last_became_active":"2024-09-21T04:00:01.990114+0000","last_became_peered":"2024-09-21T04:00:01.990114+0000","last_unstale":"2024-09-21T04:01:31.035447+0000","last_undegraded":"2024-09-21T04:01:31.035447+0000","last_fullsized":"2024-09-21T04:01:31.035447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:51.313576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108124+0000","last_change":"2024-09-21T04:00:30.182161+0000","last_active":"2024-09-21T04:01:31.108124+0000","last_peered":"2024-09-21T04:01:31.108124+0000","last_clean":"2024-09-21T04:01:31.108124+0000","last_became_active":"2024-09-21T04:00:30.181777+0000","last_became_peered":"2024-09-21T04:00:30.181777+0000","last_unstale":"2024-09-21T04:01:31.108124+0000","last_undegraded":"2024-09-21T04:01:31.108124+0000","last_fullsized":"2024-09-21T04:01:31.108124+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:35.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040102+0000","last_change":"2024-09-21T04:00:04.006784+0000","last_active":"2024-09-21T04:01:31.040102+0000","last_peered":"2024-09-21T04:01:31.040102+0000","last_clean":"2024-09-21T04:01:31.040102+0000","last_became_active":"2024-09-21T04:00:04.003841+0000","last_became_peered":"2024-09-21T04:00:04.003841+0000","last_unstale":"2024-09-21T04:01:31.040102+0000","last_undegraded":"2024-09-21T04:01:31.040102+0000","last_fullsized":"2024-09-21T04:01:31.040102+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:50.088980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033275+0000","last_change":"2024-09-21T04:00:01.986202+0000","last_active":"2024-09-21T04:01:31.033275+0000","last_peered":"2024-09-21T04:01:31.033275+0000","last_clean":"2024-09-21T04:01:31.033275+0000","last_became_active":"2024-09-21T04:00:01.985812+0000","last_became_peered":"2024-09-21T04:00:01.985812+0000","last_unstale":"2024-09-21T04:01:31.033275+0000","last_undegraded":"2024-09-21T04:01:31.033275+0000","last_fullsized":"2024-09-21T04:01:31.033275+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:05.777175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034490+0000","last_change":"2024-09-21T04:00:11.057253+0000","last_active":"2024-09-21T04:01:31.034490+0000","last_peered":"2024-09-21T04:01:31.034490+0000","last_clean":"2024-09-21T04:01:31.034490+0000","last_became_active":"2024-09-21T04:00:11.056721+0000","last_became_peered":"2024-09-21T04:00:11.056721+0000","last_unstale":"2024-09-21T04:01:31.034490+0000","last_undegraded":"2024-09-21T04:01:31.034490+0000","last_fullsized":"2024-09-21T04:01:31.034490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:19.202714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037328+0000","last_change":"2024-09-21T04:00:04.003674+0000","last_active":"2024-09-21T04:01:31.037328+0000","last_peered":"2024-09-21T04:01:31.037328+0000","last_clean":"2024-09-21T04:01:31.037328+0000","last_became_active":"2024-09-21T04:00:04.003297+0000","last_became_peered":"2024-09-21T04:00:04.003297+0000","last_unstale":"2024-09-21T04:01:31.037328+0000","last_undegraded":"2024-09-21T04:01:31.037328+0000","last_fullsized":"2024-09-21T04:01:31.037328+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.063721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039482+0000","last_change":"2024-09-21T04:00:01.986007+0000","last_active":"2024-09-21T04:01:31.039482+0000","last_peered":"2024-09-21T04:01:31.039482+0000","last_clean":"2024-09-21T04:01:31.039482+0000","last_became_active":"2024-09-21T04:00:01.985582+0000","last_became_peered":"2024-09-21T04:00:01.985582+0000","last_unstale":"2024-09-21T04:01:31.039482+0000","last_undegraded":"2024-09-21T04:01:31.039482+0000","last_fullsized":"2024-09-21T04:01:31.039482+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:48.429307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034681+0000","last_change":"2024-09-21T04:00:11.061522+0000","last_active":"2024-09-21T04:01:31.034681+0000","last_peered":"2024-09-21T04:01:31.034681+0000","last_clean":"2024-09-21T04:01:31.034681+0000","last_became_active":"2024-09-21T04:00:11.060984+0000","last_became_peered":"2024-09-21T04:00:11.060984+0000","last_unstale":"2024-09-21T04:01:31.034681+0000","last_undegraded":"2024-09-21T04:01:31.034681+0000","last_fullsized":"2024-09-21T04:01:31.034681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:51.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034769+0000","last_change":"2024-09-21T04:00:04.016468+0000","last_active":"2024-09-21T04:01:31.034769+0000","last_peered":"2024-09-21T04:01:31.034769+0000","last_clean":"2024-09-21T04:01:31.034769+0000","last_became_active":"2024-09-21T04:00:04.016177+0000","last_became_peered":"2024-09-21T04:00:04.016177+0000","last_unstale":"2024-09-21T04:01:31.034769+0000","last_undegraded":"2024-09-21T04:01:31.034769+0000","last_fullsized":"2024-09-21T04:01:31.034769+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:58.670552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039193+0000","last_change":"2024-09-21T04:00:02.162746+0000","last_active":"2024-09-21T04:01:31.039193+0000","last_peered":"2024-09-21T04:01:31.039193+0000","last_clean":"2024-09-21T04:01:31.039193+0000","last_became_active":"2024-09-21T04:00:02.162121+0000","last_became_peered":"2024-09-21T04:00:02.162121+0000","last_unstale":"2024-09-21T04:01:31.039193+0000","last_undegraded":"2024-09-21T04:01:31.039193+0000","last_fullsized":"2024-09-21T04:01:31.039193+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:02.798790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033264+0000","last_change":"2024-09-21T04:00:11.068043+0000","last_active":"2024-09-21T04:01:31.033264+0000","last_peered":"2024-09-21T04:01:31.033264+0000","last_clean":"2024-09-21T04:01:31.033264+0000","last_became_active":"2024-09-21T04:00:11.067553+0000","last_became_peered":"2024-09-21T04:00:11.067553+0000","last_unstale":"2024-09-21T04:01:31.033264+0000","last_undegraded":"2024-09-21T04:01:31.033264+0000","last_fullsized":"2024-09-21T04:01:31.033264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:34.095708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039685+0000","last_change":"2024-09-21T04:00:04.010725+0000","last_active":"2024-09-21T04:01:31.039685+0000","last_peered":"2024-09-21T04:01:31.039685+0000","last_clean":"2024-09-21T04:01:31.039685+0000","last_became_active":"2024-09-21T04:00:04.010295+0000","last_became_peered":"2024-09-21T04:00:04.010295+0000","last_unstale":"2024-09-21T04:01:31.039685+0000","last_undegraded":"2024-09-21T04:01:31.039685+0000","last_fullsized":"2024-09-21T04:01:31.039685+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:40.417814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:35.301072+0000","last_change":"2024-09-21T04:00:01.985123+0000","last_active":"2024-09-21T04:01:35.301072+0000","last_peered":"2024-09-21T04:01:35.301072+0000","last_clean":"2024-09-21T04:01:35.301072+0000","last_became_active":"2024-09-21T04:00:01.984686+0000","last_became_peered":"2024-09-21T04:00:01.984686+0000","last_unstale":"2024-09-21T04:01:35.301072+0000","last_undegraded":"2024-09-21T04:01:35.301072+0000","last_fullsized":"2024-09-21T04:01:35.301072+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:18.825567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036813+0000","last_change":"2024-09-21T04:00:11.068045+0000","last_active":"2024-09-21T04:01:31.036813+0000","last_peered":"2024-09-21T04:01:31.036813+0000","last_clean":"2024-09-21T04:01:31.036813+0000","last_became_active":"2024-09-21T04:00:11.067528+0000","last_became_peered":"2024-09-21T04:00:11.067528+0000","last_unstale":"2024-09-21T04:01:31.036813+0000","last_undegraded":"2024-09-21T04:01:31.036813+0000","last_fullsized":"2024-09-21T04:01:31.036813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:54.054763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039746+0000","last_change":"2024-09-21T04:00:04.008068+0000","last_active":"2024-09-21T04:01:31.039746+0000","last_peered":"2024-09-21T04:01:31.039746+0000","last_clean":"2024-09-21T04:01:31.039746+0000","last_became_active":"2024-09-21T04:00:04.007611+0000","last_became_peered":"2024-09-21T04:00:04.007611+0000","last_unstale":"2024-09-21T04:01:31.039746+0000","last_undegraded":"2024-09-21T04:01:31.039746+0000","last_fullsized":"2024-09-21T04:01:31.039746+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:02.363722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034956+0000","last_change":"2024-09-21T04:00:01.986011+0000","last_active":"2024-09-21T04:01:31.034956+0000","last_peered":"2024-09-21T04:01:31.034956+0000","last_clean":"2024-09-21T04:01:31.034956+0000","last_became_active":"2024-09-21T04:00:01.985637+0000","last_became_peered":"2024-09-21T04:00:01.985637+0000","last_unstale":"2024-09-21T04:01:31.034956+0000","last_undegraded":"2024-09-21T04:01:31.034956+0000","last_fullsized":"2024-09-21T04:01:31.034956+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:36.226063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037322+0000","last_change":"2024-09-21T04:00:11.067798+0000","last_active":"2024-09-21T04:01:31.037322+0000","last_peered":"2024-09-21T04:01:31.037322+0000","last_clean":"2024-09-21T04:01:31.037322+0000","last_became_active":"2024-09-21T04:00:11.067319+0000","last_became_peered":"2024-09-21T04:00:11.067319+0000","last_unstale":"2024-09-21T04:01:31.037322+0000","last_undegraded":"2024-09-21T04:01:31.037322+0000","last_fullsized":"2024-09-21T04:01:31.037322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:37.118986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032840+0000","last_change":"2024-09-21T04:00:04.003222+0000","last_active":"2024-09-21T04:01:31.032840+0000","last_peered":"2024-09-21T04:01:31.032840+0000","last_clean":"2024-09-21T04:01:31.032840+0000","last_became_active":"2024-09-21T04:00:04.002893+0000","last_became_peered":"2024-09-21T04:00:04.002893+0000","last_unstale":"2024-09-21T04:01:31.032840+0000","last_undegraded":"2024-09-21T04:01:31.032840+0000","last_fullsized":"2024-09-21T04:01:31.032840+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:18.806695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042596+0000","last_change":"2024-09-21T04:00:01.985978+0000","last_active":"2024-09-21T04:01:31.042596+0000","last_peered":"2024-09-21T04:01:31.042596+0000","last_clean":"2024-09-21T04:01:31.042596+0000","last_became_active":"2024-09-21T04:00:01.985607+0000","last_became_peered":"2024-09-21T04:00:01.985607+0000","last_unstale":"2024-09-21T04:01:31.042596+0000","last_undegraded":"2024-09-21T04:01:31.042596+0000","last_fullsized":"2024-09-21T04:01:31.042596+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:30.113727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035195+0000","last_change":"2024-09-21T04:00:11.069332+0000","last_active":"2024-09-21T04:01:31.035195+0000","last_peered":"2024-09-21T04:01:31.035195+0000","last_clean":"2024-09-21T04:01:31.035195+0000","last_became_active":"2024-09-21T04:00:11.068832+0000","last_became_peered":"2024-09-21T04:00:11.068832+0000","last_unstale":"2024-09-21T04:01:31.035195+0000","last_undegraded":"2024-09-21T04:01:31.035195+0000","last_fullsized":"2024-09-21T04:01:31.035195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:03.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039676+0000","last_change":"2024-09-21T04:00:04.004234+0000","last_active":"2024-09-21T04:01:31.039676+0000","last_peered":"2024-09-21T04:01:31.039676+0000","last_clean":"2024-09-21T04:01:31.039676+0000","last_became_active":"2024-09-21T04:00:04.003839+0000","last_became_peered":"2024-09-21T04:00:04.003839+0000","last_unstale":"2024-09-21T04:01:31.039676+0000","last_undegraded":"2024-09-21T04:01:31.039676+0000","last_fullsized":"2024-09-21T04:01:31.039676+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.971580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"83'34","reported_seq":196,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:40.305648+0000","last_change":"2024-09-21T04:00:01.990623+0000","last_active":"2024-09-21T04:01:40.305648+0000","last_peered":"2024-09-21T04:01:40.305648+0000","last_clean":"2024-09-21T04:01:40.305648+0000","last_became_active":"2024-09-21T04:00:01.990030+0000","last_became_peered":"2024-09-21T04:00:01.990030+0000","last_unstale":"2024-09-21T04:01:40.305648+0000","last_undegraded":"2024-09-21T04:01:40.305648+0000","last_fullsized":"2024-09-21T04:01:40.305648+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:07.150261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66212,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":121,"num_read_kb":125,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036459+0000","last_change":"2024-09-21T04:00:11.064198+0000","last_active":"2024-09-21T04:01:31.036459+0000","last_peered":"2024-09-21T04:01:31.036459+0000","last_clean":"2024-09-21T04:01:31.036459+0000","last_became_active":"2024-09-21T04:00:11.063519+0000","last_became_peered":"2024-09-21T04:00:11.063519+0000","last_unstale":"2024-09-21T04:01:31.036459+0000","last_undegraded":"2024-09-21T04:01:31.036459+0000","last_fullsized":"2024-09-21T04:01:31.036459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:16.189027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303706+0000","last_change":"2024-09-21T04:00:04.009685+0000","last_active":"2024-09-21T04:01:31.303706+0000","last_peered":"2024-09-21T04:01:31.303706+0000","last_clean":"2024-09-21T04:01:31.303706+0000","last_became_active":"2024-09-21T04:00:04.009217+0000","last_became_peered":"2024-09-21T04:00:04.009217+0000","last_unstale":"2024-09-21T04:01:31.303706+0000","last_undegraded":"2024-09-21T04:01:31.303706+0000","last_fullsized":"2024-09-21T04:01:31.303706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:31.780399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035384+0000","last_change":"2024-09-21T04:00:02.164467+0000","last_active":"2024-09-21T04:01:31.035384+0000","last_peered":"2024-09-21T04:01:31.035384+0000","last_clean":"2024-09-21T04:01:31.035384+0000","last_became_active":"2024-09-21T04:00:02.164091+0000","last_became_peered":"2024-09-21T04:00:02.164091+0000","last_unstale":"2024-09-21T04:01:31.035384+0000","last_undegraded":"2024-09-21T04:01:31.035384+0000","last_fullsized":"2024-09-21T04:01:31.035384+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:12.327745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293696+0000","last_change":"2024-09-21T04:00:11.058828+0000","last_active":"2024-09-21T04:01:31.293696+0000","last_peered":"2024-09-21T04:01:31.293696+0000","last_clean":"2024-09-21T04:01:31.293696+0000","last_became_active":"2024-09-21T04:00:11.058188+0000","last_became_peered":"2024-09-21T04:00:11.058188+0000","last_unstale":"2024-09-21T04:01:31.293696+0000","last_undegraded":"2024-09-21T04:01:31.293696+0000","last_fullsized":"2024-09-21T04:01:31.293696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.767306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108722+0000","last_change":"2024-09-21T04:00:04.004693+0000","last_active":"2024-09-21T04:01:31.108722+0000","last_peered":"2024-09-21T04:01:31.108722+0000","last_clean":"2024-09-21T04:01:31.108722+0000","last_became_active":"2024-09-21T04:00:04.004357+0000","last_became_peered":"2024-09-21T04:00:04.004357+0000","last_unstale":"2024-09-21T04:01:31.108722+0000","last_undegraded":"2024-09-21T04:01:31.108722+0000","last_fullsized":"2024-09-21T04:01:31.108722+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040035+0000","last_change":"2024-09-21T04:00:01.987319+0000","last_active":"2024-09-21T04:01:31.040035+0000","last_peered":"2024-09-21T04:01:31.040035+0000","last_clean":"2024-09-21T04:01:31.040035+0000","last_became_active":"2024-09-21T04:00:01.986012+0000","last_became_peered":"2024-09-21T04:00:01.986012+0000","last_unstale":"2024-09-21T04:01:31.040035+0000","last_undegraded":"2024-09-21T04:01:31.040035+0000","last_fullsized":"2024-09-21T04:01:31.040035+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:03.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038535+0000","last_change":"2024-09-21T04:00:30.139534+0000","last_active":"2024-09-21T04:01:31.038535+0000","last_peered":"2024-09-21T04:01:31.038535+0000","last_clean":"2024-09-21T04:01:31.038535+0000","last_became_active":"2024-09-21T04:00:30.138954+0000","last_became_peered":"2024-09-21T04:00:30.138954+0000","last_unstale":"2024-09-21T04:01:31.038535+0000","last_undegraded":"2024-09-21T04:01:31.038535+0000","last_fullsized":"2024-09-21T04:01:31.038535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:21.368007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303926+0000","last_change":"2024-09-21T04:00:04.013737+0000","last_active":"2024-09-21T04:01:31.303926+0000","last_peered":"2024-09-21T04:01:31.303926+0000","last_clean":"2024-09-21T04:01:31.303926+0000","last_became_active":"2024-09-21T04:00:04.012901+0000","last_became_peered":"2024-09-21T04:00:04.012901+0000","last_unstale":"2024-09-21T04:01:31.303926+0000","last_undegraded":"2024-09-21T04:01:31.303926+0000","last_fullsized":"2024-09-21T04:01:31.303926+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:50.952778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:40.305634+0000","last_change":"2024-09-21T04:00:01.987988+0000","last_active":"2024-09-21T04:01:40.305634+0000","last_peered":"2024-09-21T04:01:40.305634+0000","last_clean":"2024-09-21T04:01:40.305634+0000","last_became_active":"2024-09-21T04:00:01.986593+0000","last_became_peered":"2024-09-21T04:00:01.986593+0000","last_unstale":"2024-09-21T04:01:40.305634+0000","last_undegraded":"2024-09-21T04:01:40.305634+0000","last_fullsized":"2024-09-21T04:01:40.305634+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.256609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":112,"num_read_kb":112,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039250+0000","last_change":"2024-09-21T04:00:11.064937+0000","last_active":"2024-09-21T04:01:31.039250+0000","last_peered":"2024-09-21T04:01:31.039250+0000","last_clean":"2024-09-21T04:01:31.039250+0000","last_became_active":"2024-09-21T04:00:11.063809+0000","last_became_peered":"2024-09-21T04:00:11.063809+0000","last_unstale":"2024-09-21T04:01:31.039250+0000","last_undegraded":"2024-09-21T04:01:31.039250+0000","last_fullsized":"2024-09-21T04:01:31.039250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:00.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.107717+0000","last_change":"2024-09-21T04:00:11.068084+0000","last_active":"2024-09-21T04:01:31.107717+0000","last_peered":"2024-09-21T04:01:31.107717+0000","last_clean":"2024-09-21T04:01:31.107717+0000","last_became_active":"2024-09-21T04:00:11.067587+0000","last_became_peered":"2024-09-21T04:00:11.067587+0000","last_unstale":"2024-09-21T04:01:31.107717+0000","last_undegraded":"2024-09-21T04:01:31.107717+0000","last_fullsized":"2024-09-21T04:01:31.107717+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:30.849467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036446+0000","last_change":"2024-09-21T04:00:03.997501+0000","last_active":"2024-09-21T04:01:31.036446+0000","last_peered":"2024-09-21T04:01:31.036446+0000","last_clean":"2024-09-21T04:01:31.036446+0000","last_became_active":"2024-09-21T04:00:03.997100+0000","last_became_peered":"2024-09-21T04:00:03.997100+0000","last_unstale":"2024-09-21T04:01:31.036446+0000","last_undegraded":"2024-09-21T04:01:31.036446+0000","last_fullsized":"2024-09-21T04:01:31.036446+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:31.813970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034964+0000","last_change":"2024-09-21T04:00:01.986224+0000","last_active":"2024-09-21T04:01:31.034964+0000","last_peered":"2024-09-21T04:01:31.034964+0000","last_clean":"2024-09-21T04:01:31.034964+0000","last_became_active":"2024-09-21T04:00:01.985845+0000","last_became_peered":"2024-09-21T04:00:01.985845+0000","last_unstale":"2024-09-21T04:01:31.034964+0000","last_undegraded":"2024-09-21T04:01:31.034964+0000","last_fullsized":"2024-09-21T04:01:31.034964+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:38.895288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037441+0000","last_change":"2024-09-21T04:00:11.067705+0000","last_active":"2024-09-21T04:01:31.037441+0000","last_peered":"2024-09-21T04:01:31.037441+0000","last_clean":"2024-09-21T04:01:31.037441+0000","last_became_active":"2024-09-21T04:00:11.067252+0000","last_became_peered":"2024-09-21T04:00:11.067252+0000","last_unstale":"2024-09-21T04:01:31.037441+0000","last_undegraded":"2024-09-21T04:01:31.037441+0000","last_fullsized":"2024-09-21T04:01:31.037441+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:47.003323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039261+0000","last_change":"2024-09-21T04:00:03.996067+0000","last_active":"2024-09-21T04:01:31.039261+0000","last_peered":"2024-09-21T04:01:31.039261+0000","last_clean":"2024-09-21T04:01:31.039261+0000","last_became_active":"2024-09-21T04:00:03.995603+0000","last_became_peered":"2024-09-21T04:00:03.995603+0000","last_unstale":"2024-09-21T04:01:31.039261+0000","last_undegraded":"2024-09-21T04:01:31.039261+0000","last_fullsized":"2024-09-21T04:01:31.039261+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:19.348461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032601+0000","last_change":"2024-09-21T04:00:01.985283+0000","last_active":"2024-09-21T04:01:31.032601+0000","last_peered":"2024-09-21T04:01:31.032601+0000","last_clean":"2024-09-21T04:01:31.032601+0000","last_became_active":"2024-09-21T04:00:01.984860+0000","last_became_peered":"2024-09-21T04:00:01.984860+0000","last_unstale":"2024-09-21T04:01:31.032601+0000","last_undegraded":"2024-09-21T04:01:31.032601+0000","last_fullsized":"2024-09-21T04:01:31.032601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:38.739987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033620+0000","last_change":"2024-09-21T04:00:30.183241+0000","last_active":"2024-09-21T04:01:31.033620+0000","last_peered":"2024-09-21T04:01:31.033620+0000","last_clean":"2024-09-21T04:01:31.033620+0000","last_became_active":"2024-09-21T04:00:30.182788+0000","last_became_peered":"2024-09-21T04:00:30.182788+0000","last_unstale":"2024-09-21T04:01:31.033620+0000","last_undegraded":"2024-09-21T04:01:31.033620+0000","last_fullsized":"2024-09-21T04:01:31.033620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:47.129478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035060+0000","last_change":"2024-09-21T04:00:04.004526+0000","last_active":"2024-09-21T04:01:31.035060+0000","last_peered":"2024-09-21T04:01:31.035060+0000","last_clean":"2024-09-21T04:01:31.035060+0000","last_became_active":"2024-09-21T04:00:04.004114+0000","last_became_peered":"2024-09-21T04:00:04.004114+0000","last_unstale":"2024-09-21T04:01:31.035060+0000","last_undegraded":"2024-09-21T04:01:31.035060+0000","last_fullsized":"2024-09-21T04:01:31.035060+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:50.212647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042439+0000","last_change":"2024-09-21T04:00:11.067811+0000","last_active":"2024-09-21T04:01:31.042439+0000","last_peered":"2024-09-21T04:01:31.042439+0000","last_clean":"2024-09-21T04:01:31.042439+0000","last_became_active":"2024-09-21T04:00:11.067280+0000","last_became_peered":"2024-09-21T04:00:11.067280+0000","last_unstale":"2024-09-21T04:01:31.042439+0000","last_undegraded":"2024-09-21T04:01:31.042439+0000","last_fullsized":"2024-09-21T04:01:31.042439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:08.152231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"83'5","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:36.300122+0000","last_change":"2024-09-21T04:00:01.987215+0000","last_active":"2024-09-21T04:01:36.300122+0000","last_peered":"2024-09-21T04:01:36.300122+0000","last_clean":"2024-09-21T04:01:36.300122+0000","last_became_active":"2024-09-21T04:00:01.986738+0000","last_became_peered":"2024-09-21T04:00:01.986738+0000","last_unstale":"2024-09-21T04:01:36.300122+0000","last_undegraded":"2024-09-21T04:01:36.300122+0000","last_fullsized":"2024-09-21T04:01:36.300122+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:16.204316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039407+0000","last_change":"2024-09-21T04:00:04.003232+0000","last_active":"2024-09-21T04:01:31.039407+0000","last_peered":"2024-09-21T04:01:31.039407+0000","last_clean":"2024-09-21T04:01:31.039407+0000","last_became_active":"2024-09-21T04:00:04.002865+0000","last_became_peered":"2024-09-21T04:00:04.002865+0000","last_unstale":"2024-09-21T04:01:31.039407+0000","last_undegraded":"2024-09-21T04:01:31.039407+0000","last_fullsized":"2024-09-21T04:01:31.039407+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:29.298836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042636+0000","last_change":"2024-09-21T04:00:11.057591+0000","last_active":"2024-09-21T04:01:31.042636+0000","last_peered":"2024-09-21T04:01:31.042636+0000","last_clean":"2024-09-21T04:01:31.042636+0000","last_became_active":"2024-09-21T04:00:11.057092+0000","last_became_peered":"2024-09-21T04:00:11.057092+0000","last_unstale":"2024-09-21T04:01:31.042636+0000","last_undegraded":"2024-09-21T04:01:31.042636+0000","last_fullsized":"2024-09-21T04:01:31.042636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:47.487649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038247+0000","last_change":"2024-09-21T04:00:04.010297+0000","last_active":"2024-09-21T04:01:31.038247+0000","last_peered":"2024-09-21T04:01:31.038247+0000","last_clean":"2024-09-21T04:01:31.038247+0000","last_became_active":"2024-09-21T04:00:04.009948+0000","last_became_peered":"2024-09-21T04:00:04.009948+0000","last_unstale":"2024-09-21T04:01:31.038247+0000","last_undegraded":"2024-09-21T04:01:31.038247+0000","last_fullsized":"2024-09-21T04:01:31.038247+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:07.927430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042735+0000","last_change":"2024-09-21T04:00:04.005564+0000","last_active":"2024-09-21T04:01:31.042735+0000","last_peered":"2024-09-21T04:01:31.042735+0000","last_clean":"2024-09-21T04:01:31.042735+0000","last_became_active":"2024-09-21T04:00:04.005119+0000","last_became_peered":"2024-09-21T04:00:04.005119+0000","last_unstale":"2024-09-21T04:01:31.042735+0000","last_undegraded":"2024-09-21T04:01:31.042735+0000","last_fullsized":"2024-09-21T04:01:31.042735+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:05.844333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042358+0000","last_change":"2024-09-21T04:00:03.997004+0000","last_active":"2024-09-21T04:01:31.042358+0000","last_peered":"2024-09-21T04:01:31.042358+0000","last_clean":"2024-09-21T04:01:31.042358+0000","last_became_active":"2024-09-21T04:00:03.996570+0000","last_became_peered":"2024-09-21T04:00:03.996570+0000","last_unstale":"2024-09-21T04:01:31.042358+0000","last_undegraded":"2024-09-21T04:01:31.042358+0000","last_fullsized":"2024-09-21T04:01:31.042358+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108172+0000","last_change":"2024-09-21T04:00:04.005794+0000","last_active":"2024-09-21T04:01:31.108172+0000","last_peered":"2024-09-21T04:01:31.108172+0000","last_clean":"2024-09-21T04:01:31.108172+0000","last_became_active":"2024-09-21T04:00:04.005345+0000","last_became_peered":"2024-09-21T04:00:04.005345+0000","last_unstale":"2024-09-21T04:01:31.108172+0000","last_undegraded":"2024-09-21T04:01:31.108172+0000","last_fullsized":"2024-09-21T04:01:31.108172+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:20.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033079+0000","last_change":"2024-09-21T04:00:03.992204+0000","last_active":"2024-09-21T04:01:31.033079+0000","last_peered":"2024-09-21T04:01:31.033079+0000","last_clean":"2024-09-21T04:01:31.033079+0000","last_became_active":"2024-09-21T04:00:03.991826+0000","last_became_peered":"2024-09-21T04:00:03.991826+0000","last_unstale":"2024-09-21T04:01:31.033079+0000","last_undegraded":"2024-09-21T04:01:31.033079+0000","last_fullsized":"2024-09-21T04:01:31.033079+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.443227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037550+0000","last_change":"2024-09-21T04:00:04.004401+0000","last_active":"2024-09-21T04:01:31.037550+0000","last_peered":"2024-09-21T04:01:31.037550+0000","last_clean":"2024-09-21T04:01:31.037550+0000","last_became_active":"2024-09-21T04:00:04.003983+0000","last_became_peered":"2024-09-21T04:00:04.003983+0000","last_unstale":"2024-09-21T04:01:31.037550+0000","last_undegraded":"2024-09-21T04:01:31.037550+0000","last_fullsized":"2024-09-21T04:01:31.037550+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:06.250069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042967+0000","last_change":"2024-09-21T04:00:03.999692+0000","last_active":"2024-09-21T04:01:31.042967+0000","last_peered":"2024-09-21T04:01:31.042967+0000","last_clean":"2024-09-21T04:01:31.042967+0000","last_became_active":"2024-09-21T04:00:03.999282+0000","last_became_peered":"2024-09-21T04:00:03.999282+0000","last_unstale":"2024-09-21T04:01:31.042967+0000","last_undegraded":"2024-09-21T04:01:31.042967+0000","last_fullsized":"2024-09-21T04:01:31.042967+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.323350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039401+0000","last_change":"2024-09-21T04:00:04.002947+0000","last_active":"2024-09-21T04:01:31.039401+0000","last_peered":"2024-09-21T04:01:31.039401+0000","last_clean":"2024-09-21T04:01:31.039401+0000","last_became_active":"2024-09-21T04:00:04.002550+0000","last_became_peered":"2024-09-21T04:00:04.002550+0000","last_unstale":"2024-09-21T04:01:31.039401+0000","last_undegraded":"2024-09-21T04:01:31.039401+0000","last_fullsized":"2024-09-21T04:01:31.039401+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:17.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034680+0000","last_change":"2024-09-21T04:00:04.009700+0000","last_active":"2024-09-21T04:01:31.034680+0000","last_peered":"2024-09-21T04:01:31.034680+0000","last_clean":"2024-09-21T04:01:31.034680+0000","last_became_active":"2024-09-21T04:00:04.009311+0000","last_became_peered":"2024-09-21T04:00:04.009311+0000","last_unstale":"2024-09-21T04:01:31.034680+0000","last_undegraded":"2024-09-21T04:01:31.034680+0000","last_fullsized":"2024-09-21T04:01:31.034680+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.658543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039855+0000","last_change":"2024-09-21T04:00:04.002975+0000","last_active":"2024-09-21T04:01:31.039855+0000","last_peered":"2024-09-21T04:01:31.039855+0000","last_clean":"2024-09-21T04:01:31.039855+0000","last_became_active":"2024-09-21T04:00:04.002608+0000","last_became_peered":"2024-09-21T04:00:04.002608+0000","last_unstale":"2024-09-21T04:01:31.039855+0000","last_undegraded":"2024-09-21T04:01:31.039855+0000","last_fullsized":"2024-09-21T04:01:31.039855+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:13.044615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303499+0000","last_change":"2024-09-21T04:00:04.010797+0000","last_active":"2024-09-21T04:01:31.303499+0000","last_peered":"2024-09-21T04:01:31.303499+0000","last_clean":"2024-09-21T04:01:31.303499+0000","last_became_active":"2024-09-21T04:00:04.010377+0000","last_became_peered":"2024-09-21T04:00:04.010377+0000","last_unstale":"2024-09-21T04:01:31.303499+0000","last_undegraded":"2024-09-21T04:01:31.303499+0000","last_fullsized":"2024-09-21T04:01:31.303499+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:58.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033037+0000","last_change":"2024-09-21T04:00:04.002841+0000","last_active":"2024-09-21T04:01:31.033037+0000","last_peered":"2024-09-21T04:01:31.033037+0000","last_clean":"2024-09-21T04:01:31.033037+0000","last_became_active":"2024-09-21T04:00:04.002491+0000","last_became_peered":"2024-09-21T04:00:04.002491+0000","last_unstale":"2024-09-21T04:01:31.033037+0000","last_undegraded":"2024-09-21T04:01:31.033037+0000","last_fullsized":"2024-09-21T04:01:31.033037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:52.816860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037284+0000","last_change":"2024-09-21T04:00:04.007238+0000","last_active":"2024-09-21T04:01:31.037284+0000","last_peered":"2024-09-21T04:01:31.037284+0000","last_clean":"2024-09-21T04:01:31.037284+0000","last_became_active":"2024-09-21T04:00:04.006898+0000","last_became_peered":"2024-09-21T04:00:04.006898+0000","last_unstale":"2024-09-21T04:01:31.037284+0000","last_undegraded":"2024-09-21T04:01:31.037284+0000","last_fullsized":"2024-09-21T04:01:31.037284+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.957214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042854+0000","last_change":"2024-09-21T04:00:03.997131+0000","last_active":"2024-09-21T04:01:31.042854+0000","last_peered":"2024-09-21T04:01:31.042854+0000","last_clean":"2024-09-21T04:01:31.042854+0000","last_became_active":"2024-09-21T04:00:03.996711+0000","last_became_peered":"2024-09-21T04:00:03.996711+0000","last_unstale":"2024-09-21T04:01:31.042854+0000","last_undegraded":"2024-09-21T04:01:31.042854+0000","last_fullsized":"2024-09-21T04:01:31.042854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:25.373743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036883+0000","last_change":"2024-09-21T04:00:04.004067+0000","last_active":"2024-09-21T04:01:31.036883+0000","last_peered":"2024-09-21T04:01:31.036883+0000","last_clean":"2024-09-21T04:01:31.036883+0000","last_became_active":"2024-09-21T04:00:04.003707+0000","last_became_peered":"2024-09-21T04:00:04.003707+0000","last_unstale":"2024-09-21T04:01:31.036883+0000","last_undegraded":"2024-09-21T04:01:31.036883+0000","last_fullsized":"2024-09-21T04:01:31.036883+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:24.148194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037758+0000","last_change":"2024-09-21T04:00:04.000068+0000","last_active":"2024-09-21T04:01:31.037758+0000","last_peered":"2024-09-21T04:01:31.037758+0000","last_clean":"2024-09-21T04:01:31.037758+0000","last_became_active":"2024-09-21T04:00:03.999709+0000","last_became_peered":"2024-09-21T04:00:03.999709+0000","last_unstale":"2024-09-21T04:01:31.037758+0000","last_undegraded":"2024-09-21T04:01:31.037758+0000","last_fullsized":"2024-09-21T04:01:31.037758+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:51.249309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303179+0000","last_change":"2024-09-21T04:00:04.011884+0000","last_active":"2024-09-21T04:01:31.303179+0000","last_peered":"2024-09-21T04:01:31.303179+0000","last_clean":"2024-09-21T04:01:31.303179+0000","last_became_active":"2024-09-21T04:00:04.011449+0000","last_became_peered":"2024-09-21T04:00:04.011449+0000","last_unstale":"2024-09-21T04:01:31.303179+0000","last_undegraded":"2024-09-21T04:01:31.303179+0000","last_fullsized":"2024-09-21T04:01:31.303179+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:46.948465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108311+0000","last_change":"2024-09-21T04:00:03.992848+0000","last_active":"2024-09-21T04:01:31.108311+0000","last_peered":"2024-09-21T04:01:31.108311+0000","last_clean":"2024-09-21T04:01:31.108311+0000","last_became_active":"2024-09-21T04:00:03.991096+0000","last_became_peered":"2024-09-21T04:00:03.991096+0000","last_unstale":"2024-09-21T04:01:31.108311+0000","last_undegraded":"2024-09-21T04:01:31.108311+0000","last_fullsized":"2024-09-21T04:01:31.108311+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:19.599848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.107952+0000","last_change":"2024-09-21T04:00:04.000380+0000","last_active":"2024-09-21T04:01:31.107952+0000","last_peered":"2024-09-21T04:01:31.107952+0000","last_clean":"2024-09-21T04:01:31.107952+0000","last_became_active":"2024-09-21T04:00:03.999918+0000","last_became_peered":"2024-09-21T04:00:03.999918+0000","last_unstale":"2024-09-21T04:01:31.107952+0000","last_undegraded":"2024-09-21T04:01:31.107952+0000","last_fullsized":"2024-09-21T04:01:31.107952+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:25.607882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032905+0000","last_change":"2024-09-21T04:00:30.138053+0000","last_active":"2024-09-21T04:01:31.032905+0000","last_peered":"2024-09-21T04:01:31.032905+0000","last_clean":"2024-09-21T04:01:31.032905+0000","last_became_active":"2024-09-21T04:00:30.137682+0000","last_became_peered":"2024-09-21T04:00:30.137682+0000","last_unstale":"2024-09-21T04:01:31.032905+0000","last_undegraded":"2024-09-21T04:01:31.032905+0000","last_fullsized":"2024-09-21T04:01:31.032905+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.031655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294860+0000","last_change":"2024-09-21T04:00:04.004313+0000","last_active":"2024-09-21T04:01:31.294860+0000","last_peered":"2024-09-21T04:01:31.294860+0000","last_clean":"2024-09-21T04:01:31.294860+0000","last_became_active":"2024-09-21T04:00:04.003128+0000","last_became_peered":"2024-09-21T04:00:04.003128+0000","last_unstale":"2024-09-21T04:01:31.294860+0000","last_undegraded":"2024-09-21T04:01:31.294860+0000","last_fullsized":"2024-09-21T04:01:31.294860+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:43.469449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040339+0000","last_change":"2024-09-21T04:00:04.017136+0000","last_active":"2024-09-21T04:01:31.040339+0000","last_peered":"2024-09-21T04:01:31.040339+0000","last_clean":"2024-09-21T04:01:31.040339+0000","last_became_active":"2024-09-21T04:00:04.016732+0000","last_became_peered":"2024-09-21T04:00:04.016732+0000","last_unstale":"2024-09-21T04:01:31.040339+0000","last_undegraded":"2024-09-21T04:01:31.040339+0000","last_fullsized":"2024-09-21T04:01:31.040339+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:04.021078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034120+0000","last_change":"2024-09-21T04:00:04.012098+0000","last_active":"2024-09-21T04:01:31.034120+0000","last_peered":"2024-09-21T04:01:31.034120+0000","last_clean":"2024-09-21T04:01:31.034120+0000","last_became_active":"2024-09-21T04:00:04.011681+0000","last_became_peered":"2024-09-21T04:00:04.011681+0000","last_unstale":"2024-09-21T04:01:31.034120+0000","last_undegraded":"2024-09-21T04:01:31.034120+0000","last_fullsized":"2024-09-21T04:01:31.034120+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:59.202312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.304059+0000","last_change":"2024-09-21T04:00:04.017056+0000","last_active":"2024-09-21T04:01:31.304059+0000","last_peered":"2024-09-21T04:01:31.304059+0000","last_clean":"2024-09-21T04:01:31.304059+0000","last_became_active":"2024-09-21T04:00:04.015950+0000","last_became_peered":"2024-09-21T04:00:04.015950+0000","last_unstale":"2024-09-21T04:01:31.304059+0000","last_undegraded":"2024-09-21T04:01:31.304059+0000","last_fullsized":"2024-09-21T04:01:31.304059+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:11.267161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039220+0000","last_change":"2024-09-21T04:00:04.010314+0000","last_active":"2024-09-21T04:01:31.039220+0000","last_peered":"2024-09-21T04:01:31.039220+0000","last_clean":"2024-09-21T04:01:31.039220+0000","last_became_active":"2024-09-21T04:00:04.009917+0000","last_became_peered":"2024-09-21T04:00:04.009917+0000","last_unstale":"2024-09-21T04:01:31.039220+0000","last_undegraded":"2024-09-21T04:01:31.039220+0000","last_fullsized":"2024-09-21T04:01:31.039220+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:32.947079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039882+0000","last_change":"2024-09-21T04:00:04.007104+0000","last_active":"2024-09-21T04:01:31.039882+0000","last_peered":"2024-09-21T04:01:31.039882+0000","last_clean":"2024-09-21T04:01:31.039882+0000","last_became_active":"2024-09-21T04:00:04.006655+0000","last_became_peered":"2024-09-21T04:00:04.006655+0000","last_unstale":"2024-09-21T04:01:31.039882+0000","last_undegraded":"2024-09-21T04:01:31.039882+0000","last_fullsized":"2024-09-21T04:01:31.039882+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.834305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033563+0000","last_change":"2024-09-21T04:00:04.007842+0000","last_active":"2024-09-21T04:01:31.033563+0000","last_peered":"2024-09-21T04:01:31.033563+0000","last_clean":"2024-09-21T04:01:31.033563+0000","last_became_active":"2024-09-21T04:00:04.007223+0000","last_became_peered":"2024-09-21T04:00:04.007223+0000","last_unstale":"2024-09-21T04:01:31.033563+0000","last_undegraded":"2024-09-21T04:01:31.033563+0000","last_fullsized":"2024-09-21T04:01:31.033563+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:01.501836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039034+0000","last_change":"2024-09-21T04:00:03.997390+0000","last_active":"2024-09-21T04:01:31.039034+0000","last_peered":"2024-09-21T04:01:31.039034+0000","last_clean":"2024-09-21T04:01:31.039034+0000","last_became_active":"2024-09-21T04:00:03.997075+0000","last_became_peered":"2024-09-21T04:00:03.997075+0000","last_unstale":"2024-09-21T04:01:31.039034+0000","last_undegraded":"2024-09-21T04:01:31.039034+0000","last_fullsized":"2024-09-21T04:01:31.039034+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:50.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294706+0000","last_change":"2024-09-21T04:00:04.006203+0000","last_active":"2024-09-21T04:01:31.294706+0000","last_peered":"2024-09-21T04:01:31.294706+0000","last_clean":"2024-09-21T04:01:31.294706+0000","last_became_active":"2024-09-21T04:00:04.005150+0000","last_became_peered":"2024-09-21T04:00:04.005150+0000","last_unstale":"2024-09-21T04:01:31.294706+0000","last_undegraded":"2024-09-21T04:01:31.294706+0000","last_fullsized":"2024-09-21T04:01:31.294706+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:17.635568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108148+0000","last_change":"2024-09-21T04:00:04.011843+0000","last_active":"2024-09-21T04:01:31.108148+0000","last_peered":"2024-09-21T04:01:31.108148+0000","last_clean":"2024-09-21T04:01:31.108148+0000","last_became_active":"2024-09-21T04:00:04.011570+0000","last_became_peered":"2024-09-21T04:00:04.011570+0000","last_unstale":"2024-09-21T04:01:31.108148+0000","last_undegraded":"2024-09-21T04:01:31.108148+0000","last_fullsized":"2024-09-21T04:01:31.108148+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:59.883217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":35,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108444+0000","last_change":"2024-09-21T04:00:04.002111+0000","last_active":"2024-09-21T04:01:31.108444+0000","last_peered":"2024-09-21T04:01:31.108444+0000","last_clean":"2024-09-21T04:01:31.108444+0000","last_became_active":"2024-09-21T04:00:04.001723+0000","last_became_peered":"2024-09-21T04:00:04.001723+0000","last_unstale":"2024-09-21T04:01:31.108444+0000","last_undegraded":"2024-09-21T04:01:31.108444+0000","last_fullsized":"2024-09-21T04:01:31.108444+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:32.595150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":36,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037637+0000","last_change":"2024-09-21T04:00:03.998822+0000","last_active":"2024-09-21T04:01:31.037637+0000","last_peered":"2024-09-21T04:01:31.037637+0000","last_clean":"2024-09-21T04:01:31.037637+0000","last_became_active":"2024-09-21T04:00:03.998445+0000","last_became_peered":"2024-09-21T04:00:03.998445+0000","last_unstale":"2024-09-21T04:01:31.037637+0000","last_undegraded":"2024-09-21T04:01:31.037637+0000","last_fullsized":"2024-09-21T04:01:31.037637+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.090570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":73025,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":589,"num_read_kb":379,"num_write":245,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":219075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":211,"ondisk_log_size":211,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282913,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776160,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32116,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713036,"statfs":{"total":95995035648,"available":95962148864,"internally_reserved":0,"allocated":946176,"data_stored":493662,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972390,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28108,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717044,"statfs":{"total":95995035648,"available":95966253056,"internally_reserved":0,"allocated":1101824,"data_stored":1146690,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135915,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":974848,"data_stored":497688,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332144,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":966656,"data_stored":493970,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528373,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1019904,"data_stored":1090467,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691899,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36276,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708876,"statfs":{"total":95995035648,"available":95957889024,"internally_reserved":0,"allocated":946176,"data_stored":489487,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888128,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1028096,"data_stored":1085658,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051652,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":954368,"data_stored":493170,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247882,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":958464,"data_stored":488804,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444112,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1040384,"data_stored":556558,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1019904,"data_stored":556729,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36300,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708852,"statfs":{"total":95995035648,"available":95957864448,"internally_reserved":0,"allocated":970752,"data_stored":490552,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":67948,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T04:01:41.966 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T04:01:41.966 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T04:01:41.966 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T04:01:41.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph health --format=json 2024-09-21T04:01:42.228 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:42.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:42 smithi022 ceph-mon[31015]: pgmap v351: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T04:01:42.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:42 smithi022 ceph-mon[31015]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:42.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:42 smithi073 ceph-mon[34443]: pgmap v351: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T04:01:42.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:42 smithi073 ceph-mon[34443]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:42.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:42 smithi060 ceph-mon[33722]: pgmap v351: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T04:01:42.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:42 smithi060 ceph-mon[33722]: from='client.15207 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:01:42.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.722+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1002274191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78109df0 msgr2=0x7f7c78110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.722+0000 7f7c7dc5f640 1 --2- 172.21.15.22:0/1002274191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78109df0 0x7f7c78110620 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f7c70009ca0 tx=0x7f7c7002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.722+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1002274191 shutdown_connections 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.722+0000 7f7c7dc5f640 1 --2- 172.21.15.22:0/1002274191 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c781094a0 0x7f7c781098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.722+0000 7f7c7dc5f640 1 --2- 172.21.15.22:0/1002274191 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78109df0 0x7f7c78110620 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.722+0000 7f7c7dc5f640 1 --2- 172.21.15.22:0/1002274191 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c78103b60 0x7f7c78103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.722+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1002274191 >> 172.21.15.22:0/1002274191 conn(0x7f7c7807b850 msgr2=0x7f7c7807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.722+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1002274191 shutdown_connections 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.722+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1002274191 wait complete. 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.723+0000 7f7c7dc5f640 1 Processor -- start 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.723+0000 7f7c7dc5f640 1 -- start start 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.723+0000 7f7c7dc5f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78103b60 0x7f7c7819a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:42.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.723+0000 7f7c7dc5f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c781094a0 0x7f7c7819a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c7dc5f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c78109df0 0x7f7c7819fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c7dc5f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7c781139b0 con 0x7f7c78103b60 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c7dc5f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78113830 con 0x7f7c781094a0 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c7dc5f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78113b30 con 0x7f7c78109df0 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78103b60 0x7f7c7819a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78103b60 0x7f7c7819a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41006/0 (socket says 172.21.15.22:41006) 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c777fe640 1 -- 172.21.15.22:0/1443073401 learned_addr learned my addr 172.21.15.22:0/1443073401 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c76ffd640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c781094a0 0x7f7c7819a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c77fff640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c78109df0 0x7f7c7819fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c777fe640 1 -- 172.21.15.22:0/1443073401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c78109df0 msgr2=0x7f7c7819fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c777fe640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c78109df0 0x7f7c7819fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c777fe640 1 -- 172.21.15.22:0/1443073401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c781094a0 msgr2=0x7f7c7819a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:42.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c777fe640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c781094a0 0x7f7c7819a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c777fe640 1 -- 172.21.15.22:0/1443073401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c781a0370 con 0x7f7c78103b60 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c777fe640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78103b60 0x7f7c7819a400 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800e9f0 tx=0x7f7c6800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c74ff9640 1 -- 172.21.15.22:0/1443073401 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c6800cd80 con 0x7f7c78103b60 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1443073401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c781a0660 con 0x7f7c78103b60 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c74ff9640 1 -- 172.21.15.22:0/1443073401 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7c680108c0 con 0x7f7c78103b60 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c74ff9640 1 -- 172.21.15.22:0/1443073401 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c680187c0 con 0x7f7c78103b60 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.724+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1443073401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c781a6dc0 con 0x7f7c78103b60 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.725+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1443073401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c78103f70 con 0x7f7c78103b60 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.727+0000 7f7c74ff9640 1 -- 172.21.15.22:0/1443073401 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7c68010430 con 0x7f7c78103b60 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.728+0000 7f7c74ff9640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7c600b65a0 0x7f7c600b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.728+0000 7f7c76ffd640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7c600b65a0 0x7f7c600b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.728+0000 7f7c74ff9640 1 -- 172.21.15.22:0/1443073401 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7c680e8210 con 0x7f7c78103b60 2024-09-21T04:01:42.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.728+0000 7f7c76ffd640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7c600b65a0 0x7f7c600b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c005fd0 tx=0x7f7c6c00b510 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:42.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.731+0000 7f7c74ff9640 1 -- 172.21.15.22:0/1443073401 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7c680ae520 con 0x7f7c78103b60 2024-09-21T04:01:42.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.958+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1443073401 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f7c7802e640 con 0x7f7c78103b60 2024-09-21T04:01:42.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.958+0000 7f7c74ff9640 1 -- 172.21.15.22:0/1443073401 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f7c680b2900 con 0x7f7c78103b60 2024-09-21T04:01:42.960 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:42.960 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T04:01:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.960+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1443073401 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7c600b65a0 msgr2=0x7f7c600b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.960+0000 7f7c7dc5f640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7c600b65a0 0x7f7c600b8ab0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c005fd0 tx=0x7f7c6c00b510 comp rx=0 tx=0).stop 2024-09-21T04:01:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.960+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1443073401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78103b60 msgr2=0x7f7c7819a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.960+0000 7f7c7dc5f640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78103b60 0x7f7c7819a400 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800e9f0 tx=0x7f7c6800eeb0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.961+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1443073401 shutdown_connections 2024-09-21T04:01:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.961+0000 7f7c7dc5f640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7c600b65a0 0x7f7c600b8ab0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.961+0000 7f7c7dc5f640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7c78109df0 0x7f7c7819fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.961+0000 7f7c7dc5f640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7c781094a0 0x7f7c7819a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.961+0000 7f7c7dc5f640 1 --2- 172.21.15.22:0/1443073401 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7c78103b60 0x7f7c7819a400 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.961+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1443073401 >> 172.21.15.22:0/1443073401 conn(0x7f7c7807b850 msgr2=0x7f7c781075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.961+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1443073401 shutdown_connections 2024-09-21T04:01:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:42.961+0000 7f7c7dc5f640 1 -- 172.21.15.22:0/1443073401 wait complete. 2024-09-21T04:01:43.262 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:43 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1443073401' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T04:01:43.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:43 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1443073401' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T04:01:43.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:43 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1443073401' entity='client.admin' cmd={"prefix": "health", "format": "json"} : dispatch 2024-09-21T04:01:43.684 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T04:01:43.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:01:43.950 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:44.343 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:44 smithi022 ceph-mon[31015]: pgmap v352: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T04:01:44.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:44 smithi073 ceph-mon[34443]: pgmap v352: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T04:01:44.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.435+0000 7f4df6310640 1 -- 172.21.15.22:0/2145635835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0102a60 msgr2=0x7f4df0102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:44.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.435+0000 7f4df6310640 1 --2- 172.21.15.22:0/2145635835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0102a60 0x7f4df0102e70 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009900 tx=0x7f4de002a410 comp rx=0 tx=0).stop 2024-09-21T04:01:44.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.435+0000 7f4df6310640 1 -- 172.21.15.22:0/2145635835 shutdown_connections 2024-09-21T04:01:44.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.435+0000 7f4df6310640 1 --2- 172.21.15.22:0/2145635835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4df01083a0 0x7f4df01087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:44.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.435+0000 7f4df6310640 1 --2- 172.21.15.22:0/2145635835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df0108cf0 0x7f4df010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:44.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.435+0000 7f4df6310640 1 --2- 172.21.15.22:0/2145635835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0102a60 0x7f4df0102e70 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:44.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.435+0000 7f4df6310640 1 -- 172.21.15.22:0/2145635835 >> 172.21.15.22:0/2145635835 conn(0x7f4df0079730 msgr2=0x7f4df0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:44.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.435+0000 7f4df6310640 1 -- 172.21.15.22:0/2145635835 shutdown_connections 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.435+0000 7f4df6310640 1 -- 172.21.15.22:0/2145635835 wait complete. 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.436+0000 7f4df6310640 1 Processor -- start 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.436+0000 7f4df6310640 1 -- start start 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.436+0000 7f4df6310640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0102a60 0x7f4df019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.436+0000 7f4df6310640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df01083a0 0x7f4df019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.436+0000 7f4df6310640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4df0108cf0 0x7f4df019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.436+0000 7f4df6310640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0113930 con 0x7f4df0102a60 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.436+0000 7f4df6310640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4df01137b0 con 0x7f4df01083a0 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.436+0000 7f4df6310640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4df0113ab0 con 0x7f4df0108cf0 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.436+0000 7f4deffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0102a60 0x7f4df019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4deffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0102a60 0x7f4df019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41016/0 (socket says 172.21.15.22:41016) 2024-09-21T04:01:44.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4deffff640 1 -- 172.21.15.22:0/1851841572 learned_addr learned my addr 172.21.15.22:0/1851841572 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4def7fe640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df01083a0 0x7f4df019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4df48ad640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4df0108cf0 0x7f4df019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4deffff640 1 -- 172.21.15.22:0/1851841572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4df0108cf0 msgr2=0x7f4df019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4deffff640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4df0108cf0 0x7f4df019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4deffff640 1 -- 172.21.15.22:0/1851841572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df01083a0 msgr2=0x7f4df019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4deffff640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df01083a0 0x7f4df019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4deffff640 1 -- 172.21.15.22:0/1851841572 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4df01a0350 con 0x7f4df0102a60 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4df48ad640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4df0108cf0 0x7f4df019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4deffff640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0102a60 0x7f4df019a3e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009230 tx=0x7f4de0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4ded7fa640 1 -- 172.21.15.22:0/1851841572 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de003f030 con 0x7f4df0102a60 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4df6310640 1 -- 172.21.15.22:0/1851841572 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4df01a05e0 con 0x7f4df0102a60 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4ded7fa640 1 -- 172.21.15.22:0/1851841572 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4de0003a80 con 0x7f4df0102a60 2024-09-21T04:01:44.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4ded7fa640 1 -- 172.21.15.22:0/1851841572 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4de0035070 con 0x7f4df0102a60 2024-09-21T04:01:44.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.437+0000 7f4df6310640 1 -- 172.21.15.22:0/1851841572 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4df01a6da0 con 0x7f4df0102a60 2024-09-21T04:01:44.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.439+0000 7f4df6310640 1 -- 172.21.15.22:0/1851841572 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4df0102e70 con 0x7f4df0102a60 2024-09-21T04:01:44.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.440+0000 7f4ded7fa640 1 -- 172.21.15.22:0/1851841572 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f4de0042030 con 0x7f4df0102a60 2024-09-21T04:01:44.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.441+0000 7f4ded7fa640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4dd80b65a0 0x7f4dd80b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:44.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.441+0000 7f4ded7fa640 1 -- 172.21.15.22:0/1851841572 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f4de0107e40 con 0x7f4df0102a60 2024-09-21T04:01:44.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.441+0000 7f4def7fe640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4dd80b65a0 0x7f4dd80b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:44.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.442+0000 7f4def7fe640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4dd80b65a0 0x7f4dd80b8ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4df0100d20 tx=0x7f4de400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:44.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.446+0000 7f4ded7fa640 1 -- 172.21.15.22:0/1851841572 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4de00ce150 con 0x7f4df0102a60 2024-09-21T04:01:44.451 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:44 smithi060 ceph-mon[33722]: pgmap v352: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 1 objects/s recovering 2024-09-21T04:01:44.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.675+0000 7f4df6310640 1 -- 172.21.15.22:0/1851841572 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4df019b510 con 0x7f4df0102a60 2024-09-21T04:01:44.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.676+0000 7f4ded7fa640 1 -- 172.21.15.22:0/1851841572 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f4de00d2530 con 0x7f4df0102a60 2024-09-21T04:01:44.677 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:44.678 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-21T04:00:45:215178+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:00:45.215152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:01:44.678 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 -- 172.21.15.22:0/1851841572 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4dd80b65a0 msgr2=0x7f4dd80b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4dd80b65a0 0x7f4dd80b8ab0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4df0100d20 tx=0x7f4de400b390 comp rx=0 tx=0).stop 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 -- 172.21.15.22:0/1851841572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0102a60 msgr2=0x7f4df019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0102a60 0x7f4df019a3e0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4de0009230 tx=0x7f4de0004270 comp rx=0 tx=0).stop 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 -- 172.21.15.22:0/1851841572 shutdown_connections 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4dd80b65a0 0x7f4dd80b8ab0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4df0108cf0 0x7f4df019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4df01083a0 0x7f4df019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 --2- 172.21.15.22:0/1851841572 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4df0102a60 0x7f4df019a3e0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 -- 172.21.15.22:0/1851841572 >> 172.21.15.22:0/1851841572 conn(0x7f4df0079730 msgr2=0x7f4df0101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 -- 172.21.15.22:0/1851841572 shutdown_connections 2024-09-21T04:01:44.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:44.678+0000 7f4df6310640 1 -- 172.21.15.22:0/1851841572 wait complete. 2024-09-21T04:01:45.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:45 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1851841572' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:45.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:45 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1851841572' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:45.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:45 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1851841572' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:45.487 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:01:45.750 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:46.170 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:46 smithi022 ceph-mon[31015]: pgmap v353: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T04:01:46.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.262+0000 7f41fb787640 1 -- 172.21.15.22:0/1066268479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f4110220 msgr2=0x7f41f4112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.262+0000 7f41fb787640 1 --2- 172.21.15.22:0/1066268479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f4110220 0x7f41f4112640 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f41ec009ca0 tx=0x7f41ec02a950 comp rx=0 tx=0).stop 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.262+0000 7f41fb787640 1 -- 172.21.15.22:0/1066268479 shutdown_connections 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.262+0000 7f41fb787640 1 --2- 172.21.15.22:0/1066268479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f4110220 0x7f41f4112640 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.262+0000 7f41fb787640 1 --2- 172.21.15.22:0/1066268479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4102fc0 0x7f41f410fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.262+0000 7f41fb787640 1 --2- 172.21.15.22:0/1066268479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f4102670 0x7f41f4102a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.262+0000 7f41fb787640 1 -- 172.21.15.22:0/1066268479 >> 172.21.15.22:0/1066268479 conn(0x7f41f4079740 msgr2=0x7f41f4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.262+0000 7f41fb787640 1 -- 172.21.15.22:0/1066268479 shutdown_connections 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.262+0000 7f41fb787640 1 -- 172.21.15.22:0/1066268479 wait complete. 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41fb787640 1 Processor -- start 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41fb787640 1 -- start start 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41fb787640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f4102670 0x7f41f419c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41fb787640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4102fc0 0x7f41f419cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:46.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41fb787640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f4110220 0x7f41f41a1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41fb787640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f41f4115b40 con 0x7f41f4110220 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41fb787640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f41f41159c0 con 0x7f41f4102fc0 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41fb787640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f41f4115cc0 con 0x7f41f4102670 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41f9d24640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f4110220 0x7f41f41a1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41f9d24640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f4110220 0x7f41f41a1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41042/0 (socket says 172.21.15.22:41042) 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41f9d24640 1 -- 172.21.15.22:0/188057492 learned_addr learned my addr 172.21.15.22:0/188057492 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41f8d22640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4102fc0 0x7f41f419cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.263+0000 7f41f9523640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f4102670 0x7f41f419c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41f9d24640 1 -- 172.21.15.22:0/188057492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f4102670 msgr2=0x7f41f419c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41f9d24640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f4102670 0x7f41f419c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41f9d24640 1 -- 172.21.15.22:0/188057492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4102fc0 msgr2=0x7f41f419cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41f9d24640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4102fc0 0x7f41f419cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41f9d24640 1 -- 172.21.15.22:0/188057492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41f41a24e0 con 0x7f41f4110220 2024-09-21T04:01:46.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41f9523640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f4102670 0x7f41f419c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41f9d24640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f4110220 0x7f41f41a1db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f41ec02ae70 tx=0x7f41ec003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41ea7fc640 1 -- 172.21.15.22:0/188057492 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ec034040 con 0x7f41f4110220 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41ea7fc640 1 -- 172.21.15.22:0/188057492 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f41ec030850 con 0x7f41f4110220 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41fb787640 1 -- 172.21.15.22:0/188057492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41f41a2770 con 0x7f41f4110220 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41ea7fc640 1 -- 172.21.15.22:0/188057492 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41ec004670 con 0x7f41f4110220 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.264+0000 7f41fb787640 1 -- 172.21.15.22:0/188057492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41f41a8f30 con 0x7f41f4110220 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.265+0000 7f41fb787640 1 -- 172.21.15.22:0/188057492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41f406c1c0 con 0x7f41f4110220 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.267+0000 7f41ea7fc640 1 -- 172.21.15.22:0/188057492 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f41ec037020 con 0x7f41f4110220 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.268+0000 7f41ea7fc640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f41e00b65a0 0x7f41e00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.268+0000 7f41f9523640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f41e00b65a0 0x7f41e00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.268+0000 7f41ea7fc640 1 -- 172.21.15.22:0/188057492 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f41ec1088c0 con 0x7f41f4110220 2024-09-21T04:01:46.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.268+0000 7f41f9523640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f41e00b65a0 0x7f41e00b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f41f00058c0 tx=0x7f41f0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:46.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.271+0000 7f41ea7fc640 1 -- 172.21.15.22:0/188057492 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f41ec0cecf0 con 0x7f41f4110220 2024-09-21T04:01:46.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:46 smithi073 ceph-mon[34443]: pgmap v353: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T04:01:46.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:46 smithi060 ceph-mon[33722]: pgmap v353: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s; 0 B/s, 1 keys/s, 0 objects/s recovering 2024-09-21T04:01:46.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.497+0000 7f41fb787640 1 -- 172.21.15.22:0/188057492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f41f419d6a0 con 0x7f41f4110220 2024-09-21T04:01:46.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.498+0000 7f41ea7fc640 1 -- 172.21.15.22:0/188057492 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f41ec0d30d0 con 0x7f41f4110220 2024-09-21T04:01:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:46.500 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-21T04:00:45:215178+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:00:45.215152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:01:46.500 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-21T04:01:46.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 -- 172.21.15.22:0/188057492 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f41e00b65a0 msgr2=0x7f41e00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:46.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f41e00b65a0 0x7f41e00b8ab0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f41f00058c0 tx=0x7f41f0005850 comp rx=0 tx=0).stop 2024-09-21T04:01:46.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 -- 172.21.15.22:0/188057492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f4110220 msgr2=0x7f41f41a1db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:46.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f4110220 0x7f41f41a1db0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f41ec02ae70 tx=0x7f41ec003f10 comp rx=0 tx=0).stop 2024-09-21T04:01:46.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 -- 172.21.15.22:0/188057492 shutdown_connections 2024-09-21T04:01:46.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f41e00b65a0 0x7f41e00b8ab0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:46.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f41f4110220 0x7f41f41a1db0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:46.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f41f4102fc0 0x7f41f419cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:46.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 --2- 172.21.15.22:0/188057492 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f41f4102670 0x7f41f419c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:46.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 -- 172.21.15.22:0/188057492 >> 172.21.15.22:0/188057492 conn(0x7f41f4079740 msgr2=0x7f41f4108cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:46.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 -- 172.21.15.22:0/188057492 shutdown_connections 2024-09-21T04:01:46.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:46.500+0000 7f41fb787640 1 -- 172.21.15.22:0/188057492 wait complete. 2024-09-21T04:01:47.168 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:47 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/188057492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:47.200 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:01:47.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:47 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/188057492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:47.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:47 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/188057492' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:47.463 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.970+0000 7fa47ef46640 1 -- 172.21.15.22:0/3736159318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa478108d20 msgr2=0x7fa47810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.970+0000 7fa47ef46640 1 --2- 172.21.15.22:0/3736159318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa478108d20 0x7fa47810f550 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fa470009ca0 tx=0x7fa47002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.970+0000 7fa47ef46640 1 -- 172.21.15.22:0/3736159318 shutdown_connections 2024-09-21T04:01:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.970+0000 7fa47ef46640 1 --2- 172.21.15.22:0/3736159318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa478108d20 0x7fa47810f550 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.970+0000 7fa47ef46640 1 --2- 172.21.15.22:0/3736159318 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa4781083d0 0x7fa4781087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.970+0000 7fa47ef46640 1 --2- 172.21.15.22:0/3736159318 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa478102ae0 0x7fa478102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.970+0000 7fa47ef46640 1 -- 172.21.15.22:0/3736159318 >> 172.21.15.22:0/3736159318 conn(0x7fa478079760 msgr2=0x7fa478079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:47.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.970+0000 7fa47ef46640 1 -- 172.21.15.22:0/3736159318 shutdown_connections 2024-09-21T04:01:47.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.970+0000 7fa47ef46640 1 -- 172.21.15.22:0/3736159318 wait complete. 2024-09-21T04:01:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47ef46640 1 Processor -- start 2024-09-21T04:01:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47ef46640 1 -- start start 2024-09-21T04:01:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47ef46640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa478102ae0 0x7fa47819c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:47.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47ef46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4781083d0 0x7fa47819cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47ef46640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa478108d20 0x7fa4781a1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47ef46640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa4781128f0 con 0x7fa478102ae0 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47ef46640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa478112770 con 0x7fa478108d20 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47ef46640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa478112a70 con 0x7fa4781083d0 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47cce2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa478102ae0 0x7fa47819c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47cce2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa478102ae0 0x7fa47819c640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41052/0 (socket says 172.21.15.22:41052) 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.971+0000 7fa47cce2640 1 -- 172.21.15.22:0/3732659365 learned_addr learned my addr 172.21.15.22:0/3732659365 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa47d4e3640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa478108d20 0x7fa4781a1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa477fff640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4781083d0 0x7fa47819cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa47cce2640 1 -- 172.21.15.22:0/3732659365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4781083d0 msgr2=0x7fa47819cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa47cce2640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4781083d0 0x7fa47819cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa47cce2640 1 -- 172.21.15.22:0/3732659365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa478108d20 msgr2=0x7fa4781a1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:47.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa47cce2640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa478108d20 0x7fa4781a1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa47cce2640 1 -- 172.21.15.22:0/3732659365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4781a25b0 con 0x7fa478102ae0 2024-09-21T04:01:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa477fff640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4781083d0 0x7fa47819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa47cce2640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa478102ae0 0x7fa47819c640 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa46800b4a0 tx=0x7fa46800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa475ffb640 1 -- 172.21.15.22:0/3732659365 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468014070 con 0x7fa478102ae0 2024-09-21T04:01:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa47ef46640 1 -- 172.21.15.22:0/3732659365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4781a28a0 con 0x7fa478102ae0 2024-09-21T04:01:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa475ffb640 1 -- 172.21.15.22:0/3732659365 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa468010aa0 con 0x7fa478102ae0 2024-09-21T04:01:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.972+0000 7fa475ffb640 1 -- 172.21.15.22:0/3732659365 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa468017b70 con 0x7fa478102ae0 2024-09-21T04:01:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.973+0000 7fa47ef46640 1 -- 172.21.15.22:0/3732659365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4781a9000 con 0x7fa478102ae0 2024-09-21T04:01:47.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.974+0000 7fa47ef46640 1 -- 172.21.15.22:0/3732659365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa478103d10 con 0x7fa478102ae0 2024-09-21T04:01:47.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.975+0000 7fa475ffb640 1 -- 172.21.15.22:0/3732659365 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fa468017070 con 0x7fa478102ae0 2024-09-21T04:01:47.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.976+0000 7fa475ffb640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa4600b65a0 0x7fa4600b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:47.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.976+0000 7fa475ffb640 1 -- 172.21.15.22:0/3732659365 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa4680e6e60 con 0x7fa478102ae0 2024-09-21T04:01:47.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.976+0000 7fa477fff640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa4600b65a0 0x7fa4600b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:47.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.976+0000 7fa477fff640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa4600b65a0 0x7fa4600b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0058c0 tx=0x7fa46c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:47.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:47.980+0000 7fa475ffb640 1 -- 172.21.15.22:0/3732659365 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa4680ad1d0 con 0x7fa478102ae0 2024-09-21T04:01:48.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.173+0000 7fa47ef46640 1 -- 172.21.15.22:0/3732659365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa47819d770 con 0x7fa478102ae0 2024-09-21T04:01:48.174 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:48 smithi022 ceph-mon[31015]: pgmap v354: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T04:01:48.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.175+0000 7fa475ffb640 1 -- 172.21.15.22:0/3732659365 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24751 (secure 0 0 0) 0x7fa47819d770 con 0x7fa478102ae0 2024-09-21T04:01:48.177 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:48.177 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":85,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:01:31.025432+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11},{"from":5,"to":6}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 -- 172.21.15.22:0/3732659365 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa4600b65a0 msgr2=0x7fa4600b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa4600b65a0 0x7fa4600b8ab0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa46c0058c0 tx=0x7fa46c005850 comp rx=0 tx=0).stop 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 -- 172.21.15.22:0/3732659365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa478102ae0 msgr2=0x7fa47819c640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa478102ae0 0x7fa47819c640 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fa46800b4a0 tx=0x7fa46800b960 comp rx=0 tx=0).stop 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 -- 172.21.15.22:0/3732659365 shutdown_connections 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa4600b65a0 0x7fa4600b8ab0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa4781083d0 0x7fa47819cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa478108d20 0x7fa4781a1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 --2- 172.21.15.22:0/3732659365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa478102ae0 0x7fa47819c640 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 -- 172.21.15.22:0/3732659365 >> 172.21.15.22:0/3732659365 conn(0x7fa478079760 msgr2=0x7fa478105540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:48.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 -- 172.21.15.22:0/3732659365 shutdown_connections 2024-09-21T04:01:48.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:48.178+0000 7fa47ef46640 1 -- 172.21.15.22:0/3732659365 wait complete. 2024-09-21T04:01:48.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:48 smithi073 ceph-mon[34443]: pgmap v354: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T04:01:48.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:48 smithi060 ceph-mon[33722]: pgmap v354: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s; 0 B/s, 0 keys/s, 0 objects/s recovering 2024-09-21T04:01:48.962 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:01:49.226 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:49.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:49 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3732659365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:01:49.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:49 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3732659365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:01:49.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:49 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3732659365' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:01:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.722+0000 7f5ce8157640 1 -- 172.21.15.22:0/4165362073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce01094c0 msgr2=0x7f5ce01098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.722+0000 7f5ce8157640 1 --2- 172.21.15.22:0/4165362073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce01094c0 0x7f5ce01098d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0009900 tx=0x7f5cd002a410 comp rx=0 tx=0).stop 2024-09-21T04:01:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.722+0000 7f5ce8157640 1 -- 172.21.15.22:0/4165362073 shutdown_connections 2024-09-21T04:01:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.722+0000 7f5ce8157640 1 --2- 172.21.15.22:0/4165362073 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0109e10 0x7f5ce0110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:49.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.722+0000 7f5ce8157640 1 --2- 172.21.15.22:0/4165362073 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce01094c0 0x7f5ce01098d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:49.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.722+0000 7f5ce8157640 1 --2- 172.21.15.22:0/4165362073 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce0101fe0 0x7f5ce01023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:49.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.722+0000 7f5ce8157640 1 -- 172.21.15.22:0/4165362073 >> 172.21.15.22:0/4165362073 conn(0x7f5ce0077bc0 msgr2=0x7f5ce0078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:49.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.723+0000 7f5ce8157640 1 -- 172.21.15.22:0/4165362073 shutdown_connections 2024-09-21T04:01:49.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.723+0000 7f5ce8157640 1 -- 172.21.15.22:0/4165362073 wait complete. 2024-09-21T04:01:49.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce8157640 1 Processor -- start 2024-09-21T04:01:49.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce8157640 1 -- start start 2024-09-21T04:01:49.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce8157640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce0101fe0 0x7f5ce019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:49.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce8157640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce01094c0 0x7f5ce019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:49.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce8157640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0109e10 0x7f5ce019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce8157640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce0113930 con 0x7f5ce01094c0 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce8157640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce01137b0 con 0x7f5ce0109e10 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce8157640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5ce0113ab0 con 0x7f5ce0101fe0 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce56f2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce01094c0 0x7f5ce019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce56f2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce01094c0 0x7f5ce019aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41068/0 (socket says 172.21.15.22:41068) 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce56f2640 1 -- 172.21.15.22:0/441770090 learned_addr learned my addr 172.21.15.22:0/441770090 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.724+0000 7f5ce5ef3640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce0101fe0 0x7f5ce019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5ce66f4640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0109e10 0x7f5ce019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5ce56f2640 1 -- 172.21.15.22:0/441770090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce0101fe0 msgr2=0x7f5ce019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5ce56f2640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce0101fe0 0x7f5ce019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:49.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5ce56f2640 1 -- 172.21.15.22:0/441770090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0109e10 msgr2=0x7f5ce019fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:49.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5ce56f2640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0109e10 0x7f5ce019fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:49.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5ce56f2640 1 -- 172.21.15.22:0/441770090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ce01a03d0 con 0x7f5ce01094c0 2024-09-21T04:01:49.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5ce66f4640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0109e10 0x7f5ce019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:49.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5ce56f2640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce01094c0 0x7f5ce019aa00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0005940 tx=0x7f5cd00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:49.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5cd6ffd640 1 -- 172.21.15.22:0/441770090 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd003f030 con 0x7f5ce01094c0 2024-09-21T04:01:49.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5ce8157640 1 -- 172.21.15.22:0/441770090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ce01a0660 con 0x7f5ce01094c0 2024-09-21T04:01:49.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5cd6ffd640 1 -- 172.21.15.22:0/441770090 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5cd0003a80 con 0x7f5ce01094c0 2024-09-21T04:01:49.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5cd6ffd640 1 -- 172.21.15.22:0/441770090 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0035070 con 0x7f5ce01094c0 2024-09-21T04:01:49.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.725+0000 7f5ce8157640 1 -- 172.21.15.22:0/441770090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ce01a6e20 con 0x7f5ce01094c0 2024-09-21T04:01:49.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.727+0000 7f5ce8157640 1 -- 172.21.15.22:0/441770090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ce006b970 con 0x7f5ce01094c0 2024-09-21T04:01:49.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.728+0000 7f5cd6ffd640 1 -- 172.21.15.22:0/441770090 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f5cd0042030 con 0x7f5ce01094c0 2024-09-21T04:01:49.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.729+0000 7f5cd6ffd640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5ccc0b65a0 0x7f5ccc0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:49.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.729+0000 7f5ce5ef3640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5ccc0b65a0 0x7f5ccc0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:49.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.729+0000 7f5cd6ffd640 1 -- 172.21.15.22:0/441770090 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f5cd0108220 con 0x7f5ce01094c0 2024-09-21T04:01:49.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.730+0000 7f5ce5ef3640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5ccc0b65a0 0x7f5ccc0b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc005fd0 tx=0x7f5cdc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:49.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.732+0000 7f5cd6ffd640 1 -- 172.21.15.22:0/441770090 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5cd00ce530 con 0x7f5ce01094c0 2024-09-21T04:01:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.960+0000 7f5ce8157640 1 -- 172.21.15.22:0/441770090 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5ce010bc90 con 0x7f5ce01094c0 2024-09-21T04:01:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.961+0000 7f5cd6ffd640 1 -- 172.21.15.22:0/441770090 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f5cd00d2910 con 0x7f5ce01094c0 2024-09-21T04:01:49.963 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:01:49.963 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-21T04:00:45:215178+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:00:45.215152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:01:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-21T04:01:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.963+0000 7f5ce8157640 1 -- 172.21.15.22:0/441770090 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5ccc0b65a0 msgr2=0x7f5ccc0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.963+0000 7f5ce8157640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5ccc0b65a0 0x7f5ccc0b8ab0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc005fd0 tx=0x7f5cdc00b390 comp rx=0 tx=0).stop 2024-09-21T04:01:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.963+0000 7f5ce8157640 1 -- 172.21.15.22:0/441770090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce01094c0 msgr2=0x7f5ce019aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.963+0000 7f5ce8157640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce01094c0 0x7f5ce019aa00 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5cd0005940 tx=0x7f5cd00040e0 comp rx=0 tx=0).stop 2024-09-21T04:01:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.963+0000 7f5ce8157640 1 -- 172.21.15.22:0/441770090 shutdown_connections 2024-09-21T04:01:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.963+0000 7f5ce8157640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5ccc0b65a0 0x7f5ccc0b8ab0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.963+0000 7f5ce8157640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5ce0109e10 0x7f5ce019fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.963+0000 7f5ce8157640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5ce01094c0 0x7f5ce019aa00 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.963+0000 7f5ce8157640 1 --2- 172.21.15.22:0/441770090 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5ce0101fe0 0x7f5ce019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.963+0000 7f5ce8157640 1 -- 172.21.15.22:0/441770090 >> 172.21.15.22:0/441770090 conn(0x7f5ce0077bc0 msgr2=0x7f5ce0105590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.964+0000 7f5ce8157640 1 -- 172.21.15.22:0/441770090 shutdown_connections 2024-09-21T04:01:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:49.964+0000 7f5ce8157640 1 -- 172.21.15.22:0/441770090 wait complete. 2024-09-21T04:01:50.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:50 smithi022 ceph-mon[31015]: pgmap v355: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:01:50.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:50 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/441770090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:50.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:50 smithi073 ceph-mon[34443]: pgmap v355: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:01:50.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:50 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/441770090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:50.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:50 smithi060 ceph-mon[33722]: pgmap v355: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:01:50.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:50 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/441770090' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:01:50.771 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T04:00:04.669771+0000', 'modified': '2024-09-21T04:00:45.215152+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24647, 'mds_1': 24634, 'mds_2': 24617, 'mds_3': 24616, 'mds_4': 24610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14775': {'gid': 14775, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6839/61235994', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 61235994}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 61235994}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14787': {'gid': 14787, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6841/2021253625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6840', 'nonce': 2021253625}, {'type': 'v1', 'addr': '172.21.15.22:6841', 'nonce': 2021253625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24566': {'gid': 24566, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6833/2373240323', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6832', 'nonce': 2373240323}, {'type': 'v1', 'addr': '172.21.15.60:6833', 'nonce': 2373240323}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24571': {'gid': 24571, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.73:6833/1353426950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 1353426950}, {'type': 'v1', 'addr': '172.21.15.73:6833', 'nonce': 1353426950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24596': {'gid': 24596, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6835/2092262185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 2092262185}, {'type': 'v1', 'addr': '172.21.15.60:6835', 'nonce': 2092262185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.73:6835/4117291653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 4117291653}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 4117291653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24616': {'gid': 24616, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.73:6837/3229670499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 3229670499}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 3229670499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24617': {'gid': 24617, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.60:6837/3007306472', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 3007306472}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 3007306472}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24634': {'gid': 24634, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.73:6839/1883983314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6838', 'nonce': 1883983314}, {'type': 'v1', 'addr': '172.21.15.73:6839', 'nonce': 1883983314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24647': {'gid': 24647, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.60:6839/3182487250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 3182487250}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 3182487250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24647, 'qdb_cluster': [24647, 24634, 24617, 24616, 24610]} 2024-09-21T04:01:50.771 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T04:01:50.771 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T04:01:51.031 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:51.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.576+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2619635593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8b810de70 msgr2=0x7ff8b8110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:51.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.576+0000 7ff8bccd8640 1 --2- 172.21.15.22:0/2619635593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8b810de70 0x7ff8b8110340 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0009ca0 tx=0x7ff8b002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.576+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2619635593 shutdown_connections 2024-09-21T04:01:51.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.576+0000 7ff8bccd8640 1 --2- 172.21.15.22:0/2619635593 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8b81052a0 0x7ff8b810d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.576+0000 7ff8bccd8640 1 --2- 172.21.15.22:0/2619635593 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8b810de70 0x7ff8b8110340 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.576+0000 7ff8bccd8640 1 --2- 172.21.15.22:0/2619635593 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b81048c0 0x7ff8b8104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.576+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2619635593 >> 172.21.15.22:0/2619635593 conn(0x7ff8b8079760 msgr2=0x7ff8b8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:51.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.576+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2619635593 shutdown_connections 2024-09-21T04:01:51.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.576+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2619635593 wait complete. 2024-09-21T04:01:51.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8bccd8640 1 Processor -- start 2024-09-21T04:01:51.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8bccd8640 1 -- start start 2024-09-21T04:01:51.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8bccd8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8b81048c0 0x7ff8b819a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8bccd8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8b81052a0 0x7ff8b819a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8bccd8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b810de70 0x7ff8b819fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8bccd8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b81139d0 con 0x7ff8b81048c0 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8bccd8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b8113850 con 0x7ff8b810de70 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8bccd8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff8b8113b50 con 0x7ff8b81052a0 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8b659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8b81048c0 0x7ff8b819a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8b659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8b81048c0 0x7ff8b819a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37654/0 (socket says 172.21.15.22:37654) 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8b659c640 1 -- 172.21.15.22:0/2084526712 learned_addr learned my addr 172.21.15.22:0/2084526712 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8b6d9d640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b810de70 0x7ff8b819fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8b81052a0 0x7ff8b819a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8b659c640 1 -- 172.21.15.22:0/2084526712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8b81052a0 msgr2=0x7ff8b819a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.577+0000 7ff8b659c640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8b81052a0 0x7ff8b819a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.578+0000 7ff8b659c640 1 -- 172.21.15.22:0/2084526712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b810de70 msgr2=0x7ff8b819fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.578+0000 7ff8b659c640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b810de70 0x7ff8b819fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.578+0000 7ff8b659c640 1 -- 172.21.15.22:0/2084526712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8b81a0330 con 0x7ff8b81048c0 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.578+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8b81052a0 0x7ff8b819a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.578+0000 7ff8b659c640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8b81048c0 0x7ff8b819a3c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800c970 tx=0x7ff8a800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.578+0000 7ff8a77fe640 1 -- 172.21.15.22:0/2084526712 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a8004220 con 0x7ff8b81048c0 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.578+0000 7ff8a77fe640 1 -- 172.21.15.22:0/2084526712 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8a8007e40 con 0x7ff8b81048c0 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.578+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2084526712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8b81a0620 con 0x7ff8b81048c0 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.578+0000 7ff8a77fe640 1 -- 172.21.15.22:0/2084526712 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a800f450 con 0x7ff8b81048c0 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.578+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2084526712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8b81a6d80 con 0x7ff8b81048c0 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.581+0000 7ff8c324c740 1 Processor -- start 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.581+0000 7ff8c324c740 1 -- start start 2024-09-21T04:01:51.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee75cf60 0x5620eeb02f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee7340a0 0x5620eeb03440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 0x5620eeb03980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8c324c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620eea7ac10 con 0x5620ee7340a0 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8c324c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5620eea6a040 con 0x5620ee73c280 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8c324c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5620eea6de50 con 0x5620ee75cf60 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8a77fe640 1 -- 172.21.15.22:0/2084526712 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7ff8a800f5f0 con 0x7ff8b81048c0 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8b5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 0x5620eeb03980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8b6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee75cf60 0x5620eeb02f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8b6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee75cf60 0x5620eeb02f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:42778/0 (socket says 172.21.15.22:42778) 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8b5d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 0x5620eeb03980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:42664/0 (socket says 172.21.15.22:42664) 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8b6d9d640 1 -- 172.21.15.22:0/1041705359 learned_addr learned my addr 172.21.15.22:0/1041705359 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:51.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8b659c640 1 --2- 172.21.15.22:0/1041705359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee7340a0 0x5620eeb03440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8b5d9b640 1 -- 172.21.15.22:0/1041705359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee75cf60 msgr2=0x5620eeb02f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/1041705359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee75cf60 0x5620eeb02f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.582+0000 7ff8b5d9b640 1 -- 172.21.15.22:0/1041705359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee7340a0 msgr2=0x5620eeb03440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.583+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/1041705359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee7340a0 0x5620eeb03440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.583+0000 7ff8b5d9b640 1 -- 172.21.15.22:0/1041705359 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620ee7c8540 con 0x5620ee73c280 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.583+0000 7ff8b6d9d640 1 --2- 172.21.15.22:0/1041705359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee75cf60 0x5620eeb02f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.583+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/1041705359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 0x5620eeb03980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff8b810fc30 tx=0x7ff8ac00b830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc07a205622107dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.583+0000 7ff8a77fe640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8a00b65a0 0x7ff8a00b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.583+0000 7ff8a4ff9640 1 -- 172.21.15.22:0/1041705359 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac01f070 con 0x5620ee73c280 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.583+0000 7ff8b6d9d640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8a00b65a0 0x7ff8a00b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.583+0000 7ff8a4ff9640 1 -- 172.21.15.22:0/1041705359 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8ac01a8a0 con 0x5620ee73c280 2024-09-21T04:01:51.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.583+0000 7ff8a4ff9640 1 -- 172.21.15.22:0/1041705359 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8ac019800 con 0x5620ee73c280 2024-09-21T04:01:51.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.583+0000 7ff8a77fe640 1 -- 172.21.15.22:0/2084526712 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff8a80e7560 con 0x7ff8b81048c0 2024-09-21T04:01:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.584+0000 7ff8c324c740 1 -- 172.21.15.22:0/1041705359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 msgr2=0x5620eeb03980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.584+0000 7ff8b6d9d640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8a00b65a0 0x7ff8a00b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8b002ade0 tx=0x7ff8b0009800 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.584+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1041705359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 0x5620eeb03980 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff8b810fc30 tx=0x7ff8ac00b830 comp rx=0 tx=0).stop 2024-09-21T04:01:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.584+0000 7ff8c324c740 1 -- 172.21.15.22:0/1041705359 shutdown_connections 2024-09-21T04:01:51.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.584+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1041705359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 0x5620eeb03980 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.584+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1041705359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee7340a0 0x5620eeb03440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.584+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1041705359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee75cf60 0x5620eeb02f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.584+0000 7ff8c324c740 1 -- 172.21.15.22:0/1041705359 >> 172.21.15.22:0/1041705359 conn(0x5620ee751350 msgr2=0x5620eeb00df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.584+0000 7ff8c324c740 1 -- 172.21.15.22:0/1041705359 shutdown_connections 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.584+0000 7ff8c324c740 1 -- 172.21.15.22:0/1041705359 wait complete. 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8c324c740 1 -- start start 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8c324c740 1 Processor -- start 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 0x5620eeb0ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee73c280 0x5620eeb0ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee75cf60 0x5620eeb1aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8c324c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620ee8cb5f0 con 0x5620ee73c280 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8c324c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5620eea05010 con 0x5620ee75cf60 2024-09-21T04:01:51.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8c324c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5620eeb116e0 con 0x5620ee7340a0 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8c324c740 10 client.0 _ll_register_callbacks cb 0x5620eea64340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8b5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee73c280 0x5620eeb0ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8b659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 0x5620eeb0ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8b6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee75cf60 0x5620eeb1aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8b5d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee73c280 0x5620eeb0ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37680/0 (socket says 172.21.15.22:37680) 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.585+0000 7ff8b5d9b640 1 -- 172.21.15.22:0/1425676681 learned_addr learned my addr 172.21.15.22:0/1425676681 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff8b659c640 1 -- 172.21.15.22:0/1425676681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee75cf60 msgr2=0x5620eeb1aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff8b659c640 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee75cf60 0x5620eeb1aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff8b659c640 1 -- 172.21.15.22:0/1425676681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee73c280 msgr2=0x5620eeb0ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff8b659c640 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee73c280 0x5620eeb0ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff8b659c640 1 -- 172.21.15.22:0/1425676681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620eea32a00 con 0x5620ee7340a0 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff8b659c640 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 0x5620eeb0ea50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80e4b50 tx=0x7ff8a80eaca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7fb45d72361eea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:51.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff89dffb640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff89dffb640 1 -- 172.21.15.22:0/1425676681 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a801d040 con 0x5620ee7340a0 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff8c324c740 1 -- 172.21.15.22:0/1425676681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8ac01a8a0 con 0x5620ee7340a0 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff89dffb640 1 -- 172.21.15.22:0/1425676681 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff8a8003610 con 0x5620ee7340a0 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff89dffb640 1 -- 172.21.15.22:0/1425676681 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff8a80acfa0 con 0x5620ee7340a0 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff8c324c740 10 client.24949 fetch_fsmap learned FSMap version 28 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.586+0000 7ff8c324c740 1 -- 172.21.15.22:0/1425676681 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620eeb1d700 con 0x5620ee7340a0 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.587+0000 7ff89dffb640 1 -- 172.21.15.22:0/1425676681 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8ac01a8a0 con 0x5620ee7340a0 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.587+0000 7ff89dffb640 1 -- 172.21.15.22:0/1425676681 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff8a80e9b30 con 0x5620ee7340a0 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.587+0000 7ff8c324c740 10 client.24949 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.587+0000 7ff8c324c740 10 client.24949 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.587+0000 7ff8c324c740 20 client.24949 populate_metadata read hostname 'smithi022' 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.587+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x5620ee71b8e0 0x5620eeb210e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.587+0000 7ff8c324c740 4 client.24949 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.587+0000 7ff8c324c740 1 -- 172.21.15.22:0/1425676681 --> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5620eea7cb60 con 0x5620ee71b8e0 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.587+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x5620ee71b8e0 0x5620eeb210e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.588+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x5620ee71b8e0 0x5620eeb210e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4df21bd96c3ffed server_cookie=c5fd019432f48c5b in_seq=0 out_seq=0 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.588+0000 7ff89dffb640 10 client.24949 ms_handle_connect on v2:172.21.15.73:6834/4117291653 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff89dffb640 1 -- 172.21.15.22:0/1425676681 <== mds.4 v2:172.21.15.73:6834/4117291653 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5620eea7cb60 con 0x5620ee71b8e0 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff89dffb640 10 client.24949 handle_command_reply: tid=0 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 client.24949 shutdown 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 -- 172.21.15.22:0/1425676681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 msgr2=0x5620eeb0ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 0x5620eeb0ea50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80e4b50 tx=0x7ff8a80eaca0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 -- 172.21.15.22:0/1425676681 shutdown_connections 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x5620ee71b8e0 0x5620eeb210e0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee75cf60 0x5620eeb1aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee73c280 0x5620eeb0ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff89dffb640 0 client.24949 ms_handle_reset on v2:172.21.15.73:6834/4117291653 2024-09-21T04:01:51.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1425676681 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 0x5620eeb0ea50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 -- 172.21.15.22:0/1425676681 >> 172.21.15.22:0/1425676681 conn(0x5620ee751350 msgr2=0x5620eeb06090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:51.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 -- 172.21.15.22:0/1425676681 shutdown_connections 2024-09-21T04:01:51.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 1 -- 172.21.15.22:0/1425676681 wait complete. 2024-09-21T04:01:51.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.589+0000 7ff8c324c740 20 client.24949 trim_cache size 0 max 16384 2024-09-21T04:01:51.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.607+0000 7ff8c324c740 1 Processor -- start 2024-09-21T04:01:51.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.607+0000 7ff8c324c740 1 -- start start 2024-09-21T04:01:51.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb09020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee7340a0 0x5620eeb1a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee73c280 0x5620eeb1aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8c324c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620eeb1f420 con 0x5620ee71b8e0 2024-09-21T04:01:51.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8c324c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5620eeb1faf0 con 0x5620ee7340a0 2024-09-21T04:01:51.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8c324c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5620eeb201c0 con 0x5620ee73c280 2024-09-21T04:01:51.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb09020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb09020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37692/0 (socket says 172.21.15.22:37692) 2024-09-21T04:01:51.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b659c640 1 -- 172.21.15.22:0/1248315207 learned_addr learned my addr 172.21.15.22:0/1248315207 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:51.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/1248315207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee7340a0 0x5620eeb1a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b6d9d640 1 --2- 172.21.15.22:0/1248315207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee73c280 0x5620eeb1aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b659c640 1 -- 172.21.15.22:0/1248315207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee73c280 msgr2=0x5620eeb1aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b659c640 1 --2- 172.21.15.22:0/1248315207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee73c280 0x5620eeb1aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b659c640 1 -- 172.21.15.22:0/1248315207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee7340a0 msgr2=0x5620eeb1a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b659c640 1 --2- 172.21.15.22:0/1248315207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee7340a0 0x5620eeb1a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b659c640 1 -- 172.21.15.22:0/1248315207 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5620eeb04db0 con 0x5620ee71b8e0 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.608+0000 7ff8b659c640 1 --2- 172.21.15.22:0/1248315207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb09020 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800afd0 tx=0x7ff8a80076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81b469ddd055431d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.609+0000 7ff89ffff640 1 -- 172.21.15.22:0/1248315207 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80ac940 con 0x5620ee71b8e0 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.609+0000 7ff89ffff640 1 -- 172.21.15.22:0/1248315207 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8a8003e70 con 0x5620ee71b8e0 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.609+0000 7ff89ffff640 1 -- 172.21.15.22:0/1248315207 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a80acb20 con 0x5620ee71b8e0 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.609+0000 7ff8c324c740 1 -- 172.21.15.22:0/1248315207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 msgr2=0x5620eeb09020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.609+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1248315207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb09020 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800afd0 tx=0x7ff8a80076c0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 -- 172.21.15.22:0/1248315207 shutdown_connections 2024-09-21T04:01:51.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1248315207 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee73c280 0x5620eeb1aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1248315207 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee7340a0 0x5620eeb1a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1248315207 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb09020 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 -- 172.21.15.22:0/1248315207 >> 172.21.15.22:0/1248315207 conn(0x5620ee751350 msgr2=0x5620eeafbad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 -- 172.21.15.22:0/1248315207 shutdown_connections 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 -- 172.21.15.22:0/1248315207 wait complete. 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 -- start start 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 Processor -- start 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb29850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 0x5620eeb22d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 0x5620eeb23290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5620eeb20f60 con 0x5620ee71b8e0 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5620eeb20890 con 0x5620ee73c280 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5620eeb21630 con 0x5620ee7340a0 2024-09-21T04:01:51.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.610+0000 7ff8c324c740 10 client.0 _ll_register_callbacks cb 0x7ff8a80eada0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8b659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb29850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8b659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb29850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37704/0 (socket says 172.21.15.22:37704) 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8b659c640 1 -- 172.21.15.22:0/1353218313 learned_addr learned my addr 172.21.15.22:0/1353218313 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 0x5620eeb22d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8b659c640 1 -- 172.21.15.22:0/1353218313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 msgr2=0x5620eeb22d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8b659c640 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 0x5620eeb22d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8b659c640 1 -- 172.21.15.22:0/1353218313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 msgr2=0x5620eeb23290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8b659c640 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 0x5620eeb23290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8b659c640 1 -- 172.21.15.22:0/1353218313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5620eeb09560 con 0x5620ee71b8e0 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8b659c640 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb29850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80e50d0 tx=0x7ff8a80b6d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac8bb1315c388dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff89dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff89dffb640 1 -- 172.21.15.22:0/1353218313 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8a801d070 con 0x5620ee71b8e0 2024-09-21T04:01:51.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff89dffb640 1 -- 172.21.15.22:0/1353218313 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff8a80ac630 con 0x5620ee71b8e0 2024-09-21T04:01:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8c324c740 1 -- 172.21.15.22:0/1353218313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff8a8003e70 con 0x5620ee71b8e0 2024-09-21T04:01:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff89dffb640 1 -- 172.21.15.22:0/1353218313 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7ff8a805ae60 con 0x5620ee71b8e0 2024-09-21T04:01:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8c324c740 10 client.15255 fetch_fsmap learned FSMap version 28 2024-09-21T04:01:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.611+0000 7ff8c324c740 1 -- 172.21.15.22:0/1353218313 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5620eeb28ef0 con 0x5620ee71b8e0 2024-09-21T04:01:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.612+0000 7ff89dffb640 1 -- 172.21.15.22:0/1353218313 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff8a8003e70 con 0x5620ee71b8e0 2024-09-21T04:01:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.612+0000 7ff89dffb640 1 -- 172.21.15.22:0/1353218313 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7ff8a80abea0 con 0x5620ee71b8e0 2024-09-21T04:01:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.612+0000 7ff8c324c740 10 client.15255 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:01:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.612+0000 7ff8c324c740 10 client.15255 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T04:01:51.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.612+0000 7ff8c324c740 20 client.15255 populate_metadata read hostname 'smithi022' 2024-09-21T04:01:51.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.612+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x5620ee75cf60 0x5620eeb8f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:51.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.612+0000 7ff8c324c740 4 client.15255 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:01:51.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.612+0000 7ff8c324c740 1 -- 172.21.15.22:0/1353218313 --> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] -- command(tid 0: {"prefix": "status"}) -- 0x5620eea78610 con 0x5620ee75cf60 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.612+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x5620ee75cf60 0x5620eeb8f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff89dffb640 10 client.15255 ms_handle_connect on v2:172.21.15.73:6834/4117291653 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8b5d9b640 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x5620ee75cf60 0x5620eeb8f480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=ea6462c89f94ea05 server_cookie=4ba9abfdb20fc3fc in_seq=0 out_seq=0 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff89dffb640 1 -- 172.21.15.22:0/1353218313 <== mds.4 v2:172.21.15.73:6834/4117291653 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5620eea78610 con 0x5620ee75cf60 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff89dffb640 10 client.15255 handle_command_reply: tid=0 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 client.15255 shutdown 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 -- 172.21.15.22:0/1353218313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 msgr2=0x5620eeb29850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb29850 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80e50d0 tx=0x7ff8a80b6d50 comp rx=0 tx=0).stop 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 -- 172.21.15.22:0/1353218313 shutdown_connections 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x5620ee75cf60 0x5620eeb8f480 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5620ee7340a0 0x5620eeb22d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5620ee73c280 0x5620eeb23290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 --2- 172.21.15.22:0/1353218313 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5620ee71b8e0 0x5620eeb29850 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff89dffb640 0 client.15255 ms_handle_reset on v2:172.21.15.73:6834/4117291653 2024-09-21T04:01:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 -- 172.21.15.22:0/1353218313 >> 172.21.15.22:0/1353218313 conn(0x5620ee751350 msgr2=0x5620eeb0ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 -- 172.21.15.22:0/1353218313 shutdown_connections 2024-09-21T04:01:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 1 -- 172.21.15.22:0/1353218313 wait complete. 2024-09-21T04:01:51.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.613+0000 7ff8c324c740 20 client.15255 trim_cache size 0 max 16384 2024-09-21T04:01:51.620 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:01:51.620 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:01:51.620 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 4, 2024-09-21T04:01:51.621 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24610, 2024-09-21T04:01:51.621 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:01:51.621 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:01:51.621 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:01:51.621 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 67.403558840000002, 2024-09-21T04:01:51.621 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-21T04:01:51.621 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:01:51.621 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T04:01:51.621 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 134.987642991 2024-09-21T04:01:51.621 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:01:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2084526712 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8a00b65a0 msgr2=0x7ff8a00b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8a00b65a0 0x7ff8a00b8ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7ff8b002ade0 tx=0x7ff8b0009800 comp rx=0 tx=0).stop 2024-09-21T04:01:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2084526712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8b81048c0 msgr2=0x7ff8b819a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8b81048c0 0x7ff8b819a3c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7ff8a800c970 tx=0x7ff8a800ce30 comp rx=0 tx=0).stop 2024-09-21T04:01:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2084526712 shutdown_connections 2024-09-21T04:01:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff8a00b65a0 0x7ff8a00b8ab0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff8b81052a0 0x7ff8b819a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff8b810de70 0x7ff8b819fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 --2- 172.21.15.22:0/2084526712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8b81048c0 0x7ff8b819a3c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:51.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2084526712 >> 172.21.15.22:0/2084526712 conn(0x7ff8b8079760 msgr2=0x7ff8b81079c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:51.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2084526712 shutdown_connections 2024-09-21T04:01:51.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:51.614+0000 7ff8bccd8640 1 -- 172.21.15.22:0/2084526712 wait complete. 2024-09-21T04:01:52.274 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:52 smithi022 ceph-mon[31015]: pgmap v356: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T04:01:52.304 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T04:01:52.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:52 smithi073 ceph-mon[34443]: pgmap v356: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T04:01:52.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:52 smithi060 ceph-mon[33722]: pgmap v356: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T04:01:52.562 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.079+0000 7f6d39ca3640 1 -- 172.21.15.22:0/185603608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d34103b60 msgr2=0x7f6d34103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:53.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.079+0000 7f6d39ca3640 1 --2- 172.21.15.22:0/185603608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d34103b60 0x7f6d34103f70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f6d24009ca0 tx=0x7f6d2402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.080+0000 7f6d39ca3640 1 -- 172.21.15.22:0/185603608 shutdown_connections 2024-09-21T04:01:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.080+0000 7f6d39ca3640 1 --2- 172.21.15.22:0/185603608 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d34109df0 0x7f6d34110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.080+0000 7f6d39ca3640 1 --2- 172.21.15.22:0/185603608 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d341094a0 0x7f6d341098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.080+0000 7f6d39ca3640 1 --2- 172.21.15.22:0/185603608 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d34103b60 0x7f6d34103f70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.080+0000 7f6d39ca3640 1 -- 172.21.15.22:0/185603608 >> 172.21.15.22:0/185603608 conn(0x7f6d3407b850 msgr2=0x7f6d3407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.080+0000 7f6d39ca3640 1 -- 172.21.15.22:0/185603608 shutdown_connections 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.080+0000 7f6d39ca3640 1 -- 172.21.15.22:0/185603608 wait complete. 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.080+0000 7f6d39ca3640 1 Processor -- start 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.080+0000 7f6d39ca3640 1 -- start start 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d39ca3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d34103b60 0x7f6d3419a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d39ca3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d341094a0 0x7f6d3419aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d39ca3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d34109df0 0x7f6d3419fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d39ca3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6d34113a10 con 0x7f6d34103b60 2024-09-21T04:01:53.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d39ca3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6d34113890 con 0x7f6d34109df0 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d39ca3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6d34113b90 con 0x7f6d341094a0 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d34103b60 0x7f6d3419a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d337fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d34103b60 0x7f6d3419a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37724/0 (socket says 172.21.15.22:37724) 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d337fe640 1 -- 172.21.15.22:0/2773019372 learned_addr learned my addr 172.21.15.22:0/2773019372 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d33fff640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d34109df0 0x7f6d3419fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d341094a0 0x7f6d3419aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d337fe640 1 -- 172.21.15.22:0/2773019372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d341094a0 msgr2=0x7f6d3419aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d337fe640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d341094a0 0x7f6d3419aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d337fe640 1 -- 172.21.15.22:0/2773019372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d34109df0 msgr2=0x7f6d3419fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d337fe640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d34109df0 0x7f6d3419fca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d337fe640 1 -- 172.21.15.22:0/2773019372 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d341a0310 con 0x7f6d34103b60 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d341094a0 0x7f6d3419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:53.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d33fff640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d34109df0 0x7f6d3419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.081+0000 7f6d337fe640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d34103b60 0x7f6d3419a460 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6d24006010 tx=0x7f6d24032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.082+0000 7f6d30ff9640 1 -- 172.21.15.22:0/2773019372 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24004040 con 0x7f6d34103b60 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.082+0000 7f6d30ff9640 1 -- 172.21.15.22:0/2773019372 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d24004670 con 0x7f6d34103b60 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.082+0000 7f6d30ff9640 1 -- 172.21.15.22:0/2773019372 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d24030da0 con 0x7f6d34103b60 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.082+0000 7f6d39ca3640 1 -- 172.21.15.22:0/2773019372 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d341a05a0 con 0x7f6d34103b60 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.082+0000 7f6d39ca3640 1 -- 172.21.15.22:0/2773019372 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d341a0a90 con 0x7f6d34103b60 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.084+0000 7f6d30ff9640 1 -- 172.21.15.22:0/2773019372 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f6d240305c0 con 0x7f6d34103b60 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.084+0000 7f6d40217740 1 Processor -- start 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d40217740 1 -- start start 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d40217740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588761f60 0x557588b07f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d40217740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575887390a0 0x557588b08440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d40217740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557588741280 0x557588b08980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d40217740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557588a7fc10 con 0x557588761f60 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d40217740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557588a6f040 con 0x557588741280 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d40217740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557588a72e50 con 0x5575887390a0 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588761f60 0x557588b07f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d33fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588761f60 0x557588b07f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37736/0 (socket says 172.21.15.22:37736) 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d33fff640 1 -- 172.21.15.22:0/2849413589 learned_addr learned my addr 172.21.15.22:0/2849413589 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/2849413589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557588741280 0x557588b08980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d337fe640 1 --2- 172.21.15.22:0/2849413589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575887390a0 0x557588b08440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d33fff640 1 -- 172.21.15.22:0/2849413589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575887390a0 msgr2=0x557588b08440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d33fff640 1 --2- 172.21.15.22:0/2849413589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575887390a0 0x557588b08440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d33fff640 1 -- 172.21.15.22:0/2849413589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557588741280 msgr2=0x557588b08980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d33fff640 1 --2- 172.21.15.22:0/2849413589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557588741280 0x557588b08980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d33fff640 1 -- 172.21.15.22:0/2849413589 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575887cd540 con 0x557588761f60 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.085+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/2849413589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557588741280 0x557588b08980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.086+0000 7f6d30ff9640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6d1c0b65d0 0x7f6d1c0b8ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.086+0000 7f6d33fff640 1 --2- 172.21.15.22:0/2849413589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588761f60 0x557588b07f00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c007800 tx=0x7f6d2c007cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89053011c31b31a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.086+0000 7f6d337fe640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6d1c0b65d0 0x7f6d1c0b8ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.086+0000 7f6d30ff9640 1 -- 172.21.15.22:0/2773019372 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6d24108e40 con 0x7f6d34103b60 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.086+0000 7f6d19ffb640 1 -- 172.21.15.22:0/2849413589 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c00d950 con 0x557588761f60 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.086+0000 7f6d19ffb640 1 -- 172.21.15.22:0/2849413589 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d2c018070 con 0x557588761f60 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.086+0000 7f6d19ffb640 1 -- 172.21.15.22:0/2849413589 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2c013d10 con 0x557588761f60 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.087+0000 7f6d40217740 1 -- 172.21.15.22:0/2849413589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588761f60 msgr2=0x557588b07f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:53.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.087+0000 7f6d40217740 1 --2- 172.21.15.22:0/2849413589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588761f60 0x557588b07f00 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c007800 tx=0x7f6d2c007cc0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.087+0000 7f6d337fe640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6d1c0b65d0 0x7f6d1c0b8ae0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557588b06b80 tx=0x7f6d24031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:53.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.087+0000 7f6d40217740 1 -- 172.21.15.22:0/2849413589 shutdown_connections 2024-09-21T04:01:53.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.087+0000 7f6d40217740 1 --2- 172.21.15.22:0/2849413589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5575887390a0 0x557588b08440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.087+0000 7f6d40217740 1 --2- 172.21.15.22:0/2849413589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557588741280 0x557588b08980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.087+0000 7f6d40217740 1 --2- 172.21.15.22:0/2849413589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588761f60 0x557588b07f00 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.087+0000 7f6d40217740 1 -- 172.21.15.22:0/2849413589 >> 172.21.15.22:0/2849413589 conn(0x557588756350 msgr2=0x557588b05df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:53.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.088+0000 7f6d40217740 1 -- 172.21.15.22:0/2849413589 shutdown_connections 2024-09-21T04:01:53.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.088+0000 7f6d40217740 1 -- 172.21.15.22:0/2849413589 wait complete. 2024-09-21T04:01:53.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.088+0000 7f6d40217740 1 -- start start 2024-09-21T04:01:53.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.088+0000 7f6d40217740 1 Processor -- start 2024-09-21T04:01:53.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d40217740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b139d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d40217740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b13f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d40217740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b1f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d40217740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5575888d05f0 con 0x557588741280 2024-09-21T04:01:53.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d40217740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557588a0a010 con 0x5575887390a0 2024-09-21T04:01:53.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d40217740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557588b166e0 con 0x557588761f60 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d40217740 10 client.0 _ll_register_callbacks cb 0x557588a69340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d32ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b13f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d32ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b13f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37748/0 (socket says 172.21.15.22:37748) 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d32ffd640 1 -- 172.21.15.22:0/1013698920 learned_addr learned my addr 172.21.15.22:0/1013698920 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d33fff640 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b139d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d33fff640 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b1f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d32ffd640 1 -- 172.21.15.22:0/1013698920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 msgr2=0x557588b1f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b1f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d32ffd640 1 -- 172.21.15.22:0/1013698920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 msgr2=0x557588b139d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b139d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d32ffd640 1 -- 172.21.15.22:0/1013698920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557588a37a00 con 0x557588741280 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d33fff640 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:53.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b13f10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800f6a0 tx=0x7f6d2800fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=884da7be234b0e47 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.089+0000 7f6d12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.091+0000 7f6d12ffd640 1 -- 172.21.15.22:0/1013698920 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28016070 con 0x557588741280 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.091+0000 7f6d12ffd640 1 -- 172.21.15.22:0/1013698920 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6d2800bb00 con 0x557588741280 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.091+0000 7f6d40217740 1 -- 172.21.15.22:0/1013698920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d2c018070 con 0x557588741280 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.091+0000 7f6d12ffd640 1 -- 172.21.15.22:0/1013698920 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d2800bd00 con 0x557588741280 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.091+0000 7f6d40217740 10 client.15267 fetch_fsmap learned FSMap version 28 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.091+0000 7f6d40217740 1 -- 172.21.15.22:0/1013698920 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557588b226b0 con 0x557588741280 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.092+0000 7f6d12ffd640 1 -- 172.21.15.22:0/1013698920 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d2c018070 con 0x557588741280 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.092+0000 7f6d12ffd640 1 -- 172.21.15.22:0/1013698920 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6d2801a410 con 0x557588741280 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.092+0000 7f6d40217740 10 client.15267 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.092+0000 7f6d40217740 10 client.15267 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.092+0000 7f6d40217740 20 client.15267 populate_metadata read hostname 'smithi022' 2024-09-21T04:01:53.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.092+0000 7f6d40217740 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x5575887208e0 0x557588b26180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.092+0000 7f6d40217740 4 client.15267 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.092+0000 7f6d40217740 1 -- 172.21.15.22:0/1013698920 --> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557588a81b60 con 0x5575887208e0 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.092+0000 7f6d33fff640 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x5575887208e0 0x557588b26180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.093+0000 7f6d33fff640 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x5575887208e0 0x557588b26180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e7b4b2e671cb69f0 server_cookie=af0971616dc26b6b in_seq=0 out_seq=0 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.093+0000 7f6d12ffd640 10 client.15267 ms_handle_connect on v2:172.21.15.73:6836/3229670499 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d12ffd640 1 -- 172.21.15.22:0/1013698920 <== mds.3 v2:172.21.15.73:6836/3229670499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557588a81b60 con 0x5575887208e0 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d12ffd640 10 client.15267 handle_command_reply: tid=0 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 client.15267 shutdown 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 -- 172.21.15.22:0/1013698920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 msgr2=0x557588b13f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b13f10 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800f6a0 tx=0x7f6d2800fb60 comp rx=0 tx=0).stop 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 -- 172.21.15.22:0/1013698920 shutdown_connections 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x5575887208e0 0x557588b26180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b1f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b13f10 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d12ffd640 0 client.15267 ms_handle_reset on v2:172.21.15.73:6836/3229670499 2024-09-21T04:01:53.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 --2- 172.21.15.22:0/1013698920 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b139d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 -- 172.21.15.22:0/1013698920 >> 172.21.15.22:0/1013698920 conn(0x557588756350 msgr2=0x557588b0b0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:53.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 -- 172.21.15.22:0/1013698920 shutdown_connections 2024-09-21T04:01:53.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 1 -- 172.21.15.22:0/1013698920 wait complete. 2024-09-21T04:01:53.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.094+0000 7f6d40217740 20 client.15267 trim_cache size 0 max 16384 2024-09-21T04:01:53.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.112+0000 7f6d40217740 1 Processor -- start 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d40217740 1 -- start start 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d40217740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b1f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d40217740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b1fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d40217740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b12050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d40217740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557588b244c0 con 0x557588741280 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d40217740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557588b24b90 con 0x5575887390a0 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d40217740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557588b25260 con 0x557588761f60 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d32ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b1fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d32ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b1fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37750/0 (socket says 172.21.15.22:37750) 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d32ffd640 1 -- 172.21.15.22:0/1120396505 learned_addr learned my addr 172.21.15.22:0/1120396505 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d33fff640 1 --2- 172.21.15.22:0/1120396505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b1f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d33fff640 1 --2- 172.21.15.22:0/1120396505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b12050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d32ffd640 1 -- 172.21.15.22:0/1120396505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 msgr2=0x557588b12050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/1120396505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b12050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d32ffd640 1 -- 172.21.15.22:0/1120396505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 msgr2=0x557588b1f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/1120396505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b1f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d32ffd640 1 -- 172.21.15.22:0/1120396505 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557588b0f060 con 0x557588741280 2024-09-21T04:01:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.113+0000 7f6d33fff640 1 --2- 172.21.15.22:0/1120396505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b1f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.114+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/1120396505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b1fe80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6d28001eb0 tx=0x7f6d2800df00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13e71f7b05eb609f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.114+0000 7f6d197fa640 1 -- 172.21.15.22:0/1120396505 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28016040 con 0x557588741280 2024-09-21T04:01:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.114+0000 7f6d197fa640 1 -- 172.21.15.22:0/1120396505 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d2801acf0 con 0x557588741280 2024-09-21T04:01:53.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.114+0000 7f6d197fa640 1 -- 172.21.15.22:0/1120396505 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d2801a670 con 0x557588741280 2024-09-21T04:01:53.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.114+0000 7f6d40217740 1 -- 172.21.15.22:0/1120396505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 msgr2=0x557588b1fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:53.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.114+0000 7f6d40217740 1 --2- 172.21.15.22:0/1120396505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b1fe80 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6d28001eb0 tx=0x7f6d2800df00 comp rx=0 tx=0).stop 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.115+0000 7f6d40217740 1 -- 172.21.15.22:0/1120396505 shutdown_connections 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.115+0000 7f6d40217740 1 --2- 172.21.15.22:0/1120396505 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b12050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.115+0000 7f6d40217740 1 --2- 172.21.15.22:0/1120396505 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b1fe80 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.115+0000 7f6d40217740 1 --2- 172.21.15.22:0/1120396505 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b1f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.115+0000 7f6d40217740 1 -- 172.21.15.22:0/1120396505 >> 172.21.15.22:0/1120396505 conn(0x557588756350 msgr2=0x557588b23b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.115+0000 7f6d40217740 1 -- 172.21.15.22:0/1120396505 shutdown_connections 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.115+0000 7f6d40217740 1 -- 172.21.15.22:0/1120396505 wait complete. 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.115+0000 7f6d40217740 1 -- start start 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.115+0000 7f6d40217740 1 Processor -- start 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d40217740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b2ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d40217740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b27f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d40217740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b28460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d40217740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557588b26000 con 0x557588741280 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d40217740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557588b25930 con 0x5575887390a0 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d40217740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557588b266d0 con 0x557588761f60 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d40217740 10 client.0 _ll_register_callbacks cb 0x7f6d2800d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d32ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b27f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d32ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b27f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37758/0 (socket says 172.21.15.22:37758) 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d32ffd640 1 -- 172.21.15.22:0/839899831 learned_addr learned my addr 172.21.15.22:0/839899831 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d33fff640 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b28460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d33fff640 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b2ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d32ffd640 1 -- 172.21.15.22:0/839899831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 msgr2=0x557588b28460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b28460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d32ffd640 1 -- 172.21.15.22:0/839899831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 msgr2=0x557588b2ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b2ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d32ffd640 1 -- 172.21.15.22:0/839899831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557588b28a50 con 0x557588741280 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d33fff640 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b2ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d32ffd640 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b27f20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800d4b0 tx=0x7f6d280052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0a063320122fb00 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.116+0000 7f6d12ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d12ffd640 1 -- 172.21.15.22:0/839899831 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d28016040 con 0x557588741280 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d12ffd640 1 -- 172.21.15.22:0/839899831 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6d28004660 con 0x557588741280 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d40217740 1 -- 172.21.15.22:0/839899831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d2801acf0 con 0x557588741280 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d12ffd640 1 -- 172.21.15.22:0/839899831 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f6d28044050 con 0x557588741280 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d40217740 10 client.15273 fetch_fsmap learned FSMap version 28 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d40217740 1 -- 172.21.15.22:0/839899831 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557588b2e450 con 0x557588741280 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d12ffd640 1 -- 172.21.15.22:0/839899831 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d2801acf0 con 0x557588741280 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d12ffd640 1 -- 172.21.15.22:0/839899831 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f6d28032460 con 0x557588741280 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d40217740 10 client.15273 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:01:53.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d40217740 10 client.15273 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d40217740 20 client.15273 populate_metadata read hostname 'smithi022' 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d40217740 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x5575886f5c90 0x557588b948c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d40217740 4 client.15273 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.117+0000 7f6d40217740 1 -- 172.21.15.22:0/839899831 --> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] -- command(tid 0: {"prefix": "status"}) -- 0x557588a7d610 con 0x5575886f5c90 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d33fff640 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x5575886f5c90 0x557588b948c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d33fff640 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x5575886f5c90 0x557588b948c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=19ccb005333e0e35 server_cookie=9b0211ef5dc92846 in_seq=0 out_seq=0 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d12ffd640 10 client.15273 ms_handle_connect on v2:172.21.15.73:6836/3229670499 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d12ffd640 1 -- 172.21.15.22:0/839899831 <== mds.3 v2:172.21.15.73:6836/3229670499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x557588a7d610 con 0x5575886f5c90 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d12ffd640 10 client.15273 handle_command_reply: tid=0 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d40217740 1 client.15273 shutdown 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d40217740 1 -- 172.21.15.22:0/839899831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 msgr2=0x557588b27f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d40217740 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b27f20 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6d2800d4b0 tx=0x7f6d280052d0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d40217740 1 -- 172.21.15.22:0/839899831 shutdown_connections 2024-09-21T04:01:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d40217740 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x5575886f5c90 0x557588b948c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d40217740 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557588761f60 0x557588b28460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.118+0000 7f6d40217740 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557588741280 0x557588b27f20 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d40217740 1 --2- 172.21.15.22:0/839899831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5575887390a0 0x557588b2ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d40217740 1 -- 172.21.15.22:0/839899831 >> 172.21.15.22:0/839899831 conn(0x557588756350 msgr2=0x557588b139b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d12ffd640 0 client.15273 ms_handle_reset on v2:172.21.15.73:6836/3229670499 2024-09-21T04:01:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d40217740 1 -- 172.21.15.22:0/839899831 shutdown_connections 2024-09-21T04:01:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d40217740 1 -- 172.21.15.22:0/839899831 wait complete. 2024-09-21T04:01:53.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d40217740 20 client.15273 trim_cache size 0 max 16384 2024-09-21T04:01:53.126 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 3, 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24616, 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 69.915793817999997, 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 133.97168937000001 2024-09-21T04:01:53.127 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:01:53.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d39ca3640 1 -- 172.21.15.22:0/2773019372 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6d1c0b65d0 msgr2=0x7f6d1c0b8ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:53.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d39ca3640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6d1c0b65d0 0x7f6d1c0b8ae0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x557588b06b80 tx=0x7f6d24031000 comp rx=0 tx=0).stop 2024-09-21T04:01:53.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d39ca3640 1 -- 172.21.15.22:0/2773019372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d34103b60 msgr2=0x7f6d3419a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:53.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d39ca3640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d34103b60 0x7f6d3419a460 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6d24006010 tx=0x7f6d24032bc0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d39ca3640 1 -- 172.21.15.22:0/2773019372 shutdown_connections 2024-09-21T04:01:53.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d39ca3640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6d1c0b65d0 0x7f6d1c0b8ae0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d39ca3640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6d341094a0 0x7f6d3419aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d39ca3640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6d34109df0 0x7f6d3419fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d39ca3640 1 --2- 172.21.15.22:0/2773019372 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6d34103b60 0x7f6d3419a460 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:53.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.119+0000 7f6d39ca3640 1 -- 172.21.15.22:0/2773019372 >> 172.21.15.22:0/2773019372 conn(0x7f6d3407b850 msgr2=0x7f6d34107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:53.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.120+0000 7f6d39ca3640 1 -- 172.21.15.22:0/2773019372 shutdown_connections 2024-09-21T04:01:53.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:53.120+0000 7f6d39ca3640 1 -- 172.21.15.22:0/2773019372 wait complete. 2024-09-21T04:01:53.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T04:01:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:54.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:54 smithi022 ceph-mon[31015]: pgmap v357: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:01:54.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:54 smithi073 ceph-mon[34443]: pgmap v357: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:01:54.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:54 smithi060 ceph-mon[33722]: pgmap v357: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:01:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.716+0000 7f5141c0f640 1 -- 172.21.15.22:0/2953667678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f513c109e40 msgr2=0x7f513c110670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.716+0000 7f5141c0f640 1 --2- 172.21.15.22:0/2953667678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f513c109e40 0x7f513c110670 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f5134009ca0 tx=0x7f513402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.716+0000 7f5141c0f640 1 -- 172.21.15.22:0/2953667678 shutdown_connections 2024-09-21T04:01:54.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.716+0000 7f5141c0f640 1 --2- 172.21.15.22:0/2953667678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f513c1094f0 0x7f513c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.716+0000 7f5141c0f640 1 --2- 172.21.15.22:0/2953667678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f513c109e40 0x7f513c110670 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.716+0000 7f5141c0f640 1 --2- 172.21.15.22:0/2953667678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f513c103bb0 0x7f513c103fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.716+0000 7f5141c0f640 1 -- 172.21.15.22:0/2953667678 >> 172.21.15.22:0/2953667678 conn(0x7f513c0ff600 msgr2=0x7f513c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.716+0000 7f5141c0f640 1 -- 172.21.15.22:0/2953667678 shutdown_connections 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.716+0000 7f5141c0f640 1 -- 172.21.15.22:0/2953667678 wait complete. 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f5141c0f640 1 Processor -- start 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f5141c0f640 1 -- start start 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f5141c0f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f513c103bb0 0x7f513c19a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f5141c0f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f513c1094f0 0x7f513c19a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f5141c0f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f513c109e40 0x7f513c19fb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f5141c0f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f513c113a00 con 0x7f513c1094f0 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f5141c0f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f513c113880 con 0x7f513c109e40 2024-09-21T04:01:54.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f5141c0f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f513c113b80 con 0x7f513c103bb0 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f513affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f513c1094f0 0x7f513c19a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f513affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f513c1094f0 0x7f513c19a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37784/0 (socket says 172.21.15.22:37784) 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f513affd640 1 -- 172.21.15.22:0/4157941590 learned_addr learned my addr 172.21.15.22:0/4157941590 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.717+0000 7f513b7fe640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f513c103bb0 0x7f513c19a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f513bfff640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f513c109e40 0x7f513c19fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f513affd640 1 -- 172.21.15.22:0/4157941590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f513c103bb0 msgr2=0x7f513c19a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f513affd640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f513c103bb0 0x7f513c19a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f513affd640 1 -- 172.21.15.22:0/4157941590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f513c109e40 msgr2=0x7f513c19fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f513affd640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f513c109e40 0x7f513c19fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f513affd640 1 -- 172.21.15.22:0/4157941590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f513c1a01c0 con 0x7f513c1094f0 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f513affd640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f513c1094f0 0x7f513c19a8b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f513000c8c0 tx=0x7f513000ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f5138ff9640 1 -- 172.21.15.22:0/4157941590 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130007bb0 con 0x7f513c1094f0 2024-09-21T04:01:54.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f5138ff9640 1 -- 172.21.15.22:0/4157941590 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5130007d50 con 0x7f513c1094f0 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f5138ff9640 1 -- 172.21.15.22:0/4157941590 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5130018660 con 0x7f513c1094f0 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f5141c0f640 1 -- 172.21.15.22:0/4157941590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f513c1a04b0 con 0x7f513c1094f0 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.718+0000 7f5141c0f640 1 -- 172.21.15.22:0/4157941590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f513c1a6cd0 con 0x7f513c1094f0 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.721+0000 7f5148183740 1 Processor -- start 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.721+0000 7f5148183740 1 -- start start 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.721+0000 7f5148183740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a63f60 0x563925e09f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.721+0000 7f5138ff9640 1 -- 172.21.15.22:0/4157941590 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f513000f450 con 0x7f513c1094f0 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.721+0000 7f5148183740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a3b0a0 0x563925e0a440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.721+0000 7f5148183740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 0x563925e0a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.721+0000 7f5148183740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563925d81c10 con 0x563925a63f60 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.721+0000 7f5148183740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563925d71040 con 0x563925a3b0a0 2024-09-21T04:01:54.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.721+0000 7f5148183740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563925d74e50 con 0x563925a43280 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.721+0000 7f513bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a63f60 0x563925e09f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a63f60 0x563925e09f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37800/0 (socket says 172.21.15.22:37800) 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513bfff640 1 -- 172.21.15.22:0/160005271 learned_addr learned my addr 172.21.15.22:0/160005271 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513affd640 1 --2- 172.21.15.22:0/160005271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 0x563925e0a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513b7fe640 1 --2- 172.21.15.22:0/160005271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a3b0a0 0x563925e0a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513bfff640 1 -- 172.21.15.22:0/160005271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 msgr2=0x563925e0a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513bfff640 1 --2- 172.21.15.22:0/160005271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 0x563925e0a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513bfff640 1 -- 172.21.15.22:0/160005271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a3b0a0 msgr2=0x563925e0a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513bfff640 1 --2- 172.21.15.22:0/160005271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a3b0a0 0x563925e0a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513bfff640 1 -- 172.21.15.22:0/160005271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563925acf540 con 0x563925a63f60 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513bfff640 1 --2- 172.21.15.22:0/160005271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a63f60 0x563925e09f00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5134009ca0 tx=0x7f5134031790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50b37b63ac06eea3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f5138ff9640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f51240b6650 0x7f51240b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f5121ffb640 1 -- 172.21.15.22:0/160005271 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134031b80 con 0x563925a63f60 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f5121ffb640 1 -- 172.21.15.22:0/160005271 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5134036030 con 0x563925a63f60 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f5121ffb640 1 -- 172.21.15.22:0/160005271 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134004600 con 0x563925a63f60 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.722+0000 7f513b7fe640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f51240b6650 0x7f51240b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.723+0000 7f5138ff9640 1 -- 172.21.15.22:0/4157941590 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f51300e7840 con 0x7f513c1094f0 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.723+0000 7f5148183740 1 -- 172.21.15.22:0/160005271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a63f60 msgr2=0x563925e09f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.723+0000 7f513b7fe640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f51240b6650 0x7f51240b8b60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x563925e08b80 tx=0x7f512c00a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.723+0000 7f5148183740 1 --2- 172.21.15.22:0/160005271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a63f60 0x563925e09f00 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f5134009ca0 tx=0x7f5134031790 comp rx=0 tx=0).stop 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.723+0000 7f5148183740 1 -- 172.21.15.22:0/160005271 shutdown_connections 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.723+0000 7f5148183740 1 --2- 172.21.15.22:0/160005271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 0x563925e0a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.723+0000 7f5148183740 1 --2- 172.21.15.22:0/160005271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a3b0a0 0x563925e0a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.723+0000 7f5148183740 1 --2- 172.21.15.22:0/160005271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a63f60 0x563925e09f00 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.723+0000 7f5148183740 1 -- 172.21.15.22:0/160005271 >> 172.21.15.22:0/160005271 conn(0x563925a58350 msgr2=0x563925e07df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.724+0000 7f5148183740 1 -- 172.21.15.22:0/160005271 shutdown_connections 2024-09-21T04:01:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.724+0000 7f5148183740 1 -- 172.21.15.22:0/160005271 wait complete. 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.724+0000 7f5148183740 1 -- start start 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.724+0000 7f5148183740 1 Processor -- start 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f5148183740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e159f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f5148183740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a43280 0x563925e15f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f5148183740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a63f60 0x563925e217f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f5148183740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563925bd25f0 con 0x563925a3b0a0 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f5148183740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563925d0c010 con 0x563925a43280 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f5148183740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563925e18500 con 0x563925a63f60 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f5148183740 10 client.0 _ll_register_callbacks cb 0x563925d6b340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e159f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e159f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37804/0 (socket says 172.21.15.22:37804) 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513b7fe640 1 -- 172.21.15.22:0/1650092291 learned_addr learned my addr 172.21.15.22:0/1650092291 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513affd640 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a43280 0x563925e15f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513bfff640 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a63f60 0x563925e217f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513b7fe640 1 -- 172.21.15.22:0/1650092291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a63f60 msgr2=0x563925e217f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513b7fe640 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a63f60 0x563925e217f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513b7fe640 1 -- 172.21.15.22:0/1650092291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a43280 msgr2=0x563925e15f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513b7fe640 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a43280 0x563925e15f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513b7fe640 1 -- 172.21.15.22:0/1650092291 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563925d39a00 con 0x563925a3b0a0 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f513b7fe640 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e159f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f512c010e20 tx=0x7f512c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8795fb62f137ccb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f511affd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f511affd640 1 -- 172.21.15.22:0/1650092291 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512c00f8c0 con 0x563925a3b0a0 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f511affd640 1 -- 172.21.15.22:0/1650092291 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f512c00fa60 con 0x563925a3b0a0 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.725+0000 7f5148183740 1 -- 172.21.15.22:0/1650092291 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5134036030 con 0x563925a3b0a0 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f511affd640 1 -- 172.21.15.22:0/1650092291 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f512c00fc60 con 0x563925a3b0a0 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f5148183740 10 client.15285 fetch_fsmap learned FSMap version 28 2024-09-21T04:01:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f5148183740 1 -- 172.21.15.22:0/1650092291 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563925e24480 con 0x563925a3b0a0 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f511affd640 1 -- 172.21.15.22:0/1650092291 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5134036030 con 0x563925a3b0a0 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f511affd640 1 -- 172.21.15.22:0/1650092291 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f512c01d410 con 0x563925a3b0a0 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f5148183740 10 client.15285 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f5148183740 10 client.15285 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f5148183740 20 client.15285 populate_metadata read hostname 'smithi022' 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f5148183740 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x563925a228e0 0x563925e27f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f5148183740 4 client.15285 mds_command: new command op to 24617 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f5148183740 1 -- 172.21.15.22:0/1650092291 --> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563925d83b60 con 0x563925a228e0 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.726+0000 7f513affd640 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x563925a228e0 0x563925e27f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.727+0000 7f511affd640 10 client.15285 ms_handle_connect on v2:172.21.15.60:6836/3007306472 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.727+0000 7f513affd640 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x563925a228e0 0x563925e27f80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=276768624e4efe0b server_cookie=ec70dd2819cf2a3a in_seq=0 out_seq=0 2024-09-21T04:01:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f511affd640 1 -- 172.21.15.22:0/1650092291 <== mds.2 v2:172.21.15.60:6836/3007306472 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563925d83b60 con 0x563925a228e0 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f511affd640 10 client.15285 handle_command_reply: tid=0 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 client.15285 shutdown 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 -- 172.21.15.22:0/1650092291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 msgr2=0x563925e159f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e159f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f512c010e20 tx=0x7f512c0046c0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 -- 172.21.15.22:0/1650092291 shutdown_connections 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x563925a228e0 0x563925e27f80 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f511affd640 0 client.15285 ms_handle_reset on v2:172.21.15.60:6836/3007306472 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a63f60 0x563925e217f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a43280 0x563925e15f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 --2- 172.21.15.22:0/1650092291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e159f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 -- 172.21.15.22:0/1650092291 >> 172.21.15.22:0/1650092291 conn(0x563925a58350 msgr2=0x563925e0d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 -- 172.21.15.22:0/1650092291 shutdown_connections 2024-09-21T04:01:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 1 -- 172.21.15.22:0/1650092291 wait complete. 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.728+0000 7f5148183740 20 client.15285 trim_cache size 0 max 16384 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.746+0000 7f5148183740 1 Processor -- start 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.746+0000 7f5148183740 1 -- start start 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f5148183740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a228e0 0x563925e159d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f5148183740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a3b0a0 0x563925e15f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f5148183740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a43280 0x563925e109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f5148183740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563925e262c0 con 0x563925a43280 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f5148183740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563925e26990 con 0x563925a3b0a0 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f5148183740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563925e27060 con 0x563925a228e0 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a43280 0x563925e109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a43280 0x563925e109a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37816/0 (socket says 172.21.15.22:37816) 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513bfff640 1 -- 172.21.15.22:0/3201356114 learned_addr learned my addr 172.21.15.22:0/3201356114 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513affd640 1 --2- 172.21.15.22:0/3201356114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a3b0a0 0x563925e15f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513b7fe640 1 --2- 172.21.15.22:0/3201356114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a228e0 0x563925e159d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513bfff640 1 -- 172.21.15.22:0/3201356114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a228e0 msgr2=0x563925e159d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513bfff640 1 --2- 172.21.15.22:0/3201356114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a228e0 0x563925e159d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513bfff640 1 -- 172.21.15.22:0/3201356114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a3b0a0 msgr2=0x563925e15f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513bfff640 1 --2- 172.21.15.22:0/3201356114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a3b0a0 0x563925e15f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513bfff640 1 -- 172.21.15.22:0/3201356114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563925e0cd60 con 0x563925a43280 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.747+0000 7f513bfff640 1 --2- 172.21.15.22:0/3201356114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a43280 0x563925e109a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f51340098d0 tx=0x7f5134000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33596ba299edfc71 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f51217fa640 1 -- 172.21.15.22:0/3201356114 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134053070 con 0x563925a43280 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f51217fa640 1 -- 172.21.15.22:0/3201356114 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5134036070 con 0x563925a43280 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f51217fa640 1 -- 172.21.15.22:0/3201356114 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5134004260 con 0x563925a43280 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f5148183740 1 -- 172.21.15.22:0/3201356114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a43280 msgr2=0x563925e109a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f5148183740 1 --2- 172.21.15.22:0/3201356114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a43280 0x563925e109a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f51340098d0 tx=0x7f5134000f40 comp rx=0 tx=0).stop 2024-09-21T04:01:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f5148183740 1 -- 172.21.15.22:0/3201356114 shutdown_connections 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f5148183740 1 --2- 172.21.15.22:0/3201356114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a43280 0x563925e109a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f5148183740 1 --2- 172.21.15.22:0/3201356114 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a3b0a0 0x563925e15f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f5148183740 1 --2- 172.21.15.22:0/3201356114 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a228e0 0x563925e159d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f5148183740 1 -- 172.21.15.22:0/3201356114 >> 172.21.15.22:0/3201356114 conn(0x563925a58350 msgr2=0x563925e02ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.748+0000 7f5148183740 1 -- 172.21.15.22:0/3201356114 shutdown_connections 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.749+0000 7f5148183740 1 -- 172.21.15.22:0/3201356114 wait complete. 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.749+0000 7f5148183740 1 -- start start 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.749+0000 7f5148183740 1 Processor -- start 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.749+0000 7f5148183740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a228e0 0x563925e2a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.749+0000 7f5148183740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e2aca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.749+0000 7f5148183740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 0x563925e2b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.749+0000 7f5148183740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563925e27e00 con 0x563925a3b0a0 2024-09-21T04:01:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.749+0000 7f5148183740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563925e27730 con 0x563925a228e0 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.749+0000 7f5148183740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563925e284d0 con 0x563925a43280 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.749+0000 7f5148183740 10 client.0 _ll_register_callbacks cb 0x7f512c010aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e2aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e2aca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37830/0 (socket says 172.21.15.22:37830) 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513affd640 1 -- 172.21.15.22:0/3154221586 learned_addr learned my addr 172.21.15.22:0/3154221586 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513bfff640 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 0x563925e2b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513b7fe640 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a228e0 0x563925e2a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513affd640 1 -- 172.21.15.22:0/3154221586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 msgr2=0x563925e2b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513affd640 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 0x563925e2b1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513affd640 1 -- 172.21.15.22:0/3154221586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a228e0 msgr2=0x563925e2a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513affd640 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a228e0 0x563925e2a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513affd640 1 -- 172.21.15.22:0/3154221586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563925e2f9b0 con 0x563925a3b0a0 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513bfff640 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 0x563925e2b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f513affd640 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e2aca0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f513001f000 tx=0x7f51300e52b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c386d704850f517 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f511affd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f511affd640 1 -- 172.21.15.22:0/3154221586 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f513000f940 con 0x563925a3b0a0 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f511affd640 1 -- 172.21.15.22:0/3154221586 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f51300ac710 con 0x563925a3b0a0 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f5148183740 1 -- 172.21.15.22:0/3154221586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5134036070 con 0x563925a3b0a0 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f511affd640 1 -- 172.21.15.22:0/3154221586 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f51300b1f90 con 0x563925a3b0a0 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f5148183740 10 client.15291 fetch_fsmap learned FSMap version 28 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.750+0000 7f5148183740 1 -- 172.21.15.22:0/3154221586 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563925e30c50 con 0x563925a3b0a0 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f511affd640 1 -- 172.21.15.22:0/3154221586 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5134036070 con 0x563925a3b0a0 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f511affd640 1 -- 172.21.15.22:0/3154221586 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f51300a7c40 con 0x563925a3b0a0 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f5148183740 10 client.15291 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f5148183740 10 client.15291 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f5148183740 20 client.15291 populate_metadata read hostname 'smithi022' 2024-09-21T04:01:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f5148183740 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x563925a63f60 0x563925e96800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f5148183740 4 client.15291 mds_command: new command op to 24617 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f5148183740 1 -- 172.21.15.22:0/3154221586 --> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] -- command(tid 0: {"prefix": "status"}) -- 0x563925e26110 con 0x563925a63f60 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f513b7fe640 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x563925a63f60 0x563925e96800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f511affd640 10 client.15291 ms_handle_connect on v2:172.21.15.60:6836/3007306472 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.751+0000 7f513b7fe640 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x563925a63f60 0x563925e96800 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=adce4990cd493663 server_cookie=1e747c18e92d0b1e in_seq=0 out_seq=0 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f511affd640 1 -- 172.21.15.22:0/3154221586 <== mds.2 v2:172.21.15.60:6836/3007306472 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x563925e26110 con 0x563925a63f60 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f511affd640 10 client.15291 handle_command_reply: tid=0 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 client.15291 shutdown 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 -- 172.21.15.22:0/3154221586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 msgr2=0x563925e2aca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e2aca0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f513001f000 tx=0x7f51300e52b0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 -- 172.21.15.22:0/3154221586 shutdown_connections 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x563925a63f60 0x563925e96800 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563925a43280 0x563925e2b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563925a3b0a0 0x563925e2aca0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f511affd640 0 client.15291 ms_handle_reset on v2:172.21.15.60:6836/3007306472 2024-09-21T04:01:54.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 --2- 172.21.15.22:0/3154221586 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563925a228e0 0x563925e2a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.774 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:01:54.774 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:01:54.774 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-09-21T04:01:54.774 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24617, 2024-09-21T04:01:54.774 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:01:54.774 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:01:54.774 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:01:54.775 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 72.559073114, 2024-09-21T04:01:54.775 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-21T04:01:54.775 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:01:54.775 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T04:01:54.775 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 132.85810244199999 2024-09-21T04:01:54.775 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:01:54.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 -- 172.21.15.22:0/3154221586 >> 172.21.15.22:0/3154221586 conn(0x563925a58350 msgr2=0x563925e159d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:54.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 -- 172.21.15.22:0/3154221586 shutdown_connections 2024-09-21T04:01:54.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 1 -- 172.21.15.22:0/3154221586 wait complete. 2024-09-21T04:01:54.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.752+0000 7f5148183740 20 client.15291 trim_cache size 0 max 16384 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 -- 172.21.15.22:0/4157941590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f51240b6650 msgr2=0x7f51240b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f51240b6650 0x7f51240b8b60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x563925e08b80 tx=0x7f512c00a2d0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 -- 172.21.15.22:0/4157941590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f513c1094f0 msgr2=0x7f513c19a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f513c1094f0 0x7f513c19a8b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f513000c8c0 tx=0x7f513000ccc0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 -- 172.21.15.22:0/4157941590 shutdown_connections 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f51240b6650 0x7f51240b8b60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f513c109e40 0x7f513c19fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f513c1094f0 0x7f513c19a8b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 --2- 172.21.15.22:0/4157941590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f513c103bb0 0x7f513c19a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 -- 172.21.15.22:0/4157941590 >> 172.21.15.22:0/4157941590 conn(0x7f513c0ff600 msgr2=0x7f513c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 -- 172.21.15.22:0/4157941590 shutdown_connections 2024-09-21T04:01:54.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:54.753+0000 7f5141c0f640 1 -- 172.21.15.22:0/4157941590 wait complete. 2024-09-21T04:01:55.569 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T04:01:55.828 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:56.211 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:56 smithi022 ceph-mon[31015]: pgmap v358: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:01:56.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.301+0000 7f1699948640 1 -- 172.21.15.22:0/2539521258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1694105380 msgr2=0x7f169410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:56.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.301+0000 7f1699948640 1 --2- 172.21.15.22:0/2539521258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1694105380 0x7f169410d8d0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f1688009900 tx=0x7f168802a410 comp rx=0 tx=0).stop 2024-09-21T04:01:56.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.301+0000 7f1699948640 1 -- 172.21.15.22:0/2539521258 shutdown_connections 2024-09-21T04:01:56.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.301+0000 7f1699948640 1 --2- 172.21.15.22:0/2539521258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169410de60 0x7f1694110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.301+0000 7f1699948640 1 --2- 172.21.15.22:0/2539521258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1694105380 0x7f169410d8d0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.301+0000 7f1699948640 1 --2- 172.21.15.22:0/2539521258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1694104a30 0x7f1694104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.301+0000 7f1699948640 1 -- 172.21.15.22:0/2539521258 >> 172.21.15.22:0/2539521258 conn(0x7f16940797b0 msgr2=0x7f1694079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:56.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.301+0000 7f1699948640 1 -- 172.21.15.22:0/2539521258 shutdown_connections 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.301+0000 7f1699948640 1 -- 172.21.15.22:0/2539521258 wait complete. 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1699948640 1 Processor -- start 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1699948640 1 -- start start 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1699948640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1694104a30 0x7f169419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1699948640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1694105380 0x7f169419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1699948640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169410de60 0x7f169419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1699948640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1694113910 con 0x7f1694104a30 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1699948640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1694113790 con 0x7f169410de60 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1699948640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1694113a90 con 0x7f1694105380 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1692ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1694104a30 0x7f169419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1692ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1694104a30 0x7f169419a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37852/0 (socket says 172.21.15.22:37852) 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.302+0000 7f1692ffd640 1 -- 172.21.15.22:0/2754235721 learned_addr learned my addr 172.21.15.22:0/2754235721 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f16927fc640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1694105380 0x7f169419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f16937fe640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169410de60 0x7f169419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1692ffd640 1 -- 172.21.15.22:0/2754235721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1694105380 msgr2=0x7f169419a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1692ffd640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1694105380 0x7f169419a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1692ffd640 1 -- 172.21.15.22:0/2754235721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169410de60 msgr2=0x7f169419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1692ffd640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169410de60 0x7f169419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1692ffd640 1 -- 172.21.15.22:0/2754235721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16941a0310 con 0x7f1694104a30 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f16937fe640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169410de60 0x7f169419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1692ffd640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1694104a30 0x7f169419a3a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f168400cce0 tx=0x7f168400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:56.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1698946640 1 -- 172.21.15.22:0/2754235721 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1684004b20 con 0x7f1694104a30 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1698946640 1 -- 172.21.15.22:0/2754235721 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1684004cc0 con 0x7f1694104a30 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1698946640 1 -- 172.21.15.22:0/2754235721 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168400f6b0 con 0x7f1694104a30 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1699948640 1 -- 172.21.15.22:0/2754235721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16941a0600 con 0x7f1694104a30 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.303+0000 7f1699948640 1 -- 172.21.15.22:0/2754235721 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16941a6d60 con 0x7f1694104a30 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.306+0000 7f169febc740 1 Processor -- start 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.306+0000 7f169febc740 1 -- start start 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f169febc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f169febc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257d0440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f169febc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257d0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f169febc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ab25747c10 con 0x55ab25429f60 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f169febc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ab25737040 con 0x55ab25409280 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f169febc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ab2573ae50 con 0x55ab254010a0 2024-09-21T04:01:56.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f1698946640 1 -- 172.21.15.22:0/2754235721 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f168400f850 con 0x7f1694104a30 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f16937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f16937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257cff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37866/0 (socket says 172.21.15.22:37866) 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f16937fe640 1 -- 172.21.15.22:0/933260219 learned_addr learned my addr 172.21.15.22:0/933260219 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f16927fc640 1 --2- 172.21.15.22:0/933260219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257d0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f1692ffd640 1 --2- 172.21.15.22:0/933260219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257d0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f16937fe640 1 -- 172.21.15.22:0/933260219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 msgr2=0x55ab257d0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f16937fe640 1 --2- 172.21.15.22:0/933260219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257d0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f16937fe640 1 -- 172.21.15.22:0/933260219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 msgr2=0x55ab257d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f16937fe640 1 --2- 172.21.15.22:0/933260219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257d0980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f16937fe640 1 -- 172.21.15.22:0/933260219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab25495540 con 0x55ab25429f60 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.307+0000 7f1692ffd640 1 --2- 172.21.15.22:0/933260219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:56.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.308+0000 7f16937fe640 1 --2- 172.21.15.22:0/933260219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257cff00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f168c00bcf0 tx=0x7f168c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b7457c658abcc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.308+0000 7f1679ffb640 1 -- 172.21.15.22:0/933260219 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c015070 con 0x55ab25429f60 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.308+0000 7f1679ffb640 1 -- 172.21.15.22:0/933260219 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f168c0118d0 con 0x55ab25429f60 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.308+0000 7f1679ffb640 1 -- 172.21.15.22:0/933260219 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c010750 con 0x55ab25429f60 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.308+0000 7f1698946640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f167c0b65a0 0x7f167c0b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.308+0000 7f1692ffd640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f167c0b65a0 0x7f167c0b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.308+0000 7f1698946640 1 -- 172.21.15.22:0/2754235721 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f16840e78d0 con 0x7f1694104a30 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f169febc740 1 -- 172.21.15.22:0/933260219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 msgr2=0x55ab257cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f1692ffd640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f167c0b65a0 0x7f167c0b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55ab257ceb80 tx=0x7f16840021f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f169febc740 1 --2- 172.21.15.22:0/933260219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257cff00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f168c00bcf0 tx=0x7f168c00f730 comp rx=0 tx=0).stop 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f169febc740 1 -- 172.21.15.22:0/933260219 shutdown_connections 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f169febc740 1 --2- 172.21.15.22:0/933260219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257d0440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f169febc740 1 --2- 172.21.15.22:0/933260219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f169febc740 1 --2- 172.21.15.22:0/933260219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257cff00 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f169febc740 1 -- 172.21.15.22:0/933260219 >> 172.21.15.22:0/933260219 conn(0x55ab2541e350 msgr2=0x55ab257cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:56.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f169febc740 1 -- 172.21.15.22:0/933260219 shutdown_connections 2024-09-21T04:01:56.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f169febc740 1 -- 172.21.15.22:0/933260219 wait complete. 2024-09-21T04:01:56.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.309+0000 7f169febc740 1 -- start start 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f169febc740 1 Processor -- start 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f169febc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257db9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f169febc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257dbf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f169febc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257e7a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f169febc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ab255985f0 con 0x55ab25429f60 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f169febc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ab256d2010 con 0x55ab25409280 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f169febc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ab257de6e0 con 0x55ab254010a0 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f169febc740 10 client.0 _ll_register_callbacks cb 0x55ab25731340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f16937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257e7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f16927fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257dbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f16937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257e7a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37878/0 (socket says 172.21.15.22:37878) 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f16937fe640 1 -- 172.21.15.22:0/1388204479 learned_addr learned my addr 172.21.15.22:0/1388204479 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.310+0000 7f16937fe640 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257db9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f16927fc640 1 -- 172.21.15.22:0/1388204479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 msgr2=0x55ab257db9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f16927fc640 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257db9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f16927fc640 1 -- 172.21.15.22:0/1388204479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 msgr2=0x55ab257e7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f16927fc640 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257e7a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f16927fc640 1 -- 172.21.15.22:0/1388204479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab256ffa00 con 0x55ab25409280 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f16937fe640 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257db9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f16927fc640 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257dbf10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f168802a930 tx=0x7f1688031f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a6bdaea34355f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f1672ffd640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f1672ffd640 1 -- 172.21.15.22:0/1388204479 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1688035040 con 0x55ab25409280 2024-09-21T04:01:56.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f1672ffd640 1 -- 172.21.15.22:0/1388204479 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f1688031700 con 0x55ab25409280 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f169febc740 1 -- 172.21.15.22:0/1388204479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f168c0118d0 con 0x55ab25409280 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f1672ffd640 1 -- 172.21.15.22:0/1388204479 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f168804e050 con 0x55ab25409280 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f169febc740 10 client.25025 fetch_fsmap learned FSMap version 28 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.311+0000 7f169febc740 1 -- 172.21.15.22:0/1388204479 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ab257ea570 con 0x55ab25409280 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.312+0000 7f1672ffd640 1 -- 172.21.15.22:0/1388204479 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f168c0118d0 con 0x55ab25409280 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.312+0000 7f1672ffd640 1 -- 172.21.15.22:0/1388204479 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1688003a60 con 0x55ab25409280 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.312+0000 7f169febc740 10 client.25025 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.312+0000 7f169febc740 10 client.25025 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.312+0000 7f169febc740 20 client.25025 populate_metadata read hostname 'smithi022' 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.312+0000 7f169febc740 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x55ab253e88e0 0x55ab257edfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.312+0000 7f169febc740 4 client.25025 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.312+0000 7f169febc740 1 -- 172.21.15.22:0/1388204479 --> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab25749b60 con 0x55ab253e88e0 2024-09-21T04:01:56.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.312+0000 7f16937fe640 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x55ab253e88e0 0x55ab257edfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.313+0000 7f16937fe640 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x55ab253e88e0 0x55ab257edfc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7532a9474d4645a1 server_cookie=6687682ced74d56c in_seq=0 out_seq=0 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.313+0000 7f1672ffd640 10 client.25025 ms_handle_connect on v2:172.21.15.73:6838/1883983314 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f1672ffd640 1 -- 172.21.15.22:0/1388204479 <== mds.1 v2:172.21.15.73:6838/1883983314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ab25749b60 con 0x55ab253e88e0 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f1672ffd640 10 client.25025 handle_command_reply: tid=0 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 client.25025 shutdown 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 -- 172.21.15.22:0/1388204479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 msgr2=0x55ab257dbf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257dbf10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f168802a930 tx=0x7f1688031f40 comp rx=0 tx=0).stop 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 -- 172.21.15.22:0/1388204479 shutdown_connections 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x55ab253e88e0 0x55ab257edfc0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257e7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257dbf10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 --2- 172.21.15.22:0/1388204479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257db9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 -- 172.21.15.22:0/1388204479 >> 172.21.15.22:0/1388204479 conn(0x55ab2541e350 msgr2=0x55ab257d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:56.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f1672ffd640 0 client.25025 ms_handle_reset on v2:172.21.15.73:6838/1883983314 2024-09-21T04:01:56.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 -- 172.21.15.22:0/1388204479 shutdown_connections 2024-09-21T04:01:56.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 1 -- 172.21.15.22:0/1388204479 wait complete. 2024-09-21T04:01:56.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.314+0000 7f169febc740 20 client.25025 trim_cache size 0 max 16384 2024-09-21T04:01:56.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f169febc740 1 Processor -- start 2024-09-21T04:01:56.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f169febc740 1 -- start start 2024-09-21T04:01:56.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f169febc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab254010a0 0x55ab257ec480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f169febc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257ed220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f169febc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab25429f60 0x55ab257db9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f169febc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ab257ec300 con 0x55ab254010a0 2024-09-21T04:01:56.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f169febc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ab257ec9d0 con 0x55ab25409280 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f169febc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ab257ed0a0 con 0x55ab25429f60 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f16937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab254010a0 0x55ab257ec480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f16937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab254010a0 0x55ab257ec480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37892/0 (socket says 172.21.15.22:37892) 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f16937fe640 1 -- 172.21.15.22:0/2873646617 learned_addr learned my addr 172.21.15.22:0/2873646617 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f16927fc640 1 --2- 172.21.15.22:0/2873646617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257ed220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f16937fe640 1 --2- 172.21.15.22:0/2873646617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab25429f60 0x55ab257db9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f16937fe640 1 -- 172.21.15.22:0/2873646617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab25429f60 msgr2=0x55ab257db9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f16937fe640 1 --2- 172.21.15.22:0/2873646617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab25429f60 0x55ab257db9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f16937fe640 1 -- 172.21.15.22:0/2873646617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 msgr2=0x55ab257ed220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.333+0000 7f16937fe640 1 --2- 172.21.15.22:0/2873646617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257ed220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.334+0000 7f16937fe640 1 -- 172.21.15.22:0/2873646617 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab257d9cd0 con 0x55ab254010a0 2024-09-21T04:01:56.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.334+0000 7f16937fe640 1 --2- 172.21.15.22:0/2873646617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab254010a0 0x55ab257ec480 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f168c00b580 tx=0x7f168c00b5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d22a188a4ac2c24 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:56.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.334+0000 7f16797fa640 1 -- 172.21.15.22:0/2873646617 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c037070 con 0x55ab254010a0 2024-09-21T04:01:56.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.334+0000 7f16797fa640 1 -- 172.21.15.22:0/2873646617 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f168c011800 con 0x55ab254010a0 2024-09-21T04:01:56.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.334+0000 7f16797fa640 1 -- 172.21.15.22:0/2873646617 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c015040 con 0x55ab254010a0 2024-09-21T04:01:56.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 -- 172.21.15.22:0/2873646617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab254010a0 msgr2=0x55ab257ec480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 --2- 172.21.15.22:0/2873646617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab254010a0 0x55ab257ec480 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f168c00b580 tx=0x7f168c00b5e0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 -- 172.21.15.22:0/2873646617 shutdown_connections 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 --2- 172.21.15.22:0/2873646617 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab25429f60 0x55ab257db9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 --2- 172.21.15.22:0/2873646617 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257ed220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 --2- 172.21.15.22:0/2873646617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab254010a0 0x55ab257ec480 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 -- 172.21.15.22:0/2873646617 >> 172.21.15.22:0/2873646617 conn(0x55ab2541e350 msgr2=0x55ab257eba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 -- 172.21.15.22:0/2873646617 shutdown_connections 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 -- 172.21.15.22:0/2873646617 wait complete. 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 -- start start 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.335+0000 7f169febc740 1 Processor -- start 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f169febc740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257ef9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f169febc740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257eff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f169febc740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257f4f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f169febc740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ab257ede40 con 0x55ab25429f60 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f169febc740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ab257ed770 con 0x55ab25409280 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f169febc740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ab257ee510 con 0x55ab254010a0 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f169febc740 10 client.0 _ll_register_callbacks cb 0x7f1688005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f16937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257f4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f16937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257f4f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37904/0 (socket says 172.21.15.22:37904) 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f16937fe640 1 -- 172.21.15.22:0/3950541425 learned_addr learned my addr 172.21.15.22:0/3950541425 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f16927fc640 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f16937fe640 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257ef9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f16937fe640 1 -- 172.21.15.22:0/3950541425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 msgr2=0x55ab257ef9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f16937fe640 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257ef9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f16937fe640 1 -- 172.21.15.22:0/3950541425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 msgr2=0x55ab257eff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:56.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f16937fe640 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257eff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.336+0000 7f16937fe640 1 -- 172.21.15.22:0/3950541425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab257f55f0 con 0x55ab25429f60 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f16937fe640 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257f4f80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f168c00b840 tx=0x7f168c0114c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a376d2b70e43436 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f1672ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f1672ffd640 1 -- 172.21.15.22:0/3950541425 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f168c015070 con 0x55ab25429f60 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f1672ffd640 1 -- 172.21.15.22:0/3950541425 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f168c005450 con 0x55ab25429f60 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f169febc740 1 -- 172.21.15.22:0/3950541425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f168c011800 con 0x55ab25429f60 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f1672ffd640 1 -- 172.21.15.22:0/3950541425 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f168c044050 con 0x55ab25429f60 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f169febc740 10 client.15309 fetch_fsmap learned FSMap version 28 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f169febc740 1 -- 172.21.15.22:0/3950541425 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ab257f69b0 con 0x55ab25429f60 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f1672ffd640 1 -- 172.21.15.22:0/3950541425 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f168c011800 con 0x55ab25429f60 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f1672ffd640 1 -- 172.21.15.22:0/3950541425 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f168c0304a0 con 0x55ab25429f60 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f169febc740 10 client.15309 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.337+0000 7f169febc740 10 client.15309 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T04:01:56.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.338+0000 7f169febc740 20 client.15309 populate_metadata read hostname 'smithi022' 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.338+0000 7f169febc740 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x55ab253bdc90 0x55ab2585bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.338+0000 7f169febc740 4 client.15309 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.338+0000 7f169febc740 1 -- 172.21.15.22:0/3950541425 --> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] -- command(tid 0: {"prefix": "status"}) -- 0x55ab25745610 con 0x55ab253bdc90 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.338+0000 7f16927fc640 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x55ab253bdc90 0x55ab2585bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.338+0000 7f1672ffd640 10 client.15309 ms_handle_connect on v2:172.21.15.73:6838/1883983314 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.338+0000 7f16927fc640 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x55ab253bdc90 0x55ab2585bdd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f6914a0f1ee8e463 server_cookie=7a34686ea498c2af in_seq=0 out_seq=0 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.338+0000 7f1672ffd640 1 -- 172.21.15.22:0/3950541425 <== mds.1 v2:172.21.15.73:6838/1883983314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ab25745610 con 0x55ab253bdc90 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.338+0000 7f1672ffd640 10 client.15309 handle_command_reply: tid=0 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.338+0000 7f169febc740 1 client.15309 shutdown 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 1 -- 172.21.15.22:0/3950541425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 msgr2=0x55ab257f4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257f4f80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f168c00b840 tx=0x7f168c0114c0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 1 -- 172.21.15.22:0/3950541425 shutdown_connections 2024-09-21T04:01:56.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x55ab253bdc90 0x55ab2585bdd0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ab25429f60 0x55ab257f4f80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ab25409280 0x55ab257eff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f1672ffd640 0 client.15309 ms_handle_reset on v2:172.21.15.73:6838/1883983314 2024-09-21T04:01:56.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 1 --2- 172.21.15.22:0/3950541425 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ab254010a0 0x55ab257ef9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 1 -- 172.21.15.22:0/3950541425 >> 172.21.15.22:0/3950541425 conn(0x55ab2541e350 msgr2=0x55ab257db9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:56.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 1 -- 172.21.15.22:0/3950541425 shutdown_connections 2024-09-21T04:01:56.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 1 -- 172.21.15.22:0/3950541425 wait complete. 2024-09-21T04:01:56.346 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f169febc740 20 client.15309 trim_cache size 0 max 16384 2024-09-21T04:01:56.346 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:01:56.346 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24634, 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 75.154439694999994, 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 131.87065825600001 2024-09-21T04:01:56.347 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:01:56.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f1699948640 1 -- 172.21.15.22:0/2754235721 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f167c0b65a0 msgr2=0x7f167c0b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:56.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f1699948640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f167c0b65a0 0x7f167c0b8ab0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x55ab257ceb80 tx=0x7f16840021f0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f1699948640 1 -- 172.21.15.22:0/2754235721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1694104a30 msgr2=0x7f169419a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:56.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f1699948640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1694104a30 0x7f169419a3a0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f168400cce0 tx=0x7f168400a620 comp rx=0 tx=0).stop 2024-09-21T04:01:56.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f1699948640 1 -- 172.21.15.22:0/2754235721 shutdown_connections 2024-09-21T04:01:56.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.339+0000 7f1699948640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f167c0b65a0 0x7f167c0b8ab0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.340+0000 7f1699948640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1694105380 0x7f169419a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.340+0000 7f1699948640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f169410de60 0x7f169419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.340+0000 7f1699948640 1 --2- 172.21.15.22:0/2754235721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1694104a30 0x7f169419a3a0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:56.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.340+0000 7f1699948640 1 -- 172.21.15.22:0/2754235721 >> 172.21.15.22:0/2754235721 conn(0x7f16940797b0 msgr2=0x7f1694100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:56.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.340+0000 7f1699948640 1 -- 172.21.15.22:0/2754235721 shutdown_connections 2024-09-21T04:01:56.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:56.340+0000 7f1699948640 1 -- 172.21.15.22:0/2754235721 wait complete. 2024-09-21T04:01:56.453 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:56 smithi060 ceph-mon[33722]: pgmap v358: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:01:56.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:56 smithi073 ceph-mon[34443]: pgmap v358: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:01:57.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T04:01:57.299 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:57.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.794+0000 7f7e7db75640 1 -- 172.21.15.22:0/1374105144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e7810de40 msgr2=0x7f7e78110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:57.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.794+0000 7f7e7db75640 1 --2- 172.21.15.22:0/1374105144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e7810de40 0x7f7e78110330 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009ca0 tx=0x7f7e7002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.794+0000 7f7e7db75640 1 -- 172.21.15.22:0/1374105144 shutdown_connections 2024-09-21T04:01:57.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.794+0000 7f7e7db75640 1 --2- 172.21.15.22:0/1374105144 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e78105330 0x7f7e7810d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.794+0000 7f7e7db75640 1 --2- 172.21.15.22:0/1374105144 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e7810de40 0x7f7e78110330 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.794+0000 7f7e7db75640 1 --2- 172.21.15.22:0/1374105144 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e781049e0 0x7f7e78104df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.794+0000 7f7e7db75640 1 -- 172.21.15.22:0/1374105144 >> 172.21.15.22:0/1374105144 conn(0x7f7e78079730 msgr2=0x7f7e78079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:57.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.794+0000 7f7e7db75640 1 -- 172.21.15.22:0/1374105144 shutdown_connections 2024-09-21T04:01:57.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.794+0000 7f7e7db75640 1 -- 172.21.15.22:0/1374105144 wait complete. 2024-09-21T04:01:57.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.795+0000 7f7e7db75640 1 Processor -- start 2024-09-21T04:01:57.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.795+0000 7f7e7db75640 1 -- start start 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.795+0000 7f7e7db75640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e781049e0 0x7f7e7819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.795+0000 7f7e7db75640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e78105330 0x7f7e7819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.795+0000 7f7e7db75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7810de40 0x7f7e7819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.795+0000 7f7e7db75640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7e781139c0 con 0x7f7e78105330 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.795+0000 7f7e7db75640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7e78113840 con 0x7f7e781049e0 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.795+0000 7f7e7db75640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7e78113b40 con 0x7f7e7810de40 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.795+0000 7f7e6effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e78105330 0x7f7e7819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e6effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e78105330 0x7f7e7819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37918/0 (socket says 172.21.15.22:37918) 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e6effd640 1 -- 172.21.15.22:0/1038304097 learned_addr learned my addr 172.21.15.22:0/1038304097 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e777fe640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e781049e0 0x7f7e7819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e77fff640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7810de40 0x7f7e7819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e6effd640 1 -- 172.21.15.22:0/1038304097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7810de40 msgr2=0x7f7e7819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e6effd640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7810de40 0x7f7e7819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e6effd640 1 -- 172.21.15.22:0/1038304097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e781049e0 msgr2=0x7f7e7819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e6effd640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e781049e0 0x7f7e7819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e6effd640 1 -- 172.21.15.22:0/1038304097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e781a02e0 con 0x7f7e78105330 2024-09-21T04:01:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e6effd640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e78105330 0x7f7e7819a910 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000d750 tx=0x7f7e6000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e757fa640 1 -- 172.21.15.22:0/1038304097 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60017070 con 0x7f7e78105330 2024-09-21T04:01:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e757fa640 1 -- 172.21.15.22:0/1038304097 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e600054b0 con 0x7f7e78105330 2024-09-21T04:01:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e7db75640 1 -- 172.21.15.22:0/1038304097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e781a05d0 con 0x7f7e78105330 2024-09-21T04:01:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e757fa640 1 -- 172.21.15.22:0/1038304097 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e60004bc0 con 0x7f7e78105330 2024-09-21T04:01:57.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.796+0000 7f7e7db75640 1 -- 172.21.15.22:0/1038304097 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e781a6d30 con 0x7f7e78105330 2024-09-21T04:01:57.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.799+0000 7f7e840e9740 1 Processor -- start 2024-09-21T04:01:57.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.799+0000 7f7e840e9740 1 -- start start 2024-09-21T04:01:57.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.799+0000 7f7e757fa640 1 -- 172.21.15.22:0/1038304097 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7f7e60009c30 con 0x7f7e78105330 2024-09-21T04:01:57.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.799+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c5ff60 0x557e73005f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.799+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e73006440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.799+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c3f280 0x557e73006980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.799+0000 7f7e840e9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e72f7dc10 con 0x557e72c3f280 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.799+0000 7f7e840e9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557e72f6d040 con 0x557e72c370a0 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.799+0000 7f7e840e9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557e72f70e50 con 0x557e72c5ff60 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e6effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c3f280 0x557e73006980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e6effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c3f280 0x557e73006980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37932/0 (socket says 172.21.15.22:37932) 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e6effd640 1 -- 172.21.15.22:0/3696989974 learned_addr learned my addr 172.21.15.22:0/3696989974 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e777fe640 1 --2- 172.21.15.22:0/3696989974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e73006440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e77fff640 1 --2- 172.21.15.22:0/3696989974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c5ff60 0x557e73005f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e777fe640 1 -- 172.21.15.22:0/3696989974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c5ff60 msgr2=0x557e73005f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e777fe640 1 --2- 172.21.15.22:0/3696989974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c5ff60 0x557e73005f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e777fe640 1 -- 172.21.15.22:0/3696989974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c3f280 msgr2=0x557e73006980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:57.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e777fe640 1 --2- 172.21.15.22:0/3696989974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c3f280 0x557e73006980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e777fe640 1 -- 172.21.15.22:0/3696989974 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e72ccb540 con 0x557e72c370a0 2024-09-21T04:01:57.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e6effd640 1 --2- 172.21.15.22:0/3696989974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c3f280 0x557e73006980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:57.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e757fa640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7e640b65a0 0x7f7e640b8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e777fe640 1 --2- 172.21.15.22:0/3696989974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e73006440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800bbf0 tx=0x7f7e680107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=996f272e3b3087df server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:57.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e77fff640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7e640b65a0 0x7f7e640b8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.800+0000 7f7e757fa640 1 -- 172.21.15.22:0/1038304097 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7e600e71e0 con 0x7f7e78105330 2024-09-21T04:01:57.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.801+0000 7f7e6dffb640 1 -- 172.21.15.22:0/3696989974 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e68004030 con 0x557e72c370a0 2024-09-21T04:01:57.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.801+0000 7f7e6dffb640 1 -- 172.21.15.22:0/3696989974 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e680035f0 con 0x557e72c370a0 2024-09-21T04:01:57.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.801+0000 7f7e6dffb640 1 -- 172.21.15.22:0/3696989974 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e680116a0 con 0x557e72c370a0 2024-09-21T04:01:57.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.801+0000 7f7e840e9740 1 -- 172.21.15.22:0/3696989974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 msgr2=0x557e73006440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:57.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.801+0000 7f7e840e9740 1 --2- 172.21.15.22:0/3696989974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e73006440 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7e6800bbf0 tx=0x7f7e680107a0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.801+0000 7f7e77fff640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7e640b65a0 0x7f7e640b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7e70006010 tx=0x7f7e70009410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:57.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.802+0000 7f7e840e9740 1 -- 172.21.15.22:0/3696989974 shutdown_connections 2024-09-21T04:01:57.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.802+0000 7f7e840e9740 1 --2- 172.21.15.22:0/3696989974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c3f280 0x557e73006980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.802+0000 7f7e840e9740 1 --2- 172.21.15.22:0/3696989974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e73006440 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.802+0000 7f7e840e9740 1 --2- 172.21.15.22:0/3696989974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c5ff60 0x557e73005f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.802+0000 7f7e840e9740 1 -- 172.21.15.22:0/3696989974 >> 172.21.15.22:0/3696989974 conn(0x557e72c54350 msgr2=0x557e73003df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.802+0000 7f7e840e9740 1 -- 172.21.15.22:0/3696989974 shutdown_connections 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.802+0000 7f7e840e9740 1 -- 172.21.15.22:0/3696989974 wait complete. 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.802+0000 7f7e840e9740 1 -- start start 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.802+0000 7f7e840e9740 1 Processor -- start 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e730119e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 0x557e73011f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e7301da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e840e9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e72dce5f0 con 0x557e72c5ff60 2024-09-21T04:01:57.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e840e9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557e72f08010 con 0x557e72c370a0 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e840e9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557e730146e0 con 0x557e72c3f280 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e840e9740 10 client.0 _ll_register_callbacks cb 0x557e72f67340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e7301da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e7301da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37934/0 (socket says 172.21.15.22:37934) 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e77fff640 1 -- 172.21.15.22:0/358286732 learned_addr learned my addr 172.21.15.22:0/358286732 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e777fe640 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e730119e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e6effd640 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 0x557e73011f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e77fff640 1 -- 172.21.15.22:0/358286732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 msgr2=0x557e73011f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e77fff640 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 0x557e73011f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e77fff640 1 -- 172.21.15.22:0/358286732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 msgr2=0x557e730119e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e77fff640 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e730119e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.803+0000 7f7e77fff640 1 -- 172.21.15.22:0/358286732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e72f35a00 con 0x557e72c5ff60 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e77fff640 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e7301da30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7e70035000 tx=0x7f7e7002a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6904d4bbd4442b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e56ffd640 1 -- 172.21.15.22:0/358286732 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70031780 con 0x557e72c5ff60 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e56ffd640 1 -- 172.21.15.22:0/358286732 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7e70004250 con 0x557e72c5ff60 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e840e9740 1 -- 172.21.15.22:0/358286732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e680035f0 con 0x557e72c5ff60 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e56ffd640 1 -- 172.21.15.22:0/358286732 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e70004450 con 0x557e72c5ff60 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e840e9740 10 client.15321 fetch_fsmap learned FSMap version 28 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e840e9740 1 -- 172.21.15.22:0/358286732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557e73020680 con 0x557e72c5ff60 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e56ffd640 1 -- 172.21.15.22:0/358286732 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e680035f0 con 0x557e72c5ff60 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e56ffd640 1 -- 172.21.15.22:0/358286732 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7e70051070 con 0x557e72c5ff60 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.804+0000 7f7e840e9740 10 client.15321 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:01:57.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.805+0000 7f7e840e9740 10 client.15321 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T04:01:57.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.805+0000 7f7e840e9740 20 client.15321 populate_metadata read hostname 'smithi022' 2024-09-21T04:01:57.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.805+0000 7f7e840e9740 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557e72c1e8e0 0x557e73024260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.805+0000 7f7e840e9740 4 client.15321 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:01:57.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.805+0000 7f7e840e9740 1 -- 172.21.15.22:0/358286732 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e72f7fb60 con 0x557e72c1e8e0 2024-09-21T04:01:57.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.805+0000 7f7e777fe640 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557e72c1e8e0 0x557e73024260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.805+0000 7f7e56ffd640 10 client.15321 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:01:57.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.805+0000 7f7e777fe640 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557e72c1e8e0 0x557e73024260 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=688ce0c5cfbfbd13 server_cookie=7a3d8ce054e36007 in_seq=0 out_seq=0 2024-09-21T04:01:57.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.806+0000 7f7e56ffd640 1 -- 172.21.15.22:0/358286732 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557e72f7fb60 con 0x557e72c1e8e0 2024-09-21T04:01:57.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.806+0000 7f7e56ffd640 10 client.15321 handle_command_reply: tid=0 2024-09-21T04:01:57.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.806+0000 7f7e840e9740 1 client.15321 shutdown 2024-09-21T04:01:57.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.806+0000 7f7e840e9740 1 -- 172.21.15.22:0/358286732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 msgr2=0x557e7301da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e840e9740 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e7301da30 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f7e70035000 tx=0x7f7e7002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e840e9740 1 -- 172.21.15.22:0/358286732 shutdown_connections 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e840e9740 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557e72c1e8e0 0x557e73024260 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e840e9740 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 0x557e73011f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e840e9740 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e7301da30 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e840e9740 1 --2- 172.21.15.22:0/358286732 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e730119e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e840e9740 1 -- 172.21.15.22:0/358286732 >> 172.21.15.22:0/358286732 conn(0x557e72c54350 msgr2=0x557e73009090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e56ffd640 0 client.15321 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e840e9740 1 -- 172.21.15.22:0/358286732 shutdown_connections 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e840e9740 1 -- 172.21.15.22:0/358286732 wait complete. 2024-09-21T04:01:57.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.807+0000 7f7e840e9740 20 client.15321 trim_cache size 0 max 16384 2024-09-21T04:01:57.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.825+0000 7f7e840e9740 1 Processor -- start 2024-09-21T04:01:57.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.825+0000 7f7e840e9740 1 -- start start 2024-09-21T04:01:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.825+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c370a0 0x557e730220e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.825+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c3f280 0x557e7300c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.825+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73003600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.825+0000 7f7e840e9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e73022710 con 0x557e72c5ff60 2024-09-21T04:01:57.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.825+0000 7f7e840e9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557e73022c70 con 0x557e72c3f280 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.825+0000 7f7e840e9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557e73023340 con 0x557e72c370a0 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.825+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73003600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73003600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37940/0 (socket says 172.21.15.22:37940) 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e77fff640 1 -- 172.21.15.22:0/80388029 learned_addr learned my addr 172.21.15.22:0/80388029 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e777fe640 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c370a0 0x557e730220e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e77fff640 1 -- 172.21.15.22:0/80388029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c370a0 msgr2=0x557e730220e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e77fff640 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c370a0 0x557e730220e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e6effd640 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c3f280 0x557e7300c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e77fff640 1 -- 172.21.15.22:0/80388029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c3f280 msgr2=0x557e7300c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e77fff640 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c3f280 0x557e7300c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e77fff640 1 -- 172.21.15.22:0/80388029 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e73012aa0 con 0x557e72c5ff60 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e777fe640 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c370a0 0x557e730220e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:57.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e6effd640 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c3f280 0x557e7300c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:01:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e77fff640 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73003600 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7e7002ade0 tx=0x7f7e70009bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=996f00cf2782d369 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e6d7fa640 1 -- 172.21.15.22:0/80388029 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70031780 con 0x557e72c5ff60 2024-09-21T04:01:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e6d7fa640 1 -- 172.21.15.22:0/80388029 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e70036050 con 0x557e72c5ff60 2024-09-21T04:01:57.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.826+0000 7f7e6d7fa640 1 -- 172.21.15.22:0/80388029 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70004850 con 0x557e72c5ff60 2024-09-21T04:01:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.827+0000 7f7e840e9740 1 -- 172.21.15.22:0/80388029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 msgr2=0x557e73003600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.827+0000 7f7e840e9740 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73003600 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f7e7002ade0 tx=0x7f7e70009bd0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.827+0000 7f7e840e9740 1 -- 172.21.15.22:0/80388029 shutdown_connections 2024-09-21T04:01:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.827+0000 7f7e840e9740 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73003600 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.827+0000 7f7e840e9740 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c3f280 0x557e7300c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.827+0000 7f7e840e9740 1 --2- 172.21.15.22:0/80388029 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c370a0 0x557e730220e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.827+0000 7f7e840e9740 1 -- 172.21.15.22:0/80388029 >> 172.21.15.22:0/80388029 conn(0x557e72c54350 msgr2=0x557e730219d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.827+0000 7f7e840e9740 1 -- 172.21.15.22:0/80388029 shutdown_connections 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.827+0000 7f7e840e9740 1 -- 172.21.15.22:0/80388029 wait complete. 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e840e9740 1 -- start start 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e840e9740 1 Processor -- start 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e7302cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 0x557e73028140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e840e9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73028680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e840e9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557e730240e0 con 0x557e72c5ff60 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e840e9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557e73023a10 con 0x557e72c370a0 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e840e9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557e730247b0 con 0x557e72c3f280 2024-09-21T04:01:57.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e840e9740 10 client.0 _ll_register_callbacks cb 0x7f7e70009980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73028680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e77fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73028680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37956/0 (socket says 172.21.15.22:37956) 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e6effd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 0x557e73028140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e777fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e7302cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.828+0000 7f7e77fff640 1 -- 172.21.15.22:0/2141289139 learned_addr learned my addr 172.21.15.22:0/2141289139 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e77fff640 1 -- 172.21.15.22:0/2141289139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 msgr2=0x557e73028140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e77fff640 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 0x557e73028140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e77fff640 1 -- 172.21.15.22:0/2141289139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 msgr2=0x557e7302cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e77fff640 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e7302cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e77fff640 1 -- 172.21.15.22:0/2141289139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e73028d90 con 0x557e72c5ff60 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e6effd640 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 0x557e73028140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e77fff640 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73028680 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009ca0 tx=0x7f7e70030f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff6d27a0b0de95a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:57.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e56ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e56ffd640 1 -- 172.21.15.22:0/2141289139 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e70031780 con 0x557e72c5ff60 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e56ffd640 1 -- 172.21.15.22:0/2141289139 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7e70053440 con 0x557e72c5ff60 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e840e9740 1 -- 172.21.15.22:0/2141289139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e70036050 con 0x557e72c5ff60 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e56ffd640 1 -- 172.21.15.22:0/2141289139 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7e700307d0 con 0x557e72c5ff60 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e840e9740 10 client.15327 fetch_fsmap learned FSMap version 28 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.829+0000 7f7e840e9740 1 -- 172.21.15.22:0/2141289139 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x557e7308f4d0 con 0x557e72c5ff60 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.830+0000 7f7e56ffd640 1 -- 172.21.15.22:0/2141289139 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7e70036050 con 0x557e72c5ff60 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.830+0000 7f7e56ffd640 1 -- 172.21.15.22:0/2141289139 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f7e70051070 con 0x557e72c5ff60 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.830+0000 7f7e840e9740 10 client.15327 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.830+0000 7f7e840e9740 10 client.15327 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.830+0000 7f7e840e9740 20 client.15327 populate_metadata read hostname 'smithi022' 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.830+0000 7f7e840e9740 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557e72bf3c90 0x557e73092970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:57.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.830+0000 7f7e840e9740 4 client.15327 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.830+0000 7f7e840e9740 1 -- 172.21.15.22:0/2141289139 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "status"}) -- 0x557e72f7b610 con 0x557e72bf3c90 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.830+0000 7f7e777fe640 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557e72bf3c90 0x557e73092970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e777fe640 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557e72bf3c90 0x557e73092970 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10e56b2e4862015 server_cookie=2b77832638a90ade in_seq=0 out_seq=0 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e56ffd640 10 client.15327 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e56ffd640 1 -- 172.21.15.22:0/2141289139 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557e72f7b610 con 0x557e72bf3c90 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e56ffd640 10 client.15327 handle_command_reply: tid=0 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 client.15327 shutdown 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 -- 172.21.15.22:0/2141289139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 msgr2=0x557e73028680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73028680 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009ca0 tx=0x7f7e70030f60 comp rx=0 tx=0).stop 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 -- 172.21.15.22:0/2141289139 shutdown_connections 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557e72bf3c90 0x557e73092970 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557e72c3f280 0x557e73028140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e56ffd640 0 client.15327 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:01:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557e72c5ff60 0x557e73028680 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 --2- 172.21.15.22:0/2141289139 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557e72c370a0 0x557e7302cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 -- 172.21.15.22:0/2141289139 >> 172.21.15.22:0/2141289139 conn(0x557e72c54350 msgr2=0x557e73003600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 -- 172.21.15.22:0/2141289139 shutdown_connections 2024-09-21T04:01:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 1 -- 172.21.15.22:0/2141289139 wait complete. 2024-09-21T04:01:57.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.831+0000 7f7e840e9740 20 client.15327 trim_cache size 0 max 16384 2024-09-21T04:01:57.839 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:01:57.839 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:01:57.839 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-21T04:01:57.839 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24647, 2024-09-21T04:01:57.840 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:01:57.840 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:01:57.840 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:01:57.840 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 112.83068724100001, 2024-09-21T04:01:57.840 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-21T04:01:57.840 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:01:57.840 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T04:01:57.840 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 124.572072656 2024-09-21T04:01:57.840 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 -- 172.21.15.22:0/1038304097 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7e640b65a0 msgr2=0x7f7e640b8ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7e640b65a0 0x7f7e640b8ab0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f7e70006010 tx=0x7f7e70009410 comp rx=0 tx=0).stop 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 -- 172.21.15.22:0/1038304097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e78105330 msgr2=0x7f7e7819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e78105330 0x7f7e7819a910 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f7e6000d750 tx=0x7f7e6000dc10 comp rx=0 tx=0).stop 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 -- 172.21.15.22:0/1038304097 shutdown_connections 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7e640b65a0 0x7f7e640b8ab0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7e7810de40 0x7f7e7819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7e78105330 0x7f7e7819a910 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 --2- 172.21.15.22:0/1038304097 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7e781049e0 0x7f7e7819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 -- 172.21.15.22:0/1038304097 >> 172.21.15.22:0/1038304097 conn(0x7f7e78079730 msgr2=0x7f7e781078d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:57.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 -- 172.21.15.22:0/1038304097 shutdown_connections 2024-09-21T04:01:57.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:57.832+0000 7f7e7db75640 1 -- 172.21.15.22:0/1038304097 wait complete. 2024-09-21T04:01:58.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:01:58 smithi060 ceph-mon[33722]: pgmap v359: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:01:58.595 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:01:58 smithi022 ceph-mon[31015]: pgmap v359: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:01:58.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:01:58 smithi073 ceph-mon[34443]: pgmap v359: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:01:58.624 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T04:01:58.624 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T04:01:58.633 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-21T04:01:58.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T04:01:58.890 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:01:59.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.389+0000 7fd31797f640 1 -- 172.21.15.22:0/4042747495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd310103830 msgr2=0x7fd31010a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.389+0000 7fd31797f640 1 --2- 172.21.15.22:0/4042747495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd310103830 0x7fd31010a1d0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fd30800adb0 tx=0x7fd30802b830 comp rx=0 tx=0).stop 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.389+0000 7fd31797f640 1 -- 172.21.15.22:0/4042747495 shutdown_connections 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.389+0000 7fd31797f640 1 --2- 172.21.15.22:0/4042747495 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd310103830 0x7fd31010a1d0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.389+0000 7fd31797f640 1 --2- 172.21.15.22:0/4042747495 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310102e90 0x7fd3101032a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.389+0000 7fd31797f640 1 --2- 172.21.15.22:0/4042747495 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd310101e00 0x7fd310102270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.389+0000 7fd31797f640 1 -- 172.21.15.22:0/4042747495 >> 172.21.15.22:0/4042747495 conn(0x7fd3100fd770 msgr2=0x7fd3100ffc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.389+0000 7fd31797f640 1 -- 172.21.15.22:0/4042747495 shutdown_connections 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.389+0000 7fd31797f640 1 -- 172.21.15.22:0/4042747495 wait complete. 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd31797f640 1 Processor -- start 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd31797f640 1 -- start start 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd31797f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd310101e00 0x7fd3101059f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd31797f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310102e90 0x7fd3101042c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd31797f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd310103830 0x7fd310104800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd31797f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd31010d080 con 0x7fd310103830 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd31797f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd31010cf00 con 0x7fd310102e90 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd31797f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd31010d200 con 0x7fd310101e00 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd315f1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd310103830 0x7fd310104800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd315f1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd310103830 0x7fd310104800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37984/0 (socket says 172.21.15.22:37984) 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd315f1c640 1 -- 172.21.15.22:0/3200217065 learned_addr learned my addr 172.21.15.22:0/3200217065 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd31571b640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd310101e00 0x7fd3101059f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd314f1a640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310102e90 0x7fd3101042c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd315f1c640 1 -- 172.21.15.22:0/3200217065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd310101e00 msgr2=0x7fd3101059f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd315f1c640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd310101e00 0x7fd3101059f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd315f1c640 1 -- 172.21.15.22:0/3200217065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310102e90 msgr2=0x7fd3101042c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd315f1c640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310102e90 0x7fd3101042c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd315f1c640 1 -- 172.21.15.22:0/3200217065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd310104f00 con 0x7fd310103830 2024-09-21T04:01:59.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.390+0000 7fd31571b640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd310101e00 0x7fd3101059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.391+0000 7fd315f1c640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd310103830 0x7fd310104800 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd3080328d0 tx=0x7fd308032e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.391+0000 7fd3067fc640 1 -- 172.21.15.22:0/3200217065 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308041070 con 0x7fd310103830 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.391+0000 7fd3067fc640 1 -- 172.21.15.22:0/3200217065 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd308003d80 con 0x7fd310103830 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.391+0000 7fd3067fc640 1 -- 172.21.15.22:0/3200217065 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd308004720 con 0x7fd310103830 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.391+0000 7fd31797f640 1 -- 172.21.15.22:0/3200217065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3101a3f70 con 0x7fd310103830 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.391+0000 7fd31797f640 1 -- 172.21.15.22:0/3200217065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3101a4310 con 0x7fd310103830 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.392+0000 7fd31797f640 1 -- 172.21.15.22:0/3200217065 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3101a44e0 con 0x7fd310103830 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.395+0000 7fd3067fc640 1 -- 172.21.15.22:0/3200217065 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 17) ==== 154563+0+0 (secure 0 0 0) 0x7fd308033420 con 0x7fd310103830 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.395+0000 7fd3067fc640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2fc0b6620 0x7fd2fc0b8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.395+0000 7fd31571b640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2fc0b6620 0x7fd2fc0b8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.395+0000 7fd3067fc640 1 -- 172.21.15.22:0/3200217065 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fd308108ec0 con 0x7fd310103830 2024-09-21T04:01:59.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.396+0000 7fd31571b640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2fc0b6620 0x7fd2fc0b8b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009fc0 tx=0x7fd30c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:01:59.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.399+0000 7fd3067fc640 1 -- 172.21.15.22:0/3200217065 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd3080cf1d0 con 0x7fd310103830 2024-09-21T04:01:59.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.605+0000 7fd31797f640 1 -- 172.21.15.22:0/3200217065 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7fd310109ae0 con 0x7fd2fc0b6620 2024-09-21T04:01:59.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.606+0000 7fd3067fc640 1 -- 172.21.15.22:0/3200217065 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7fd310109ae0 con 0x7fd2fc0b6620 2024-09-21T04:01:59.609 INFO:teuthology.orchestra.run.smithi022.stdout:Backend: cephadm 2024-09-21T04:01:59.609 INFO:teuthology.orchestra.run.smithi022.stdout:Available: Yes 2024-09-21T04:01:59.609 INFO:teuthology.orchestra.run.smithi022.stdout:Paused: No 2024-09-21T04:01:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.608+0000 7fd31797f640 1 -- 172.21.15.22:0/3200217065 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2fc0b6620 msgr2=0x7fd2fc0b8b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.608+0000 7fd31797f640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2fc0b6620 0x7fd2fc0b8b30 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fd30c009fc0 tx=0x7fd30c005f90 comp rx=0 tx=0).stop 2024-09-21T04:01:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.608+0000 7fd31797f640 1 -- 172.21.15.22:0/3200217065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd310103830 msgr2=0x7fd310104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:01:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.608+0000 7fd31797f640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd310103830 0x7fd310104800 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fd3080328d0 tx=0x7fd308032e20 comp rx=0 tx=0).stop 2024-09-21T04:01:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.609+0000 7fd31797f640 1 -- 172.21.15.22:0/3200217065 shutdown_connections 2024-09-21T04:01:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.609+0000 7fd31797f640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd2fc0b6620 0x7fd2fc0b8b30 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.609+0000 7fd31797f640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd310103830 0x7fd310104800 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.609+0000 7fd31797f640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd310102e90 0x7fd3101042c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.609+0000 7fd31797f640 1 --2- 172.21.15.22:0/3200217065 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd310101e00 0x7fd3101059f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:01:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.609+0000 7fd31797f640 1 -- 172.21.15.22:0/3200217065 >> 172.21.15.22:0/3200217065 conn(0x7fd3100fd770 msgr2=0x7fd3101083c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:01:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.609+0000 7fd31797f640 1 -- 172.21.15.22:0/3200217065 shutdown_connections 2024-09-21T04:01:59.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:01:59.609+0000 7fd31797f640 1 -- 172.21.15.22:0/3200217065 wait complete. 2024-09-21T04:02:00.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:00 smithi022 ceph-mon[31015]: pgmap v360: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:02:00.322 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:00 smithi022 ceph-mon[31015]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:00.356 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T04:02:00.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:00 smithi060 ceph-mon[33722]: pgmap v360: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:02:00.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:00 smithi060 ceph-mon[33722]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:00.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:00 smithi073 ceph-mon[34443]: pgmap v360: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:02:00.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:00 smithi073 ceph-mon[34443]: from='client.15333 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:00.617 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:01.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.156+0000 7f7fdb18d640 1 -- 172.21.15.22:0/2866942444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fd4106a10 msgr2=0x7f7fd4106e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:01.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.156+0000 7f7fdb18d640 1 --2- 172.21.15.22:0/2866942444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fd4106a10 0x7f7fd4106e20 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7fc0009900 tx=0x7f7fc002a480 comp rx=0 tx=0).stop 2024-09-21T04:02:01.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.156+0000 7f7fdb18d640 1 -- 172.21.15.22:0/2866942444 shutdown_connections 2024-09-21T04:02:01.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.156+0000 7f7fdb18d640 1 --2- 172.21.15.22:0/2866942444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd41073b0 0x7f7fd410dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:01.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.156+0000 7f7fdb18d640 1 --2- 172.21.15.22:0/2866942444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fd4106a10 0x7f7fd4106e20 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:01.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.156+0000 7f7fdb18d640 1 --2- 172.21.15.22:0/2866942444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fd4105980 0x7f7fd4105df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:01.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.156+0000 7f7fdb18d640 1 -- 172.21.15.22:0/2866942444 >> 172.21.15.22:0/2866942444 conn(0x7f7fd41012f0 msgr2=0x7f7fd41037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:01.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.156+0000 7f7fdb18d640 1 -- 172.21.15.22:0/2866942444 shutdown_connections 2024-09-21T04:02:01.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.156+0000 7f7fdb18d640 1 -- 172.21.15.22:0/2866942444 wait complete. 2024-09-21T04:02:01.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fdb18d640 1 Processor -- start 2024-09-21T04:02:01.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fdb18d640 1 -- start start 2024-09-21T04:02:01.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fdb18d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fd4105980 0x7f7fd419c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:01.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fdb18d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd4106a10 0x7f7fd419c750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:01.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fdb18d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fd41073b0 0x7f7fd419d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fdb18d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd4111460 con 0x7f7fd41073b0 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fdb18d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd41112e0 con 0x7f7fd4106a10 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fdb18d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7fd41115e0 con 0x7f7fd4105980 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd972a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fd41073b0 0x7f7fd419d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd972a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fd41073b0 0x7f7fd419d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57914/0 (socket says 172.21.15.22:57914) 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd972a640 1 -- 172.21.15.22:0/3868858152 learned_addr learned my addr 172.21.15.22:0/3868858152 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd3fff640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd4106a10 0x7f7fd419c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd8f29640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fd4105980 0x7f7fd419c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd972a640 1 -- 172.21.15.22:0/3868858152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fd4105980 msgr2=0x7f7fd419c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd972a640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fd4105980 0x7f7fd419c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd972a640 1 -- 172.21.15.22:0/3868858152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd4106a10 msgr2=0x7f7fd419c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:01.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd972a640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd4106a10 0x7f7fd419c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:01.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd972a640 1 -- 172.21.15.22:0/3868858152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fd419db10 con 0x7f7fd41073b0 2024-09-21T04:02:01.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.157+0000 7f7fd3fff640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd4106a10 0x7f7fd419c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:01.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.158+0000 7f7fd972a640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fd41073b0 0x7f7fd419d2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00eb10 tx=0x7f7fcc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:01.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.158+0000 7f7fd1ffb640 1 -- 172.21.15.22:0/3868858152 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc004b20 con 0x7f7fd41073b0 2024-09-21T04:02:01.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.158+0000 7f7fd1ffb640 1 -- 172.21.15.22:0/3868858152 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7fcc004cc0 con 0x7f7fd41073b0 2024-09-21T04:02:01.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.158+0000 7f7fdb18d640 1 -- 172.21.15.22:0/3868858152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fd419de00 con 0x7f7fd41073b0 2024-09-21T04:02:01.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.158+0000 7f7fd1ffb640 1 -- 172.21.15.22:0/3868858152 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7fcc010690 con 0x7f7fd41073b0 2024-09-21T04:02:01.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.158+0000 7f7fdb18d640 1 -- 172.21.15.22:0/3868858152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fd41a4500 con 0x7f7fd41073b0 2024-09-21T04:02:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.159+0000 7f7fdb18d640 1 -- 172.21.15.22:0/3868858152 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fd410cb40 con 0x7f7fd41073b0 2024-09-21T04:02:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.161+0000 7f7fd1ffb640 1 -- 172.21.15.22:0/3868858152 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7fcc005020 con 0x7f7fd41073b0 2024-09-21T04:02:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.161+0000 7f7fd1ffb640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7fc40b6590 0x7f7fc40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:01.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.162+0000 7f7fd8f29640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7fc40b6590 0x7f7fc40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:01.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.162+0000 7f7fd1ffb640 1 -- 172.21.15.22:0/3868858152 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7fcc0e7cd0 con 0x7f7fd41073b0 2024-09-21T04:02:01.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.162+0000 7f7fd8f29640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7fc40b6590 0x7f7fc40b8aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009bd0 tx=0x7f7fc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:01.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.166+0000 7f7fd1ffb640 1 -- 172.21.15.22:0/3868858152 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fcc0ae1a0 con 0x7f7fd41073b0 2024-09-21T04:02:01.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.365+0000 7f7fdb18d640 1 -- 172.21.15.22:0/3868858152 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7fd4063800 con 0x7f7fc40b6590 2024-09-21T04:02:01.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.377+0000 7f7fd1ffb640 1 -- 172.21.15.22:0/3868858152 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f7fd4063800 con 0x7f7fc40b6590 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:mds.a smithi022 running (2m) 60s ago 2m 83.9M - 19.3.0-5120-g18432218 ddce307e1f32 90f20fbcc5b7 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:mds.b smithi060 running (2m) 62s ago 2m 96.4M - 19.3.0-5120-g18432218 ddce307e1f32 c174ba78bae8 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:mds.c smithi073 running (2m) 62s ago 2m 85.2M - 19.3.0-5120-g18432218 ddce307e1f32 7db555eed38f 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:mds.d smithi022 running (2m) 60s ago 2m 83.2M - 19.3.0-5120-g18432218 ddce307e1f32 8a1cd8c88917 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:mds.e smithi060 running (2m) 62s ago 2m 84.7M - 19.3.0-5120-g18432218 ddce307e1f32 d36b2b6e6880 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:mds.f smithi073 running (2m) 62s ago 2m 84.7M - 19.3.0-5120-g18432218 ddce307e1f32 0d2eb9eae615 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:mds.g smithi022 running (2m) 60s ago 2m 83.3M - 19.3.0-5120-g18432218 ddce307e1f32 a5d6deb87649 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:mds.h smithi060 running (2m) 62s ago 2m 85.0M - 19.3.0-5120-g18432218 ddce307e1f32 a283df23cc3d 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:mds.i smithi073 running (2m) 62s ago 2m 85.2M - 19.3.0-5120-g18432218 ddce307e1f32 d4733cff4578 2024-09-21T04:02:01.380 INFO:teuthology.orchestra.run.smithi022.stdout:mds.j smithi022 running (2m) 60s ago 2m 82.2M - 19.3.0-5120-g18432218 ddce307e1f32 808efe801ad4 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:mds.k smithi060 running (2m) 62s ago 2m 85.7M - 19.3.0-5120-g18432218 ddce307e1f32 49f75a4572c0 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:mds.l smithi073 running (2m) 62s ago 2m 83.0M - 19.3.0-5120-g18432218 ddce307e1f32 50b7701970fa 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.x smithi022 *:9283,8765 running (10m) 60s ago 10m 589M - 19.3.0-5120-g18432218 ddce307e1f32 b2c9cbad686b 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.y smithi060 *:8443,8765 running (8m) 62s ago 8m 525M - 19.3.0-5120-g18432218 ddce307e1f32 ae3b2e9ed1d9 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:mgr.z smithi073 *:8443,8765 running (8m) 62s ago 8m 525M - 19.3.0-5120-g18432218 ddce307e1f32 50dde4f04bd0 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:mon.a smithi022 running (10m) 60s ago 10m 120M 2048M 19.3.0-5120-g18432218 ddce307e1f32 f3c4fd300993 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:mon.b smithi060 running (8m) 62s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 7f5455fe1e3f 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:mon.c smithi073 running (8m) 62s ago 8m 110M 2048M 19.3.0-5120-g18432218 ddce307e1f32 1da834a6f621 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 smithi022 running (7m) 60s ago 7m 125M 4273M 19.3.0-5120-g18432218 ddce307e1f32 8668143e12b1 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 smithi060 running (7m) 62s ago 7m 125M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7b51297caf7d 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 smithi073 running (6m) 62s ago 6m 126M 4272M 19.3.0-5120-g18432218 ddce307e1f32 97acbfa2c2ac 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 smithi022 running (6m) 60s ago 6m 120M 4273M 19.3.0-5120-g18432218 ddce307e1f32 065348046f1e 2024-09-21T04:02:01.381 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 smithi060 running (5m) 62s ago 5m 111M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7d51ff1542ec 2024-09-21T04:02:01.382 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 smithi073 running (5m) 62s ago 5m 123M 4272M 19.3.0-5120-g18432218 ddce307e1f32 3c7dc23667e4 2024-09-21T04:02:01.382 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 smithi022 running (5m) 60s ago 5m 119M 4273M 19.3.0-5120-g18432218 ddce307e1f32 f1ded252e70b 2024-09-21T04:02:01.382 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 smithi060 running (4m) 62s ago 4m 111M 4273M 19.3.0-5120-g18432218 ddce307e1f32 8f8264fb6a78 2024-09-21T04:02:01.382 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 smithi073 running (4m) 62s ago 4m 111M 4272M 19.3.0-5120-g18432218 ddce307e1f32 1dea37ae13be 2024-09-21T04:02:01.382 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 smithi022 running (3m) 60s ago 3m 109M 4273M 19.3.0-5120-g18432218 ddce307e1f32 7c9116c9e1e1 2024-09-21T04:02:01.382 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 smithi060 running (3m) 62s ago 3m 112M 4273M 19.3.0-5120-g18432218 ddce307e1f32 e2944ee37b12 2024-09-21T04:02:01.382 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 smithi073 running (2m) 62s ago 2m 120M 4272M 19.3.0-5120-g18432218 ddce307e1f32 b546d9b128f7 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 -- 172.21.15.22:0/3868858152 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7fc40b6590 msgr2=0x7f7fc40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7fc40b6590 0x7f7fc40b8aa0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7fc8009bd0 tx=0x7f7fc8005f90 comp rx=0 tx=0).stop 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 -- 172.21.15.22:0/3868858152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fd41073b0 msgr2=0x7f7fd419d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fd41073b0 0x7f7fd419d2f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f7fcc00eb10 tx=0x7f7fcc00c2d0 comp rx=0 tx=0).stop 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 -- 172.21.15.22:0/3868858152 shutdown_connections 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7fc40b6590 0x7f7fc40b8aa0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7fd41073b0 0x7f7fd419d2f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7fd4106a10 0x7f7fd419c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 --2- 172.21.15.22:0/3868858152 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7fd4105980 0x7f7fd419c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 -- 172.21.15.22:0/3868858152 >> 172.21.15.22:0/3868858152 conn(0x7f7fd41012f0 msgr2=0x7f7fd4109d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 -- 172.21.15.22:0/3868858152 shutdown_connections 2024-09-21T04:02:01.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:01.380+0000 7f7fdb18d640 1 -- 172.21.15.22:0/3868858152 wait complete. 2024-09-21T04:02:02.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T04:02:02.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:02 smithi060 ceph-mon[33722]: pgmap v361: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T04:02:02.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:02 smithi060 ceph-mon[33722]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-09-21T04:02:02.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:02 smithi060 ceph-mon[33722]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:02.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:02 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:02:02.461 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:02 smithi073 ceph-mon[34443]: pgmap v361: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T04:02:02.461 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:02 smithi073 ceph-mon[34443]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-09-21T04:02:02.462 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:02 smithi073 ceph-mon[34443]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:02.462 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:02 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:02:02.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:02 smithi022 ceph-mon[31015]: pgmap v361: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 341 B/s wr, 11 op/s 2024-09-21T04:02:02.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:02 smithi022 ceph-mon[31015]: mgrmap e18: x(active, since 9m), standbys: y, z 2024-09-21T04:02:02.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:02 smithi022 ceph-mon[31015]: from='client.15339 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:02.512 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:02 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:02:03.152 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:03.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.667+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/867490853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cec1036d0 msgr2=0x7f0cec103ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:03.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.667+0000 7f0cf0ec5640 1 --2- 172.21.15.22:0/867490853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cec1036d0 0x7f0cec103ae0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4009900 tx=0x7f0cd402a480 comp rx=0 tx=0).stop 2024-09-21T04:02:03.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.667+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/867490853 shutdown_connections 2024-09-21T04:02:03.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.667+0000 7f0cf0ec5640 1 --2- 172.21.15.22:0/867490853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cec104070 0x7f0cec10aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:03.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.667+0000 7f0cf0ec5640 1 --2- 172.21.15.22:0/867490853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cec1036d0 0x7f0cec103ae0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:03.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.667+0000 7f0cf0ec5640 1 --2- 172.21.15.22:0/867490853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cec102640 0x7f0cec102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:03.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.667+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/867490853 >> 172.21.15.22:0/867490853 conn(0x7f0cec0fdfb0 msgr2=0x7f0cec100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:03.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.667+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/867490853 shutdown_connections 2024-09-21T04:02:03.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.667+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/867490853 wait complete. 2024-09-21T04:02:03.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.668+0000 7f0cf0ec5640 1 Processor -- start 2024-09-21T04:02:03.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.668+0000 7f0cf0ec5640 1 -- start start 2024-09-21T04:02:03.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.668+0000 7f0cf0ec5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cec102640 0x7f0cec06b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.668+0000 7f0cf0ec5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cec1036d0 0x7f0cec19ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.668+0000 7f0cf0ec5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cec104070 0x7f0cec1a1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.668+0000 7f0cf0ec5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec10e140 con 0x7f0cec1036d0 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.668+0000 7f0cf0ec5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec10dfc0 con 0x7f0cec104070 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.668+0000 7f0cf0ec5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0cec10e2c0 con 0x7f0cec102640 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0ce9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cec1036d0 0x7f0cec19ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0ce9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cec1036d0 0x7f0cec19ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57928/0 (socket says 172.21.15.22:57928) 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0ce9d9b640 1 -- 172.21.15.22:0/1512435364 learned_addr learned my addr 172.21.15.22:0/1512435364 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0cea59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cec102640 0x7f0cec06b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0cead9d640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cec104070 0x7f0cec1a1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0cea59c640 1 -- 172.21.15.22:0/1512435364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cec104070 msgr2=0x7f0cec1a1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0cea59c640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cec104070 0x7f0cec1a1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:03.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0cea59c640 1 -- 172.21.15.22:0/1512435364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cec1036d0 msgr2=0x7f0cec19ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0cea59c640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cec1036d0 0x7f0cec19ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0cea59c640 1 -- 172.21.15.22:0/1512435364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cec1a19a0 con 0x7f0cec102640 2024-09-21T04:02:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0ce9d9b640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cec1036d0 0x7f0cec19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0cead9d640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cec104070 0x7f0cec1a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0cea59c640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cec102640 0x7f0cec06b6c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00eb00 tx=0x7f0cdc00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0ce37fe640 1 -- 172.21.15.22:0/1512435364 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc010430 con 0x7f0cec102640 2024-09-21T04:02:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0ce37fe640 1 -- 172.21.15.22:0/1512435364 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0cdc010a60 con 0x7f0cec102640 2024-09-21T04:02:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.669+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/1512435364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cec1a1c90 con 0x7f0cec102640 2024-09-21T04:02:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.670+0000 7f0ce37fe640 1 -- 172.21.15.22:0/1512435364 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cdc0179c0 con 0x7f0cec102640 2024-09-21T04:02:03.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.670+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/1512435364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cec1a2180 con 0x7f0cec102640 2024-09-21T04:02:03.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.671+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/1512435364 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cec109800 con 0x7f0cec102640 2024-09-21T04:02:03.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.672+0000 7f0ce37fe640 1 -- 172.21.15.22:0/1512435364 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0cdc017ba0 con 0x7f0cec102640 2024-09-21T04:02:03.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.673+0000 7f0ce37fe640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0cd80b6510 0x7f0cd80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:03.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.673+0000 7f0ce9d9b640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0cd80b6510 0x7f0cd80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:03.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.673+0000 7f0ce37fe640 1 -- 172.21.15.22:0/1512435364 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f0cdc0e8420 con 0x7f0cec102640 2024-09-21T04:02:03.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.674+0000 7f0ce9d9b640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0cd80b6510 0x7f0cd80b8a20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4005760 tx=0x7f0cd4031400 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:03.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.676+0000 7f0ce37fe640 1 -- 172.21.15.22:0/1512435364 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0cdc0ae8f0 con 0x7f0cec102640 2024-09-21T04:02:03.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.892+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/1512435364 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f0cec063800 con 0x7f0cd80b6510 2024-09-21T04:02:03.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.898+0000 7f0ce37fe640 1 -- 172.21.15.22:0/1512435364 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f0cec063800 con 0x7f0cd80b6510 2024-09-21T04:02:03.901 INFO:teuthology.orchestra.run.smithi022.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T04:02:03.901 INFO:teuthology.orchestra.run.smithi022.stdout:mds.all 12/12 0s ago 2m smithi022=a;smithi022=d;smithi022=g;smithi022=j;smithi060=b;smithi060=e;smithi060=h;smithi060=k;smithi073=c;smithi073=f;smithi073=i;smithi073=l;count:12 2024-09-21T04:02:03.901 INFO:teuthology.orchestra.run.smithi022.stdout:mgr 3/3 0s ago 8m smithi022=x;smithi060=y;smithi073=z;count:3 2024-09-21T04:02:03.901 INFO:teuthology.orchestra.run.smithi022.stdout:mon 3/3 0s ago 9m smithi022:172.21.15.22=a;smithi060:172.21.15.60=b;smithi073:172.21.15.73=c;count:3 2024-09-21T04:02:03.901 INFO:teuthology.orchestra.run.smithi022.stdout:osd 12 0s ago - 2024-09-21T04:02:03.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.900+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/1512435364 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0cd80b6510 msgr2=0x7f0cd80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:03.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.900+0000 7f0cf0ec5640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0cd80b6510 0x7f0cd80b8a20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0cd4005760 tx=0x7f0cd4031400 comp rx=0 tx=0).stop 2024-09-21T04:02:03.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.900+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/1512435364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cec102640 msgr2=0x7f0cec06b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:03.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.900+0000 7f0cf0ec5640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cec102640 0x7f0cec06b6c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc00eb00 tx=0x7f0cdc00c2d0 comp rx=0 tx=0).stop 2024-09-21T04:02:03.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.900+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/1512435364 shutdown_connections 2024-09-21T04:02:03.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.900+0000 7f0cf0ec5640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f0cd80b6510 0x7f0cd80b8a20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:03.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.900+0000 7f0cf0ec5640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0cec104070 0x7f0cec1a1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:03.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.900+0000 7f0cf0ec5640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0cec1036d0 0x7f0cec19ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:03.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.900+0000 7f0cf0ec5640 1 --2- 172.21.15.22:0/1512435364 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0cec102640 0x7f0cec06b6c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:03.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.900+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/1512435364 >> 172.21.15.22:0/1512435364 conn(0x7f0cec0fdfb0 msgr2=0x7f0cec1069d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:03.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.901+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/1512435364 shutdown_connections 2024-09-21T04:02:03.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:03.901+0000 7f0cf0ec5640 1 -- 172.21.15.22:0/1512435364 wait complete. 2024-09-21T04:02:04.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:04 smithi022 ceph-mon[31015]: pgmap v362: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-21T04:02:04.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.533 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:02:04.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:02:04.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.562 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T04:02:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:04 smithi073 ceph-mon[34443]: pgmap v362: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-21T04:02:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:02:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:02:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:04 smithi060 ceph-mon[33722]: pgmap v362: 129 pgs: 129 active+clean; 648 KiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 9 op/s 2024-09-21T04:02:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:02:04.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:02:04.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:02:04.817 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:05.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 -- 172.21.15.22:0/1341667706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7501094a0 msgr2=0x7fb75010b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:05.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 --2- 172.21.15.22:0/1341667706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7501094a0 0x7fb75010b9b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fb748009ca0 tx=0x7fb74802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 -- 172.21.15.22:0/1341667706 shutdown_connections 2024-09-21T04:02:05.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 --2- 172.21.15.22:0/1341667706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb750106900 0x7fb750108d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 --2- 172.21.15.22:0/1341667706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7501094a0 0x7fb75010b9b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 --2- 172.21.15.22:0/1341667706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75006c660 0x7fb7501063c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 -- 172.21.15.22:0/1341667706 >> 172.21.15.22:0/1341667706 conn(0x7fb7500fdfe0 msgr2=0x7fb750100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 -- 172.21.15.22:0/1341667706 shutdown_connections 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 -- 172.21.15.22:0/1341667706 wait complete. 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 Processor -- start 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.313+0000 7fb757d36640 1 -- start start 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb757d36640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75006c660 0x7fb75019c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb757d36640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750106900 0x7fb75019c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb757d36640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7501094a0 0x7fb75019d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb757d36640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb75010f2a0 con 0x7fb750106900 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb757d36640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb75010f120 con 0x7fb75006c660 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb757d36640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb75010f420 con 0x7fb7501094a0 2024-09-21T04:02:05.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb7552d1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750106900 0x7fb75019c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb7552d1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750106900 0x7fb75019c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57952/0 (socket says 172.21.15.22:57952) 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb7552d1640 1 -- 172.21.15.22:0/397731122 learned_addr learned my addr 172.21.15.22:0/397731122 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb755ad2640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75006c660 0x7fb75019c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb7562d3640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7501094a0 0x7fb75019d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb7552d1640 1 -- 172.21.15.22:0/397731122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7501094a0 msgr2=0x7fb75019d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb7552d1640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7501094a0 0x7fb75019d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb7552d1640 1 -- 172.21.15.22:0/397731122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75006c660 msgr2=0x7fb75019c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb7552d1640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75006c660 0x7fb75019c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb7552d1640 1 -- 172.21.15.22:0/397731122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb75019daa0 con 0x7fb750106900 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb755ad2640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75006c660 0x7fb75019c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb7552d1640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750106900 0x7fb75019c6e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb74000e9f0 tx=0x7fb74000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:05.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.314+0000 7fb746ffd640 1 -- 172.21.15.22:0/397731122 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb74000cd80 con 0x7fb750106900 2024-09-21T04:02:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.315+0000 7fb746ffd640 1 -- 172.21.15.22:0/397731122 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7400108c0 con 0x7fb750106900 2024-09-21T04:02:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.315+0000 7fb746ffd640 1 -- 172.21.15.22:0/397731122 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7400187c0 con 0x7fb750106900 2024-09-21T04:02:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.315+0000 7fb757d36640 1 -- 172.21.15.22:0/397731122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb75019dd90 con 0x7fb750106900 2024-09-21T04:02:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.315+0000 7fb757d36640 1 -- 172.21.15.22:0/397731122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7501a4490 con 0x7fb750106900 2024-09-21T04:02:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.316+0000 7fb757d36640 1 -- 172.21.15.22:0/397731122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb750106d50 con 0x7fb750106900 2024-09-21T04:02:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.317+0000 7fb746ffd640 1 -- 172.21.15.22:0/397731122 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb740010430 con 0x7fb750106900 2024-09-21T04:02:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.318+0000 7fb746ffd640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb73c0b6510 0x7fb73c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.318+0000 7fb755ad2640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb73c0b6510 0x7fb73c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.318+0000 7fb746ffd640 1 -- 172.21.15.22:0/397731122 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fb7400e7f90 con 0x7fb750106900 2024-09-21T04:02:05.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.319+0000 7fb755ad2640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb73c0b6510 0x7fb73c0b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb74c005d00 tx=0x7fb74c005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:05.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.321+0000 7fb746ffd640 1 -- 172.21.15.22:0/397731122 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb7400ae460 con 0x7fb750106900 2024-09-21T04:02:05.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.519+0000 7fb757d36640 1 -- 172.21.15.22:0/397731122 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fb75010b320 con 0x7fb73c0b6510 2024-09-21T04:02:05.522 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:05 smithi022 ceph-mon[31015]: from='client.25015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:05.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.521+0000 7fb746ffd640 1 -- 172.21.15.22:0/397731122 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+187 (secure 0 0 0) 0x7fb75010b320 con 0x7fb73c0b6510 2024-09-21T04:02:05.523 INFO:teuthology.orchestra.run.smithi022.stdout:HOST ADDR LABELS STATUS 2024-09-21T04:02:05.523 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022 172.21.15.22 2024-09-21T04:02:05.523 INFO:teuthology.orchestra.run.smithi022.stdout:smithi060 172.21.15.60 2024-09-21T04:02:05.524 INFO:teuthology.orchestra.run.smithi022.stdout:smithi073 172.21.15.73 2024-09-21T04:02:05.524 INFO:teuthology.orchestra.run.smithi022.stdout:3 hosts in cluster 2024-09-21T04:02:05.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.523+0000 7fb757d36640 1 -- 172.21.15.22:0/397731122 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb73c0b6510 msgr2=0x7fb73c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:05.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.523+0000 7fb757d36640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb73c0b6510 0x7fb73c0b8a20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb74c005d00 tx=0x7fb74c005c70 comp rx=0 tx=0).stop 2024-09-21T04:02:05.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.523+0000 7fb757d36640 1 -- 172.21.15.22:0/397731122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750106900 msgr2=0x7fb75019c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:05.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.523+0000 7fb757d36640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750106900 0x7fb75019c6e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fb74000e9f0 tx=0x7fb74000eeb0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.523+0000 7fb757d36640 1 -- 172.21.15.22:0/397731122 shutdown_connections 2024-09-21T04:02:05.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.523+0000 7fb757d36640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb73c0b6510 0x7fb73c0b8a20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.523+0000 7fb757d36640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb7501094a0 0x7fb75019d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.523+0000 7fb757d36640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb750106900 0x7fb75019c6e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.523+0000 7fb757d36640 1 --2- 172.21.15.22:0/397731122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb75006c660 0x7fb75019c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:05.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.523+0000 7fb757d36640 1 -- 172.21.15.22:0/397731122 >> 172.21.15.22:0/397731122 conn(0x7fb7500fdfe0 msgr2=0x7fb750100400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:05.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.524+0000 7fb757d36640 1 -- 172.21.15.22:0/397731122 shutdown_connections 2024-09-21T04:02:05.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:05.524+0000 7fb757d36640 1 -- 172.21.15.22:0/397731122 wait complete. 2024-09-21T04:02:05.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:05 smithi073 ceph-mon[34443]: from='client.25015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:05.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:05 smithi060 ceph-mon[33722]: from='client.25015 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:06.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T04:02:06.423 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:06.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:06 smithi022 ceph-mon[31015]: pgmap v363: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T04:02:06.593 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:06 smithi022 ceph-mon[31015]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:06.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:06 smithi073 ceph-mon[34443]: pgmap v363: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T04:02:06.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:06 smithi073 ceph-mon[34443]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:06 smithi060 ceph-mon[33722]: pgmap v363: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T04:02:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:06 smithi060 ceph-mon[33722]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.929+0000 7f2643c1c640 1 -- 172.21.15.22:0/1412670134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f263c102670 msgr2=0x7f263c102ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.929+0000 7f2643c1c640 1 --2- 172.21.15.22:0/1412670134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f263c102670 0x7f263c102ae0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2638009900 tx=0x7f263802a480 comp rx=0 tx=0).stop 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.929+0000 7f2643c1c640 1 -- 172.21.15.22:0/1412670134 shutdown_connections 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.929+0000 7f2643c1c640 1 --2- 172.21.15.22:0/1412670134 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c103700 0x7f263c103b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.929+0000 7f2643c1c640 1 --2- 172.21.15.22:0/1412670134 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f263c1040a0 0x7f263c10aa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.929+0000 7f2643c1c640 1 --2- 172.21.15.22:0/1412670134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f263c102670 0x7f263c102ae0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.929+0000 7f2643c1c640 1 -- 172.21.15.22:0/1412670134 >> 172.21.15.22:0/1412670134 conn(0x7f263c0fdfe0 msgr2=0x7f263c100490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.930+0000 7f2643c1c640 1 -- 172.21.15.22:0/1412670134 shutdown_connections 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.930+0000 7f2643c1c640 1 -- 172.21.15.22:0/1412670134 wait complete. 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.930+0000 7f2643c1c640 1 Processor -- start 2024-09-21T04:02:06.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.930+0000 7f2643c1c640 1 -- start start 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.930+0000 7f2643c1c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f263c102670 0x7f263c199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.930+0000 7f2643c1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f263c103700 0x7f263c19a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f2643c1c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c1040a0 0x7f263c19b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f2643c1c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10e160 con 0x7f263c103700 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f2643c1c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10dfe0 con 0x7f263c102670 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f2643c1c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f263c10e2e0 con 0x7f263c1040a0 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26411b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f263c103700 0x7f263c19a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26411b7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f263c103700 0x7f263c19a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57974/0 (socket says 172.21.15.22:57974) 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26411b7640 1 -- 172.21.15.22:0/3198794570 learned_addr learned my addr 172.21.15.22:0/3198794570 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26419b8640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f263c102670 0x7f263c199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26421b9640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c1040a0 0x7f263c19b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:06.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26411b7640 1 -- 172.21.15.22:0/3198794570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c1040a0 msgr2=0x7f263c19b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26411b7640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c1040a0 0x7f263c19b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26411b7640 1 -- 172.21.15.22:0/3198794570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f263c102670 msgr2=0x7f263c199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26411b7640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f263c102670 0x7f263c199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26411b7640 1 -- 172.21.15.22:0/3198794570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263c19b980 con 0x7f263c103700 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f26411b7640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f263c103700 0x7f263c19a5c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f262c00c970 tx=0x7f262c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f2632ffd640 1 -- 172.21.15.22:0/3198794570 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c007bb0 con 0x7f263c103700 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f2632ffd640 1 -- 172.21.15.22:0/3198794570 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f262c007d50 con 0x7f263c103700 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f2643c1c640 1 -- 172.21.15.22:0/3198794570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263c19bc70 con 0x7f263c103700 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.931+0000 7f2632ffd640 1 -- 172.21.15.22:0/3198794570 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262c004e40 con 0x7f263c103700 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.932+0000 7f2643c1c640 1 -- 172.21.15.22:0/3198794570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f263c1a2370 con 0x7f263c103700 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.933+0000 7f2643c1c640 1 -- 172.21.15.22:0/3198794570 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f263c1a2540 con 0x7f263c103700 2024-09-21T04:02:06.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.934+0000 7f2632ffd640 1 -- 172.21.15.22:0/3198794570 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f262c005000 con 0x7f263c103700 2024-09-21T04:02:06.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.935+0000 7f2632ffd640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26280b6590 0x7f26280b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:06.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.935+0000 7f2632ffd640 1 -- 172.21.15.22:0/3198794570 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f262c0e7710 con 0x7f263c103700 2024-09-21T04:02:06.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.935+0000 7f26419b8640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26280b6590 0x7f26280b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:06.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.936+0000 7f26419b8640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26280b6590 0x7f26280b8aa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f26380057c0 tx=0x7f2638000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:06.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:06.938+0000 7f2632ffd640 1 -- 172.21.15.22:0/3198794570 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f262c014030 con 0x7f263c103700 2024-09-21T04:02:07.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.134+0000 7f2643c1c640 1 -- 172.21.15.22:0/3198794570 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f263c100090 con 0x7f26280b6590 2024-09-21T04:02:07.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.136+0000 7f2632ffd640 1 -- 172.21.15.22:0/3198794570 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f263c100090 con 0x7f26280b6590 2024-09-21T04:02:07.139 INFO:teuthology.orchestra.run.smithi022.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T04:02:07.139 INFO:teuthology.orchestra.run.smithi022.stdout:smithi022 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB747402EC480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T04:02:07.139 INFO:teuthology.orchestra.run.smithi022.stdout:smithi060 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7476008A480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-21T04:02:07.139 INFO:teuthology.orchestra.run.smithi022.stdout:smithi073 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040115400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T04:02:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 -- 172.21.15.22:0/3198794570 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26280b6590 msgr2=0x7f26280b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26280b6590 0x7f26280b8aa0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f26380057c0 tx=0x7f2638000bc0 comp rx=0 tx=0).stop 2024-09-21T04:02:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 -- 172.21.15.22:0/3198794570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f263c103700 msgr2=0x7f263c19a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f263c103700 0x7f263c19a5c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f262c00c970 tx=0x7f262c00ce30 comp rx=0 tx=0).stop 2024-09-21T04:02:07.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 -- 172.21.15.22:0/3198794570 shutdown_connections 2024-09-21T04:02:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26280b6590 0x7f26280b8aa0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f263c1040a0 0x7f263c19b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f263c103700 0x7f263c19a5c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 --2- 172.21.15.22:0/3198794570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f263c102670 0x7f263c199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 -- 172.21.15.22:0/3198794570 >> 172.21.15.22:0/3198794570 conn(0x7f263c0fdfe0 msgr2=0x7f263c0ff980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:07.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 -- 172.21.15.22:0/3198794570 shutdown_connections 2024-09-21T04:02:07.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:07.138+0000 7f2643c1c640 1 -- 172.21.15.22:0/3198794570 wait complete. 2024-09-21T04:02:07.784 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T04:02:07.881 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-21T04:02:07.881 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T04:02:08.151 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:08.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:08 smithi022 ceph-mon[31015]: pgmap v364: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T04:02:08.546 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:08 smithi022 ceph-mon[31015]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:08.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:08 smithi073 ceph-mon[34443]: pgmap v364: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T04:02:08.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:08 smithi073 ceph-mon[34443]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:08.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.638+0000 7fa703fd2640 1 -- 172.21.15.22:0/4265773402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6fc103750 msgr2=0x7fa6fc103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.638+0000 7fa703fd2640 1 --2- 172.21.15.22:0/4265773402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6fc103750 0x7fa6fc103bc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009900 tx=0x7fa6f802a480 comp rx=0 tx=0).stop 2024-09-21T04:02:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.638+0000 7fa703fd2640 1 -- 172.21.15.22:0/4265773402 shutdown_connections 2024-09-21T04:02:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.638+0000 7fa703fd2640 1 --2- 172.21.15.22:0/4265773402 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6fc105180 0x7fa6fc10bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.638+0000 7fa703fd2640 1 --2- 172.21.15.22:0/4265773402 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6fc1047e0 0x7fa6fc104bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.638+0000 7fa703fd2640 1 --2- 172.21.15.22:0/4265773402 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6fc103750 0x7fa6fc103bc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.638+0000 7fa703fd2640 1 -- 172.21.15.22:0/4265773402 >> 172.21.15.22:0/4265773402 conn(0x7fa6fc0ff0c0 msgr2=0x7fa6fc101570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.638+0000 7fa703fd2640 1 -- 172.21.15.22:0/4265773402 shutdown_connections 2024-09-21T04:02:08.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.638+0000 7fa703fd2640 1 -- 172.21.15.22:0/4265773402 wait complete. 2024-09-21T04:02:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.638+0000 7fa703fd2640 1 Processor -- start 2024-09-21T04:02:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa703fd2640 1 -- start start 2024-09-21T04:02:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa703fd2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6fc103750 0x7fa6fc199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa703fd2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6fc1047e0 0x7fa6fc19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa703fd2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6fc105180 0x7fa6fc19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa703fd2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc10f220 con 0x7fa6fc103750 2024-09-21T04:02:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa703fd2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc10f0a0 con 0x7fa6fc105180 2024-09-21T04:02:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa703fd2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa6fc10f3a0 con 0x7fa6fc1047e0 2024-09-21T04:02:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa701d6e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6fc103750 0x7fa6fc199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:08.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa701d6e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6fc103750 0x7fa6fc199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58004/0 (socket says 172.21.15.22:58004) 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa701d6e640 1 -- 172.21.15.22:0/3258923377 learned_addr learned my addr 172.21.15.22:0/3258923377 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa70156d640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6fc1047e0 0x7fa6fc19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa70256f640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6fc105180 0x7fa6fc19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa701d6e640 1 -- 172.21.15.22:0/3258923377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6fc1047e0 msgr2=0x7fa6fc19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa701d6e640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6fc1047e0 0x7fa6fc19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa701d6e640 1 -- 172.21.15.22:0/3258923377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6fc105180 msgr2=0x7fa6fc19b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa701d6e640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6fc105180 0x7fa6fc19b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa701d6e640 1 -- 172.21.15.22:0/3258923377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6fc19b870 con 0x7fa6fc103750 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.639+0000 7fa70256f640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6fc105180 0x7fa6fc19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.640+0000 7fa701d6e640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6fc103750 0x7fa6fc199ed0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009230 tx=0x7fa6f80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.640+0000 7fa6f2ffd640 1 -- 172.21.15.22:0/3258923377 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f803f030 con 0x7fa6fc103750 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.640+0000 7fa6f2ffd640 1 -- 172.21.15.22:0/3258923377 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6f8003c90 con 0x7fa6fc103750 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.640+0000 7fa6f2ffd640 1 -- 172.21.15.22:0/3258923377 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6f8035070 con 0x7fa6fc103750 2024-09-21T04:02:08.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.640+0000 7fa703fd2640 1 -- 172.21.15.22:0/3258923377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6fc19bb00 con 0x7fa6fc103750 2024-09-21T04:02:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.640+0000 7fa703fd2640 1 -- 172.21.15.22:0/3258923377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6fc1a2120 con 0x7fa6fc103750 2024-09-21T04:02:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.641+0000 7fa703fd2640 1 -- 172.21.15.22:0/3258923377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6fc103bc0 con 0x7fa6fc103750 2024-09-21T04:02:08.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.642+0000 7fa6f2ffd640 1 -- 172.21.15.22:0/3258923377 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa6f8042030 con 0x7fa6fc103750 2024-09-21T04:02:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.643+0000 7fa6f2ffd640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6e80b6510 0x7fa6e80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.643+0000 7fa70156d640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6e80b6510 0x7fa6e80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.643+0000 7fa6f2ffd640 1 -- 172.21.15.22:0/3258923377 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa6f81081d0 con 0x7fa6fc103750 2024-09-21T04:02:08.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.644+0000 7fa70156d640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6e80b6510 0x7fa6e80b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec005e10 tx=0x7fa6ec005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:08.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.647+0000 7fa6f2ffd640 1 -- 172.21.15.22:0/3258923377 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa6f80ce6a0 con 0x7fa6fc103750 2024-09-21T04:02:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:08 smithi060 ceph-mon[33722]: pgmap v364: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T04:02:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:08 smithi060 ceph-mon[33722]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T04:02:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.874+0000 7fa703fd2640 1 -- 172.21.15.22:0/3258923377 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa6fc10a930 con 0x7fa6fc103750 2024-09-21T04:02:08.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.875+0000 7fa6f2ffd640 1 -- 172.21.15.22:0/3258923377 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) ==== 76+0+3120 (secure 0 0 0) 0x7fa6f80d2a80 con 0x7fa6fc103750 2024-09-21T04:02:08.877 INFO:teuthology.orchestra.run.smithi022.stdout:e28 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:btime 2024-09-21T04:00:45:215178+0000 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:legacy client fscid: 1 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:Filesystem 'cephfs' (1) 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:fs_name cephfs 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 28 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-09-21T04:00:04.669771+0000 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-09-21T04:00:45.215152+0000 2024-09-21T04:02:08.878 INFO:teuthology.orchestra.run.smithi022.stdout:tableserver 0 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:root 0 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:session_timeout 300 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:session_autoclose 300 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:max_file_size 1099511627776 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:max_xattr_size 65536 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:required_client_features {} 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:last_failure 0 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:last_failure_osd_epoch 0 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:max_mds 5 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:in 0,1,2,3,4 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:up {0=24647,1=24634,2=24617,3=24616,4=24610} 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:failed 2024-09-21T04:02:08.879 INFO:teuthology.orchestra.run.smithi022.stdout:damaged 2024-09-21T04:02:08.880 INFO:teuthology.orchestra.run.smithi022.stdout:stopped 2024-09-21T04:02:08.880 INFO:teuthology.orchestra.run.smithi022.stdout:data_pools [3,4] 2024-09-21T04:02:08.880 INFO:teuthology.orchestra.run.smithi022.stdout:metadata_pool 2 2024-09-21T04:02:08.880 INFO:teuthology.orchestra.run.smithi022.stdout:inline_data disabled 2024-09-21T04:02:08.880 INFO:teuthology.orchestra.run.smithi022.stdout:balancer 2024-09-21T04:02:08.880 INFO:teuthology.orchestra.run.smithi022.stdout:bal_rank_mask -1 2024-09-21T04:02:08.880 INFO:teuthology.orchestra.run.smithi022.stdout:standby_count_wanted 0 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:qdb_cluster leader: 24647 members: 24647,24634,24617,24616,24610 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b{0:24647} state up:active seq 4 addr [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.e{0:24596} state up:standby-replay seq 1 addr [v2:172.21.15.60:6834/2092262185,v1:172.21.15.60:6835/2092262185] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.i{1:24634} state up:active seq 16 addr [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.l{1:24571} state up:standby-replay seq 1 addr [v2:172.21.15.73:6832/1353426950,v1:172.21.15.73:6833/1353426950] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.h{2:24617} state up:active seq 17 addr [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.k{2:24566} state up:standby-replay seq 1 addr [v2:172.21.15.60:6832/2373240323,v1:172.21.15.60:6833/2373240323] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c{3:24616} state up:active seq 18 addr [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a{3:14787} state up:standby-replay seq 1 addr [v2:172.21.15.22:6840/2021253625,v1:172.21.15.22:6841/2021253625] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.f{4:24610} state up:active seq 18 addr [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.g{4:14775} state up:standby-replay seq 1 addr [v2:172.21.15.22:6838/61235994,v1:172.21.15.22:6839/61235994] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:08.881 INFO:teuthology.orchestra.run.smithi022.stdout:Standby daemons: 2024-09-21T04:02:08.882 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:08.882 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.j{-1:14712} state up:standby seq 1 addr [v2:172.21.15.22:6834/536633009,v1:172.21.15.22:6835/536633009] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.882 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d{-1:14724} state up:standby seq 1 addr [v2:172.21.15.22:6836/3675102872,v1:172.21.15.22:6837/3675102872] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T04:02:08.882 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-21T04:02:08.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 -- 172.21.15.22:0/3258923377 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6e80b6510 msgr2=0x7fa6e80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:08.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6e80b6510 0x7fa6e80b8a20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fa6ec005e10 tx=0x7fa6ec005da0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 -- 172.21.15.22:0/3258923377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6fc103750 msgr2=0x7fa6fc199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:08.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6fc103750 0x7fa6fc199ed0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fa6f8009230 tx=0x7fa6f80042f0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 -- 172.21.15.22:0/3258923377 shutdown_connections 2024-09-21T04:02:08.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6e80b6510 0x7fa6e80b8a20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6fc1047e0 0x7fa6fc19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6fc105180 0x7fa6fc19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 --2- 172.21.15.22:0/3258923377 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6fc103750 0x7fa6fc199ed0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:08.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 -- 172.21.15.22:0/3258923377 >> 172.21.15.22:0/3258923377 conn(0x7fa6fc0ff0c0 msgr2=0x7fa6fc107b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:08.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 -- 172.21.15.22:0/3258923377 shutdown_connections 2024-09-21T04:02:08.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:08.877+0000 7fa703fd2640 1 -- 172.21.15.22:0/3258923377 wait complete. 2024-09-21T04:02:09.582 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:09 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3258923377' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T04:02:09.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- bash -c 'ceph osd dump' 2024-09-21T04:02:09.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:09 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3258923377' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T04:02:09.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:09 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3258923377' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T04:02:09.843 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:10.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.331+0000 7f569a7b4640 1 -- 172.21.15.22:0/4045620347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5694104870 msgr2=0x7f5694104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:10.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.331+0000 7f569a7b4640 1 --2- 172.21.15.22:0/4045620347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5694104870 0x7f5694104c80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f5688009900 tx=0x7f568802a480 comp rx=0 tx=0).stop 2024-09-21T04:02:10.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.331+0000 7f569a7b4640 1 -- 172.21.15.22:0/4045620347 shutdown_connections 2024-09-21T04:02:10.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.331+0000 7f569a7b4640 1 --2- 172.21.15.22:0/4045620347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5694105210 0x7f569410bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:10.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.331+0000 7f569a7b4640 1 --2- 172.21.15.22:0/4045620347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5694104870 0x7f5694104c80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:10.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.331+0000 7f569a7b4640 1 --2- 172.21.15.22:0/4045620347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56941037e0 0x7f5694103c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:10.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.331+0000 7f569a7b4640 1 -- 172.21.15.22:0/4045620347 >> 172.21.15.22:0/4045620347 conn(0x7f56940ff150 msgr2=0x7f5694101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:10.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.331+0000 7f569a7b4640 1 -- 172.21.15.22:0/4045620347 shutdown_connections 2024-09-21T04:02:10.340 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.331+0000 7f569a7b4640 1 -- 172.21.15.22:0/4045620347 wait complete. 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.332+0000 7f569a7b4640 1 Processor -- start 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.332+0000 7f569a7b4640 1 -- start start 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.332+0000 7f569a7b4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56941037e0 0x7f5694199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.332+0000 7f569a7b4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5694104870 0x7f569419a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.332+0000 7f569a7b4640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5694105210 0x7f569419b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.332+0000 7f569a7b4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f569410f270 con 0x7f5694104870 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.332+0000 7f569a7b4640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f569410f0f0 con 0x7f5694105210 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.332+0000 7f569a7b4640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f569410f3f0 con 0x7f56941037e0 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5694104870 0x7f569419a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5694104870 0x7f569419a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:58026/0 (socket says 172.21.15.22:58026) 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f5693fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56941037e0 0x7f5694199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56937fe640 1 -- 172.21.15.22:0/3091597560 learned_addr learned my addr 172.21.15.22:0/3091597560 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:10.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f5698d51640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5694105210 0x7f569419b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56937fe640 1 -- 172.21.15.22:0/3091597560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56941037e0 msgr2=0x7f5694199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56937fe640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56941037e0 0x7f5694199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56937fe640 1 -- 172.21.15.22:0/3091597560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5694105210 msgr2=0x7f569419b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56937fe640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5694105210 0x7f569419b110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56937fe640 1 -- 172.21.15.22:0/3091597560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f569419b930 con 0x7f5694104870 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56937fe640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5694104870 0x7f569419a570 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5688009230 tx=0x7f56880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56917fa640 1 -- 172.21.15.22:0/3091597560 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f568803f030 con 0x7f5694104870 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f569a7b4640 1 -- 172.21.15.22:0/3091597560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f569419bbc0 con 0x7f5694104870 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56917fa640 1 -- 172.21.15.22:0/3091597560 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5688003c90 con 0x7f5694104870 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f56917fa640 1 -- 172.21.15.22:0/3091597560 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5688035070 con 0x7f5694104870 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.333+0000 7f569a7b4640 1 -- 172.21.15.22:0/3091597560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56941a2320 con 0x7f5694104870 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.334+0000 7f569a7b4640 1 -- 172.21.15.22:0/3091597560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5694103c50 con 0x7f5694104870 2024-09-21T04:02:10.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.336+0000 7f56917fa640 1 -- 172.21.15.22:0/3091597560 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5688042030 con 0x7f5694104870 2024-09-21T04:02:10.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.337+0000 7f56917fa640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f567c0b6590 0x7f567c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:10.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.337+0000 7f5693fff640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f567c0b6590 0x7f567c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:10.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.337+0000 7f56917fa640 1 -- 172.21.15.22:0/3091597560 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f5688108040 con 0x7f5694104870 2024-09-21T04:02:10.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.337+0000 7f5693fff640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f567c0b6590 0x7f567c0b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5684005fd0 tx=0x7f568400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:10.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.340+0000 7f56917fa640 1 -- 172.21.15.22:0/3091597560 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f56880d2890 con 0x7f5694104870 2024-09-21T04:02:10.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.531+0000 7f569a7b4640 1 -- 172.21.15.22:0/3091597560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f569410a9c0 con 0x7f5694104870 2024-09-21T04:02:10.534 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:10 smithi022 ceph-mon[31015]: pgmap v365: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T04:02:10.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.532+0000 7f56917fa640 1 -- 172.21.15.22:0/3091597560 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v85) ==== 56+0+5645 (secure 0 0 0) 0x7f56880d77d0 con 0x7f5694104870 2024-09-21T04:02:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 85 2024-09-21T04:02:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:fsid ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T04:02:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-09-21T03:51:32.216990+0000 2024-09-21T04:02:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:modified 2024-09-21T04:01:31.025432+0000 2024-09-21T04:02:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-21T04:02:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:crush_version 27 2024-09-21T04:02:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:full_ratio 0.95 2024-09-21T04:02:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:backfillfull_ratio 0.9 2024-09-21T04:02:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:nearfull_ratio 0.85 2024-09-21T04:02:10.535 INFO:teuthology.orchestra.run.smithi022.stdout:require_min_compat_client luminous 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:min_compat_client luminous 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:require_osd_release squid 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:stretch_mode_enabled false 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 20 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 2.25 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 74 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:max_osd 12 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6802/360746726,v1:172.21.15.22:6803/360746726] [v2:172.21.15.22:6804/360746726,v1:172.21.15.22:6805/360746726] exists,up 83062b79-0279-4099-afb7-f1a51046ca56 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:osd.1 up in weight 1 up_from 13 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6800/1805383565,v1:172.21.15.60:6801/1805383565] [v2:172.21.15.60:6802/1805383565,v1:172.21.15.60:6803/1805383565] exists,up 08151432-cfef-4b3d-88eb-5cd78d8eab0b 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:osd.2 up in weight 1 up_from 17 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6800/3937108185,v1:172.21.15.73:6801/3937108185] [v2:172.21.15.73:6802/3937108185,v1:172.21.15.73:6803/3937108185] exists,up c6ac00d8-4358-45b9-85d2-c14921cdd053 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:osd.3 up in weight 1 up_from 23 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6810/2768755547,v1:172.21.15.22:6811/2768755547] [v2:172.21.15.22:6812/2768755547,v1:172.21.15.22:6813/2768755547] exists,up c5b81662-58c9-4931-9377-b9bd9f18c6e4 2024-09-21T04:02:10.536 INFO:teuthology.orchestra.run.smithi022.stdout:osd.4 up in weight 1 up_from 29 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6808/1223928144,v1:172.21.15.60:6809/1223928144] [v2:172.21.15.60:6810/1223928144,v1:172.21.15.60:6811/1223928144] exists,up aa0cec75-47d4-4449-b928-fae79f9196e5 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:osd.5 up in weight 1 up_from 34 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6808/1537788628,v1:172.21.15.73:6809/1537788628] [v2:172.21.15.73:6810/1537788628,v1:172.21.15.73:6811/1537788628] exists,up a273207d-bf1d-4931-913d-e23491b84857 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:osd.6 up in weight 1 up_from 40 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6818/998386094,v1:172.21.15.22:6819/998386094] [v2:172.21.15.22:6820/998386094,v1:172.21.15.22:6821/998386094] exists,up d5061cbb-19ed-4027-9249-9c46cac4cf5b 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:osd.7 up in weight 1 up_from 45 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6816/1887420372,v1:172.21.15.60:6817/1887420372] [v2:172.21.15.60:6818/1887420372,v1:172.21.15.60:6819/1887420372] exists,up 3e922938-5d07-46fe-aa70-a2d9d34844d5 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:osd.8 up in weight 1 up_from 51 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6816/3798177718,v1:172.21.15.73:6817/3798177718] [v2:172.21.15.73:6818/3798177718,v1:172.21.15.73:6819/3798177718] exists,up 0ec0cee7-24d3-4022-802c-506565544114 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:osd.9 up in weight 1 up_from 57 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.22:6826/672345828,v1:172.21.15.22:6827/672345828] [v2:172.21.15.22:6828/672345828,v1:172.21.15.22:6829/672345828] exists,up 968b9387-432d-43fc-a2e7-76257b93cc83 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:osd.10 up in weight 1 up_from 62 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.60:6824/1905936274,v1:172.21.15.60:6825/1905936274] [v2:172.21.15.60:6826/1905936274,v1:172.21.15.60:6827/1905936274] exists,up b7c321ad-f83a-4d51-a4dc-65dfe62b59e2 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:osd.11 up in weight 1 up_from 68 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.73:6824/2116186038,v1:172.21.15.73:6825/2116186038] [v2:172.21.15.73:6826/2116186038,v1:172.21.15.73:6827/2116186038] exists,up 2c83d7da-b854-47cb-8768-48f57bd3ef85 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.0 [7,11,5,6] 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.6 [8,11] 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.b [2,4] 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.1a [8,1] 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 2.1d [2,4] 2024-09-21T04:02:10.537 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.3 [4,9] 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.6 [4,6] 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.c [3,9] 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 3.33 [5,9] 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 4.6 [9,11] 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 4.b [9,8] 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 4.e [5,8] 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:pg_upmap_items 4.10 [9,8] 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/2250622126 expires 2024-09-22T03:52:28.809522+0000 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/1700605044 expires 2024-09-22T03:52:28.809522+0000 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6801/3598394913 expires 2024-09-22T03:52:28.809522+0000 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/4275033300 expires 2024-09-22T03:52:02.449463+0000 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/636257932 expires 2024-09-22T03:52:02.449463+0000 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/807920923 expires 2024-09-22T03:52:02.449463+0000 2024-09-21T04:02:10.538 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6801/859526938 expires 2024-09-22T03:52:02.449463+0000 2024-09-21T04:02:10.539 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:0/1683797431 expires 2024-09-22T03:52:28.809522+0000 2024-09-21T04:02:10.539 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/3598394913 expires 2024-09-22T03:52:28.809522+0000 2024-09-21T04:02:10.539 INFO:teuthology.orchestra.run.smithi022.stdout:blocklist 172.21.15.22:6800/859526938 expires 2024-09-22T03:52:02.449463+0000 2024-09-21T04:02:10.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.534+0000 7f569a7b4640 1 -- 172.21.15.22:0/3091597560 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f567c0b6590 msgr2=0x7f567c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.534+0000 7f569a7b4640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f567c0b6590 0x7f567c0b8aa0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f5684005fd0 tx=0x7f568400b390 comp rx=0 tx=0).stop 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.534+0000 7f569a7b4640 1 -- 172.21.15.22:0/3091597560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5694104870 msgr2=0x7f569419a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.534+0000 7f569a7b4640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5694104870 0x7f569419a570 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f5688009230 tx=0x7f56880042f0 comp rx=0 tx=0).stop 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.534+0000 7f569a7b4640 1 -- 172.21.15.22:0/3091597560 shutdown_connections 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.534+0000 7f569a7b4640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f567c0b6590 0x7f567c0b8aa0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.534+0000 7f569a7b4640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5694105210 0x7f569419b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.534+0000 7f569a7b4640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5694104870 0x7f569419a570 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.534+0000 7f569a7b4640 1 --2- 172.21.15.22:0/3091597560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f56941037e0 0x7f5694199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.534+0000 7f569a7b4640 1 -- 172.21.15.22:0/3091597560 >> 172.21.15.22:0/3091597560 conn(0x7f56940ff150 msgr2=0x7f5694107b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.535+0000 7f569a7b4640 1 -- 172.21.15.22:0/3091597560 shutdown_connections 2024-09-21T04:02:10.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:10.535+0000 7f569a7b4640 1 -- 172.21.15.22:0/3091597560 wait complete. 2024-09-21T04:02:10.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:10 smithi073 ceph-mon[34443]: pgmap v365: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T04:02:10.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:10 smithi060 ceph-mon[33722]: pgmap v365: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 426 B/s wr, 10 op/s 2024-09-21T04:02:11.296 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-21T04:02:11.313 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:02:11.576 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:11.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:11 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3091597560' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T04:02:11.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:11 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3091597560' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T04:02:11.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:11 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3091597560' entity='client.admin' cmd={"prefix": "osd dump"} : dispatch 2024-09-21T04:02:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.082+0000 7f1c52281640 1 -- 172.21.15.22:0/668959589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c4c103bb0 msgr2=0x7f1c4c103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.082+0000 7f1c52281640 1 --2- 172.21.15.22:0/668959589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c4c103bb0 0x7f1c4c103fc0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c009900 tx=0x7f1c3c02a3f0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.082+0000 7f1c52281640 1 -- 172.21.15.22:0/668959589 shutdown_connections 2024-09-21T04:02:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.082+0000 7f1c52281640 1 --2- 172.21.15.22:0/668959589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c109e40 0x7f1c4c110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.082+0000 7f1c52281640 1 --2- 172.21.15.22:0/668959589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c4c1094f0 0x7f1c4c109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.082+0000 7f1c52281640 1 --2- 172.21.15.22:0/668959589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c4c103bb0 0x7f1c4c103fc0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.082+0000 7f1c52281640 1 -- 172.21.15.22:0/668959589 >> 172.21.15.22:0/668959589 conn(0x7f1c4c0ff600 msgr2=0x7f1c4c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.082+0000 7f1c52281640 1 -- 172.21.15.22:0/668959589 shutdown_connections 2024-09-21T04:02:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.082+0000 7f1c52281640 1 -- 172.21.15.22:0/668959589 wait complete. 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.083+0000 7f1c52281640 1 Processor -- start 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.083+0000 7f1c52281640 1 -- start start 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.083+0000 7f1c52281640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c4c103bb0 0x7f1c4c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.083+0000 7f1c52281640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c4c1094f0 0x7f1c4c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.083+0000 7f1c52281640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c109e40 0x7f1c4c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c52281640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c1139b0 con 0x7f1c4c1094f0 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c52281640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c113830 con 0x7f1c4c103bb0 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c52281640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1c4c113b30 con 0x7f1c4c109e40 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c4c1094f0 0x7f1c4c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c4c1094f0 0x7f1c4c19a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38760/0 (socket says 172.21.15.22:38760) 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4b7fe640 1 -- 172.21.15.22:0/668877883 learned_addr learned my addr 172.21.15.22:0/668877883 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4bfff640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c4c103bb0 0x7f1c4c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c5081e640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c109e40 0x7f1c4c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4b7fe640 1 -- 172.21.15.22:0/668877883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c109e40 msgr2=0x7f1c4c19fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:12.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4b7fe640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c109e40 0x7f1c4c19fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4b7fe640 1 -- 172.21.15.22:0/668877883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c4c103bb0 msgr2=0x7f1c4c19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4b7fe640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c4c103bb0 0x7f1c4c19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4b7fe640 1 -- 172.21.15.22:0/668877883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c4c1a02d0 con 0x7f1c4c1094f0 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4bfff640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c4c103bb0 0x7f1c4c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c4b7fe640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c4c1094f0 0x7f1c4c19a9c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000c8c0 tx=0x7f1c4000cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c497fa640 1 -- 172.21.15.22:0/668877883 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c40007bb0 con 0x7f1c4c1094f0 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c497fa640 1 -- 172.21.15.22:0/668877883 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c40007d50 con 0x7f1c4c1094f0 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c52281640 1 -- 172.21.15.22:0/668877883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c4c1a05c0 con 0x7f1c4c1094f0 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c497fa640 1 -- 172.21.15.22:0/668877883 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c400186a0 con 0x7f1c4c1094f0 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.084+0000 7f1c52281640 1 -- 172.21.15.22:0/668877883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c4c1a6de0 con 0x7f1c4c1094f0 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.086+0000 7f1c52281640 1 -- 172.21.15.22:0/668877883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c4c103fc0 con 0x7f1c4c1094f0 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.087+0000 7f1c497fa640 1 -- 172.21.15.22:0/668877883 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1c4000fa00 con 0x7f1c4c1094f0 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.088+0000 7f1c497fa640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1c340b6540 0x7f1c340b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:12.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.088+0000 7f1c4bfff640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1c340b6540 0x7f1c340b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:12.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.089+0000 7f1c497fa640 1 -- 172.21.15.22:0/668877883 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f1c400e7840 con 0x7f1c4c1094f0 2024-09-21T04:02:12.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.089+0000 7f1c4bfff640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1c340b6540 0x7f1c340b8a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c006010 tx=0x7f1c3c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:12.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.093+0000 7f1c497fa640 1 -- 172.21.15.22:0/668877883 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1c40014030 con 0x7f1c4c1094f0 2024-09-21T04:02:12.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.319+0000 7f1c52281640 1 -- 172.21.15.22:0/668877883 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1c4c19b550 con 0x7f1c4c1094f0 2024-09-21T04:02:12.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.319+0000 7f1c497fa640 1 -- 172.21.15.22:0/668877883 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f1c400adcb0 con 0x7f1c4c1094f0 2024-09-21T04:02:12.322 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:12.322 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-21T04:00:45:215178+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:00:45.215152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:02:12.322 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-21T04:02:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 -- 172.21.15.22:0/668877883 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1c340b6540 msgr2=0x7f1c340b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:12.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1c340b6540 0x7f1c340b8a50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c006010 tx=0x7f1c3c000bc0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 -- 172.21.15.22:0/668877883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c4c1094f0 msgr2=0x7f1c4c19a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c4c1094f0 0x7f1c4c19a9c0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f1c4000c8c0 tx=0x7f1c4000cd80 comp rx=0 tx=0).stop 2024-09-21T04:02:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 -- 172.21.15.22:0/668877883 shutdown_connections 2024-09-21T04:02:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1c340b6540 0x7f1c340b8a50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1c4c109e40 0x7f1c4c19fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1c4c1094f0 0x7f1c4c19a9c0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 --2- 172.21.15.22:0/668877883 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1c4c103bb0 0x7f1c4c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 -- 172.21.15.22:0/668877883 >> 172.21.15.22:0/668877883 conn(0x7f1c4c0ff600 msgr2=0x7f1c4c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 -- 172.21.15.22:0/668877883 shutdown_connections 2024-09-21T04:02:12.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:12.322+0000 7f1c52281640 1 -- 172.21.15.22:0/668877883 wait complete. 2024-09-21T04:02:12.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:12 smithi022 ceph-mon[31015]: pgmap v366: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T04:02:12.603 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:12 smithi060 ceph-mon[33722]: pgmap v366: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T04:02:12.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:12 smithi073 ceph-mon[34443]: pgmap v366: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 426 B/s wr, 11 op/s 2024-09-21T04:02:13.029 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:02:13.292 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:13.585 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:13 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/668877883' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:13.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:13 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/668877883' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:13.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:13 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/668877883' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:13.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.796+0000 7f9c45ac2640 1 -- 172.21.15.22:0/3410597614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c40105300 msgr2=0x7f9c4010d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:13.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.796+0000 7f9c45ac2640 1 --2- 172.21.15.22:0/3410597614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c40105300 0x7f9c4010d850 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f9c34009900 tx=0x7f9c3402a410 comp rx=0 tx=0).stop 2024-09-21T04:02:13.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.796+0000 7f9c45ac2640 1 -- 172.21.15.22:0/3410597614 shutdown_connections 2024-09-21T04:02:13.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.796+0000 7f9c45ac2640 1 --2- 172.21.15.22:0/3410597614 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c4010de10 0x7f9c40110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:13.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.796+0000 7f9c45ac2640 1 --2- 172.21.15.22:0/3410597614 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c40105300 0x7f9c4010d850 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:13.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.796+0000 7f9c45ac2640 1 --2- 172.21.15.22:0/3410597614 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c401049b0 0x7f9c40104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:13.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.796+0000 7f9c45ac2640 1 -- 172.21.15.22:0/3410597614 >> 172.21.15.22:0/3410597614 conn(0x7f9c40079760 msgr2=0x7f9c40079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:13.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.796+0000 7f9c45ac2640 1 -- 172.21.15.22:0/3410597614 shutdown_connections 2024-09-21T04:02:13.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.796+0000 7f9c45ac2640 1 -- 172.21.15.22:0/3410597614 wait complete. 2024-09-21T04:02:13.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c45ac2640 1 Processor -- start 2024-09-21T04:02:13.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c45ac2640 1 -- start start 2024-09-21T04:02:13.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c45ac2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c401049b0 0x7f9c40198dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:13.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c45ac2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c40105300 0x7f9c40199310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:13.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c45ac2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4010de10 0x7f9c4019fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c45ac2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9c40113920 con 0x7f9c4010de10 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c45ac2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9c401137a0 con 0x7f9c401049b0 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c45ac2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9c40113aa0 con 0x7f9c40105300 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c3f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c401049b0 0x7f9c40198dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c3ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4010de10 0x7f9c4019fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c3ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4010de10 0x7f9c4019fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38782/0 (socket says 172.21.15.22:38782) 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c3f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c401049b0 0x7f9c40198dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:48424/0 (socket says 172.21.15.22:48424) 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c3ffff640 1 -- 172.21.15.22:0/593939334 learned_addr learned my addr 172.21.15.22:0/593939334 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.797+0000 7f9c3effd640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c40105300 0x7f9c40199310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3ffff640 1 -- 172.21.15.22:0/593939334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c40105300 msgr2=0x7f9c40199310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3ffff640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c40105300 0x7f9c40199310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:13.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3ffff640 1 -- 172.21.15.22:0/593939334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c401049b0 msgr2=0x7f9c40198dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:13.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3ffff640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c401049b0 0x7f9c40198dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:13.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3ffff640 1 -- 172.21.15.22:0/593939334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c401a0370 con 0x7f9c4010de10 2024-09-21T04:02:13.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3f7fe640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c401049b0 0x7f9c40198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:13.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3effd640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c40105300 0x7f9c40199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:13.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3ffff640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4010de10 0x7f9c4019fe30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800eb10 tx=0x7f9c3800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:13.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3cff9640 1 -- 172.21.15.22:0/593939334 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38004b20 con 0x7f9c4010de10 2024-09-21T04:02:13.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c45ac2640 1 -- 172.21.15.22:0/593939334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c401a0660 con 0x7f9c4010de10 2024-09-21T04:02:13.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3cff9640 1 -- 172.21.15.22:0/593939334 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c38004cc0 con 0x7f9c4010de10 2024-09-21T04:02:13.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c3cff9640 1 -- 172.21.15.22:0/593939334 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38010690 con 0x7f9c4010de10 2024-09-21T04:02:13.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.798+0000 7f9c45ac2640 1 -- 172.21.15.22:0/593939334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c401a0b70 con 0x7f9c4010de10 2024-09-21T04:02:13.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.799+0000 7f9c45ac2640 1 -- 172.21.15.22:0/593939334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c4006c2c0 con 0x7f9c4010de10 2024-09-21T04:02:13.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.801+0000 7f9c3cff9640 1 -- 172.21.15.22:0/593939334 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9c38005000 con 0x7f9c4010de10 2024-09-21T04:02:13.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.802+0000 7f9c3cff9640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9c280b6510 0x7f9c280b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:13.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.802+0000 7f9c3f7fe640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9c280b6510 0x7f9c280b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:13.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.802+0000 7f9c3cff9640 1 -- 172.21.15.22:0/593939334 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f9c380e7e80 con 0x7f9c4010de10 2024-09-21T04:02:13.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.802+0000 7f9c3f7fe640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9c280b6510 0x7f9c280b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9c4010da10 tx=0x7f9c30005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:13.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:13.805+0000 7f9c3cff9640 1 -- 172.21.15.22:0/593939334 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9c38056710 con 0x7f9c4010de10 2024-09-21T04:02:14.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.032+0000 7f9c45ac2640 1 -- 172.21.15.22:0/593939334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9c40106f00 con 0x7f9c4010de10 2024-09-21T04:02:14.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.032+0000 7f9c3cff9640 1 -- 172.21.15.22:0/593939334 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11959 (secure 0 0 0) 0x7f9c380ae2f0 con 0x7f9c4010de10 2024-09-21T04:02:14.035 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:14.035 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":28,"btime":"2024-09-21T04:00:45:215178+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:00:45.215152+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:02:14.036 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 28 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 -- 172.21.15.22:0/593939334 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9c280b6510 msgr2=0x7f9c280b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9c280b6510 0x7f9c280b8a20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9c4010da10 tx=0x7f9c30005f90 comp rx=0 tx=0).stop 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 -- 172.21.15.22:0/593939334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4010de10 msgr2=0x7f9c4019fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4010de10 0x7f9c4019fe30 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800eb10 tx=0x7f9c3800c2d0 comp rx=0 tx=0).stop 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 -- 172.21.15.22:0/593939334 shutdown_connections 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9c280b6510 0x7f9c280b8a20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9c40105300 0x7f9c40199310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c4010de10 0x7f9c4019fe30 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 --2- 172.21.15.22:0/593939334 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9c401049b0 0x7f9c40198dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 -- 172.21.15.22:0/593939334 >> 172.21.15.22:0/593939334 conn(0x7f9c40079760 msgr2=0x7f9c40100c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 -- 172.21.15.22:0/593939334 shutdown_connections 2024-09-21T04:02:14.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:14.035+0000 7f9c45ac2640 1 -- 172.21.15.22:0/593939334 wait complete. 2024-09-21T04:02:14.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:14 smithi022 ceph-mon[31015]: pgmap v367: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T04:02:14.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:14 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/593939334' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:14.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:14 smithi073 ceph-mon[34443]: pgmap v367: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T04:02:14.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:14 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/593939334' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:14 smithi060 ceph-mon[33722]: pgmap v367: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T04:02:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:14 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/593939334' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:14.847 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:02:15.114 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:15.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.589+0000 7f633e8db640 1 -- 172.21.15.22:0/414773185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63381094c0 msgr2=0x7f63381098d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:15.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.589+0000 7f633e8db640 1 --2- 172.21.15.22:0/414773185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63381094c0 0x7f63381098d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f632c009900 tx=0x7f632c02a410 comp rx=0 tx=0).stop 2024-09-21T04:02:15.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.589+0000 7f633e8db640 1 -- 172.21.15.22:0/414773185 shutdown_connections 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.589+0000 7f633e8db640 1 --2- 172.21.15.22:0/414773185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6338109e10 0x7f6338110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.589+0000 7f633e8db640 1 --2- 172.21.15.22:0/414773185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63381094c0 0x7f63381098d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.589+0000 7f633e8db640 1 --2- 172.21.15.22:0/414773185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6338101fe0 0x7f63381023f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.589+0000 7f633e8db640 1 -- 172.21.15.22:0/414773185 >> 172.21.15.22:0/414773185 conn(0x7f6338077bc0 msgr2=0x7f6338078000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.589+0000 7f633e8db640 1 -- 172.21.15.22:0/414773185 shutdown_connections 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.589+0000 7f633e8db640 1 -- 172.21.15.22:0/414773185 wait complete. 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.590+0000 7f633e8db640 1 Processor -- start 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.590+0000 7f633e8db640 1 -- start start 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f633e8db640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6338101fe0 0x7f633819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f633e8db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63381094c0 0x7f633819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:15.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f633e8db640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6338109e10 0x7f633819fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f633e8db640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6338113930 con 0x7f63381094c0 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f633e8db640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f63381137b0 con 0x7f6338109e10 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f633e8db640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6338113ab0 con 0x7f6338101fe0 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f63377fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63381094c0 0x7f633819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f63377fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63381094c0 0x7f633819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38790/0 (socket says 172.21.15.22:38790) 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f63377fe640 1 -- 172.21.15.22:0/1001490304 learned_addr learned my addr 172.21.15.22:0/1001490304 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f6337fff640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6338101fe0 0x7f633819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f633ce78640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6338109e10 0x7f633819fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f63377fe640 1 -- 172.21.15.22:0/1001490304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6338101fe0 msgr2=0x7f633819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f63377fe640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6338101fe0 0x7f633819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f63377fe640 1 -- 172.21.15.22:0/1001490304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6338109e10 msgr2=0x7f633819fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f63377fe640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6338109e10 0x7f633819fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f63377fe640 1 -- 172.21.15.22:0/1001490304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63381a02f0 con 0x7f63381094c0 2024-09-21T04:02:15.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f633ce78640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6338109e10 0x7f633819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.591+0000 7f63377fe640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63381094c0 0x7f633819a9e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f632c005940 tx=0x7f632c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.592+0000 7f63357fa640 1 -- 172.21.15.22:0/1001490304 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c03f030 con 0x7f63381094c0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.592+0000 7f633e8db640 1 -- 172.21.15.22:0/1001490304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63381a0580 con 0x7f63381094c0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.592+0000 7f63357fa640 1 -- 172.21.15.22:0/1001490304 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f632c003a80 con 0x7f63381094c0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.592+0000 7f63357fa640 1 -- 172.21.15.22:0/1001490304 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c035070 con 0x7f63381094c0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.592+0000 7f633e8db640 1 -- 172.21.15.22:0/1001490304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63381a0ab0 con 0x7f63381094c0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.593+0000 7f633e8db640 1 -- 172.21.15.22:0/1001490304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63381023f0 con 0x7f63381094c0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.594+0000 7f63357fa640 1 -- 172.21.15.22:0/1001490304 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f632c042030 con 0x7f63381094c0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.595+0000 7f63357fa640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f63200b6540 0x7f63200b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.595+0000 7f6337fff640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f63200b6540 0x7f63200b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.595+0000 7f63357fa640 1 -- 172.21.15.22:0/1001490304 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f632c107fa0 con 0x7f63381094c0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.596+0000 7f6337fff640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f63200b6540 0x7f63200b8a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f632800abe0 tx=0x7f632800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:15.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.599+0000 7f63357fa640 1 -- 172.21.15.22:0/1001490304 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f63381a0ab0 con 0x7f63381094c0 2024-09-21T04:02:15.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.790+0000 7f633e8db640 1 -- 172.21.15.22:0/1001490304 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f633819b570 con 0x7f63381094c0 2024-09-21T04:02:15.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.791+0000 7f63357fa640 1 -- 172.21.15.22:0/1001490304 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24751 (secure 0 0 0) 0x7f632c0ce470 con 0x7f63381094c0 2024-09-21T04:02:15.794 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:15.795 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":85,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:01:31.025432+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11},{"from":5,"to":6}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:02:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 -- 172.21.15.22:0/1001490304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f63200b6540 msgr2=0x7f63200b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f63200b6540 0x7f63200b8a50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f632800abe0 tx=0x7f632800a2d0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 -- 172.21.15.22:0/1001490304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63381094c0 msgr2=0x7f633819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:15.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63381094c0 0x7f633819a9e0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f632c005940 tx=0x7f632c0040e0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 -- 172.21.15.22:0/1001490304 shutdown_connections 2024-09-21T04:02:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f63200b6540 0x7f63200b8a50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6338109e10 0x7f633819fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63381094c0 0x7f633819a9e0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 --2- 172.21.15.22:0/1001490304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6338101fe0 0x7f633819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 -- 172.21.15.22:0/1001490304 >> 172.21.15.22:0/1001490304 conn(0x7f6338077bc0 msgr2=0x7f6338107600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 -- 172.21.15.22:0/1001490304 shutdown_connections 2024-09-21T04:02:15.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:15.794+0000 7f633e8db640 1 -- 172.21.15.22:0/1001490304 wait complete. 2024-09-21T04:02:16.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:16 smithi022 ceph-mon[31015]: pgmap v368: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T04:02:16.405 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:16 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1001490304' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:02:16.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 28, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T04:00:04.669771+0000', 'modified': '2024-09-21T04:00:45.215152+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24647, 'mds_1': 24634, 'mds_2': 24617, 'mds_3': 24616, 'mds_4': 24610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14775': {'gid': 14775, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6839/61235994', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 61235994}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 61235994}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14787': {'gid': 14787, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6841/2021253625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6840', 'nonce': 2021253625}, {'type': 'v1', 'addr': '172.21.15.22:6841', 'nonce': 2021253625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24566': {'gid': 24566, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6833/2373240323', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6832', 'nonce': 2373240323}, {'type': 'v1', 'addr': '172.21.15.60:6833', 'nonce': 2373240323}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24571': {'gid': 24571, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.73:6833/1353426950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 1353426950}, {'type': 'v1', 'addr': '172.21.15.73:6833', 'nonce': 1353426950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24596': {'gid': 24596, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6835/2092262185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 2092262185}, {'type': 'v1', 'addr': '172.21.15.60:6835', 'nonce': 2092262185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.73:6835/4117291653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 4117291653}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 4117291653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24616': {'gid': 24616, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.73:6837/3229670499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 3229670499}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 3229670499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24617': {'gid': 24617, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.60:6837/3007306472', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 3007306472}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 3007306472}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24634': {'gid': 24634, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.73:6839/1883983314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6838', 'nonce': 1883983314}, {'type': 'v1', 'addr': '172.21.15.73:6839', 'nonce': 1883983314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24647': {'gid': 24647, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.60:6839/3182487250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 3182487250}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 3182487250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24647, 'qdb_cluster': [24647, 24634, 24617, 24616, 24610]} 2024-09-21T04:02:16.437 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T04:02:16.438 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T04:02:16.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:16 smithi073 ceph-mon[34443]: pgmap v368: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T04:02:16.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:16 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1001490304' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:02:16.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:16 smithi060 ceph-mon[33722]: pgmap v368: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 85 B/s wr, 9 op/s 2024-09-21T04:02:16.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:16 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1001490304' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:02:16.704 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:17.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.202+0000 7fa366617640 1 -- 172.21.15.22:0/640034432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa360109e00 msgr2=0x7fa360110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:17.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.202+0000 7fa366617640 1 --2- 172.21.15.22:0/640034432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa360109e00 0x7fa360110630 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fa358009ca0 tx=0x7fa35802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.202+0000 7fa366617640 1 -- 172.21.15.22:0/640034432 shutdown_connections 2024-09-21T04:02:17.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.202+0000 7fa366617640 1 --2- 172.21.15.22:0/640034432 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa360109e00 0x7fa360110630 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.202+0000 7fa366617640 1 --2- 172.21.15.22:0/640034432 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3601094b0 0x7fa3601098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.202+0000 7fa366617640 1 --2- 172.21.15.22:0/640034432 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa360101f70 0x7fa360102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.202+0000 7fa366617640 1 -- 172.21.15.22:0/640034432 >> 172.21.15.22:0/640034432 conn(0x7fa360077c60 msgr2=0x7fa3600780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.202+0000 7fa366617640 1 -- 172.21.15.22:0/640034432 shutdown_connections 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.202+0000 7fa366617640 1 -- 172.21.15.22:0/640034432 wait complete. 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.203+0000 7fa366617640 1 Processor -- start 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.203+0000 7fa366617640 1 -- start start 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa366617640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa360101f70 0x7fa36019a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa366617640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3601094b0 0x7fa36019a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa366617640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa360109e00 0x7fa36019fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa366617640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa3601139c0 con 0x7fa360109e00 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa366617640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa360113840 con 0x7fa3601094b0 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa366617640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa360113b40 con 0x7fa360101f70 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa364bb4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa360109e00 0x7fa36019fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa364bb4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa360109e00 0x7fa36019fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38796/0 (socket says 172.21.15.22:38796) 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa364bb4640 1 -- 172.21.15.22:0/1705306183 learned_addr learned my addr 172.21.15.22:0/1705306183 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3601094b0 0x7fa36019a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.204+0000 7fa35ffff640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa360101f70 0x7fa36019a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa364bb4640 1 -- 172.21.15.22:0/1705306183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa360101f70 msgr2=0x7fa36019a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa364bb4640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa360101f70 0x7fa36019a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa364bb4640 1 -- 172.21.15.22:0/1705306183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3601094b0 msgr2=0x7fa36019a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa364bb4640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3601094b0 0x7fa36019a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa364bb4640 1 -- 172.21.15.22:0/1705306183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3601a02c0 con 0x7fa360109e00 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa364bb4640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa360109e00 0x7fa36019fb90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa358005cc0 tx=0x7fa358032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa35d7fa640 1 -- 172.21.15.22:0/1705306183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358004040 con 0x7fa360109e00 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa366617640 1 -- 172.21.15.22:0/1705306183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3601a0550 con 0x7fa360109e00 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa35d7fa640 1 -- 172.21.15.22:0/1705306183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa358004670 con 0x7fa360109e00 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa35d7fa640 1 -- 172.21.15.22:0/1705306183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa358030cc0 con 0x7fa360109e00 2024-09-21T04:02:17.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.205+0000 7fa366617640 1 -- 172.21.15.22:0/1705306183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3601a6d10 con 0x7fa360109e00 2024-09-21T04:02:17.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.208+0000 7fa36cb8b740 1 Processor -- start 2024-09-21T04:02:17.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.209+0000 7fa35d7fa640 1 -- 172.21.15.22:0/1705306183 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa35804e430 con 0x7fa360109e00 2024-09-21T04:02:17.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.209+0000 7fa36cb8b740 1 -- start start 2024-09-21T04:02:17.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.209+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ccf60 0x55e936772f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.209+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363a40a0 0x55e936773440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.209+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363ac280 0x55e936773980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.209+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e9366eac10 con 0x55e9363ac280 2024-09-21T04:02:17.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.209+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55e9366da040 con 0x55e9363a40a0 2024-09-21T04:02:17.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.209+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e9366dde50 con 0x55e9363ccf60 2024-09-21T04:02:17.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.209+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363ac280 0x55e936773980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.209+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363ac280 0x55e936773980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38804/0 (socket says 172.21.15.22:38804) 2024-09-21T04:02:17.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35f7fe640 1 -- 172.21.15.22:0/3304286887 learned_addr learned my addr 172.21.15.22:0/3304286887 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:17.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35ffff640 1 --2- 172.21.15.22:0/3304286887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363a40a0 0x55e936773440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/3304286887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ccf60 0x55e936772f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35ffff640 1 -- 172.21.15.22:0/3304286887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ccf60 msgr2=0x55e936772f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:17.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35ffff640 1 --2- 172.21.15.22:0/3304286887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ccf60 0x55e936772f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35ffff640 1 -- 172.21.15.22:0/3304286887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363ac280 msgr2=0x55e936773980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:17.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35ffff640 1 --2- 172.21.15.22:0/3304286887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363ac280 0x55e936773980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35ffff640 1 -- 172.21.15.22:0/3304286887 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e936438540 con 0x55e9363a40a0 2024-09-21T04:02:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/3304286887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363ac280 0x55e936773980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35d7fa640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa3480b6510 0x7fa3480b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa3480b6510 0x7fa3480b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35ffff640 1 --2- 172.21.15.22:0/3304286887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363a40a0 0x55e936773440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa35000ab40 tx=0x7fa35000f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4fb593aef54c97b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.210+0000 7fa35d7fa640 1 -- 172.21.15.22:0/1705306183 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa358108c90 con 0x7fa360109e00 2024-09-21T04:02:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.211+0000 7fa3467fc640 1 -- 172.21.15.22:0/3304286887 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350004020 con 0x55e9363a40a0 2024-09-21T04:02:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.211+0000 7fa3467fc640 1 -- 172.21.15.22:0/3304286887 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3500041c0 con 0x55e9363a40a0 2024-09-21T04:02:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.211+0000 7fa3467fc640 1 -- 172.21.15.22:0/3304286887 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3500186a0 con 0x55e9363a40a0 2024-09-21T04:02:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3304286887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363a40a0 msgr2=0x55e936773440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:17.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3304286887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363a40a0 0x55e936773440 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa35000ab40 tx=0x7fa35000f3c0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa3480b6510 0x7fa3480b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa35400afd0 tx=0x7fa35400a640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:17.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3304286887 shutdown_connections 2024-09-21T04:02:17.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3304286887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363ac280 0x55e936773980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3304286887 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363a40a0 0x55e936773440 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3304286887 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ccf60 0x55e936772f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3304286887 >> 172.21.15.22:0/3304286887 conn(0x55e9363c1350 msgr2=0x55e936770df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:17.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3304286887 shutdown_connections 2024-09-21T04:02:17.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3304286887 wait complete. 2024-09-21T04:02:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 -- start start 2024-09-21T04:02:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.212+0000 7fa36cb8b740 1 Processor -- start 2024-09-21T04:02:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936782b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 0x55e9367830d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ccf60 0x55e93678ece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e93653b5f0 con 0x55e9363a40a0 2024-09-21T04:02:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55e936675010 con 0x55e9363ac280 2024-09-21T04:02:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e936785980 con 0x55e9363ccf60 2024-09-21T04:02:17.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa36cb8b740 10 client.0 _ll_register_callbacks cb 0x55e9366d4340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:17.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa35ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936782b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa35ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936782b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38816/0 (socket says 172.21.15.22:38816) 2024-09-21T04:02:17.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa35ffff640 1 -- 172.21.15.22:0/3933364921 learned_addr learned my addr 172.21.15.22:0/3933364921 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:17.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 0x55e9367830d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa364bb4640 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ccf60 0x55e93678ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa35ffff640 1 -- 172.21.15.22:0/3933364921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ccf60 msgr2=0x55e93678ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:17.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa35ffff640 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ccf60 0x55e93678ece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa35ffff640 1 -- 172.21.15.22:0/3933364921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 msgr2=0x55e9367830d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.213+0000 7fa35ffff640 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 0x55e9367830d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.214+0000 7fa35ffff640 1 -- 172.21.15.22:0/3933364921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9366a2a00 con 0x55e9363a40a0 2024-09-21T04:02:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.215+0000 7fa35ffff640 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936782b30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa350005e00 tx=0x7fa350005e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4985c16b32a4fbf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.215+0000 7fa33f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:17.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.215+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3933364921 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa350027020 con 0x55e9363a40a0 2024-09-21T04:02:17.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.215+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3933364921 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa350004370 con 0x55e9363a40a0 2024-09-21T04:02:17.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.215+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3933364921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa3500041c0 con 0x55e9363a40a0 2024-09-21T04:02:17.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.215+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3933364921 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa350032050 con 0x55e9363a40a0 2024-09-21T04:02:17.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.215+0000 7fa36cb8b740 10 client.15399 fetch_fsmap learned FSMap version 28 2024-09-21T04:02:17.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.215+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3933364921 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e936791880 con 0x55e9363a40a0 2024-09-21T04:02:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.215+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3933364921 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa3500041c0 con 0x55e9363a40a0 2024-09-21T04:02:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.216+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3933364921 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa350004a40 con 0x55e9363a40a0 2024-09-21T04:02:17.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.216+0000 7fa36cb8b740 10 client.15399 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:02:17.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.216+0000 7fa36cb8b740 10 client.15399 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T04:02:17.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.216+0000 7fa36cb8b740 20 client.15399 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:17.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.216+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x55e93638b8e0 0x55e936794ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.216+0000 7fa36cb8b740 4 client.15399 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:17.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.216+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3933364921 --> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9366ecb60 con 0x55e93638b8e0 2024-09-21T04:02:17.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.216+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x55e93638b8e0 0x55e936794ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.217+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x55e93638b8e0 0x55e936794ff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d2bb130a24d50789 server_cookie=ccb7995d2093623 in_seq=0 out_seq=0 2024-09-21T04:02:17.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.217+0000 7fa33f7fe640 10 client.15399 ms_handle_connect on v2:172.21.15.73:6834/4117291653 2024-09-21T04:02:17.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3933364921 <== mds.4 v2:172.21.15.73:6834/4117291653 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55e9366ecb60 con 0x55e93638b8e0 2024-09-21T04:02:17.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa33f7fe640 10 client.15399 handle_command_reply: tid=0 2024-09-21T04:02:17.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa36cb8b740 1 client.15399 shutdown 2024-09-21T04:02:17.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3933364921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 msgr2=0x55e936782b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:17.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936782b30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fa350005e00 tx=0x7fa350005e30 comp rx=0 tx=0).stop 2024-09-21T04:02:17.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3933364921 shutdown_connections 2024-09-21T04:02:17.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x55e93638b8e0 0x55e936794ff0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa33f7fe640 0 client.15399 ms_handle_reset on v2:172.21.15.73:6834/4117291653 2024-09-21T04:02:17.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ccf60 0x55e93678ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 0x55e9367830d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3933364921 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936782b30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.218+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3933364921 >> 172.21.15.22:0/3933364921 conn(0x55e9363c1350 msgr2=0x55e93676f3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:17.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.219+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3933364921 shutdown_connections 2024-09-21T04:02:17.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.219+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3933364921 wait complete. 2024-09-21T04:02:17.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.219+0000 7fa36cb8b740 20 client.15399 trim_cache size 0 max 16384 2024-09-21T04:02:17.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa36cb8b740 1 Processor -- start 2024-09-21T04:02:17.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa36cb8b740 1 -- start start 2024-09-21T04:02:17.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e93638b8e0 0x55e9367934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e93678ec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 0x55e93678f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e936793330 con 0x55e9363a40a0 2024-09-21T04:02:17.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55e936793a00 con 0x55e9363ac280 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e9367940d0 con 0x55e93638b8e0 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e93678ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e93678ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38820/0 (socket says 172.21.15.22:38820) 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.241+0000 7fa35f7fe640 1 -- 172.21.15.22:0/902856088 learned_addr learned my addr 172.21.15.22:0/902856088 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa35ffff640 1 --2- 172.21.15.22:0/902856088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e93638b8e0 0x55e9367934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa364bb4640 1 --2- 172.21.15.22:0/902856088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 0x55e93678f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa35f7fe640 1 -- 172.21.15.22:0/902856088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e93638b8e0 msgr2=0x55e9367934b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/902856088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e93638b8e0 0x55e9367934b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa35f7fe640 1 -- 172.21.15.22:0/902856088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 msgr2=0x55e93678f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/902856088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 0x55e93678f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa35f7fe640 1 -- 172.21.15.22:0/902856088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e93677e3c0 con 0x55e9363a40a0 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa364bb4640 1 --2- 172.21.15.22:0/902856088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 0x55e93678f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:17.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/902856088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e93678ec50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa35400aa60 tx=0x7fa3540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec233d224a8c816 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:17.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa345ffb640 1 -- 172.21.15.22:0/902856088 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3540240d0 con 0x55e9363a40a0 2024-09-21T04:02:17.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa345ffb640 1 -- 172.21.15.22:0/902856088 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa354024270 con 0x55e9363a40a0 2024-09-21T04:02:17.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.242+0000 7fa345ffb640 1 -- 172.21.15.22:0/902856088 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354024df0 con 0x55e9363a40a0 2024-09-21T04:02:17.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.243+0000 7fa36cb8b740 1 -- 172.21.15.22:0/902856088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 msgr2=0x55e93678ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:17.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.243+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/902856088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e93678ec50 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fa35400aa60 tx=0x7fa3540046c0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.243+0000 7fa36cb8b740 1 -- 172.21.15.22:0/902856088 shutdown_connections 2024-09-21T04:02:17.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.243+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/902856088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e9363ac280 0x55e93678f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.243+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/902856088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e93678ec50 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.243+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/902856088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e93638b8e0 0x55e9367934b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.243+0000 7fa36cb8b740 1 -- 172.21.15.22:0/902856088 >> 172.21.15.22:0/902856088 conn(0x55e9363c1350 msgr2=0x55e9367828e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.243+0000 7fa36cb8b740 1 -- 172.21.15.22:0/902856088 shutdown_connections 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.243+0000 7fa36cb8b740 1 -- 172.21.15.22:0/902856088 wait complete. 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.244+0000 7fa36cb8b740 1 -- start start 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.244+0000 7fa36cb8b740 1 Processor -- start 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.244+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e93638b8e0 0x55e936797660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.244+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936797ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa36cb8b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ac280 0x55e93679cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55e936794e70 con 0x55e9363a40a0 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55e9367947a0 con 0x55e93638b8e0 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa36cb8b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55e936795540 con 0x55e9363ac280 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa36cb8b740 10 client.0 _ll_register_callbacks cb 0x7fa35400a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936797ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa35f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936797ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38832/0 (socket says 172.21.15.22:38832) 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa35f7fe640 1 -- 172.21.15.22:0/3774796571 learned_addr learned my addr 172.21.15.22:0/3774796571 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa364bb4640 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ac280 0x55e93679cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa35ffff640 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e93638b8e0 0x55e936797660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa35f7fe640 1 -- 172.21.15.22:0/3774796571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ac280 msgr2=0x55e93679cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ac280 0x55e93679cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa35f7fe640 1 -- 172.21.15.22:0/3774796571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e93638b8e0 msgr2=0x55e936797660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e93638b8e0 0x55e936797660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa35f7fe640 1 -- 172.21.15.22:0/3774796571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e93679d2e0 con 0x55e9363a40a0 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa35f7fe640 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936797ba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa35401b040 tx=0x7fa35400a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c29d48bb3db20f2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa33f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.245+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3774796571 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa354041030 con 0x55e9363a40a0 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3774796571 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa354030040 con 0x55e9363a40a0 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3774796571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa354024270 con 0x55e9363a40a0 2024-09-21T04:02:17.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3774796571 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa354039040 con 0x55e9363a40a0 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa36cb8b740 10 client.15405 fetch_fsmap learned FSMap version 28 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3774796571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55e936800a70 con 0x55e9363a40a0 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3774796571 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa354024270 con 0x55e9363a40a0 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3774796571 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa35403c030 con 0x55e9363a40a0 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa36cb8b740 10 client.15405 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa36cb8b740 10 client.15405 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa36cb8b740 20 client.15405 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x55e9363ccf60 0x55e936803fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa36cb8b740 4 client.15405 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.246+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3774796571 --> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] -- command(tid 0: {"prefix": "status"}) -- 0x55e9366e8610 con 0x55e9363ccf60 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.247+0000 7fa35ffff640 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x55e9363ccf60 0x55e936803fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.247+0000 7fa35ffff640 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x55e9363ccf60 0x55e936803fb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5bdd2164b603bb06 server_cookie=f26ba5eb290901ba in_seq=0 out_seq=0 2024-09-21T04:02:17.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.247+0000 7fa33f7fe640 10 client.15405 ms_handle_connect on v2:172.21.15.73:6834/4117291653 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.247+0000 7fa33f7fe640 1 -- 172.21.15.22:0/3774796571 <== mds.4 v2:172.21.15.73:6834/4117291653 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55e9366e8610 con 0x55e9363ccf60 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.247+0000 7fa33f7fe640 10 client.15405 handle_command_reply: tid=0 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.247+0000 7fa36cb8b740 1 client.15405 shutdown 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3774796571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 msgr2=0x55e936797ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936797ba0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fa35401b040 tx=0x7fa35400a8a0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3774796571 shutdown_connections 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x55e9363ccf60 0x55e936803fb0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa33f7fe640 0 client.15405 ms_handle_reset on v2:172.21.15.73:6834/4117291653 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55e9363ac280 0x55e93679cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55e9363a40a0 0x55e936797ba0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 1 --2- 172.21.15.22:0/3774796571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55e93638b8e0 0x55e936797660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3774796571 >> 172.21.15.22:0/3774796571 conn(0x55e9363c1350 msgr2=0x55e9367828e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3774796571 shutdown_connections 2024-09-21T04:02:17.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 1 -- 172.21.15.22:0/3774796571 wait complete. 2024-09-21T04:02:17.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.248+0000 7fa36cb8b740 20 client.15405 trim_cache size 0 max 16384 2024-09-21T04:02:17.256 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:17.256 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:02:17.256 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 4, 2024-09-21T04:02:17.256 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24610, 2024-09-21T04:02:17.256 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:02:17.256 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:02:17.256 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:02:17.256 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 93.038937340999993, 2024-09-21T04:02:17.256 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-21T04:02:17.257 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:02:17.257 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T04:02:17.257 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 160.62302123500001 2024-09-21T04:02:17.257 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:17.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 -- 172.21.15.22:0/1705306183 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa3480b6510 msgr2=0x7fa3480b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa3480b6510 0x7fa3480b8a20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa35400afd0 tx=0x7fa35400a640 comp rx=0 tx=0).stop 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 -- 172.21.15.22:0/1705306183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa360109e00 msgr2=0x7fa36019fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa360109e00 0x7fa36019fb90 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fa358005cc0 tx=0x7fa358032c40 comp rx=0 tx=0).stop 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 -- 172.21.15.22:0/1705306183 shutdown_connections 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa3480b6510 0x7fa3480b8a20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa360109e00 0x7fa36019fb90 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa3601094b0 0x7fa36019a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 --2- 172.21.15.22:0/1705306183 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa360101f70 0x7fa36019a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 -- 172.21.15.22:0/1705306183 >> 172.21.15.22:0/1705306183 conn(0x7fa360077c60 msgr2=0x7fa3601074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 -- 172.21.15.22:0/1705306183 shutdown_connections 2024-09-21T04:02:17.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:17.249+0000 7fa366617640 1 -- 172.21.15.22:0/1705306183 wait complete. 2024-09-21T04:02:17.968 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T04:02:18.230 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:18.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:18 smithi022 ceph-mon[31015]: pgmap v369: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:02:18.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:18 smithi073 ceph-mon[34443]: pgmap v369: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:02:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:18 smithi060 ceph-mon[33722]: pgmap v369: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:02:18.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.730+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1018886579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa0106bf0 msgr2=0x7f4aa0110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:18.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.730+0000 7f4aa5c8a640 1 --2- 172.21.15.22:0/1018886579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa0106bf0 0x7f4aa0110660 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f4a98009900 tx=0x7f4a9802a410 comp rx=0 tx=0).stop 2024-09-21T04:02:18.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.730+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1018886579 shutdown_connections 2024-09-21T04:02:18.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.730+0000 7f4aa5c8a640 1 --2- 172.21.15.22:0/1018886579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa0106bf0 0x7f4aa0110660 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.730+0000 7f4aa5c8a640 1 --2- 172.21.15.22:0/1018886579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa01062a0 0x7f4aa01066b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.730+0000 7f4aa5c8a640 1 --2- 172.21.15.22:0/1018886579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa01020b0 0x7f4aa01024c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.730+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1018886579 >> 172.21.15.22:0/1018886579 conn(0x7f4aa0079e30 msgr2=0x7f4aa007a240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:18.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.730+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1018886579 shutdown_connections 2024-09-21T04:02:18.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.730+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1018886579 wait complete. 2024-09-21T04:02:18.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4aa5c8a640 1 Processor -- start 2024-09-21T04:02:18.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4aa5c8a640 1 -- start start 2024-09-21T04:02:18.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4aa5c8a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa01020b0 0x7f4aa019a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4aa5c8a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa01062a0 0x7f4aa019a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4aa5c8a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa0106bf0 0x7f4aa019fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4aa5c8a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa01139c0 con 0x7f4aa01062a0 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4aa5c8a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa0113840 con 0x7f4aa01020b0 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4aa5c8a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4aa0113b40 con 0x7f4aa0106bf0 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4a9effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa01062a0 0x7f4aa019a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4a9effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa01062a0 0x7f4aa019a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38854/0 (socket says 172.21.15.22:38854) 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.731+0000 7f4a9effd640 1 -- 172.21.15.22:0/1108644706 learned_addr learned my addr 172.21.15.22:0/1108644706 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa01020b0 0x7f4aa019a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa0106bf0 0x7f4aa019fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9effd640 1 -- 172.21.15.22:0/1108644706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa0106bf0 msgr2=0x7f4aa019fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9effd640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa0106bf0 0x7f4aa019fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9effd640 1 -- 172.21.15.22:0/1108644706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa01020b0 msgr2=0x7f4aa019a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:18.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9effd640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa01020b0 0x7f4aa019a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9effd640 1 -- 172.21.15.22:0/1108644706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aa01a0320 con 0x7f4aa01062a0 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa0106bf0 0x7f4aa019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9effd640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa01062a0 0x7f4aa019a950 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400c970 tx=0x7f4a9400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9cff9640 1 -- 172.21.15.22:0/1108644706 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a94004220 con 0x7f4aa01062a0 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9cff9640 1 -- 172.21.15.22:0/1108644706 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a94007e40 con 0x7f4aa01062a0 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1108644706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4aa01a0610 con 0x7f4aa01062a0 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4a9cff9640 1 -- 172.21.15.22:0/1108644706 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a940047a0 con 0x7f4aa01062a0 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.732+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1108644706 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4aa01a6d70 con 0x7f4aa01062a0 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4aac1fe740 1 Processor -- start 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4aac1fe740 1 -- start start 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4a9cff9640 1 -- 172.21.15.22:0/1108644706 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4a940079b0 con 0x7f4aa01062a0 2024-09-21T04:02:18.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e115f60 0x564b7e4bbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4bc440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4bc980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564b7e433c10 con 0x564b7e0ed0a0 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564b7e423040 con 0x564b7e0f5280 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x564b7e426e50 con 0x564b7e115f60 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4a9f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4bc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4a9f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4bc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38856/0 (socket says 172.21.15.22:38856) 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.735+0000 7f4a9f7fe640 1 -- 172.21.15.22:0/755535394 learned_addr learned my addr 172.21.15.22:0/755535394 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/755535394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e115f60 0x564b7e4bbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a9f7fe640 1 -- 172.21.15.22:0/755535394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e115f60 msgr2=0x564b7e4bbf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:18.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/755535394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e115f60 0x564b7e4bbf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a9effd640 1 --2- 172.21.15.22:0/755535394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4bc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a9f7fe640 1 -- 172.21.15.22:0/755535394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 msgr2=0x564b7e4bc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/755535394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4bc980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a9f7fe640 1 -- 172.21.15.22:0/755535394 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7e181540 con 0x564b7e0ed0a0 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/755535394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4bc440 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4a90010420 tx=0x7f4a900108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61c4b421eb0ae2b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a85ffb640 1 -- 172.21.15.22:0/755535394 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90016070 con 0x564b7e0ed0a0 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a85ffb640 1 -- 172.21.15.22:0/755535394 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a90004d20 con 0x564b7e0ed0a0 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a85ffb640 1 -- 172.21.15.22:0/755535394 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a900053a0 con 0x564b7e0ed0a0 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a9cff9640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a880b6590 0x7f4a880b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.736+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a880b6590 0x7f4a880b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4a9cff9640 1 -- 172.21.15.22:0/1108644706 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f4a940e7360 con 0x7f4aa01062a0 2024-09-21T04:02:18.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4aac1fe740 1 -- 172.21.15.22:0/755535394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 msgr2=0x564b7e4bc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/755535394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4bc440 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f4a90010420 tx=0x7f4a900108e0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a880b6590 0x7f4a880b8aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4a980096c0 tx=0x7f4a98005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4aac1fe740 1 -- 172.21.15.22:0/755535394 shutdown_connections 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/755535394 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4bc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/755535394 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4bc440 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/755535394 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e115f60 0x564b7e4bbf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4aac1fe740 1 -- 172.21.15.22:0/755535394 >> 172.21.15.22:0/755535394 conn(0x564b7e10a350 msgr2=0x564b7e4b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4aac1fe740 1 -- 172.21.15.22:0/755535394 shutdown_connections 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.737+0000 7f4aac1fe740 1 -- 172.21.15.22:0/755535394 wait complete. 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.738+0000 7f4aac1fe740 1 -- start start 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.738+0000 7f4aac1fe740 1 Processor -- start 2024-09-21T04:02:18.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.738+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.738+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4cc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.738+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e115f60 0x564b7e4d7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.738+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564b7e2845f0 con 0x564b7e0ed0a0 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.738+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564b7e3be010 con 0x564b7e0f5280 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.738+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x564b7e4cea10 con 0x564b7e115f60 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4aac1fe740 10 client.0 _ll_register_callbacks cb 0x564b7e41d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38864/0 (socket says 172.21.15.22:38864) 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9f7fe640 1 -- 172.21.15.22:0/123514782 learned_addr learned my addr 172.21.15.22:0/123514782 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e115f60 0x564b7e4d7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9effd640 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4cc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9f7fe640 1 -- 172.21.15.22:0/123514782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e115f60 msgr2=0x564b7e4d7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e115f60 0x564b7e4d7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9f7fe640 1 -- 172.21.15.22:0/123514782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 msgr2=0x564b7e4cc310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4cc310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9f7fe640 1 -- 172.21.15.22:0/123514782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7e3eba00 con 0x564b7e0ed0a0 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9effd640 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4cbdd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4a90005cc0 tx=0x7f4a90003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396ce59c52fa32f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a7effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a7effd640 1 -- 172.21.15.22:0/123514782 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a90029060 con 0x564b7e0ed0a0 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4a7effd640 1 -- 172.21.15.22:0/123514782 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f4a90003e00 con 0x564b7e0ed0a0 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.739+0000 7f4aac1fe740 1 -- 172.21.15.22:0/123514782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a90004d20 con 0x564b7e0ed0a0 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4a7effd640 1 -- 172.21.15.22:0/123514782 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4a90030050 con 0x564b7e0ed0a0 2024-09-21T04:02:18.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4aac1fe740 10 client.15417 fetch_fsmap learned FSMap version 28 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4aac1fe740 1 -- 172.21.15.22:0/123514782 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b7e4da9a0 con 0x564b7e0ed0a0 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4a7effd640 1 -- 172.21.15.22:0/123514782 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a90004d20 con 0x564b7e0ed0a0 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4a7effd640 1 -- 172.21.15.22:0/123514782 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4a9000f040 con 0x564b7e0ed0a0 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4aac1fe740 10 client.15417 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4aac1fe740 10 client.15417 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4aac1fe740 20 client.15417 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x564b7e0d48e0 0x564b7e4de010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4aac1fe740 4 client.15417 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4aac1fe740 1 -- 172.21.15.22:0/123514782 --> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564b7e435b60 con 0x564b7e0d48e0 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.740+0000 7f4a9effd640 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x564b7e0d48e0 0x564b7e4de010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.741+0000 7f4a7effd640 10 client.15417 ms_handle_connect on v2:172.21.15.73:6836/3229670499 2024-09-21T04:02:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.741+0000 7f4a9effd640 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x564b7e0d48e0 0x564b7e4de010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a052429c6fdfc6bb server_cookie=f2a576b1cf95307c in_seq=0 out_seq=0 2024-09-21T04:02:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4a7effd640 1 -- 172.21.15.22:0/123514782 <== mds.3 v2:172.21.15.73:6836/3229670499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x564b7e435b60 con 0x564b7e0d48e0 2024-09-21T04:02:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4a7effd640 10 client.15417 handle_command_reply: tid=0 2024-09-21T04:02:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 client.15417 shutdown 2024-09-21T04:02:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 -- 172.21.15.22:0/123514782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 msgr2=0x564b7e4cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4cbdd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4a90005cc0 tx=0x7f4a90003c10 comp rx=0 tx=0).stop 2024-09-21T04:02:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 -- 172.21.15.22:0/123514782 shutdown_connections 2024-09-21T04:02:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x564b7e0d48e0 0x564b7e4de010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4a7effd640 0 client.15417 ms_handle_reset on v2:172.21.15.73:6836/3229670499 2024-09-21T04:02:18.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e115f60 0x564b7e4d7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4cc310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/123514782 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4cbdd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 -- 172.21.15.22:0/123514782 >> 172.21.15.22:0/123514782 conn(0x564b7e10a350 msgr2=0x564b7e4bf090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 -- 172.21.15.22:0/123514782 shutdown_connections 2024-09-21T04:02:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 1 -- 172.21.15.22:0/123514782 wait complete. 2024-09-21T04:02:18.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.742+0000 7f4aac1fe740 20 client.15417 trim_cache size 0 max 16384 2024-09-21T04:02:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.760+0000 7f4aac1fe740 1 Processor -- start 2024-09-21T04:02:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.760+0000 7f4aac1fe740 1 -- start start 2024-09-21T04:02:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0d48e0 0x564b7e4cb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e0ed0a0 0x564b7e4c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0f5280 0x564b7e4c72c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564b7e4dc350 con 0x564b7e0f5280 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564b7e4dca20 con 0x564b7e0d48e0 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x564b7e4dd0f0 con 0x564b7e0ed0a0 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0f5280 0x564b7e4c72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0f5280 0x564b7e4c72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38880/0 (socket says 172.21.15.22:38880) 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9ffff640 1 -- 172.21.15.22:0/4065946700 learned_addr learned my addr 172.21.15.22:0/4065946700 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9effd640 1 --2- 172.21.15.22:0/4065946700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e0ed0a0 0x564b7e4c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/4065946700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0d48e0 0x564b7e4cb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9ffff640 1 -- 172.21.15.22:0/4065946700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e0ed0a0 msgr2=0x564b7e4c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/4065946700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e0ed0a0 0x564b7e4c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9ffff640 1 -- 172.21.15.22:0/4065946700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0d48e0 msgr2=0x564b7e4cb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/4065946700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0d48e0 0x564b7e4cb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9ffff640 1 -- 172.21.15.22:0/4065946700 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564b7e4c6870 con 0x564b7e0f5280 2024-09-21T04:02:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.761+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/4065946700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0f5280 0x564b7e4c72c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4a98033000 tx=0x7f4a9803d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac68050590a60220 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.762+0000 7f4a857fa640 1 -- 172.21.15.22:0/4065946700 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a98035050 con 0x564b7e0f5280 2024-09-21T04:02:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.762+0000 7f4a857fa640 1 -- 172.21.15.22:0/4065946700 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a98004440 con 0x564b7e0f5280 2024-09-21T04:02:18.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.762+0000 7f4a857fa640 1 -- 172.21.15.22:0/4065946700 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9803b820 con 0x564b7e0f5280 2024-09-21T04:02:18.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.762+0000 7f4aac1fe740 1 -- 172.21.15.22:0/4065946700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0f5280 msgr2=0x564b7e4c72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:18.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.762+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/4065946700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0f5280 0x564b7e4c72c0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f4a98033000 tx=0x7f4a9803d000 comp rx=0 tx=0).stop 2024-09-21T04:02:18.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.762+0000 7f4aac1fe740 1 -- 172.21.15.22:0/4065946700 shutdown_connections 2024-09-21T04:02:18.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.762+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/4065946700 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e0ed0a0 0x564b7e4c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.762+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/4065946700 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0f5280 0x564b7e4c72c0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.762+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/4065946700 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0d48e0 0x564b7e4cb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.762+0000 7f4aac1fe740 1 -- 172.21.15.22:0/4065946700 >> 172.21.15.22:0/4065946700 conn(0x564b7e10a350 msgr2=0x564b7e4cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.763+0000 7f4aac1fe740 1 -- 172.21.15.22:0/4065946700 shutdown_connections 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.763+0000 7f4aac1fe740 1 -- 172.21.15.22:0/4065946700 wait complete. 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.763+0000 7f4aac1fe740 1 -- start start 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.763+0000 7f4aac1fe740 1 Processor -- start 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.763+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e0d48e0 0x564b7e4e09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.763+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4e0f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4aac1fe740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4e5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564b7e4dde90 con 0x564b7e0ed0a0 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x564b7e4dd7c0 con 0x564b7e0f5280 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4aac1fe740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x564b7e4de560 con 0x564b7e0d48e0 2024-09-21T04:02:18.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4aac1fe740 10 client.0 _ll_register_callbacks cb 0x7f4a90009ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4e0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4e0f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38890/0 (socket says 172.21.15.22:38890) 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9effd640 1 -- 172.21.15.22:0/3935515959 learned_addr learned my addr 172.21.15.22:0/3935515959 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e0d48e0 0x564b7e4e09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4e5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9effd640 1 -- 172.21.15.22:0/3935515959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e0d48e0 msgr2=0x564b7e4e09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9effd640 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e0d48e0 0x564b7e4e09f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9effd640 1 -- 172.21.15.22:0/3935515959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 msgr2=0x564b7e4e5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9effd640 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4e5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9effd640 1 -- 172.21.15.22:0/3935515959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564b7e4e5e50 con 0x564b7e0ed0a0 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9ffff640 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4e5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:18.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a9effd640 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4e0f70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4a94004520 tx=0x7f4a940b4f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fa259c038dde26f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a7effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a7effd640 1 -- 172.21.15.22:0/3935515959 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a9401d040 con 0x564b7e0ed0a0 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4a7effd640 1 -- 172.21.15.22:0/3935515959 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f4a940984b0 con 0x564b7e0ed0a0 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.764+0000 7f4aac1fe740 1 -- 172.21.15.22:0/3935515959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4a98004440 con 0x564b7e0ed0a0 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4a7effd640 1 -- 172.21.15.22:0/3935515959 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4a940a9780 con 0x564b7e0ed0a0 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4aac1fe740 10 client.15423 fetch_fsmap learned FSMap version 28 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4aac1fe740 1 -- 172.21.15.22:0/3935515959 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564b7e5494e0 con 0x564b7e0ed0a0 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4a7effd640 1 -- 172.21.15.22:0/3935515959 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4a98004440 con 0x564b7e0ed0a0 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4a7effd640 1 -- 172.21.15.22:0/3935515959 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4a940abe00 con 0x564b7e0ed0a0 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4aac1fe740 10 client.15423 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:02:18.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4aac1fe740 10 client.15423 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4aac1fe740 20 client.15423 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x564b7e115f60 0x564b7e54cc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4aac1fe740 4 client.15423 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4aac1fe740 1 -- 172.21.15.22:0/3935515959 --> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] -- command(tid 0: {"prefix": "status"}) -- 0x564b7e431610 con 0x564b7e115f60 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.765+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x564b7e115f60 0x564b7e54cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4a9f7fe640 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x564b7e115f60 0x564b7e54cc20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=c0df6782128ec7e8 server_cookie=38491bf62e71f5ca in_seq=0 out_seq=0 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4a7effd640 10 client.15423 ms_handle_connect on v2:172.21.15.73:6836/3229670499 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4a7effd640 1 -- 172.21.15.22:0/3935515959 <== mds.3 v2:172.21.15.73:6836/3229670499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x564b7e431610 con 0x564b7e115f60 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4a7effd640 10 client.15423 handle_command_reply: tid=0 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4aac1fe740 1 client.15423 shutdown 2024-09-21T04:02:18.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4aac1fe740 1 -- 172.21.15.22:0/3935515959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 msgr2=0x564b7e4e0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4e0f70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f4a94004520 tx=0x7f4a940b4f90 comp rx=0 tx=0).stop 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4aac1fe740 1 -- 172.21.15.22:0/3935515959 shutdown_connections 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x564b7e115f60 0x564b7e54cc20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x564b7e0f5280 0x564b7e4e5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564b7e0ed0a0 0x564b7e4e0f70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4aac1fe740 1 --2- 172.21.15.22:0/3935515959 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x564b7e0d48e0 0x564b7e4e09f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.766+0000 7f4aac1fe740 1 -- 172.21.15.22:0/3935515959 >> 172.21.15.22:0/3935515959 conn(0x564b7e10a350 msgr2=0x564b7e4cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4a7effd640 0 client.15423 ms_handle_reset on v2:172.21.15.73:6836/3229670499 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aac1fe740 1 -- 172.21.15.22:0/3935515959 shutdown_connections 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aac1fe740 1 -- 172.21.15.22:0/3935515959 wait complete. 2024-09-21T04:02:18.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aac1fe740 20 client.15423 trim_cache size 0 max 16384 2024-09-21T04:02:18.776 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:18.776 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:02:18.776 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 3, 2024-09-21T04:02:18.776 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24616, 2024-09-21T04:02:18.776 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:02:18.776 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:02:18.776 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:02:18.776 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 95.564784539000001, 2024-09-21T04:02:18.776 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-21T04:02:18.776 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:02:18.777 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T04:02:18.777 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 159.620680542 2024-09-21T04:02:18.777 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1108644706 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a880b6590 msgr2=0x7f4a880b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aa5c8a640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a880b6590 0x7f4a880b8aa0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4a980096c0 tx=0x7f4a98005a20 comp rx=0 tx=0).stop 2024-09-21T04:02:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1108644706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa01062a0 msgr2=0x7f4aa019a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aa5c8a640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa01062a0 0x7f4aa019a950 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400c970 tx=0x7f4a9400ce30 comp rx=0 tx=0).stop 2024-09-21T04:02:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1108644706 shutdown_connections 2024-09-21T04:02:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aa5c8a640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f4a880b6590 0x7f4a880b8aa0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aa5c8a640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4aa0106bf0 0x7f4aa019fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aa5c8a640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4aa01062a0 0x7f4aa019a950 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aa5c8a640 1 --2- 172.21.15.22:0/1108644706 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4aa01020b0 0x7f4aa019a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.767+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1108644706 >> 172.21.15.22:0/1108644706 conn(0x7f4aa0079e30 msgr2=0x7f4aa0107570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:18.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.768+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1108644706 shutdown_connections 2024-09-21T04:02:18.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:18.768+0000 7f4aa5c8a640 1 -- 172.21.15.22:0/1108644706 wait complete. 2024-09-21T04:02:19.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T04:02:19.807 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.277+0000 7f233c009640 1 -- 172.21.15.22:0/1402214469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2334103b60 msgr2=0x7f2334103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.277+0000 7f233c009640 1 --2- 172.21.15.22:0/1402214469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2334103b60 0x7f2334103f70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f2330009900 tx=0x7f233002a410 comp rx=0 tx=0).stop 2024-09-21T04:02:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.277+0000 7f233c009640 1 -- 172.21.15.22:0/1402214469 shutdown_connections 2024-09-21T04:02:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.277+0000 7f233c009640 1 --2- 172.21.15.22:0/1402214469 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2334109df0 0x7f2334110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.277+0000 7f233c009640 1 --2- 172.21.15.22:0/1402214469 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23341094a0 0x7f23341098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.277+0000 7f233c009640 1 --2- 172.21.15.22:0/1402214469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2334103b60 0x7f2334103f70 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.277+0000 7f233c009640 1 -- 172.21.15.22:0/1402214469 >> 172.21.15.22:0/1402214469 conn(0x7f233407b850 msgr2=0x7f233407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.277+0000 7f233c009640 1 -- 172.21.15.22:0/1402214469 shutdown_connections 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.277+0000 7f233c009640 1 -- 172.21.15.22:0/1402214469 wait complete. 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f233c009640 1 Processor -- start 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f233c009640 1 -- start start 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f233c009640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2334103b60 0x7f233419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f233c009640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23341094a0 0x7f233419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f233c009640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334109df0 0x7f233419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f233c009640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2334113960 con 0x7f23341094a0 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f233c009640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f23341137e0 con 0x7f2334109df0 2024-09-21T04:02:20.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f233c009640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2334113ae0 con 0x7f2334103b60 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f23395a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23341094a0 0x7f233419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f23395a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23341094a0 0x7f233419a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38908/0 (socket says 172.21.15.22:38908) 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f23395a4640 1 -- 172.21.15.22:0/1385558246 learned_addr learned my addr 172.21.15.22:0/1385558246 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f2339da5640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2334103b60 0x7f233419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.278+0000 7f233a5a6640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334109df0 0x7f233419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f23395a4640 1 -- 172.21.15.22:0/1385558246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2334103b60 msgr2=0x7f233419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f23395a4640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2334103b60 0x7f233419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f23395a4640 1 -- 172.21.15.22:0/1385558246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334109df0 msgr2=0x7f233419fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f23395a4640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334109df0 0x7f233419fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f23395a4640 1 -- 172.21.15.22:0/1385558246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23341a02e0 con 0x7f23341094a0 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f23395a4640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23341094a0 0x7f233419a9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f232400c8c0 tx=0x7f232400cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f232affd640 1 -- 172.21.15.22:0/1385558246 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2324007bb0 con 0x7f23341094a0 2024-09-21T04:02:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f232affd640 1 -- 172.21.15.22:0/1385558246 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2324007d50 con 0x7f23341094a0 2024-09-21T04:02:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f233c009640 1 -- 172.21.15.22:0/1385558246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23341a05d0 con 0x7f23341094a0 2024-09-21T04:02:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f233c009640 1 -- 172.21.15.22:0/1385558246 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23341a6df0 con 0x7f23341094a0 2024-09-21T04:02:20.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.279+0000 7f232affd640 1 -- 172.21.15.22:0/1385558246 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23240186a0 con 0x7f23341094a0 2024-09-21T04:02:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f234257d740 1 Processor -- start 2024-09-21T04:02:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f234257d740 1 -- start start 2024-09-21T04:02:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f234257d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd46f60 0x55b9ec0ecf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f234257d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec0ed440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f234257d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd26280 0x55b9ec0ed980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f234257d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b9ec064c10 con 0x55b9ebd46f60 2024-09-21T04:02:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f234257d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b9ec054040 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f234257d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b9ec057e50 con 0x55b9ebd26280 2024-09-21T04:02:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f233a5a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd46f60 0x55b9ec0ecf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f233a5a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd46f60 0x55b9ec0ecf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38914/0 (socket says 172.21.15.22:38914) 2024-09-21T04:02:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.282+0000 7f233a5a6640 1 -- 172.21.15.22:0/3311529895 learned_addr learned my addr 172.21.15.22:0/3311529895 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:20.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f2339da5640 1 --2- 172.21.15.22:0/3311529895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec0ed440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f232affd640 1 -- 172.21.15.22:0/1385558246 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f232400f450 con 0x7f23341094a0 2024-09-21T04:02:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f233a5a6640 1 -- 172.21.15.22:0/3311529895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd26280 msgr2=0x55b9ec0ed980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f233a5a6640 1 --2- 172.21.15.22:0/3311529895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd26280 0x55b9ec0ed980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f233a5a6640 1 -- 172.21.15.22:0/3311529895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 msgr2=0x55b9ec0ed440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f233a5a6640 1 --2- 172.21.15.22:0/3311529895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec0ed440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f233a5a6640 1 -- 172.21.15.22:0/3311529895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ebdb2540 con 0x55b9ebd46f60 2024-09-21T04:02:20.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f233a5a6640 1 --2- 172.21.15.22:0/3311529895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd46f60 0x55b9ec0ecf00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f232c00ae10 tx=0x7f232c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74e9b6aae40a0e99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f231ffff640 1 -- 172.21.15.22:0/3311529895 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c003b70 con 0x55b9ebd46f60 2024-09-21T04:02:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f231ffff640 1 -- 172.21.15.22:0/3311529895 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f232c003d10 con 0x55b9ebd46f60 2024-09-21T04:02:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.283+0000 7f231ffff640 1 -- 172.21.15.22:0/3311529895 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c010970 con 0x55b9ebd46f60 2024-09-21T04:02:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f232affd640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23200b65c0 0x7f23200b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f2339da5640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23200b65c0 0x7f23200b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f232affd640 1 -- 172.21.15.22:0/1385558246 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f23240e7550 con 0x7f23341094a0 2024-09-21T04:02:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f234257d740 1 -- 172.21.15.22:0/3311529895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd46f60 msgr2=0x55b9ec0ecf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f2339da5640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23200b65c0 0x7f23200b8ad0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f23300057c0 tx=0x7f23300058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f234257d740 1 --2- 172.21.15.22:0/3311529895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd46f60 0x55b9ec0ecf00 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f232c00ae10 tx=0x7f232c00f790 comp rx=0 tx=0).stop 2024-09-21T04:02:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f234257d740 1 -- 172.21.15.22:0/3311529895 shutdown_connections 2024-09-21T04:02:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f234257d740 1 --2- 172.21.15.22:0/3311529895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd26280 0x55b9ec0ed980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f234257d740 1 --2- 172.21.15.22:0/3311529895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec0ed440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f234257d740 1 --2- 172.21.15.22:0/3311529895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd46f60 0x55b9ec0ecf00 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.284+0000 7f234257d740 1 -- 172.21.15.22:0/3311529895 >> 172.21.15.22:0/3311529895 conn(0x55b9ebd3b350 msgr2=0x55b9ec0eadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.285+0000 7f234257d740 1 -- 172.21.15.22:0/3311529895 shutdown_connections 2024-09-21T04:02:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.285+0000 7f234257d740 1 -- 172.21.15.22:0/3311529895 wait complete. 2024-09-21T04:02:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.285+0000 7f234257d740 1 -- start start 2024-09-21T04:02:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.285+0000 7f234257d740 1 Processor -- start 2024-09-21T04:02:20.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f234257d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec0f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f234257d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd26280 0x55b9ec0f8f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f234257d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd46f60 0x55b9ec104a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f234257d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b9ebeb55f0 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f234257d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b9ebfef010 con 0x55b9ebd26280 2024-09-21T04:02:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f234257d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b9ec0fb6e0 con 0x55b9ebd46f60 2024-09-21T04:02:20.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f234257d740 10 client.0 _ll_register_callbacks cb 0x55b9ec04e340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f2339da5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec0f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f2339da5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec0f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38922/0 (socket says 172.21.15.22:38922) 2024-09-21T04:02:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f2339da5640 1 -- 172.21.15.22:0/3632436473 learned_addr learned my addr 172.21.15.22:0/3632436473 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f233a5a6640 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd46f60 0x55b9ec104a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f23395a4640 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd26280 0x55b9ec0f8f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f2339da5640 1 -- 172.21.15.22:0/3632436473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd46f60 msgr2=0x55b9ec104a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:20.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f2339da5640 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd46f60 0x55b9ec104a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f2339da5640 1 -- 172.21.15.22:0/3632436473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd26280 msgr2=0x55b9ec0f8f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f2339da5640 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd26280 0x55b9ec0f8f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f2339da5640 1 -- 172.21.15.22:0/3632436473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ec01ca00 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f2339da5640 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec0f8a30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2330033000 tx=0x7f2330009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d045f8ba050617 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.286+0000 7f231d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:20.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f231d7fa640 1 -- 172.21.15.22:0/3632436473 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2330035040 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f231d7fa640 1 -- 172.21.15.22:0/3632436473 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f23300037f0 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f234257d740 1 -- 172.21.15.22:0/3632436473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f232c003d10 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f231d7fa640 1 -- 172.21.15.22:0/3632436473 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f23300044d0 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f234257d740 10 client.15435 fetch_fsmap learned FSMap version 28 2024-09-21T04:02:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f234257d740 1 -- 172.21.15.22:0/3632436473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b9ec107690 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f231d7fa640 1 -- 172.21.15.22:0/3632436473 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f232c003d10 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f231d7fa640 1 -- 172.21.15.22:0/3632436473 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2330044030 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f234257d740 10 client.15435 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:02:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f234257d740 10 client.15435 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T04:02:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f234257d740 20 client.15435 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f234257d740 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x55b9ebd058e0 0x55b9ec10b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f234257d740 4 client.15435 mds_command: new command op to 24617 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.287+0000 7f234257d740 1 -- 172.21.15.22:0/3632436473 --> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b9ec066b60 con 0x55b9ebd058e0 2024-09-21T04:02:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.288+0000 7f23395a4640 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x55b9ebd058e0 0x55b9ec10b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.288+0000 7f23395a4640 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x55b9ebd058e0 0x55b9ec10b150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=272613fe4d3d6ce0 server_cookie=f15be452ca6a42b4 in_seq=0 out_seq=0 2024-09-21T04:02:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.288+0000 7f231d7fa640 10 client.15435 ms_handle_connect on v2:172.21.15.60:6836/3007306472 2024-09-21T04:02:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f231d7fa640 1 -- 172.21.15.22:0/3632436473 <== mds.2 v2:172.21.15.60:6836/3007306472 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b9ec066b60 con 0x55b9ebd058e0 2024-09-21T04:02:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f231d7fa640 10 client.15435 handle_command_reply: tid=0 2024-09-21T04:02:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f234257d740 1 client.15435 shutdown 2024-09-21T04:02:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f234257d740 1 -- 172.21.15.22:0/3632436473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd1e0a0 msgr2=0x55b9ec0f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f234257d740 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec0f8a30 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f2330033000 tx=0x7f2330009260 comp rx=0 tx=0).stop 2024-09-21T04:02:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f234257d740 1 -- 172.21.15.22:0/3632436473 shutdown_connections 2024-09-21T04:02:20.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f234257d740 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x55b9ebd058e0 0x55b9ec10b150 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f234257d740 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd46f60 0x55b9ec104a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f234257d740 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd26280 0x55b9ec0f8f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f234257d740 1 --2- 172.21.15.22:0/3632436473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec0f8a30 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f231d7fa640 0 client.15435 ms_handle_reset on v2:172.21.15.60:6836/3007306472 2024-09-21T04:02:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.289+0000 7f234257d740 1 -- 172.21.15.22:0/3632436473 >> 172.21.15.22:0/3632436473 conn(0x55b9ebd3b350 msgr2=0x55b9ec0f0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.290+0000 7f234257d740 1 -- 172.21.15.22:0/3632436473 shutdown_connections 2024-09-21T04:02:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.290+0000 7f234257d740 1 -- 172.21.15.22:0/3632436473 wait complete. 2024-09-21T04:02:20.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.290+0000 7f234257d740 20 client.15435 trim_cache size 0 max 16384 2024-09-21T04:02:20.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f234257d740 1 Processor -- start 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f234257d740 1 -- start start 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f234257d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd058e0 0x55b9ec1049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f234257d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec104ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f234257d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec0f70b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f234257d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b9ec109490 con 0x55b9ebd26280 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f234257d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b9ec109b60 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f234257d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b9ec10a230 con 0x55b9ebd058e0 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f233a5a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec0f70b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f233a5a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec0f70b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38938/0 (socket says 172.21.15.22:38938) 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f233a5a6640 1 -- 172.21.15.22:0/2673440758 learned_addr learned my addr 172.21.15.22:0/2673440758 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f2339da5640 1 --2- 172.21.15.22:0/2673440758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd058e0 0x55b9ec1049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.308+0000 7f23395a4640 1 --2- 172.21.15.22:0/2673440758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec104ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.309+0000 7f233a5a6640 1 -- 172.21.15.22:0/2673440758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd058e0 msgr2=0x55b9ec1049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:20.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.309+0000 7f233a5a6640 1 --2- 172.21.15.22:0/2673440758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd058e0 0x55b9ec1049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.309+0000 7f233a5a6640 1 -- 172.21.15.22:0/2673440758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 msgr2=0x55b9ec104ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:20.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.309+0000 7f233a5a6640 1 --2- 172.21.15.22:0/2673440758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec104ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.309+0000 7f233a5a6640 1 -- 172.21.15.22:0/2673440758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b9ec0f95a0 con 0x55b9ebd26280 2024-09-21T04:02:20.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.309+0000 7f23395a4640 1 --2- 172.21.15.22:0/2673440758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:20.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.309+0000 7f233a5a6640 1 --2- 172.21.15.22:0/2673440758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec0f70b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f232c004990 tx=0x7f232c005f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47a9678067240b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:20.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.309+0000 7f231f7fe640 1 -- 172.21.15.22:0/2673440758 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c028070 con 0x55b9ebd26280 2024-09-21T04:02:20.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.309+0000 7f231f7fe640 1 -- 172.21.15.22:0/2673440758 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f232c004bc0 con 0x55b9ebd26280 2024-09-21T04:02:20.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.309+0000 7f231f7fe640 1 -- 172.21.15.22:0/2673440758 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c0052a0 con 0x55b9ebd26280 2024-09-21T04:02:20.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.310+0000 7f234257d740 1 -- 172.21.15.22:0/2673440758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 msgr2=0x55b9ec0f70b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.310+0000 7f234257d740 1 --2- 172.21.15.22:0/2673440758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec0f70b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f232c004990 tx=0x7f232c005f60 comp rx=0 tx=0).stop 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.310+0000 7f234257d740 1 -- 172.21.15.22:0/2673440758 shutdown_connections 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.310+0000 7f234257d740 1 --2- 172.21.15.22:0/2673440758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec0f70b0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.310+0000 7f234257d740 1 --2- 172.21.15.22:0/2673440758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec104ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.310+0000 7f234257d740 1 --2- 172.21.15.22:0/2673440758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd058e0 0x55b9ec1049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.310+0000 7f234257d740 1 -- 172.21.15.22:0/2673440758 >> 172.21.15.22:0/2673440758 conn(0x55b9ebd3b350 msgr2=0x55b9ec0f8a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.310+0000 7f234257d740 1 -- 172.21.15.22:0/2673440758 shutdown_connections 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.310+0000 7f234257d740 1 -- 172.21.15.22:0/2673440758 wait complete. 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.310+0000 7f234257d740 1 -- start start 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f234257d740 1 Processor -- start 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f234257d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd058e0 0x55b9ec10d810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f234257d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec10ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f234257d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec112fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f234257d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b9ec10afd0 con 0x55b9ebd26280 2024-09-21T04:02:20.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f234257d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b9ec10a900 con 0x55b9ebd058e0 2024-09-21T04:02:20.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f234257d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b9ec10b6a0 con 0x55b9ebd1e0a0 2024-09-21T04:02:20.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f234257d740 10 client.0 _ll_register_callbacks cb 0x7f2330009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:20.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f233a5a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec112fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f233a5a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec112fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38950/0 (socket says 172.21.15.22:38950) 2024-09-21T04:02:20.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f233a5a6640 1 -- 172.21.15.22:0/1560373723 learned_addr learned my addr 172.21.15.22:0/1560373723 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f2339da5640 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd058e0 0x55b9ec10d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.311+0000 7f23395a4640 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec10ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f233a5a6640 1 -- 172.21.15.22:0/1560373723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd1e0a0 msgr2=0x55b9ec10ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f233a5a6640 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec10ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f233a5a6640 1 -- 172.21.15.22:0/1560373723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd058e0 msgr2=0x55b9ec10d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f233a5a6640 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd058e0 0x55b9ec10d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f233a5a6640 1 -- 172.21.15.22:0/1560373723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b9ec1134e0 con 0x55b9ebd26280 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f233a5a6640 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec112fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f232c00f7d0 tx=0x7f232c010df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21ea4c38b2f6517 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f231d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f231d7fa640 1 -- 172.21.15.22:0/1560373723 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232c034030 con 0x55b9ebd26280 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f231d7fa640 1 -- 172.21.15.22:0/1560373723 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f232c02d660 con 0x55b9ebd26280 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f234257d740 1 -- 172.21.15.22:0/1560373723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f232c004bc0 con 0x55b9ebd26280 2024-09-21T04:02:20.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f231d7fa640 1 -- 172.21.15.22:0/1560373723 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f232c041050 con 0x55b9ebd26280 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f234257d740 10 client.15441 fetch_fsmap learned FSMap version 28 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f234257d740 1 -- 172.21.15.22:0/1560373723 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b9ec176d00 con 0x55b9ebd26280 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.312+0000 7f231d7fa640 1 -- 172.21.15.22:0/1560373723 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f232c004bc0 con 0x55b9ebd26280 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.313+0000 7f231d7fa640 1 -- 172.21.15.22:0/1560373723 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f232c0247c0 con 0x55b9ebd26280 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.313+0000 7f234257d740 10 client.15441 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.313+0000 7f234257d740 10 client.15441 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.313+0000 7f234257d740 20 client.15441 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.313+0000 7f234257d740 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x55b9ebd46f60 0x55b9ec179f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.313+0000 7f234257d740 4 client.15441 mds_command: new command op to 24617 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.313+0000 7f234257d740 1 -- 172.21.15.22:0/1560373723 --> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] -- command(tid 0: {"prefix": "status"}) -- 0x55b9ec062610 con 0x55b9ebd46f60 2024-09-21T04:02:20.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.313+0000 7f2339da5640 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x55b9ebd46f60 0x55b9ec179f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.313+0000 7f231d7fa640 10 client.15441 ms_handle_connect on v2:172.21.15.60:6836/3007306472 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.313+0000 7f2339da5640 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x55b9ebd46f60 0x55b9ec179f10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4b1622d5083a6430 server_cookie=75f2c791d44f276f in_seq=0 out_seq=0 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f231d7fa640 1 -- 172.21.15.22:0/1560373723 <== mds.2 v2:172.21.15.60:6836/3007306472 1 ==== command_reply(tid 0: 0 ) ==== 8+0+320 (crc 0 0 0) 0x55b9ec062610 con 0x55b9ebd46f60 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f231d7fa640 10 client.15441 handle_command_reply: tid=0 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 client.15441 shutdown 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 -- 172.21.15.22:0/1560373723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 msgr2=0x55b9ec112fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec112fa0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f232c00f7d0 tx=0x7f232c010df0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 -- 172.21.15.22:0/1560373723 shutdown_connections 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x55b9ebd46f60 0x55b9ec179f10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b9ebd1e0a0 0x55b9ec10ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b9ebd26280 0x55b9ec112fa0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 --2- 172.21.15.22:0/1560373723 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b9ebd058e0 0x55b9ec10d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f231d7fa640 0 client.15441 ms_handle_reset on v2:172.21.15.60:6836/3007306472 2024-09-21T04:02:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 -- 172.21.15.22:0/1560373723 >> 172.21.15.22:0/1560373723 conn(0x55b9ebd3b350 msgr2=0x55b9ec0ea600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 -- 172.21.15.22:0/1560373723 shutdown_connections 2024-09-21T04:02:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 1 -- 172.21.15.22:0/1560373723 wait complete. 2024-09-21T04:02:20.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.314+0000 7f234257d740 20 client.15441 trim_cache size 0 max 16384 2024-09-21T04:02:20.323 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:20.323 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:02:20.323 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-09-21T04:02:20.323 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24617, 2024-09-21T04:02:20.323 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:02:20.324 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:02:20.324 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:02:20.324 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 98.121950282, 2024-09-21T04:02:20.324 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-21T04:02:20.324 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:02:20.324 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T04:02:20.324 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 158.42097927 2024-09-21T04:02:20.324 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 -- 172.21.15.22:0/1385558246 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23200b65c0 msgr2=0x7f23200b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23200b65c0 0x7f23200b8ad0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f23300057c0 tx=0x7f23300058d0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 -- 172.21.15.22:0/1385558246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23341094a0 msgr2=0x7f233419a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23341094a0 0x7f233419a9d0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f232400c8c0 tx=0x7f232400cd80 comp rx=0 tx=0).stop 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 -- 172.21.15.22:0/1385558246 shutdown_connections 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23200b65c0 0x7f23200b8ad0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2334109df0 0x7f233419fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23341094a0 0x7f233419a9d0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 --2- 172.21.15.22:0/1385558246 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2334103b60 0x7f233419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 -- 172.21.15.22:0/1385558246 >> 172.21.15.22:0/1385558246 conn(0x7f233407b850 msgr2=0x7f2334107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 -- 172.21.15.22:0/1385558246 shutdown_connections 2024-09-21T04:02:20.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:20.315+0000 7f233c009640 1 -- 172.21.15.22:0/1385558246 wait complete. 2024-09-21T04:02:20.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:20 smithi022 ceph-mon[31015]: pgmap v370: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:02:20.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:20 smithi073 ceph-mon[34443]: pgmap v370: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:02:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:20 smithi060 ceph-mon[33722]: pgmap v370: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:02:21.039 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T04:02:21.294 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:21.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.812+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2023943544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c01025e0 msgr2=0x7fe0c01029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:21.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.812+0000 7fe0c7a84640 1 --2- 172.21.15.22:0/2023943544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c01025e0 0x7fe0c01029f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc009900 tx=0x7fe0bc02a480 comp rx=0 tx=0).stop 2024-09-21T04:02:21.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.812+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2023943544 shutdown_connections 2024-09-21T04:02:21.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.812+0000 7fe0c7a84640 1 --2- 172.21.15.22:0/2023943544 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0c0110190 0x7fe0c01125b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.812+0000 7fe0c7a84640 1 --2- 172.21.15.22:0/2023943544 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c0102f30 0x7fe0c010fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.812+0000 7fe0c7a84640 1 --2- 172.21.15.22:0/2023943544 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c01025e0 0x7fe0c01029f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.812+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2023943544 >> 172.21.15.22:0/2023943544 conn(0x7fe0c0079710 msgr2=0x7fe0c0079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.812+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2023943544 shutdown_connections 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.812+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2023943544 wait complete. 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c7a84640 1 Processor -- start 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c7a84640 1 -- start start 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c7a84640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c01025e0 0x7fe0c019c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c7a84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c0102f30 0x7fe0c019cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c7a84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0c0110190 0x7fe0c01a1e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c7a84640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c0115b30 con 0x7fe0c0102f30 2024-09-21T04:02:21.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c7a84640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c01159b0 con 0x7fe0c01025e0 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c7a84640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe0c0115cb0 con 0x7fe0c0110190 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c501f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c0102f30 0x7fe0c019cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c501f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c0102f30 0x7fe0c019cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43250/0 (socket says 172.21.15.22:43250) 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c501f640 1 -- 172.21.15.22:0/2914175832 learned_addr learned my addr 172.21.15.22:0/2914175832 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.813+0000 7fe0c5820640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c01025e0 0x7fe0c019c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0c6021640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0c0110190 0x7fe0c01a1e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0c501f640 1 -- 172.21.15.22:0/2914175832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0c0110190 msgr2=0x7fe0c01a1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0c501f640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0c0110190 0x7fe0c01a1e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0c501f640 1 -- 172.21.15.22:0/2914175832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c01025e0 msgr2=0x7fe0c019c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0c501f640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c01025e0 0x7fe0c019c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0c501f640 1 -- 172.21.15.22:0/2914175832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0c01a2550 con 0x7fe0c0102f30 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0c6021640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0c0110190 0x7fe0c01a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0c501f640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c0102f30 0x7fe0c019cb80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000d950 tx=0x7fe0b000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:21.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0b6ffd640 1 -- 172.21.15.22:0/2914175832 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0017070 con 0x7fe0c0102f30 2024-09-21T04:02:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0b6ffd640 1 -- 172.21.15.22:0/2914175832 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0b0009c30 con 0x7fe0c0102f30 2024-09-21T04:02:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2914175832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0c01a2840 con 0x7fe0c0102f30 2024-09-21T04:02:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0b6ffd640 1 -- 172.21.15.22:0/2914175832 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b000f620 con 0x7fe0c0102f30 2024-09-21T04:02:21.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.814+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2914175832 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0c01a8fa0 con 0x7fe0c0102f30 2024-09-21T04:02:21.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.817+0000 7fe0cdff8740 1 Processor -- start 2024-09-21T04:02:21.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0cdff8740 1 -- start start 2024-09-21T04:02:21.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 0x56107d3bdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cfef0a0 0x56107d3be440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cff7280 0x56107d3be980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56107d335c10 con 0x56107cfef0a0 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56107d325040 con 0x56107d017f60 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56107d328e50 con 0x56107cff7280 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0b6ffd640 1 -- 172.21.15.22:0/2914175832 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe0b0010460 con 0x7fe0c0102f30 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0c5820640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cfef0a0 0x56107d3be440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0c5820640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cfef0a0 0x56107d3be440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43254/0 (socket says 172.21.15.22:43254) 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0c5820640 1 -- 172.21.15.22:0/1053882983 learned_addr learned my addr 172.21.15.22:0/1053882983 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.818+0000 7fe0c6021640 1 --2- 172.21.15.22:0/1053882983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 0x56107d3bdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0c501f640 1 --2- 172.21.15.22:0/1053882983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cff7280 0x56107d3be980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0c5820640 1 -- 172.21.15.22:0/1053882983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cff7280 msgr2=0x56107d3be980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:21.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0c5820640 1 --2- 172.21.15.22:0/1053882983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cff7280 0x56107d3be980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0c5820640 1 -- 172.21.15.22:0/1053882983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 msgr2=0x56107d3bdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0c5820640 1 --2- 172.21.15.22:0/1053882983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 0x56107d3bdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0c5820640 1 -- 172.21.15.22:0/1053882983 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107d083540 con 0x56107cfef0a0 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0c6021640 1 --2- 172.21.15.22:0/1053882983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 0x56107d3bdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0c5820640 1 --2- 172.21.15.22:0/1053882983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cfef0a0 0x56107d3be440 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc02a9a0 tx=0x7fe0bc031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2951384581468245 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0abfff640 1 -- 172.21.15.22:0/1053882983 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc035030 con 0x56107cfef0a0 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0abfff640 1 -- 172.21.15.22:0/1053882983 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0bc040070 con 0x56107cfef0a0 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0abfff640 1 -- 172.21.15.22:0/1053882983 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc003a10 con 0x56107cfef0a0 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.819+0000 7fe0b6ffd640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe0ac0b6590 0x7fe0ac0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0c6021640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe0ac0b6590 0x7fe0ac0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0b6ffd640 1 -- 172.21.15.22:0/2914175832 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fe0b00e72a0 con 0x7fe0c0102f30 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0cdff8740 1 -- 172.21.15.22:0/1053882983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cfef0a0 msgr2=0x56107d3be440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0c6021640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe0ac0b6590 0x7fe0ac0b8aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8011630 tx=0x7fe0b800a730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:21.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/1053882983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cfef0a0 0x56107d3be440 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc02a9a0 tx=0x7fe0bc031dc0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0cdff8740 1 -- 172.21.15.22:0/1053882983 shutdown_connections 2024-09-21T04:02:21.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/1053882983 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cff7280 0x56107d3be980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/1053882983 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cfef0a0 0x56107d3be440 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/1053882983 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 0x56107d3bdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0cdff8740 1 -- 172.21.15.22:0/1053882983 >> 172.21.15.22:0/1053882983 conn(0x56107d00c350 msgr2=0x56107d3bbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:21.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0cdff8740 1 -- 172.21.15.22:0/1053882983 shutdown_connections 2024-09-21T04:02:21.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.820+0000 7fe0cdff8740 1 -- 172.21.15.22:0/1053882983 wait complete. 2024-09-21T04:02:21.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.821+0000 7fe0cdff8740 1 -- start start 2024-09-21T04:02:21.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.821+0000 7fe0cdff8740 1 Processor -- start 2024-09-21T04:02:21.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.821+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107cfef0a0 0x56107d3c9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.821+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cff7280 0x56107d3c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.821+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3d59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.821+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56107d1865f0 con 0x56107d017f60 2024-09-21T04:02:21.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.821+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56107d2c0010 con 0x56107cfef0a0 2024-09-21T04:02:21.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.821+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56107d3cc680 con 0x56107cff7280 2024-09-21T04:02:21.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0cdff8740 10 client.0 _ll_register_callbacks cb 0x56107d31f340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c6021640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3d59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c6021640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3d59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43262/0 (socket says 172.21.15.22:43262) 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c6021640 1 -- 172.21.15.22:0/745398483 learned_addr learned my addr 172.21.15.22:0/745398483 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c501f640 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cff7280 0x56107d3c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c5820640 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107cfef0a0 0x56107d3c9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c6021640 1 -- 172.21.15.22:0/745398483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cff7280 msgr2=0x56107d3c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c6021640 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cff7280 0x56107d3c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c6021640 1 -- 172.21.15.22:0/745398483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107cfef0a0 msgr2=0x56107d3c9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c6021640 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107cfef0a0 0x56107d3c9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c6021640 1 -- 172.21.15.22:0/745398483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56107d2eda00 con 0x56107d017f60 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0c6021640 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3d59a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800ffe0 tx=0x7fe0b8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9af7976cfe10f702 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:21.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0a97fa640 1 -- 172.21.15.22:0/745398483 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b801e620 con 0x56107d017f60 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0a97fa640 1 -- 172.21.15.22:0/745398483 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fe0b801e7c0 con 0x56107d017f60 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.822+0000 7fe0cdff8740 1 -- 172.21.15.22:0/745398483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0bc040070 con 0x56107d017f60 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0a97fa640 1 -- 172.21.15.22:0/745398483 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0b8031050 con 0x56107d017f60 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0cdff8740 10 client.15453 fetch_fsmap learned FSMap version 28 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0cdff8740 1 -- 172.21.15.22:0/745398483 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56107d3d8630 con 0x56107d017f60 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0a97fa640 1 -- 172.21.15.22:0/745398483 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0bc040070 con 0x56107d017f60 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0a97fa640 1 -- 172.21.15.22:0/745398483 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe0b801b920 con 0x56107d017f60 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0cdff8740 10 client.15453 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0cdff8740 10 client.15453 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0cdff8740 20 client.15453 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x56107cfd68e0 0x56107d3dc130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0cdff8740 4 client.15453 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.823+0000 7fe0cdff8740 1 -- 172.21.15.22:0/745398483 --> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56107d337b60 con 0x56107cfd68e0 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.824+0000 7fe0c5820640 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x56107cfd68e0 0x56107d3dc130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.824+0000 7fe0c5820640 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x56107cfd68e0 0x56107d3dc130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2145c5e0526d782d server_cookie=a211f479094d4969 in_seq=0 out_seq=0 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.824+0000 7fe0a97fa640 10 client.15453 ms_handle_connect on v2:172.21.15.73:6838/1883983314 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0a97fa640 1 -- 172.21.15.22:0/745398483 <== mds.1 v2:172.21.15.73:6838/1883983314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56107d337b60 con 0x56107cfd68e0 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0a97fa640 10 client.15453 handle_command_reply: tid=0 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 client.15453 shutdown 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 -- 172.21.15.22:0/745398483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 msgr2=0x56107d3d59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3d59a0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fe0b800ffe0 tx=0x7fe0b8004a40 comp rx=0 tx=0).stop 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 -- 172.21.15.22:0/745398483 shutdown_connections 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x56107cfd68e0 0x56107d3dc130 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cff7280 0x56107d3c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3d59a0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0a97fa640 0 client.15453 ms_handle_reset on v2:172.21.15.73:6838/1883983314 2024-09-21T04:02:21.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/745398483 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107cfef0a0 0x56107d3c9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 -- 172.21.15.22:0/745398483 >> 172.21.15.22:0/745398483 conn(0x56107d00c350 msgr2=0x56107d3c1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:21.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 -- 172.21.15.22:0/745398483 shutdown_connections 2024-09-21T04:02:21.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 1 -- 172.21.15.22:0/745398483 wait complete. 2024-09-21T04:02:21.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.825+0000 7fe0cdff8740 20 client.15453 trim_cache size 0 max 16384 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0cdff8740 1 Processor -- start 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0cdff8740 1 -- start start 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cfef0a0 0x56107d3d5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107cff7280 0x56107d3d5e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3c8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56107d3da470 con 0x56107d017f60 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56107d3dab40 con 0x56107cff7280 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56107d3db210 con 0x56107cfef0a0 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0c6021640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0c6021640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3c8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43274/0 (socket says 172.21.15.22:43274) 2024-09-21T04:02:21.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0c6021640 1 -- 172.21.15.22:0/2743039855 learned_addr learned my addr 172.21.15.22:0/2743039855 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.844+0000 7fe0c501f640 1 --2- 172.21.15.22:0/2743039855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107cff7280 0x56107d3d5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.845+0000 7fe0c5820640 1 --2- 172.21.15.22:0/2743039855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cfef0a0 0x56107d3d5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.845+0000 7fe0c6021640 1 -- 172.21.15.22:0/2743039855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cfef0a0 msgr2=0x56107d3d5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.845+0000 7fe0c6021640 1 --2- 172.21.15.22:0/2743039855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cfef0a0 0x56107d3d5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.845+0000 7fe0c6021640 1 -- 172.21.15.22:0/2743039855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107cff7280 msgr2=0x56107d3d5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.845+0000 7fe0c6021640 1 --2- 172.21.15.22:0/2743039855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107cff7280 0x56107d3d5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.845+0000 7fe0c6021640 1 -- 172.21.15.22:0/2743039855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56107d3b6080 con 0x56107d017f60 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.845+0000 7fe0c6021640 1 --2- 172.21.15.22:0/2743039855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3c8080 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8011f60 tx=0x7fe0b800a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f5927ad8f3bd4e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.845+0000 7fe0ab7fe640 1 -- 172.21.15.22:0/2743039855 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8004cb0 con 0x56107d017f60 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.845+0000 7fe0ab7fe640 1 -- 172.21.15.22:0/2743039855 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0b803a070 con 0x56107d017f60 2024-09-21T04:02:21.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.845+0000 7fe0ab7fe640 1 -- 172.21.15.22:0/2743039855 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b8005260 con 0x56107d017f60 2024-09-21T04:02:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 -- 172.21.15.22:0/2743039855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 msgr2=0x56107d3c8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/2743039855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3c8080 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8011f60 tx=0x7fe0b800a7a0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 -- 172.21.15.22:0/2743039855 shutdown_connections 2024-09-21T04:02:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/2743039855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107d017f60 0x56107d3c8080 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/2743039855 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107cff7280 0x56107d3d5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/2743039855 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cfef0a0 0x56107d3d5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 -- 172.21.15.22:0/2743039855 >> 172.21.15.22:0/2743039855 conn(0x56107d00c350 msgr2=0x56107d3c99e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 -- 172.21.15.22:0/2743039855 shutdown_connections 2024-09-21T04:02:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 -- 172.21.15.22:0/2743039855 wait complete. 2024-09-21T04:02:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 -- start start 2024-09-21T04:02:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.846+0000 7fe0cdff8740 1 Processor -- start 2024-09-21T04:02:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cfef0a0 0x56107d3de470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cff7280 0x56107d3de9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0cdff8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 0x56107d3deef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56107d3dbfb0 con 0x56107cff7280 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56107d3db8e0 con 0x56107d017f60 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0cdff8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56107d3dc680 con 0x56107cfef0a0 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0cdff8740 10 client.0 _ll_register_callbacks cb 0x7fe0b800ada0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0c501f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cff7280 0x56107d3de9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0c501f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cff7280 0x56107d3de9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43284/0 (socket says 172.21.15.22:43284) 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0c501f640 1 -- 172.21.15.22:0/208332540 learned_addr learned my addr 172.21.15.22:0/208332540 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0c5820640 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cfef0a0 0x56107d3de470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0c6021640 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 0x56107d3deef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0c501f640 1 -- 172.21.15.22:0/208332540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cfef0a0 msgr2=0x56107d3de470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0c501f640 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cfef0a0 0x56107d3de470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0c501f640 1 -- 172.21.15.22:0/208332540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 msgr2=0x56107d3deef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0c501f640 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 0x56107d3deef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.847+0000 7fe0c501f640 1 -- 172.21.15.22:0/208332540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56107d3e3d00 con 0x56107cff7280 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0c501f640 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cff7280 0x56107d3de9b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00acfa0 tx=0x7fe0b00ac960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be78e6a76cfd337c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0a97fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0a97fa640 1 -- 172.21.15.22:0/208332540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0b0020040 con 0x56107cff7280 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0cdff8740 1 -- 172.21.15.22:0/208332540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0b803a070 con 0x56107cff7280 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0a97fa640 1 -- 172.21.15.22:0/208332540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fe0b0010750 con 0x56107cff7280 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0a97fa640 1 -- 172.21.15.22:0/208332540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe0b00acb20 con 0x56107cff7280 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0cdff8740 10 client.15459 fetch_fsmap learned FSMap version 28 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0cdff8740 1 -- 172.21.15.22:0/208332540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56107d447960 con 0x56107cff7280 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0a97fa640 1 -- 172.21.15.22:0/208332540 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe0b803a070 con 0x56107cff7280 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0a97fa640 1 -- 172.21.15.22:0/208332540 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe0b0010950 con 0x56107cff7280 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0cdff8740 10 client.15459 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.848+0000 7fe0cdff8740 10 client.15459 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.849+0000 7fe0cdff8740 20 client.15459 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.849+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x56107cfabc90 0x56107d44b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.849+0000 7fe0cdff8740 4 client.15459 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.849+0000 7fe0cdff8740 1 -- 172.21.15.22:0/208332540 --> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] -- command(tid 0: {"prefix": "status"}) -- 0x56107d333610 con 0x56107cfabc90 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.849+0000 7fe0c5820640 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x56107cfabc90 0x56107d44b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.849+0000 7fe0c5820640 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x56107cfabc90 0x56107d44b290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8212facccfd57594 server_cookie=d14d41d38907a8d1 in_seq=0 out_seq=0 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.849+0000 7fe0a97fa640 10 client.15459 ms_handle_connect on v2:172.21.15.73:6838/1883983314 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.849+0000 7fe0a97fa640 1 -- 172.21.15.22:0/208332540 <== mds.1 v2:172.21.15.73:6838/1883983314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+322 (crc 0 0 0) 0x56107d333610 con 0x56107cfabc90 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.849+0000 7fe0a97fa640 10 client.15459 handle_command_reply: tid=0 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.849+0000 7fe0cdff8740 1 client.15459 shutdown 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 1 -- 172.21.15.22:0/208332540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cff7280 msgr2=0x56107d3de9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cff7280 0x56107d3de9b0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fe0b00acfa0 tx=0x7fe0b00ac960 comp rx=0 tx=0).stop 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 1 -- 172.21.15.22:0/208332540 shutdown_connections 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x56107cfabc90 0x56107d44b290 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56107d017f60 0x56107d3deef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56107cff7280 0x56107d3de9b0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0a97fa640 0 client.15459 ms_handle_reset on v2:172.21.15.73:6838/1883983314 2024-09-21T04:02:21.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 1 --2- 172.21.15.22:0/208332540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56107cfef0a0 0x56107d3de470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 1 -- 172.21.15.22:0/208332540 >> 172.21.15.22:0/208332540 conn(0x56107d00c350 msgr2=0x56107d3bb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:21.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 1 -- 172.21.15.22:0/208332540 shutdown_connections 2024-09-21T04:02:21.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 1 -- 172.21.15.22:0/208332540 wait complete. 2024-09-21T04:02:21.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.850+0000 7fe0cdff8740 20 client.15459 trim_cache size 0 max 16384 2024-09-21T04:02:21.858 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:21.858 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:02:21.858 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-09-21T04:02:21.859 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24634, 2024-09-21T04:02:21.859 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:02:21.859 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:02:21.859 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:02:21.859 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 100.665484187, 2024-09-21T04:02:21.859 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-21T04:02:21.859 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:02:21.859 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T04:02:21.859 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 157.381703066 2024-09-21T04:02:21.859 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:21.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2914175832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe0ac0b6590 msgr2=0x7fe0ac0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:21.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe0ac0b6590 0x7fe0ac0b8aa0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe0b8011630 tx=0x7fe0b800a730 comp rx=0 tx=0).stop 2024-09-21T04:02:21.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2914175832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c0102f30 msgr2=0x7fe0c019cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:21.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c0102f30 0x7fe0c019cb80 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fe0b000d950 tx=0x7fe0b000de10 comp rx=0 tx=0).stop 2024-09-21T04:02:21.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2914175832 shutdown_connections 2024-09-21T04:02:21.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe0ac0b6590 0x7fe0ac0b8aa0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe0c0110190 0x7fe0c01a1e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe0c0102f30 0x7fe0c019cb80 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 --2- 172.21.15.22:0/2914175832 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0c01025e0 0x7fe0c019c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2914175832 >> 172.21.15.22:0/2914175832 conn(0x7fe0c0079710 msgr2=0x7fe0c01116a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2914175832 shutdown_connections 2024-09-21T04:02:21.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:21.851+0000 7fe0c7a84640 1 -- 172.21.15.22:0/2914175832 wait complete. 2024-09-21T04:02:22.520 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:22 smithi022 ceph-mon[31015]: pgmap v371: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T04:02:22.549 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T04:02:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:22 smithi073 ceph-mon[34443]: pgmap v371: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T04:02:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:22 smithi060 ceph-mon[33722]: pgmap v371: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 11 op/s 2024-09-21T04:02:22.807 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:23.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.308+0000 7f434ad55640 1 -- 172.21.15.22:0/805598436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4344109e00 msgr2=0x7f4344110630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:23.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.308+0000 7f434ad55640 1 --2- 172.21.15.22:0/805598436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4344109e00 0x7f4344110630 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f4334009ca0 tx=0x7f433402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.308+0000 7f434ad55640 1 -- 172.21.15.22:0/805598436 shutdown_connections 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.308+0000 7f434ad55640 1 --2- 172.21.15.22:0/805598436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4344109e00 0x7f4344110630 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.308+0000 7f434ad55640 1 --2- 172.21.15.22:0/805598436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43441094b0 0x7f43441098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.308+0000 7f434ad55640 1 --2- 172.21.15.22:0/805598436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4344103bc0 0x7f4344103fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.308+0000 7f434ad55640 1 -- 172.21.15.22:0/805598436 >> 172.21.15.22:0/805598436 conn(0x7f434407b910 msgr2=0x7f434407bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.308+0000 7f434ad55640 1 -- 172.21.15.22:0/805598436 shutdown_connections 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.308+0000 7f434ad55640 1 -- 172.21.15.22:0/805598436 wait complete. 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f434ad55640 1 Processor -- start 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f434ad55640 1 -- start start 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f434ad55640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4344103bc0 0x7f434419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f434ad55640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43441094b0 0x7f434419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f434ad55640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4344109e00 0x7f434419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f434ad55640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f43441139c0 con 0x7f4344103bc0 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f434ad55640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4344113840 con 0x7f43441094b0 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f4348af1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4344103bc0 0x7f434419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f434ad55640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4344113b40 con 0x7f4344109e00 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f4348af1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4344103bc0 0x7f434419a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43296/0 (socket says 172.21.15.22:43296) 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f4348af1640 1 -- 172.21.15.22:0/894167268 learned_addr learned my addr 172.21.15.22:0/894167268 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.309+0000 7f4343fff640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43441094b0 0x7f434419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f43492f2640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4344109e00 0x7f434419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f4348af1640 1 -- 172.21.15.22:0/894167268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4344109e00 msgr2=0x7f434419fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f4348af1640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4344109e00 0x7f434419fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f4348af1640 1 -- 172.21.15.22:0/894167268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43441094b0 msgr2=0x7f434419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f4348af1640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43441094b0 0x7f434419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f4348af1640 1 -- 172.21.15.22:0/894167268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43441a02c0 con 0x7f4344103bc0 2024-09-21T04:02:23.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f4348af1640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4344103bc0 0x7f434419a350 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f433c00d770 tx=0x7f433c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f4341ffb640 1 -- 172.21.15.22:0/894167268 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c017070 con 0x7f4344103bc0 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f4341ffb640 1 -- 172.21.15.22:0/894167268 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f433c0054b0 con 0x7f4344103bc0 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f434ad55640 1 -- 172.21.15.22:0/894167268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43441a05b0 con 0x7f4344103bc0 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f4341ffb640 1 -- 172.21.15.22:0/894167268 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f433c004c60 con 0x7f4344103bc0 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.310+0000 7f434ad55640 1 -- 172.21.15.22:0/894167268 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43441a6d10 con 0x7f4344103bc0 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.313+0000 7f43512c9740 1 Processor -- start 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.313+0000 7f4341ffb640 1 -- 172.21.15.22:0/894167268 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f433c004e00 con 0x7f4344103bc0 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.313+0000 7f43512c9740 1 -- start start 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.313+0000 7f43512c9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 0x556325fc7f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.313+0000 7f43512c9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325bf90a0 0x556325fc8440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.313+0000 7f43512c9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fc8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.313+0000 7f43512c9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556325f3fc10 con 0x556325bf90a0 2024-09-21T04:02:23.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.313+0000 7f43512c9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556325f2f040 con 0x556325c01280 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.313+0000 7f43512c9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556325f32e50 con 0x556325c21f60 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f4348af1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325bf90a0 0x556325fc8440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f43492f2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 0x556325fc7f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f4348af1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325bf90a0 0x556325fc8440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43304/0 (socket says 172.21.15.22:43304) 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f4348af1640 1 -- 172.21.15.22:0/588356378 learned_addr learned my addr 172.21.15.22:0/588356378 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f4343fff640 1 --2- 172.21.15.22:0/588356378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fc8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f43492f2640 1 -- 172.21.15.22:0/588356378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 msgr2=0x556325fc8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f43492f2640 1 --2- 172.21.15.22:0/588356378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fc8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f43492f2640 1 -- 172.21.15.22:0/588356378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325bf90a0 msgr2=0x556325fc8440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f43492f2640 1 --2- 172.21.15.22:0/588356378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325bf90a0 0x556325fc8440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f43492f2640 1 -- 172.21.15.22:0/588356378 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556325c8d540 con 0x556325c21f60 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f4341ffb640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f43300b6510 0x7f43300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f4348af1640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f43300b6510 0x7f43300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.314+0000 7f43492f2640 1 --2- 172.21.15.22:0/588356378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 0x556325fc7f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4334006010 tx=0x7f4334009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=198883e8bcf6b832 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:23.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.315+0000 7f4341ffb640 1 -- 172.21.15.22:0/894167268 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f433c0e7130 con 0x7f4344103bc0 2024-09-21T04:02:23.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.315+0000 7f433affd640 1 -- 172.21.15.22:0/588356378 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4334031980 con 0x556325c21f60 2024-09-21T04:02:23.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.315+0000 7f433affd640 1 -- 172.21.15.22:0/588356378 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4334036040 con 0x556325c21f60 2024-09-21T04:02:23.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.315+0000 7f433affd640 1 -- 172.21.15.22:0/588356378 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43340042a0 con 0x556325c21f60 2024-09-21T04:02:23.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.315+0000 7f43512c9740 1 -- 172.21.15.22:0/588356378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 msgr2=0x556325fc7f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:23.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.315+0000 7f4348af1640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f43300b6510 0x7f43300b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f433c005780 tx=0x7f433c094040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:23.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.315+0000 7f43512c9740 1 --2- 172.21.15.22:0/588356378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 0x556325fc7f00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4334006010 tx=0x7f4334009a20 comp rx=0 tx=0).stop 2024-09-21T04:02:23.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.316+0000 7f43512c9740 1 -- 172.21.15.22:0/588356378 shutdown_connections 2024-09-21T04:02:23.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.316+0000 7f43512c9740 1 --2- 172.21.15.22:0/588356378 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fc8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.316+0000 7f43512c9740 1 --2- 172.21.15.22:0/588356378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325bf90a0 0x556325fc8440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.316+0000 7f43512c9740 1 --2- 172.21.15.22:0/588356378 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 0x556325fc7f00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.316+0000 7f43512c9740 1 -- 172.21.15.22:0/588356378 >> 172.21.15.22:0/588356378 conn(0x556325c16350 msgr2=0x556325fc5df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:23.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.316+0000 7f43512c9740 1 -- 172.21.15.22:0/588356378 shutdown_connections 2024-09-21T04:02:23.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.316+0000 7f43512c9740 1 -- 172.21.15.22:0/588356378 wait complete. 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.316+0000 7f43512c9740 1 -- start start 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.316+0000 7f43512c9740 1 Processor -- start 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43512c9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325bf90a0 0x556325fd39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43512c9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fd3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43512c9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fdf970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43512c9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556325d905f0 con 0x556325c21f60 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43512c9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556325eca010 con 0x556325c01280 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43512c9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556325fd6680 con 0x556325bf90a0 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43512c9740 10 client.0 _ll_register_callbacks cb 0x556325f29340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43492f2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fdf970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43492f2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fdf970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43312/0 (socket says 172.21.15.22:43312) 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43492f2640 1 -- 172.21.15.22:0/1421953408 learned_addr learned my addr 172.21.15.22:0/1421953408 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:23.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f4343fff640 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fd3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43492f2640 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325bf90a0 0x556325fd39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43492f2640 1 -- 172.21.15.22:0/1421953408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325bf90a0 msgr2=0x556325fd39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43492f2640 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325bf90a0 0x556325fd39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43492f2640 1 -- 172.21.15.22:0/1421953408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 msgr2=0x556325fd3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43492f2640 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fd3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43492f2640 1 -- 172.21.15.22:0/1421953408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556325ef7a00 con 0x556325c21f60 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f4343fff640 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fd3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f43492f2640 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fdf970 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x556325fd6000 tx=0x7f433403e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7ef1fd008696bfc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.317+0000 7f4323fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f4323fff640 1 -- 172.21.15.22:0/1421953408 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4334059060 con 0x556325c21f60 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f4323fff640 1 -- 172.21.15.22:0/1421953408 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f4334003b70 con 0x556325c21f60 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f43512c9740 1 -- 172.21.15.22:0/1421953408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4334036040 con 0x556325c21f60 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f4323fff640 1 -- 172.21.15.22:0/1421953408 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4334004b40 con 0x556325c21f60 2024-09-21T04:02:23.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f43512c9740 10 client.15471 fetch_fsmap learned FSMap version 28 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f43512c9740 1 -- 172.21.15.22:0/1421953408 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556325fe2580 con 0x556325c21f60 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f4323fff640 1 -- 172.21.15.22:0/1421953408 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4334036040 con 0x556325c21f60 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f4323fff640 1 -- 172.21.15.22:0/1421953408 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f433405c080 con 0x556325c21f60 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f43512c9740 10 client.15471 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f43512c9740 10 client.15471 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f43512c9740 20 client.15471 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f43512c9740 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556325be08e0 0x556325fe5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f43512c9740 4 client.15471 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.318+0000 7f43512c9740 1 -- 172.21.15.22:0/1421953408 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556325f41b60 con 0x556325be08e0 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.319+0000 7f4343fff640 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556325be08e0 0x556325fe5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.319+0000 7f4343fff640 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556325be08e0 0x556325fe5ac0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4ab9dbd0b561625 server_cookie=964cabb8ae0bb431 in_seq=0 out_seq=0 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.319+0000 7f4323fff640 10 client.15471 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f4323fff640 1 -- 172.21.15.22:0/1421953408 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556325f41b60 con 0x556325be08e0 2024-09-21T04:02:23.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f4323fff640 10 client.15471 handle_command_reply: tid=0 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 client.15471 shutdown 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 -- 172.21.15.22:0/1421953408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 msgr2=0x556325fdf970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fdf970 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x556325fd6000 tx=0x7f433403e040 comp rx=0 tx=0).stop 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 -- 172.21.15.22:0/1421953408 shutdown_connections 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556325be08e0 0x556325fe5ac0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fdf970 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fd3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 --2- 172.21.15.22:0/1421953408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325bf90a0 0x556325fd39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 -- 172.21.15.22:0/1421953408 >> 172.21.15.22:0/1421953408 conn(0x556325c16350 msgr2=0x556325fcb090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f4323fff640 0 client.15471 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 -- 172.21.15.22:0/1421953408 shutdown_connections 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 1 -- 172.21.15.22:0/1421953408 wait complete. 2024-09-21T04:02:23.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.320+0000 7f43512c9740 20 client.15471 trim_cache size 0 max 16384 2024-09-21T04:02:23.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f43512c9740 1 Processor -- start 2024-09-21T04:02:23.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f43512c9740 1 -- start start 2024-09-21T04:02:23.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f43512c9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325bf90a0 0x556325fce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f43512c9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c01280 0x556325fdf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f43512c9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 0x556325fdfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f43512c9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556325fe3e00 con 0x556325c01280 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f43512c9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556325fe44d0 con 0x556325bf90a0 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f43512c9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556325fe4ba0 con 0x556325c21f60 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f4343fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c01280 0x556325fdf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f4343fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c01280 0x556325fdf8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43324/0 (socket says 172.21.15.22:43324) 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f4343fff640 1 -- 172.21.15.22:0/3145061970 learned_addr learned my addr 172.21.15.22:0/3145061970 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f43492f2640 1 --2- 172.21.15.22:0/3145061970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325bf90a0 0x556325fce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.339+0000 7f43492f2640 1 --2- 172.21.15.22:0/3145061970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 0x556325fdfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.340+0000 7f4343fff640 1 -- 172.21.15.22:0/3145061970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 msgr2=0x556325fdfe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.340+0000 7f4343fff640 1 --2- 172.21.15.22:0/3145061970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 0x556325fdfe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.340+0000 7f4343fff640 1 -- 172.21.15.22:0/3145061970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325bf90a0 msgr2=0x556325fce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:23.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.340+0000 7f4343fff640 1 --2- 172.21.15.22:0/3145061970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325bf90a0 0x556325fce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.340+0000 7f4343fff640 1 -- 172.21.15.22:0/3145061970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556325fd4850 con 0x556325c01280 2024-09-21T04:02:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.340+0000 7f43492f2640 1 --2- 172.21.15.22:0/3145061970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 0x556325fdfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:23.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.340+0000 7f4343fff640 1 --2- 172.21.15.22:0/3145061970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c01280 0x556325fdf8e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f434406bb30 tx=0x7f432c00b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=391de59dcf24f78f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:23.347 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.340+0000 7f433a7fc640 1 -- 172.21.15.22:0/3145061970 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c003d80 con 0x556325c01280 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.340+0000 7f433a7fc640 1 -- 172.21.15.22:0/3145061970 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f432c0054b0 con 0x556325c01280 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.340+0000 7f433a7fc640 1 -- 172.21.15.22:0/3145061970 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c004e60 con 0x556325c01280 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.341+0000 7f43512c9740 1 -- 172.21.15.22:0/3145061970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c01280 msgr2=0x556325fdf8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.341+0000 7f43512c9740 1 --2- 172.21.15.22:0/3145061970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c01280 0x556325fdf8e0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f434406bb30 tx=0x7f432c00b390 comp rx=0 tx=0).stop 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.341+0000 7f43512c9740 1 -- 172.21.15.22:0/3145061970 shutdown_connections 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.341+0000 7f43512c9740 1 --2- 172.21.15.22:0/3145061970 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325c21f60 0x556325fdfe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.341+0000 7f43512c9740 1 --2- 172.21.15.22:0/3145061970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c01280 0x556325fdf8e0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.341+0000 7f43512c9740 1 --2- 172.21.15.22:0/3145061970 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325bf90a0 0x556325fce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.341+0000 7f43512c9740 1 -- 172.21.15.22:0/3145061970 >> 172.21.15.22:0/3145061970 conn(0x556325c16350 msgr2=0x556325fd3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.341+0000 7f43512c9740 1 -- 172.21.15.22:0/3145061970 shutdown_connections 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.341+0000 7f43512c9740 1 -- 172.21.15.22:0/3145061970 wait complete. 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43512c9740 1 -- start start 2024-09-21T04:02:23.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43512c9740 1 Processor -- start 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43512c9740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325bf90a0 0x556325fee160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43512c9740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fee740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43512c9740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fe77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43512c9740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556325fe5940 con 0x556325c21f60 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43512c9740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556325fe5270 con 0x556325c01280 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43512c9740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556325fe6010 con 0x556325bf90a0 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43512c9740 10 client.0 _ll_register_callbacks cb 0x7f433c0eaae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43492f2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fe77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43492f2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fe77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43330/0 (socket says 172.21.15.22:43330) 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43492f2640 1 -- 172.21.15.22:0/1929256277 learned_addr learned my addr 172.21.15.22:0/1929256277 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.342+0000 7f43492f2640 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325bf90a0 0x556325fee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f4343fff640 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fee740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f43492f2640 1 -- 172.21.15.22:0/1929256277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325bf90a0 msgr2=0x556325fee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f43492f2640 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325bf90a0 0x556325fee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f43492f2640 1 -- 172.21.15.22:0/1929256277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 msgr2=0x556325fee740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f43492f2640 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fee740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f43492f2640 1 -- 172.21.15.22:0/1929256277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556325fe7f50 con 0x556325c21f60 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f43492f2640 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fe77c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f433402aeb0 tx=0x7f43340098a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=101514266f67d8c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f4323fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f4323fff640 1 -- 172.21.15.22:0/1929256277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4334059040 con 0x556325c21f60 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f4323fff640 1 -- 172.21.15.22:0/1929256277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f4334004650 con 0x556325c21f60 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f43512c9740 1 -- 172.21.15.22:0/1929256277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f432c0054b0 con 0x556325c21f60 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f4323fff640 1 -- 172.21.15.22:0/1929256277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f433406f050 con 0x556325c21f60 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f43512c9740 10 client.15477 fetch_fsmap learned FSMap version 28 2024-09-21T04:02:23.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.343+0000 7f43512c9740 1 -- 172.21.15.22:0/1929256277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x556325fed900 con 0x556325c21f60 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.344+0000 7f4323fff640 1 -- 172.21.15.22:0/1929256277 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f432c0054b0 con 0x556325c21f60 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.344+0000 7f4323fff640 1 -- 172.21.15.22:0/1929256277 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4334030c90 con 0x556325c21f60 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.344+0000 7f43512c9740 10 client.15477 fetch_fsmap finished waiting for FSMap version 28 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.344+0000 7f43512c9740 10 client.15477 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.344+0000 7f43512c9740 20 client.15477 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.344+0000 7f43512c9740 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556325bb5c90 0x5563260543c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.344+0000 7f43512c9740 4 client.15477 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.344+0000 7f43512c9740 1 -- 172.21.15.22:0/1929256277 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "status"}) -- 0x556325f3d610 con 0x556325bb5c90 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.344+0000 7f4343fff640 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556325bb5c90 0x5563260543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f4343fff640 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556325bb5c90 0x5563260543c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd6d5c0cd7baa5f7 server_cookie=fb0e6298eea163e in_seq=0 out_seq=0 2024-09-21T04:02:23.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f4323fff640 10 client.15477 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:02:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f4323fff640 1 -- 172.21.15.22:0/1929256277 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556325f3d610 con 0x556325bb5c90 2024-09-21T04:02:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f4323fff640 10 client.15477 handle_command_reply: tid=0 2024-09-21T04:02:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 client.15477 shutdown 2024-09-21T04:02:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 -- 172.21.15.22:0/1929256277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 msgr2=0x556325fe77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:23.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fe77c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f433402aeb0 tx=0x7f43340098a0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 -- 172.21.15.22:0/1929256277 shutdown_connections 2024-09-21T04:02:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556325bb5c90 0x5563260543c0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556325c21f60 0x556325fe77c0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556325c01280 0x556325fee740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f4323fff640 0 client.15477 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:02:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 --2- 172.21.15.22:0/1929256277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556325bf90a0 0x556325fee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 -- 172.21.15.22:0/1929256277 >> 172.21.15.22:0/1929256277 conn(0x556325c16350 msgr2=0x556325fc5600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 -- 172.21.15.22:0/1929256277 shutdown_connections 2024-09-21T04:02:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.345+0000 7f43512c9740 1 -- 172.21.15.22:0/1929256277 wait complete. 2024-09-21T04:02:23.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f43512c9740 20 client.15477 trim_cache size 0 max 16384 2024-09-21T04:02:23.355 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:23.355 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:02:23.355 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-21T04:02:23.355 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24647, 2024-09-21T04:02:23.356 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:02:23.356 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:02:23.356 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:02:23.356 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 138.34470882700001, 2024-09-21T04:02:23.356 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 28, 2024-09-21T04:02:23.356 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:02:23.356 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 83, 2024-09-21T04:02:23.356 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 150.08609736099999 2024-09-21T04:02:23.356 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:23.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 -- 172.21.15.22:0/894167268 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f43300b6510 msgr2=0x7f43300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:23.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f43300b6510 0x7f43300b8a20 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f433c005780 tx=0x7f433c094040 comp rx=0 tx=0).stop 2024-09-21T04:02:23.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 -- 172.21.15.22:0/894167268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4344103bc0 msgr2=0x7f434419a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:23.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4344103bc0 0x7f434419a350 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f433c00d770 tx=0x7f433c00dc30 comp rx=0 tx=0).stop 2024-09-21T04:02:23.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 -- 172.21.15.22:0/894167268 shutdown_connections 2024-09-21T04:02:23.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f43300b6510 0x7f43300b8a20 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4344109e00 0x7f434419fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f43441094b0 0x7f434419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 --2- 172.21.15.22:0/894167268 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4344103bc0 0x7f434419a350 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:23.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 -- 172.21.15.22:0/894167268 >> 172.21.15.22:0/894167268 conn(0x7f434407b910 msgr2=0x7f43441074a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:23.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 -- 172.21.15.22:0/894167268 shutdown_connections 2024-09-21T04:02:23.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:23.346+0000 7f434ad55640 1 -- 172.21.15.22:0/894167268 wait complete. 2024-09-21T04:02:24.043 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T04:02:24.060 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T04:02:24.060 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-21T04:02:24.060 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-09-21T04:02:24.061 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T04:02:24.061 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-09-21T04:02:24.061 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-09-21T04:02:24.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:24.061 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-21T04:02:24.078 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-09-21T04:02:24.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:24.079 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-09-21T04:02:24.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:24.147 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-09-21T04:02:24.250 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T04:02:24.250 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T04:02:24.250 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs ls 2024-09-21T04:02:24.512 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:24.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:24 smithi022 ceph-mon[31015]: pgmap v372: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:02:24.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:24 smithi073 ceph-mon[34443]: pgmap v372: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:02:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:24 smithi060 ceph-mon[33722]: pgmap v372: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-09-21T04:02:25.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.018+0000 7f5d37ed2640 1 -- 172.21.15.22:0/2265569003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d30102a70 msgr2=0x7f5d30102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:25.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.018+0000 7f5d37ed2640 1 --2- 172.21.15.22:0/2265569003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d30102a70 0x7f5d30102e80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009ca0 tx=0x7f5d2002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:02:25.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.018+0000 7f5d37ed2640 1 -- 172.21.15.22:0/2265569003 shutdown_connections 2024-09-21T04:02:25.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.018+0000 7f5d37ed2640 1 --2- 172.21.15.22:0/2265569003 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d301083b0 0x7f5d301087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:25.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.018+0000 7f5d37ed2640 1 --2- 172.21.15.22:0/2265569003 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d30108d00 0x7f5d3010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:25.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.018+0000 7f5d37ed2640 1 --2- 172.21.15.22:0/2265569003 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d30102a70 0x7f5d30102e80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:25.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.018+0000 7f5d37ed2640 1 -- 172.21.15.22:0/2265569003 >> 172.21.15.22:0/2265569003 conn(0x7f5d30079730 msgr2=0x7f5d30079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.018+0000 7f5d37ed2640 1 -- 172.21.15.22:0/2265569003 shutdown_connections 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.018+0000 7f5d37ed2640 1 -- 172.21.15.22:0/2265569003 wait complete. 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.019+0000 7f5d37ed2640 1 Processor -- start 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.019+0000 7f5d37ed2640 1 -- start start 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.019+0000 7f5d37ed2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d30102a70 0x7f5d3019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.019+0000 7f5d37ed2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d301083b0 0x7f5d3019a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.019+0000 7f5d37ed2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d30108d00 0x7f5d3019fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.019+0000 7f5d37ed2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5d301139d0 con 0x7f5d301083b0 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.019+0000 7f5d37ed2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30113850 con 0x7f5d30108d00 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.019+0000 7f5d37ed2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5d30113b50 con 0x7f5d30102a70 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d3546d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d301083b0 0x7f5d3019a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d3546d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d301083b0 0x7f5d3019a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43356/0 (socket says 172.21.15.22:43356) 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d3546d640 1 -- 172.21.15.22:0/3647176928 learned_addr learned my addr 172.21.15.22:0/3647176928 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d3646f640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d30108d00 0x7f5d3019fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:25.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d35c6e640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d30102a70 0x7f5d3019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:25.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d3546d640 1 -- 172.21.15.22:0/3647176928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d30102a70 msgr2=0x7f5d3019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d3546d640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d30102a70 0x7f5d3019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d3546d640 1 -- 172.21.15.22:0/3647176928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d30108d00 msgr2=0x7f5d3019fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d3546d640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d30108d00 0x7f5d3019fc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d3546d640 1 -- 172.21.15.22:0/3647176928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d301a0390 con 0x7f5d301083b0 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d3546d640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d301083b0 0x7f5d3019a9c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400d770 tx=0x7f5d2400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d2effd640 1 -- 172.21.15.22:0/3647176928 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d24017070 con 0x7f5d301083b0 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d2effd640 1 -- 172.21.15.22:0/3647176928 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d24009c30 con 0x7f5d301083b0 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d37ed2640 1 -- 172.21.15.22:0/3647176928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d301a0680 con 0x7f5d301083b0 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d2effd640 1 -- 172.21.15.22:0/3647176928 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d2400f620 con 0x7f5d301083b0 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.020+0000 7f5d37ed2640 1 -- 172.21.15.22:0/3647176928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d301a6de0 con 0x7f5d301083b0 2024-09-21T04:02:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.022+0000 7f5d37ed2640 1 -- 172.21.15.22:0/3647176928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d30103cf0 con 0x7f5d301083b0 2024-09-21T04:02:25.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.024+0000 7f5d2effd640 1 -- 172.21.15.22:0/3647176928 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5d2401a070 con 0x7f5d301083b0 2024-09-21T04:02:25.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.025+0000 7f5d2effd640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5d180b6510 0x7f5d180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:25.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.025+0000 7f5d35c6e640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5d180b6510 0x7f5d180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:25.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.025+0000 7f5d2effd640 1 -- 172.21.15.22:0/3647176928 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f5d240e7190 con 0x7f5d301083b0 2024-09-21T04:02:25.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.026+0000 7f5d35c6e640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5d180b6510 0x7f5d180b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5d20000f80 tx=0x7f5d20031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:25.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.028+0000 7f5d2effd640 1 -- 172.21.15.22:0/3647176928 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d24009de0 con 0x7f5d301083b0 2024-09-21T04:02:25.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.257+0000 7f5d37ed2640 1 -- 172.21.15.22:0/3647176928 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5d30102e80 con 0x7f5d301083b0 2024-09-21T04:02:25.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.257+0000 7f5d2effd640 1 -- 172.21.15.22:0/3647176928 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v28) ==== 53+0+88 (secure 0 0 0) 0x7f5d30102e80 con 0x7f5d301083b0 2024-09-21T04:02:25.260 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-09-21T04:02:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.259+0000 7f5d37ed2640 1 -- 172.21.15.22:0/3647176928 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5d180b6510 msgr2=0x7f5d180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.259+0000 7f5d37ed2640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5d180b6510 0x7f5d180b8a20 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f5d20000f80 tx=0x7f5d20031000 comp rx=0 tx=0).stop 2024-09-21T04:02:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.259+0000 7f5d37ed2640 1 -- 172.21.15.22:0/3647176928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d301083b0 msgr2=0x7f5d3019a9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.259+0000 7f5d37ed2640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d301083b0 0x7f5d3019a9c0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f5d2400d770 tx=0x7f5d2400dc30 comp rx=0 tx=0).stop 2024-09-21T04:02:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.259+0000 7f5d37ed2640 1 -- 172.21.15.22:0/3647176928 shutdown_connections 2024-09-21T04:02:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.259+0000 7f5d37ed2640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f5d180b6510 0x7f5d180b8a20 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:25.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.259+0000 7f5d37ed2640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5d30108d00 0x7f5d3019fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.259+0000 7f5d37ed2640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5d301083b0 0x7f5d3019a9c0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.259+0000 7f5d37ed2640 1 --2- 172.21.15.22:0/3647176928 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5d30102a70 0x7f5d3019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.259+0000 7f5d37ed2640 1 -- 172.21.15.22:0/3647176928 >> 172.21.15.22:0/3647176928 conn(0x7f5d30079730 msgr2=0x7f5d301014f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.260+0000 7f5d37ed2640 1 -- 172.21.15.22:0/3647176928 shutdown_connections 2024-09-21T04:02:25.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:25.260+0000 7f5d37ed2640 1 -- 172.21.15.22:0/3647176928 wait complete. 2024-09-21T04:02:25.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:25 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3647176928' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T04:02:25.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:25 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3647176928' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T04:02:25.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:25 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3647176928' entity='client.admin' cmd={"prefix": "fs ls"} : dispatch 2024-09-21T04:02:25.948 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T04:02:25.948 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T04:02:25.948 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-09-21T04:02:25.948 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T04:02:25.948 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-09-21T04:02:25.949 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T04:02:25.949 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T04:02:25.949 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T04:02:25.949 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-09-21T04:02:25.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:25.949 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-09-21T04:02:25.967 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T04:02:25.967 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T04:02:25.967 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T04:02:25.967 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-21T04:02:25.967 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T04:02:25.968 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42114sec preferred_lft 42114sec 2024-09-21T04:02:25.969 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-09-21T04:02:25.969 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-09-21T04:02:25.969 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T04:02:25.969 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-09-21T04:02:25.969 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-09-21T04:02:25.969 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T04:02:25.969 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T04:02:25.969 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-21T04:02:25.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2024-09-21T04:02:25.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2024-09-21T04:02:25.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2024-09-21T04:02:25.970 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T04:02:25.970 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-21T04:02:26.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T04:02:26.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:02:26.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:26.115 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T04:02:26.140 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-09-21T04:02:26.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:26.142 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-09-21T04:02:26.200 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-09-21T04:02:26.200 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T04:02:26.200 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T04:02:26.200 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T04:02:26.200 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T04:02:26.200 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T04:02:26.200 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-21T04:02:26.200 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T04:02:26.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T04:02:26.201 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T04:02:26.201 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-21T04:02:26.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T04:02:26.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:02:26.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:26.331 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-21T04:02:26.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:26.347 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2024-09-21T04:02:26.404 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T04:02:26.404 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-21T04:02:26.404 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--tmp-cephfs 2024-09-21T04:02:26.404 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-09-21T04:02:26.404 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-21T04:02:26.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T04:02:26.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:02:26.524 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-09-21T04:02:26.524 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T04:02:26.525 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-21T04:02:26.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-09-21T04:02:26.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T04:02:26.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-09-21T04:02:26.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-09-21T04:02:26.525 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-09-21T04:02:26.525 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-21T04:02:26.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T04:02:26.582 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:26 smithi022 ceph-mon[31015]: pgmap v373: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:02:26.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:26 smithi073 ceph-mon[34443]: pgmap v373: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:02:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:02:26.643 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T04:02:26.643 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-09-21T04:02:26.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-09-21T04:02:26.643 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T04:02:26.643 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-09-21T04:02:26.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T04:02:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:26 smithi060 ceph-mon[33722]: pgmap v373: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:02:26.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:02:26.722 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-09-21T04:02:26.722 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T04:02:26.722 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /tmp/cephfs 2024-09-21T04:02:26.741 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/tmp/cephfs' 2024-09-21T04:02:26.741 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T04:02:26.741 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /tmp/cephfs 2024-09-21T04:02:26.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-09-21T04:02:26.864 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T04:02:26.921 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-09-21T04:02:26.921 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-09-21T04:02:26.921 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-09-21T04:02:26.921 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-09-21T04:02:26.921 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-09-21T04:02:26.921 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-09-21T04:02:26.921 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T04:02:26.922 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/5f74897d9924b42859eb9057dc548fea6f42075012c0e10a17957f0836884f90/merged 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/945874f9596555e49ac527fdae9f00a1be4ba21bff7f4a1ae28b5a31113127a9/merged 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/0 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T04:02:26.923 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/8342034dba8271e9f00d39e79da86c17e0868294308f302935ab9a94a1faa79d/merged 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/cf89ac8d65367164789d66391644e441e4909e01e52f096b25c64952fc0a4b9e/merged 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/80f341a618e91f6431e23070fa999e75bd6a7f5bc8a8c8e0d1f22972c8913d58/merged 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/ff14717a4cf86ac0d202e82deb7b4e43ae7b5deb2f66b09989dbd992e89c1e59/merged 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/ca461000355198278aa2d497498f3d801f88a90343b1b5bb7d243de9ee7e85ef/merged 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/44a6921cb3a25c706fa56a6b6dd741b157357b2c0f6f81fa314aba2835e3b028/merged 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/b29d4065f379a5f01177d815f41f3d4cee4afc65631b47ea55fcfba2a70785d1/merged 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/757f836a2b86b901ced2b1ad08377a22ac77397633ac3b8d71b74e6ba0885cf2/merged 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-21T04:02:26.924 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:26.924 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-09-21T04:02:26.977 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T04:02:26.977 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/qa/sv_0/81c13557-8a4c-4bf3-bc55-6e1a3770aeb4 --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2024-09-21T04:02:27.020 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-09-21T04:02:27.045 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T04:02:27.103 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-09-21T04:02:27.103 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-09-21T04:02:27.103 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-09-21T04:02:27.103 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-09-21T04:02:27.103 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-09-21T04:02:27.103 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-09-21T04:02:27.104 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/5f74897d9924b42859eb9057dc548fea6f42075012c0e10a17957f0836884f90/merged 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/945874f9596555e49ac527fdae9f00a1be4ba21bff7f4a1ae28b5a31113127a9/merged 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/0 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/8342034dba8271e9f00d39e79da86c17e0868294308f302935ab9a94a1faa79d/merged 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/cf89ac8d65367164789d66391644e441e4909e01e52f096b25c64952fc0a4b9e/merged 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/80f341a618e91f6431e23070fa999e75bd6a7f5bc8a8c8e0d1f22972c8913d58/merged 2024-09-21T04:02:27.105 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/ff14717a4cf86ac0d202e82deb7b4e43ae7b5deb2f66b09989dbd992e89c1e59/merged 2024-09-21T04:02:27.106 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/ca461000355198278aa2d497498f3d801f88a90343b1b5bb7d243de9ee7e85ef/merged 2024-09-21T04:02:27.106 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/44a6921cb3a25c706fa56a6b6dd741b157357b2c0f6f81fa314aba2835e3b028/merged 2024-09-21T04:02:27.106 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/b29d4065f379a5f01177d815f41f3d4cee4afc65631b47ea55fcfba2a70785d1/merged 2024-09-21T04:02:27.106 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/757f836a2b86b901ced2b1ad08377a22ac77397633ac3b8d71b74e6ba0885cf2/merged 2024-09-21T04:02:27.106 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-09-21T04:02:27.106 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-21T04:02:27.106 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-21T04:02:27.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:27.106 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-09-21T04:02:27.118 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:2024-09-21T04:02:27.116+0000 7f7a2cb1d480 -1 init, newargv = 0x7f7a20004b60 newargc=17 2024-09-21T04:02:27.119 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[85359]: starting ceph client 2024-09-21T04:02:27.142 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[85359]: starting fuse 2024-09-21T04:02:28.236 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-09-21T04:02:28.270 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T04:02:28.330 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-09-21T04:02:28.330 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/selinux 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-09-21T04:02:28.331 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay 2024-09-21T04:02:28.332 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/5f74897d9924b42859eb9057dc548fea6f42075012c0e10a17957f0836884f90/merged 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/945874f9596555e49ac527fdae9f00a1be4ba21bff7f4a1ae28b5a31113127a9/merged 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/0 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/8342034dba8271e9f00d39e79da86c17e0868294308f302935ab9a94a1faa79d/merged 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/cf89ac8d65367164789d66391644e441e4909e01e52f096b25c64952fc0a4b9e/merged 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/80f341a618e91f6431e23070fa999e75bd6a7f5bc8a8c8e0d1f22972c8913d58/merged 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/ff14717a4cf86ac0d202e82deb7b4e43ae7b5deb2f66b09989dbd992e89c1e59/merged 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/ca461000355198278aa2d497498f3d801f88a90343b1b5bb7d243de9ee7e85ef/merged 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/44a6921cb3a25c706fa56a6b6dd741b157357b2c0f6f81fa314aba2835e3b028/merged 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/b29d4065f379a5f01177d815f41f3d4cee4afc65631b47ea55fcfba2a70785d1/merged 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/containers/storage/overlay/757f836a2b86b901ced2b1ad08377a22ac77397633ac3b8d71b74e6ba0885cf2/merged 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-21T04:02:28.333 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-09-21T04:02:28.334 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs 2024-09-21T04:02:28.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:28.335 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-09-21T04:02:28.393 INFO:teuthology.orchestra.run.smithi022.stdout:120 2024-09-21T04:02:28.393 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-21T04:02:28.393 DEBUG:teuthology.orchestra.run.smithi022:> sudo stdin-killer -- python3 -c ' 2024-09-21T04:02:28.393 DEBUG:teuthology.orchestra.run.smithi022:> import glob 2024-09-21T04:02:28.393 DEBUG:teuthology.orchestra.run.smithi022:> import re 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> import os 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> import subprocess 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> def _find_admin_socket(client_name): 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> files = glob.glob(asok_path) 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> mountpoint = "/tmp/cephfs" 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> # Given a non-glob path, it better be there 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> if "*" not in asok_path: 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> assert(len(files) == 1) 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> return files[0] 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> 2024-09-21T04:02:28.394 DEBUG:teuthology.orchestra.run.smithi022:> for f in files: 2024-09-21T04:02:28.395 DEBUG:teuthology.orchestra.run.smithi022:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T04:02:28.395 DEBUG:teuthology.orchestra.run.smithi022:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T04:02:28.395 DEBUG:teuthology.orchestra.run.smithi022:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T04:02:28.395 DEBUG:teuthology.orchestra.run.smithi022:> contents = proc_f.read() 2024-09-21T04:02:28.395 DEBUG:teuthology.orchestra.run.smithi022:> if mountpoint in contents: 2024-09-21T04:02:28.395 DEBUG:teuthology.orchestra.run.smithi022:> return f 2024-09-21T04:02:28.395 DEBUG:teuthology.orchestra.run.smithi022:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T04:02:28.395 DEBUG:teuthology.orchestra.run.smithi022:> 2024-09-21T04:02:28.395 DEBUG:teuthology.orchestra.run.smithi022:> print(_find_admin_socket("client.0")) 2024-09-21T04:02:28.395 DEBUG:teuthology.orchestra.run.smithi022:> ' 2024-09-21T04:02:28.520 INFO:teuthology.orchestra.run.smithi022.stdout:/var/run/ceph/ceph-client.0.85359.asok 2024-09-21T04:02:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T04:02:28.530 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:28 smithi022 ceph-mon[31015]: pgmap v374: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:02:28.531 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.85359.asok 2024-09-21T04:02:28.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:28.532 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.85359.asok status 2024-09-21T04:02:28.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:28 smithi073 ceph-mon[34443]: pgmap v374: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:02:28.680 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:28.680 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": { 2024-09-21T04:02:28.680 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_sha1": "1843221895adccfb3b692060251dd6a0183bc410", 2024-09-21T04:02:28.680 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.3.0-5120-g18432218 (1843221895adccfb3b692060251dd6a0183bc410) squid (dev)", 2024-09-21T04:02:28.680 INFO:teuthology.orchestra.run.smithi022.stdout: "entity_id": "0", 2024-09-21T04:02:28.680 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": "smithi022", 2024-09-21T04:02:28.680 INFO:teuthology.orchestra.run.smithi022.stdout: "mount_point": "/tmp/cephfs", 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "pid": "85359", 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "root": "/volumes/qa/sv_0/81c13557-8a4c-4bf3-bc55-6e1a3770aeb4" 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_count": 0, 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_pinned_count": 0, 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 15489, 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "inst": { 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "name": { 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "client", 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "num": 15489 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2024-09-21T04:02:28.681 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3754240172 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3754240172 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "inst_str": "client.15489 192.168.0.1:0/3754240172", 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "addr_str": "192.168.0.1:0/3754240172", 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "inode_count": 5, 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_epoch": 28, 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch": 85, 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch_barrier": 0, 2024-09-21T04:02:28.682 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklisted": false, 2024-09-21T04:02:28.683 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs" 2024-09-21T04:02:28.683 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:28.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:28.691 DEBUG:teuthology.orchestra.run.smithi022:> stat --file-system '--printf=%T 2024-09-21T04:02:28.691 DEBUG:teuthology.orchestra.run.smithi022:> ' -- /tmp/cephfs 2024-09-21T04:02:28.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:28 smithi060 ceph-mon[33722]: pgmap v374: 129 pgs: 129 active+clean; 648 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:02:28.707 INFO:teuthology.orchestra.run.smithi022.stdout:fuseblk 2024-09-21T04:02:28.707 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2024-09-21T04:02:28.707 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:02:28.707 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /tmp/cephfs 2024-09-21T04:02:28.775 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T04:02:28.784 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T04:02:28.784 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi022.front.sepia.ceph.com 2024-09-21T04:02:28.785 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-09-21T04:02:28.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 -- 172.21.15.22:0/3177377934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7781050e0 msgr2=0x7fe77810ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:28.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 --2- 172.21.15.22:0/3177377934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7781050e0 0x7fe77810ba80 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fe770009ca0 tx=0x7fe77002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:02:28.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 -- 172.21.15.22:0/3177377934 shutdown_connections 2024-09-21T04:02:28.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 --2- 172.21.15.22:0/3177377934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7781050e0 0x7fe77810ba80 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:28.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 --2- 172.21.15.22:0/3177377934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe778104740 0x7fe778104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:28.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 --2- 172.21.15.22:0/3177377934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe7781036c0 0x7fe778103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:28.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 -- 172.21.15.22:0/3177377934 >> 172.21.15.22:0/3177377934 conn(0x7fe7780ff020 msgr2=0x7fe7781014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:28.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 -- 172.21.15.22:0/3177377934 shutdown_connections 2024-09-21T04:02:28.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 -- 172.21.15.22:0/3177377934 wait complete. 2024-09-21T04:02:28.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 Processor -- start 2024-09-21T04:02:28.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.927+0000 7fe77da15640 1 -- start start 2024-09-21T04:02:28.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe77da15640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7781036c0 0x7fe778199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:28.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe77da15640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe778104740 0x7fe77819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:28.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe77da15640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7781050e0 0x7fe77819b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:28.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe77da15640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810f170 con 0x7fe7781050e0 2024-09-21T04:02:28.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe77da15640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810eff0 con 0x7fe7781036c0 2024-09-21T04:02:28.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe77da15640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe77810f2f0 con 0x7fe778104740 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe7777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7781050e0 0x7fe77819b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe7777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7781050e0 0x7fe77819b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43370/0 (socket says 172.21.15.22:43370) 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe7777fe640 1 -- 172.21.15.22:0/820757697 learned_addr learned my addr 172.21.15.22:0/820757697 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe76ffff640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe778104740 0x7fe77819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe776ffd640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7781036c0 0x7fe778199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe7777fe640 1 -- 172.21.15.22:0/820757697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe778104740 msgr2=0x7fe77819a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe7777fe640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe778104740 0x7fe77819a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe7777fe640 1 -- 172.21.15.22:0/820757697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7781036c0 msgr2=0x7fe778199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe7777fe640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7781036c0 0x7fe778199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe7777fe640 1 -- 172.21.15.22:0/820757697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe77819b870 con 0x7fe7781050e0 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe7777fe640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7781050e0 0x7fe77819b050 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe770009dc0 tx=0x7fe770003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.928+0000 7fe77ca13640 1 -- 172.21.15.22:0/820757697 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe770004240 con 0x7fe7781050e0 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.929+0000 7fe77da15640 1 -- 172.21.15.22:0/820757697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe77819bb00 con 0x7fe7781050e0 2024-09-21T04:02:28.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.929+0000 7fe77ca13640 1 -- 172.21.15.22:0/820757697 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe770040030 con 0x7fe7781050e0 2024-09-21T04:02:28.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.929+0000 7fe77ca13640 1 -- 172.21.15.22:0/820757697 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe77003b430 con 0x7fe7781050e0 2024-09-21T04:02:28.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.929+0000 7fe77da15640 1 -- 172.21.15.22:0/820757697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7781a2250 con 0x7fe7781050e0 2024-09-21T04:02:28.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.930+0000 7fe77da15640 1 -- 172.21.15.22:0/820757697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe778103b30 con 0x7fe7781050e0 2024-09-21T04:02:28.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.931+0000 7fe77ca13640 1 -- 172.21.15.22:0/820757697 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe7700305c0 con 0x7fe7781050e0 2024-09-21T04:02:28.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.932+0000 7fe77ca13640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe7640b6510 0x7fe7640b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:28.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.932+0000 7fe776ffd640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe7640b6510 0x7fe7640b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:28.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.932+0000 7fe77ca13640 1 -- 172.21.15.22:0/820757697 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fe770108600 con 0x7fe7781050e0 2024-09-21T04:02:28.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.933+0000 7fe776ffd640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe7640b6510 0x7fe7640b8a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe768009b60 tx=0x7fe768005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:28.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:28.935+0000 7fe77ca13640 1 -- 172.21.15.22:0/820757697 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe7700cead0 con 0x7fe7781050e0 2024-09-21T04:02:29.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.163+0000 7fe77da15640 1 -- 172.21.15.22:0/820757697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fe77810a890 con 0x7fe7781050e0 2024-09-21T04:02:29.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.355+0000 7fe77ca13640 1 -- 172.21.15.22:0/820757697 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v29) ==== 117+0+0 (secure 0 0 0) 0x7fe7700d2eb0 con 0x7fe7781050e0 2024-09-21T04:02:29.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.358+0000 7fe77da15640 1 -- 172.21.15.22:0/820757697 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe7640b6510 msgr2=0x7fe7640b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:29.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.358+0000 7fe77da15640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe7640b6510 0x7fe7640b8a20 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fe768009b60 tx=0x7fe768005f90 comp rx=0 tx=0).stop 2024-09-21T04:02:29.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.358+0000 7fe77da15640 1 -- 172.21.15.22:0/820757697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7781050e0 msgr2=0x7fe77819b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:29.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.358+0000 7fe77da15640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7781050e0 0x7fe77819b050 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fe770009dc0 tx=0x7fe770003ba0 comp rx=0 tx=0).stop 2024-09-21T04:02:29.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.359+0000 7fe77da15640 1 -- 172.21.15.22:0/820757697 shutdown_connections 2024-09-21T04:02:29.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.359+0000 7fe77da15640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe7640b6510 0x7fe7640b8a20 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:29.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.359+0000 7fe77da15640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe778104740 0x7fe77819a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:29.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.359+0000 7fe77da15640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe7781050e0 0x7fe77819b050 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:29.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.359+0000 7fe77da15640 1 --2- 172.21.15.22:0/820757697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe7781036c0 0x7fe778199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:29.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.359+0000 7fe77da15640 1 -- 172.21.15.22:0/820757697 >> 172.21.15.22:0/820757697 conn(0x7fe7780ff020 msgr2=0x7fe778107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:29.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.359+0000 7fe77da15640 1 -- 172.21.15.22:0/820757697 shutdown_connections 2024-09-21T04:02:29.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:29.359+0000 7fe77da15640 1 -- 172.21.15.22:0/820757697 wait complete. 2024-09-21T04:02:29.373 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-21T04:02:29.383 INFO:teuthology.run_tasks:Running task quiescer... 2024-09-21T04:02:29.395 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T04:02:29.395 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T04:02:29.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:29 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/820757697' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T04:02:29.653 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:29.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:29 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/820757697' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T04:02:29.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:29 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/820757697' entity='client.admin' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} : dispatch 2024-09-21T04:02:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.171+0000 7f13c96b5640 1 -- 172.21.15.22:0/4144484420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c41094a0 msgr2=0x7f13c41098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.171+0000 7f13c96b5640 1 --2- 172.21.15.22:0/4144484420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c41094a0 0x7f13c41098b0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f13ac009900 tx=0x7f13ac02a410 comp rx=0 tx=0).stop 2024-09-21T04:02:30.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.171+0000 7f13c96b5640 1 -- 172.21.15.22:0/4144484420 shutdown_connections 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.171+0000 7f13c96b5640 1 --2- 172.21.15.22:0/4144484420 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13c4109df0 0x7f13c4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.171+0000 7f13c96b5640 1 --2- 172.21.15.22:0/4144484420 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c41094a0 0x7f13c41098b0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.171+0000 7f13c96b5640 1 --2- 172.21.15.22:0/4144484420 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c4103b60 0x7f13c4103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.171+0000 7f13c96b5640 1 -- 172.21.15.22:0/4144484420 >> 172.21.15.22:0/4144484420 conn(0x7f13c407b850 msgr2=0x7f13c407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.171+0000 7f13c96b5640 1 -- 172.21.15.22:0/4144484420 shutdown_connections 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.171+0000 7f13c96b5640 1 -- 172.21.15.22:0/4144484420 wait complete. 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.172+0000 7f13c96b5640 1 Processor -- start 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.172+0000 7f13c96b5640 1 -- start start 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.172+0000 7f13c96b5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c4103b60 0x7f13c419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.172+0000 7f13c96b5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c41094a0 0x7f13c419aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.172+0000 7f13c96b5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13c4109df0 0x7f13c419fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.172+0000 7f13c96b5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f13c4113960 con 0x7f13c4103b60 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.172+0000 7f13c96b5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f13c41137e0 con 0x7f13c4109df0 2024-09-21T04:02:30.189 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.172+0000 7f13c96b5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f13c4113ae0 con 0x7f13c41094a0 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.172+0000 7f13c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c4103b60 0x7f13c419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c4103b60 0x7f13c419a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43388/0 (socket says 172.21.15.22:43388) 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c2ffd640 1 -- 172.21.15.22:0/2565677895 learned_addr learned my addr 172.21.15.22:0/2565677895 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c27fc640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c41094a0 0x7f13c419aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c37fe640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13c4109df0 0x7f13c419fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c2ffd640 1 -- 172.21.15.22:0/2565677895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c41094a0 msgr2=0x7f13c419aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c2ffd640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c41094a0 0x7f13c419aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c2ffd640 1 -- 172.21.15.22:0/2565677895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13c4109df0 msgr2=0x7f13c419fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c2ffd640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13c4109df0 0x7f13c419fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c2ffd640 1 -- 172.21.15.22:0/2565677895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c41a0400 con 0x7f13c4103b60 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c27fc640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c41094a0 0x7f13c419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c37fe640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13c4109df0 0x7f13c419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c2ffd640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c4103b60 0x7f13c419a490 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00d950 tx=0x7f13bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:30.190 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13bbfff640 1 -- 172.21.15.22:0/2565677895 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc017030 con 0x7f13c4103b60 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13bbfff640 1 -- 172.21.15.22:0/2565677895 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f13bc004020 con 0x7f13c4103b60 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c96b5640 1 -- 172.21.15.22:0/2565677895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13c41a06f0 con 0x7f13c4103b60 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13bbfff640 1 -- 172.21.15.22:0/2565677895 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13bc0055d0 con 0x7f13c4103b60 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.173+0000 7f13c96b5640 1 -- 172.21.15.22:0/2565677895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13c41a6e50 con 0x7f13c4103b60 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.174+0000 7f13c96b5640 1 -- 172.21.15.22:0/2565677895 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c4103f70 con 0x7f13c4103b60 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.176+0000 7f13bbfff640 1 -- 172.21.15.22:0/2565677895 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f13bc009a30 con 0x7f13c4103b60 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.177+0000 7f13bbfff640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f13b00b6510 0x7f13b00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.177+0000 7f13c27fc640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f13b00b6510 0x7f13b00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.177+0000 7f13bbfff640 1 -- 172.21.15.22:0/2565677895 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f13bc0e77a0 con 0x7f13c4103b60 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.177+0000 7f13c27fc640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f13b00b6510 0x7f13b00b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0057c0 tx=0x7f13ac009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:30.191 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.180+0000 7f13bbfff640 1 -- 172.21.15.22:0/2565677895 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f13bc0adc70 con 0x7f13c4103b60 2024-09-21T04:02:30.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.368+0000 7f13c96b5640 1 -- 172.21.15.22:0/2565677895 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13c4063800 con 0x7f13b00b6510 2024-09-21T04:02:30.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.374+0000 7f13bbfff640 1 -- 172.21.15.22:0/2565677895 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340790 (secure 0 0 0) 0x7f13c4063800 con 0x7f13b00b6510 2024-09-21T04:02:30.380 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:30.382 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-21T04:02:30.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 -- 172.21.15.22:0/2565677895 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f13b00b6510 msgr2=0x7f13b00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:30.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f13b00b6510 0x7f13b00b8a20 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f13ac0057c0 tx=0x7f13ac009680 comp rx=0 tx=0).stop 2024-09-21T04:02:30.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 -- 172.21.15.22:0/2565677895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c4103b60 msgr2=0x7f13c419a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:30.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c4103b60 0x7f13c419a490 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f13bc00d950 tx=0x7f13bc00de10 comp rx=0 tx=0).stop 2024-09-21T04:02:30.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 -- 172.21.15.22:0/2565677895 shutdown_connections 2024-09-21T04:02:30.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f13b00b6510 0x7f13b00b8a20 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:30.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f13c41094a0 0x7f13c419aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:30.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f13c4109df0 0x7f13c419fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:30.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 --2- 172.21.15.22:0/2565677895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f13c4103b60 0x7f13c419a490 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:30.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 -- 172.21.15.22:0/2565677895 >> 172.21.15.22:0/2565677895 conn(0x7f13c407b850 msgr2=0x7f13c4105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:30.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 -- 172.21.15.22:0/2565677895 shutdown_connections 2024-09-21T04:02:30.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:30.378+0000 7f13c96b5640 1 -- 172.21.15.22:0/2565677895 wait complete. 2024-09-21T04:02:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:30 smithi060 ceph-mon[33722]: pgmap v375: 129 pgs: 129 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T04:02:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:30 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/820757697' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T04:02:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:30 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:02:30.813 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:30 smithi022 ceph-mon[31015]: pgmap v375: 129 pgs: 129 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T04:02:30.813 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:30 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/820757697' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T04:02:30.814 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:30 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:02:30.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:30 smithi073 ceph-mon[34443]: pgmap v375: 129 pgs: 129 active+clean; 649 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-09-21T04:02:30.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:30 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/820757697' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-09-21T04:02:30.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:30 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:02:31.089 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":375,"stamp":"2024-09-21T04:02:28.954478+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":664971,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1134,"num_read_kb":672,"num_write":379,"num_write_kb":2303,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951840,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":813,"ondisk_log_size":813,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390016,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551808,"statfs":{"total":1151940427776,"available":1151541051392,"internally_reserved":0,"allocated":11927552,"data_stored":7886513,"data_compressed":496992,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":954,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":117,"num_read_kb":52,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003880"},"pg_stats":[{"pgid":"2.1f","version":"85'14","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:24.368855+0000","last_change":"2024-09-21T04:00:01.985519+0000","last_active":"2024-09-21T04:02:24.368855+0000","last_peered":"2024-09-21T04:02:24.368855+0000","last_clean":"2024-09-21T04:02:24.368855+0000","last_became_active":"2024-09-21T04:00:01.984904+0000","last_became_peered":"2024-09-21T04:00:01.984904+0000","last_unstale":"2024-09-21T04:02:24.368855+0000","last_undegraded":"2024-09-21T04:02:24.368855+0000","last_fullsized":"2024-09-21T04:02:24.368855+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:20.596034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304394+0000","last_change":"2024-09-21T04:00:04.007864+0000","last_active":"2024-09-21T04:01:59.304394+0000","last_peered":"2024-09-21T04:01:59.304394+0000","last_clean":"2024-09-21T04:01:59.304394+0000","last_became_active":"2024-09-21T04:00:04.007470+0000","last_became_peered":"2024-09-21T04:00:04.007470+0000","last_unstale":"2024-09-21T04:01:59.304394+0000","last_undegraded":"2024-09-21T04:01:59.304394+0000","last_fullsized":"2024-09-21T04:01:59.304394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:11.452170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042202+0000","last_change":"2024-09-21T04:00:11.068152+0000","last_active":"2024-09-21T04:01:31.042202+0000","last_peered":"2024-09-21T04:01:31.042202+0000","last_clean":"2024-09-21T04:01:31.042202+0000","last_became_active":"2024-09-21T04:00:11.067647+0000","last_became_peered":"2024-09-21T04:00:11.067647+0000","last_unstale":"2024-09-21T04:01:31.042202+0000","last_undegraded":"2024-09-21T04:01:31.042202+0000","last_fullsized":"2024-09-21T04:01:31.042202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:35.652827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039714+0000","last_change":"2024-09-21T04:00:02.162198+0000","last_active":"2024-09-21T04:01:31.039714+0000","last_peered":"2024-09-21T04:01:31.039714+0000","last_clean":"2024-09-21T04:01:31.039714+0000","last_became_active":"2024-09-21T04:00:02.161840+0000","last_became_peered":"2024-09-21T04:00:02.161840+0000","last_unstale":"2024-09-21T04:01:31.039714+0000","last_undegraded":"2024-09-21T04:01:31.039714+0000","last_fullsized":"2024-09-21T04:01:31.039714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:31.353273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.308677+0000","last_change":"2024-09-21T04:00:03.997274+0000","last_active":"2024-09-21T04:01:59.308677+0000","last_peered":"2024-09-21T04:01:59.308677+0000","last_clean":"2024-09-21T04:01:59.308677+0000","last_became_active":"2024-09-21T04:00:03.996917+0000","last_became_peered":"2024-09-21T04:00:03.996917+0000","last_unstale":"2024-09-21T04:01:59.308677+0000","last_undegraded":"2024-09-21T04:01:59.308677+0000","last_fullsized":"2024-09-21T04:01:59.308677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:05.700703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293556+0000","last_change":"2024-09-21T04:00:11.058687+0000","last_active":"2024-09-21T04:01:31.293556+0000","last_peered":"2024-09-21T04:01:31.293556+0000","last_clean":"2024-09-21T04:01:31.293556+0000","last_became_active":"2024-09-21T04:00:11.058099+0000","last_became_peered":"2024-09-21T04:00:11.058099+0000","last_unstale":"2024-09-21T04:01:31.293556+0000","last_undegraded":"2024-09-21T04:01:31.293556+0000","last_fullsized":"2024-09-21T04:01:31.293556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:50.332295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.307558+0000","last_change":"2024-09-21T04:01:31.307478+0000","last_active":"2024-09-21T04:01:31.307558+0000","last_peered":"2024-09-21T04:01:31.307558+0000","last_clean":"2024-09-21T04:01:31.307558+0000","last_became_active":"2024-09-21T04:01:31.296040+0000","last_became_peered":"2024-09-21T04:01:31.296040+0000","last_unstale":"2024-09-21T04:01:31.307558+0000","last_undegraded":"2024-09-21T04:01:31.307558+0000","last_fullsized":"2024-09-21T04:01:31.307558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:16.547730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.322752+0000","last_change":"2024-09-21T04:00:04.012120+0000","last_active":"2024-09-21T04:01:59.322752+0000","last_peered":"2024-09-21T04:01:59.322752+0000","last_clean":"2024-09-21T04:01:59.322752+0000","last_became_active":"2024-09-21T04:00:04.011648+0000","last_became_peered":"2024-09-21T04:00:04.011648+0000","last_unstale":"2024-09-21T04:01:59.322752+0000","last_undegraded":"2024-09-21T04:01:59.322752+0000","last_fullsized":"2024-09-21T04:01:59.322752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.716845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293922+0000","last_change":"2024-09-21T04:00:11.059509+0000","last_active":"2024-09-21T04:01:31.293922+0000","last_peered":"2024-09-21T04:01:31.293922+0000","last_clean":"2024-09-21T04:01:31.293922+0000","last_became_active":"2024-09-21T04:00:11.058674+0000","last_became_peered":"2024-09-21T04:00:11.058674+0000","last_unstale":"2024-09-21T04:01:31.293922+0000","last_undegraded":"2024-09-21T04:01:31.293922+0000","last_fullsized":"2024-09-21T04:01:31.293922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:13.078117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039158+0000","last_change":"2024-09-21T04:00:01.987624+0000","last_active":"2024-09-21T04:01:31.039158+0000","last_peered":"2024-09-21T04:01:31.039158+0000","last_clean":"2024-09-21T04:01:31.039158+0000","last_became_active":"2024-09-21T04:00:01.987212+0000","last_became_peered":"2024-09-21T04:00:01.987212+0000","last_unstale":"2024-09-21T04:01:31.039158+0000","last_undegraded":"2024-09-21T04:01:31.039158+0000","last_fullsized":"2024-09-21T04:01:31.039158+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:18.554590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.310276+0000","last_change":"2024-09-21T04:00:04.017507+0000","last_active":"2024-09-21T04:01:59.310276+0000","last_peered":"2024-09-21T04:01:59.310276+0000","last_clean":"2024-09-21T04:01:59.310276+0000","last_became_active":"2024-09-21T04:00:04.017120+0000","last_became_peered":"2024-09-21T04:00:04.017120+0000","last_unstale":"2024-09-21T04:01:59.310276+0000","last_undegraded":"2024-09-21T04:01:59.310276+0000","last_fullsized":"2024-09-21T04:01:59.310276+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:19.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293558+0000","last_change":"2024-09-21T04:00:11.055047+0000","last_active":"2024-09-21T04:01:31.293558+0000","last_peered":"2024-09-21T04:01:31.293558+0000","last_clean":"2024-09-21T04:01:31.293558+0000","last_became_active":"2024-09-21T04:00:11.054504+0000","last_became_peered":"2024-09-21T04:00:11.054504+0000","last_unstale":"2024-09-21T04:01:31.293558+0000","last_undegraded":"2024-09-21T04:01:31.293558+0000","last_fullsized":"2024-09-21T04:01:31.293558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.963011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.312681+0000","last_change":"2024-09-21T04:00:04.012633+0000","last_active":"2024-09-21T04:01:59.312681+0000","last_peered":"2024-09-21T04:01:59.312681+0000","last_clean":"2024-09-21T04:01:59.312681+0000","last_became_active":"2024-09-21T04:00:04.012246+0000","last_became_peered":"2024-09-21T04:00:04.012246+0000","last_unstale":"2024-09-21T04:01:59.312681+0000","last_undegraded":"2024-09-21T04:01:59.312681+0000","last_fullsized":"2024-09-21T04:01:59.312681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:58.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039221+0000","last_change":"2024-09-21T04:00:30.144195+0000","last_active":"2024-09-21T04:01:31.039221+0000","last_peered":"2024-09-21T04:01:31.039221+0000","last_clean":"2024-09-21T04:01:31.039221+0000","last_became_active":"2024-09-21T04:00:30.140690+0000","last_became_peered":"2024-09-21T04:00:30.140690+0000","last_unstale":"2024-09-21T04:01:31.039221+0000","last_undegraded":"2024-09-21T04:01:31.039221+0000","last_fullsized":"2024-09-21T04:01:31.039221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:42.686216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295148+0000","last_change":"2024-09-21T04:00:11.333935+0000","last_active":"2024-09-21T04:01:31.295148+0000","last_peered":"2024-09-21T04:01:31.295148+0000","last_clean":"2024-09-21T04:01:31.295148+0000","last_became_active":"2024-09-21T04:00:11.333336+0000","last_became_peered":"2024-09-21T04:00:11.333336+0000","last_unstale":"2024-09-21T04:01:31.295148+0000","last_undegraded":"2024-09-21T04:01:31.295148+0000","last_fullsized":"2024-09-21T04:01:31.295148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:23.890845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304106+0000","last_change":"2024-09-21T04:00:04.002579+0000","last_active":"2024-09-21T04:01:59.304106+0000","last_peered":"2024-09-21T04:01:59.304106+0000","last_clean":"2024-09-21T04:01:59.304106+0000","last_became_active":"2024-09-21T04:00:04.001926+0000","last_became_peered":"2024-09-21T04:00:04.001926+0000","last_unstale":"2024-09-21T04:01:59.304106+0000","last_undegraded":"2024-09-21T04:01:59.304106+0000","last_fullsized":"2024-09-21T04:01:59.304106+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:11.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"83'3","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042477+0000","last_change":"2024-09-21T04:00:01.983276+0000","last_active":"2024-09-21T04:01:31.042477+0000","last_peered":"2024-09-21T04:01:31.042477+0000","last_clean":"2024-09-21T04:01:31.042477+0000","last_became_active":"2024-09-21T04:00:01.982828+0000","last_became_peered":"2024-09-21T04:00:01.982828+0000","last_unstale":"2024-09-21T04:01:31.042477+0000","last_undegraded":"2024-09-21T04:01:31.042477+0000","last_fullsized":"2024-09-21T04:01:31.042477+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:52.266947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293768+0000","last_change":"2024-09-21T04:00:11.067529+0000","last_active":"2024-09-21T04:01:31.293768+0000","last_peered":"2024-09-21T04:01:31.293768+0000","last_clean":"2024-09-21T04:01:31.293768+0000","last_became_active":"2024-09-21T04:00:11.066975+0000","last_became_peered":"2024-09-21T04:00:11.066975+0000","last_unstale":"2024-09-21T04:01:31.293768+0000","last_undegraded":"2024-09-21T04:01:31.293768+0000","last_fullsized":"2024-09-21T04:01:31.293768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:09.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.302144+0000","last_change":"2024-09-21T04:00:04.005822+0000","last_active":"2024-09-21T04:01:59.302144+0000","last_peered":"2024-09-21T04:01:59.302144+0000","last_clean":"2024-09-21T04:01:59.302144+0000","last_became_active":"2024-09-21T04:00:04.005468+0000","last_became_peered":"2024-09-21T04:00:04.005468+0000","last_unstale":"2024-09-21T04:01:59.302144+0000","last_undegraded":"2024-09-21T04:01:59.302144+0000","last_fullsized":"2024-09-21T04:01:59.302144+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:08.863103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039911+0000","last_change":"2024-09-21T04:00:01.984489+0000","last_active":"2024-09-21T04:01:31.039911+0000","last_peered":"2024-09-21T04:01:31.039911+0000","last_clean":"2024-09-21T04:01:31.039911+0000","last_became_active":"2024-09-21T04:00:01.983873+0000","last_became_peered":"2024-09-21T04:00:01.983873+0000","last_unstale":"2024-09-21T04:01:31.039911+0000","last_undegraded":"2024-09-21T04:01:31.039911+0000","last_fullsized":"2024-09-21T04:01:31.039911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:22.717693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036859+0000","last_change":"2024-09-21T04:00:11.069148+0000","last_active":"2024-09-21T04:01:31.036859+0000","last_peered":"2024-09-21T04:01:31.036859+0000","last_clean":"2024-09-21T04:01:31.036859+0000","last_became_active":"2024-09-21T04:00:11.068723+0000","last_became_peered":"2024-09-21T04:00:11.068723+0000","last_unstale":"2024-09-21T04:01:31.036859+0000","last_undegraded":"2024-09-21T04:01:31.036859+0000","last_fullsized":"2024-09-21T04:01:31.036859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:42.822525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.291688+0000","last_change":"2024-09-21T04:00:04.000526+0000","last_active":"2024-09-21T04:01:59.291688+0000","last_peered":"2024-09-21T04:01:59.291688+0000","last_clean":"2024-09-21T04:01:59.291688+0000","last_became_active":"2024-09-21T04:00:04.000137+0000","last_became_peered":"2024-09-21T04:00:04.000137+0000","last_unstale":"2024-09-21T04:01:59.291688+0000","last_undegraded":"2024-09-21T04:01:59.291688+0000","last_fullsized":"2024-09-21T04:01:59.291688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:12.055499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303435+0000","last_change":"2024-09-21T04:00:02.162359+0000","last_active":"2024-09-21T04:01:31.303435+0000","last_peered":"2024-09-21T04:01:31.303435+0000","last_clean":"2024-09-21T04:01:31.303435+0000","last_became_active":"2024-09-21T04:00:02.161946+0000","last_became_peered":"2024-09-21T04:00:02.161946+0000","last_unstale":"2024-09-21T04:01:31.303435+0000","last_undegraded":"2024-09-21T04:01:31.303435+0000","last_fullsized":"2024-09-21T04:01:31.303435+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:18.841278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294781+0000","last_change":"2024-09-21T04:00:30.138669+0000","last_active":"2024-09-21T04:01:31.294781+0000","last_peered":"2024-09-21T04:01:31.294781+0000","last_clean":"2024-09-21T04:01:31.294781+0000","last_became_active":"2024-09-21T04:00:30.137548+0000","last_became_peered":"2024-09-21T04:00:30.137548+0000","last_unstale":"2024-09-21T04:01:31.294781+0000","last_undegraded":"2024-09-21T04:01:31.294781+0000","last_fullsized":"2024-09-21T04:01:31.294781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:56.867964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304813+0000","last_change":"2024-09-21T04:00:30.396672+0000","last_active":"2024-09-21T04:01:59.304813+0000","last_peered":"2024-09-21T04:01:59.304813+0000","last_clean":"2024-09-21T04:01:59.304813+0000","last_became_active":"2024-09-21T04:00:30.396066+0000","last_became_peered":"2024-09-21T04:00:30.396066+0000","last_unstale":"2024-09-21T04:01:59.304813+0000","last_undegraded":"2024-09-21T04:01:59.304813+0000","last_fullsized":"2024-09-21T04:01:59.304813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:01.582768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295111+0000","last_change":"2024-09-21T04:00:02.213481+0000","last_active":"2024-09-21T04:01:31.295111+0000","last_peered":"2024-09-21T04:01:31.295111+0000","last_clean":"2024-09-21T04:01:31.295111+0000","last_became_active":"2024-09-21T04:00:02.213093+0000","last_became_peered":"2024-09-21T04:00:02.213093+0000","last_unstale":"2024-09-21T04:01:31.295111+0000","last_undegraded":"2024-09-21T04:01:31.295111+0000","last_fullsized":"2024-09-21T04:01:31.295111+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:20.700406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042307+0000","last_change":"2024-09-21T04:00:11.058780+0000","last_active":"2024-09-21T04:01:31.042307+0000","last_peered":"2024-09-21T04:01:31.042307+0000","last_clean":"2024-09-21T04:01:31.042307+0000","last_became_active":"2024-09-21T04:00:11.058309+0000","last_became_peered":"2024-09-21T04:00:11.058309+0000","last_unstale":"2024-09-21T04:01:31.042307+0000","last_undegraded":"2024-09-21T04:01:31.042307+0000","last_fullsized":"2024-09-21T04:01:31.042307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:31.134604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.305244+0000","last_change":"2024-09-21T04:00:04.005954+0000","last_active":"2024-09-21T04:01:59.305244+0000","last_peered":"2024-09-21T04:01:59.305244+0000","last_clean":"2024-09-21T04:01:59.305244+0000","last_became_active":"2024-09-21T04:00:04.005609+0000","last_became_peered":"2024-09-21T04:00:04.005609+0000","last_unstale":"2024-09-21T04:01:59.305244+0000","last_undegraded":"2024-09-21T04:01:59.305244+0000","last_fullsized":"2024-09-21T04:01:59.305244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:52.596627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'15","reported_seq":74,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:00.024761+0000","last_change":"2024-09-21T04:01:31.047655+0000","last_active":"2024-09-21T04:02:00.024761+0000","last_peered":"2024-09-21T04:02:00.024761+0000","last_clean":"2024-09-21T04:02:00.024761+0000","last_became_active":"2024-09-21T04:01:31.040521+0000","last_became_peered":"2024-09-21T04:01:31.040521+0000","last_unstale":"2024-09-21T04:02:00.024761+0000","last_undegraded":"2024-09-21T04:02:00.024761+0000","last_fullsized":"2024-09-21T04:02:00.024761+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:32.316804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039138+0000","last_change":"2024-09-21T04:00:11.334127+0000","last_active":"2024-09-21T04:01:31.039138+0000","last_peered":"2024-09-21T04:01:31.039138+0000","last_clean":"2024-09-21T04:01:31.039138+0000","last_became_active":"2024-09-21T04:00:11.333601+0000","last_became_peered":"2024-09-21T04:00:11.333601+0000","last_unstale":"2024-09-21T04:01:31.039138+0000","last_undegraded":"2024-09-21T04:01:31.039138+0000","last_fullsized":"2024-09-21T04:01:31.039138+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.114185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.285432+0000","last_change":"2024-09-21T04:00:03.988967+0000","last_active":"2024-09-21T04:01:59.285432+0000","last_peered":"2024-09-21T04:01:59.285432+0000","last_clean":"2024-09-21T04:01:59.285432+0000","last_became_active":"2024-09-21T04:00:03.988617+0000","last_became_peered":"2024-09-21T04:00:03.988617+0000","last_unstale":"2024-09-21T04:01:59.285432+0000","last_undegraded":"2024-09-21T04:01:59.285432+0000","last_fullsized":"2024-09-21T04:01:59.285432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040198+0000","last_change":"2024-09-21T04:00:02.162698+0000","last_active":"2024-09-21T04:01:31.040198+0000","last_peered":"2024-09-21T04:01:31.040198+0000","last_clean":"2024-09-21T04:01:31.040198+0000","last_became_active":"2024-09-21T04:00:02.162254+0000","last_became_peered":"2024-09-21T04:00:02.162254+0000","last_unstale":"2024-09-21T04:01:31.040198+0000","last_undegraded":"2024-09-21T04:01:31.040198+0000","last_fullsized":"2024-09-21T04:01:31.040198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:07.409718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037136+0000","last_change":"2024-09-21T04:00:11.057825+0000","last_active":"2024-09-21T04:01:31.037136+0000","last_peered":"2024-09-21T04:01:31.037136+0000","last_clean":"2024-09-21T04:01:31.037136+0000","last_became_active":"2024-09-21T04:00:11.057308+0000","last_became_peered":"2024-09-21T04:00:11.057308+0000","last_unstale":"2024-09-21T04:01:31.037136+0000","last_undegraded":"2024-09-21T04:01:31.037136+0000","last_fullsized":"2024-09-21T04:01:31.037136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.925835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296292+0000","last_change":"2024-09-21T04:00:03.996631+0000","last_active":"2024-09-21T04:01:59.296292+0000","last_peered":"2024-09-21T04:01:59.296292+0000","last_clean":"2024-09-21T04:01:59.296292+0000","last_became_active":"2024-09-21T04:00:03.996264+0000","last_became_peered":"2024-09-21T04:00:03.996264+0000","last_unstale":"2024-09-21T04:01:59.296292+0000","last_undegraded":"2024-09-21T04:01:59.296292+0000","last_fullsized":"2024-09-21T04:01:59.296292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:27.270843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036962+0000","last_change":"2024-09-21T04:00:02.162450+0000","last_active":"2024-09-21T04:01:31.036962+0000","last_peered":"2024-09-21T04:01:31.036962+0000","last_clean":"2024-09-21T04:01:31.036962+0000","last_became_active":"2024-09-21T04:00:02.161991+0000","last_became_peered":"2024-09-21T04:00:02.161991+0000","last_unstale":"2024-09-21T04:01:31.036962+0000","last_undegraded":"2024-09-21T04:01:31.036962+0000","last_fullsized":"2024-09-21T04:01:31.036962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:09.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039345+0000","last_change":"2024-09-21T04:00:11.333873+0000","last_active":"2024-09-21T04:01:31.039345+0000","last_peered":"2024-09-21T04:01:31.039345+0000","last_clean":"2024-09-21T04:01:31.039345+0000","last_became_active":"2024-09-21T04:00:11.333368+0000","last_became_peered":"2024-09-21T04:00:11.333368+0000","last_unstale":"2024-09-21T04:01:31.039345+0000","last_undegraded":"2024-09-21T04:01:31.039345+0000","last_fullsized":"2024-09-21T04:01:31.039345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:53.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296904+0000","last_change":"2024-09-21T04:00:30.138320+0000","last_active":"2024-09-21T04:01:59.296904+0000","last_peered":"2024-09-21T04:01:59.296904+0000","last_clean":"2024-09-21T04:01:59.296904+0000","last_became_active":"2024-09-21T04:00:30.137866+0000","last_became_peered":"2024-09-21T04:00:30.137866+0000","last_unstale":"2024-09-21T04:01:59.296904+0000","last_undegraded":"2024-09-21T04:01:59.296904+0000","last_fullsized":"2024-09-21T04:01:59.296904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:39.992746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'8","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:27.374403+0000","last_change":"2024-09-21T04:00:01.986355+0000","last_active":"2024-09-21T04:02:27.374403+0000","last_peered":"2024-09-21T04:02:27.374403+0000","last_clean":"2024-09-21T04:02:27.374403+0000","last_became_active":"2024-09-21T04:00:01.985960+0000","last_became_peered":"2024-09-21T04:00:01.985960+0000","last_unstale":"2024-09-21T04:02:27.374403+0000","last_undegraded":"2024-09-21T04:02:27.374403+0000","last_fullsized":"2024-09-21T04:02:27.374403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:08.417218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1597,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033004+0000","last_change":"2024-09-21T04:00:11.066363+0000","last_active":"2024-09-21T04:01:31.033004+0000","last_peered":"2024-09-21T04:01:31.033004+0000","last_clean":"2024-09-21T04:01:31.033004+0000","last_became_active":"2024-09-21T04:00:11.065923+0000","last_became_peered":"2024-09-21T04:00:11.065923+0000","last_unstale":"2024-09-21T04:01:31.033004+0000","last_undegraded":"2024-09-21T04:01:31.033004+0000","last_fullsized":"2024-09-21T04:01:31.033004+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:49.720377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304674+0000","last_change":"2024-09-21T04:00:04.010139+0000","last_active":"2024-09-21T04:01:59.304674+0000","last_peered":"2024-09-21T04:01:59.304674+0000","last_clean":"2024-09-21T04:01:59.304674+0000","last_became_active":"2024-09-21T04:00:04.009764+0000","last_became_peered":"2024-09-21T04:00:04.009764+0000","last_unstale":"2024-09-21T04:01:59.304674+0000","last_undegraded":"2024-09-21T04:01:59.304674+0000","last_fullsized":"2024-09-21T04:01:59.304674+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:08.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"83'5","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:23.367934+0000","last_change":"2024-09-21T04:00:02.162297+0000","last_active":"2024-09-21T04:02:23.367934+0000","last_peered":"2024-09-21T04:02:23.367934+0000","last_clean":"2024-09-21T04:02:23.367934+0000","last_became_active":"2024-09-21T04:00:02.161884+0000","last_became_peered":"2024-09-21T04:00:02.161884+0000","last_unstale":"2024-09-21T04:02:23.367934+0000","last_undegraded":"2024-09-21T04:02:23.367934+0000","last_fullsized":"2024-09-21T04:02:23.367934+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:21.108188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033190+0000","last_change":"2024-09-21T04:00:11.335000+0000","last_active":"2024-09-21T04:01:31.033190+0000","last_peered":"2024-09-21T04:01:31.033190+0000","last_clean":"2024-09-21T04:01:31.033190+0000","last_became_active":"2024-09-21T04:00:11.334529+0000","last_became_peered":"2024-09-21T04:00:11.334529+0000","last_unstale":"2024-09-21T04:01:31.033190+0000","last_undegraded":"2024-09-21T04:01:31.033190+0000","last_fullsized":"2024-09-21T04:01:31.033190+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:54.148883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.306427+0000","last_change":"2024-09-21T04:00:03.988089+0000","last_active":"2024-09-21T04:01:59.306427+0000","last_peered":"2024-09-21T04:01:59.306427+0000","last_clean":"2024-09-21T04:01:59.306427+0000","last_became_active":"2024-09-21T04:00:03.987641+0000","last_became_peered":"2024-09-21T04:00:03.987641+0000","last_unstale":"2024-09-21T04:01:59.306427+0000","last_undegraded":"2024-09-21T04:01:59.306427+0000","last_fullsized":"2024-09-21T04:01:59.306427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:46.249510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.047436+0000","last_change":"2024-09-21T04:01:31.046744+0000","last_active":"2024-09-21T04:01:31.047436+0000","last_peered":"2024-09-21T04:01:31.047436+0000","last_clean":"2024-09-21T04:01:31.047436+0000","last_became_active":"2024-09-21T04:01:31.041093+0000","last_became_peered":"2024-09-21T04:01:31.041093+0000","last_unstale":"2024-09-21T04:01:31.047436+0000","last_undegraded":"2024-09-21T04:01:31.047436+0000","last_fullsized":"2024-09-21T04:01:31.047436+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:14.159990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,8],"acting":[11,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035140+0000","last_change":"2024-09-21T04:00:30.349715+0000","last_active":"2024-09-21T04:01:31.035140+0000","last_peered":"2024-09-21T04:01:31.035140+0000","last_clean":"2024-09-21T04:01:31.035140+0000","last_became_active":"2024-09-21T04:00:30.349233+0000","last_became_peered":"2024-09-21T04:00:30.349233+0000","last_unstale":"2024-09-21T04:01:31.035140+0000","last_undegraded":"2024-09-21T04:01:31.035140+0000","last_fullsized":"2024-09-21T04:01:31.035140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.933082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303096+0000","last_change":"2024-09-21T04:00:04.005025+0000","last_active":"2024-09-21T04:01:59.303096+0000","last_peered":"2024-09-21T04:01:59.303096+0000","last_clean":"2024-09-21T04:01:59.303096+0000","last_became_active":"2024-09-21T04:00:04.004697+0000","last_became_peered":"2024-09-21T04:00:04.004697+0000","last_unstale":"2024-09-21T04:01:59.303096+0000","last_undegraded":"2024-09-21T04:01:59.303096+0000","last_fullsized":"2024-09-21T04:01:59.303096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:30.663231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295076+0000","last_change":"2024-09-21T04:00:01.987438+0000","last_active":"2024-09-21T04:01:31.295076+0000","last_peered":"2024-09-21T04:01:31.295076+0000","last_clean":"2024-09-21T04:01:31.295076+0000","last_became_active":"2024-09-21T04:00:01.986995+0000","last_became_peered":"2024-09-21T04:00:01.986995+0000","last_unstale":"2024-09-21T04:01:31.295076+0000","last_undegraded":"2024-09-21T04:01:31.295076+0000","last_fullsized":"2024-09-21T04:01:31.295076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:16.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040093+0000","last_change":"2024-09-21T03:58:47.597000+0000","last_active":"2024-09-21T04:01:31.040093+0000","last_peered":"2024-09-21T04:01:31.040093+0000","last_clean":"2024-09-21T04:01:31.040093+0000","last_became_active":"2024-09-21T03:58:47.590826+0000","last_became_peered":"2024-09-21T03:58:47.590826+0000","last_unstale":"2024-09-21T04:01:31.040093+0000","last_undegraded":"2024-09-21T04:01:31.040093+0000","last_fullsized":"2024-09-21T04:01:31.040093+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_clean_scrub_stamp":"2024-09-21T03:55:20.271286+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:53.813660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040238+0000","last_change":"2024-09-21T04:00:11.057229+0000","last_active":"2024-09-21T04:01:31.040238+0000","last_peered":"2024-09-21T04:01:31.040238+0000","last_clean":"2024-09-21T04:01:31.040238+0000","last_became_active":"2024-09-21T04:00:11.056722+0000","last_became_peered":"2024-09-21T04:00:11.056722+0000","last_unstale":"2024-09-21T04:01:31.040238+0000","last_undegraded":"2024-09-21T04:01:31.040238+0000","last_fullsized":"2024-09-21T04:01:31.040238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:53.311589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.312449+0000","last_change":"2024-09-21T04:00:04.013650+0000","last_active":"2024-09-21T04:01:59.312449+0000","last_peered":"2024-09-21T04:01:59.312449+0000","last_clean":"2024-09-21T04:01:59.312449+0000","last_became_active":"2024-09-21T04:00:04.013284+0000","last_became_peered":"2024-09-21T04:00:04.013284+0000","last_unstale":"2024-09-21T04:01:59.312449+0000","last_undegraded":"2024-09-21T04:01:59.312449+0000","last_fullsized":"2024-09-21T04:01:59.312449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:53.098998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"83'5","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:23.368324+0000","last_change":"2024-09-21T04:00:02.213332+0000","last_active":"2024-09-21T04:02:23.368324+0000","last_peered":"2024-09-21T04:02:23.368324+0000","last_clean":"2024-09-21T04:02:23.368324+0000","last_became_active":"2024-09-21T04:00:02.212853+0000","last_became_peered":"2024-09-21T04:00:02.212853+0000","last_unstale":"2024-09-21T04:02:23.368324+0000","last_undegraded":"2024-09-21T04:02:23.368324+0000","last_fullsized":"2024-09-21T04:02:23.368324+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:52.923489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":102,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303077+0000","last_change":"2024-09-21T04:00:11.057139+0000","last_active":"2024-09-21T04:01:31.303077+0000","last_peered":"2024-09-21T04:01:31.303077+0000","last_clean":"2024-09-21T04:01:31.303077+0000","last_became_active":"2024-09-21T04:00:11.056549+0000","last_became_peered":"2024-09-21T04:00:11.056549+0000","last_unstale":"2024-09-21T04:01:31.303077+0000","last_undegraded":"2024-09-21T04:01:31.303077+0000","last_fullsized":"2024-09-21T04:01:31.303077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:28.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304521+0000","last_change":"2024-09-21T04:00:30.141278+0000","last_active":"2024-09-21T04:01:59.304521+0000","last_peered":"2024-09-21T04:01:59.304521+0000","last_clean":"2024-09-21T04:01:59.304521+0000","last_became_active":"2024-09-21T04:00:30.140692+0000","last_became_peered":"2024-09-21T04:00:30.140692+0000","last_unstale":"2024-09-21T04:01:59.304521+0000","last_undegraded":"2024-09-21T04:01:59.304521+0000","last_fullsized":"2024-09-21T04:01:59.304521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:15.600486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035507+0000","last_change":"2024-09-21T04:00:01.990532+0000","last_active":"2024-09-21T04:01:31.035507+0000","last_peered":"2024-09-21T04:01:31.035507+0000","last_clean":"2024-09-21T04:01:31.035507+0000","last_became_active":"2024-09-21T04:00:01.990114+0000","last_became_peered":"2024-09-21T04:00:01.990114+0000","last_unstale":"2024-09-21T04:01:31.035507+0000","last_undegraded":"2024-09-21T04:01:31.035507+0000","last_fullsized":"2024-09-21T04:01:31.035507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:51.313576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108185+0000","last_change":"2024-09-21T04:00:30.182161+0000","last_active":"2024-09-21T04:01:31.108185+0000","last_peered":"2024-09-21T04:01:31.108185+0000","last_clean":"2024-09-21T04:01:31.108185+0000","last_became_active":"2024-09-21T04:00:30.181777+0000","last_became_peered":"2024-09-21T04:00:30.181777+0000","last_unstale":"2024-09-21T04:01:31.108185+0000","last_undegraded":"2024-09-21T04:01:31.108185+0000","last_fullsized":"2024-09-21T04:01:31.108185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:35.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307052+0000","last_change":"2024-09-21T04:00:04.006784+0000","last_active":"2024-09-21T04:01:59.307052+0000","last_peered":"2024-09-21T04:01:59.307052+0000","last_clean":"2024-09-21T04:01:59.307052+0000","last_became_active":"2024-09-21T04:00:04.003841+0000","last_became_peered":"2024-09-21T04:00:04.003841+0000","last_unstale":"2024-09-21T04:01:59.307052+0000","last_undegraded":"2024-09-21T04:01:59.307052+0000","last_fullsized":"2024-09-21T04:01:59.307052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:50.088980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033310+0000","last_change":"2024-09-21T04:00:01.986202+0000","last_active":"2024-09-21T04:01:31.033310+0000","last_peered":"2024-09-21T04:01:31.033310+0000","last_clean":"2024-09-21T04:01:31.033310+0000","last_became_active":"2024-09-21T04:00:01.985812+0000","last_became_peered":"2024-09-21T04:00:01.985812+0000","last_unstale":"2024-09-21T04:01:31.033310+0000","last_undegraded":"2024-09-21T04:01:31.033310+0000","last_fullsized":"2024-09-21T04:01:31.033310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:05.777175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034572+0000","last_change":"2024-09-21T04:00:11.057253+0000","last_active":"2024-09-21T04:01:31.034572+0000","last_peered":"2024-09-21T04:01:31.034572+0000","last_clean":"2024-09-21T04:01:31.034572+0000","last_became_active":"2024-09-21T04:00:11.056721+0000","last_became_peered":"2024-09-21T04:00:11.056721+0000","last_unstale":"2024-09-21T04:01:31.034572+0000","last_undegraded":"2024-09-21T04:01:31.034572+0000","last_fullsized":"2024-09-21T04:01:31.034572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:19.202714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304854+0000","last_change":"2024-09-21T04:00:04.003674+0000","last_active":"2024-09-21T04:01:59.304854+0000","last_peered":"2024-09-21T04:01:59.304854+0000","last_clean":"2024-09-21T04:01:59.304854+0000","last_became_active":"2024-09-21T04:00:04.003297+0000","last_became_peered":"2024-09-21T04:00:04.003297+0000","last_unstale":"2024-09-21T04:01:59.304854+0000","last_undegraded":"2024-09-21T04:01:59.304854+0000","last_fullsized":"2024-09-21T04:01:59.304854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.063721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"83'2","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039558+0000","last_change":"2024-09-21T04:00:01.986007+0000","last_active":"2024-09-21T04:01:31.039558+0000","last_peered":"2024-09-21T04:01:31.039558+0000","last_clean":"2024-09-21T04:01:31.039558+0000","last_became_active":"2024-09-21T04:00:01.985582+0000","last_became_peered":"2024-09-21T04:00:01.985582+0000","last_unstale":"2024-09-21T04:01:31.039558+0000","last_undegraded":"2024-09-21T04:01:31.039558+0000","last_fullsized":"2024-09-21T04:01:31.039558+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:48.429307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034852+0000","last_change":"2024-09-21T04:00:11.061522+0000","last_active":"2024-09-21T04:01:31.034852+0000","last_peered":"2024-09-21T04:01:31.034852+0000","last_clean":"2024-09-21T04:01:31.034852+0000","last_became_active":"2024-09-21T04:00:11.060984+0000","last_became_peered":"2024-09-21T04:00:11.060984+0000","last_unstale":"2024-09-21T04:01:31.034852+0000","last_undegraded":"2024-09-21T04:01:31.034852+0000","last_fullsized":"2024-09-21T04:01:31.034852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:51.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.309095+0000","last_change":"2024-09-21T04:00:04.016468+0000","last_active":"2024-09-21T04:01:59.309095+0000","last_peered":"2024-09-21T04:01:59.309095+0000","last_clean":"2024-09-21T04:01:59.309095+0000","last_became_active":"2024-09-21T04:00:04.016177+0000","last_became_peered":"2024-09-21T04:00:04.016177+0000","last_unstale":"2024-09-21T04:01:59.309095+0000","last_undegraded":"2024-09-21T04:01:59.309095+0000","last_fullsized":"2024-09-21T04:01:59.309095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:58.670552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039248+0000","last_change":"2024-09-21T04:00:02.162746+0000","last_active":"2024-09-21T04:01:31.039248+0000","last_peered":"2024-09-21T04:01:31.039248+0000","last_clean":"2024-09-21T04:01:31.039248+0000","last_became_active":"2024-09-21T04:00:02.162121+0000","last_became_peered":"2024-09-21T04:00:02.162121+0000","last_unstale":"2024-09-21T04:01:31.039248+0000","last_undegraded":"2024-09-21T04:01:31.039248+0000","last_fullsized":"2024-09-21T04:01:31.039248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:02.798790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033264+0000","last_change":"2024-09-21T04:00:11.068043+0000","last_active":"2024-09-21T04:01:31.033264+0000","last_peered":"2024-09-21T04:01:31.033264+0000","last_clean":"2024-09-21T04:01:31.033264+0000","last_became_active":"2024-09-21T04:00:11.067553+0000","last_became_peered":"2024-09-21T04:00:11.067553+0000","last_unstale":"2024-09-21T04:01:31.033264+0000","last_undegraded":"2024-09-21T04:01:31.033264+0000","last_fullsized":"2024-09-21T04:01:31.033264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:34.095708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307897+0000","last_change":"2024-09-21T04:00:04.010725+0000","last_active":"2024-09-21T04:01:59.307897+0000","last_peered":"2024-09-21T04:01:59.307897+0000","last_clean":"2024-09-21T04:01:59.307897+0000","last_became_active":"2024-09-21T04:00:04.010295+0000","last_became_peered":"2024-09-21T04:00:04.010295+0000","last_unstale":"2024-09-21T04:01:59.307897+0000","last_undegraded":"2024-09-21T04:01:59.307897+0000","last_fullsized":"2024-09-21T04:01:59.307897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:40.417814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:25.371318+0000","last_change":"2024-09-21T04:00:01.985123+0000","last_active":"2024-09-21T04:02:25.371318+0000","last_peered":"2024-09-21T04:02:25.371318+0000","last_clean":"2024-09-21T04:02:25.371318+0000","last_became_active":"2024-09-21T04:00:01.984686+0000","last_became_peered":"2024-09-21T04:00:01.984686+0000","last_unstale":"2024-09-21T04:02:25.371318+0000","last_undegraded":"2024-09-21T04:02:25.371318+0000","last_fullsized":"2024-09-21T04:02:25.371318+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:18.825567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036813+0000","last_change":"2024-09-21T04:00:11.068045+0000","last_active":"2024-09-21T04:01:31.036813+0000","last_peered":"2024-09-21T04:01:31.036813+0000","last_clean":"2024-09-21T04:01:31.036813+0000","last_became_active":"2024-09-21T04:00:11.067528+0000","last_became_peered":"2024-09-21T04:00:11.067528+0000","last_unstale":"2024-09-21T04:01:31.036813+0000","last_undegraded":"2024-09-21T04:01:31.036813+0000","last_fullsized":"2024-09-21T04:01:31.036813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:54.054763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.308037+0000","last_change":"2024-09-21T04:00:04.008068+0000","last_active":"2024-09-21T04:01:59.308037+0000","last_peered":"2024-09-21T04:01:59.308037+0000","last_clean":"2024-09-21T04:01:59.308037+0000","last_became_active":"2024-09-21T04:00:04.007611+0000","last_became_peered":"2024-09-21T04:00:04.007611+0000","last_unstale":"2024-09-21T04:01:59.308037+0000","last_undegraded":"2024-09-21T04:01:59.308037+0000","last_fullsized":"2024-09-21T04:01:59.308037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:02.363722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035983+0000","last_change":"2024-09-21T04:00:01.986011+0000","last_active":"2024-09-21T04:01:31.035983+0000","last_peered":"2024-09-21T04:01:31.035983+0000","last_clean":"2024-09-21T04:01:31.035983+0000","last_became_active":"2024-09-21T04:00:01.985637+0000","last_became_peered":"2024-09-21T04:00:01.985637+0000","last_unstale":"2024-09-21T04:01:31.035983+0000","last_undegraded":"2024-09-21T04:01:31.035983+0000","last_fullsized":"2024-09-21T04:01:31.035983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:36.226063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037322+0000","last_change":"2024-09-21T04:00:11.067798+0000","last_active":"2024-09-21T04:01:31.037322+0000","last_peered":"2024-09-21T04:01:31.037322+0000","last_clean":"2024-09-21T04:01:31.037322+0000","last_became_active":"2024-09-21T04:00:11.067319+0000","last_became_peered":"2024-09-21T04:00:11.067319+0000","last_unstale":"2024-09-21T04:01:31.037322+0000","last_undegraded":"2024-09-21T04:01:31.037322+0000","last_fullsized":"2024-09-21T04:01:31.037322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:37.118986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.297180+0000","last_change":"2024-09-21T04:00:04.003222+0000","last_active":"2024-09-21T04:01:59.297180+0000","last_peered":"2024-09-21T04:01:59.297180+0000","last_clean":"2024-09-21T04:01:59.297180+0000","last_became_active":"2024-09-21T04:00:04.002893+0000","last_became_peered":"2024-09-21T04:00:04.002893+0000","last_unstale":"2024-09-21T04:01:59.297180+0000","last_undegraded":"2024-09-21T04:01:59.297180+0000","last_fullsized":"2024-09-21T04:01:59.297180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:18.806695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042658+0000","last_change":"2024-09-21T04:00:01.985978+0000","last_active":"2024-09-21T04:01:31.042658+0000","last_peered":"2024-09-21T04:01:31.042658+0000","last_clean":"2024-09-21T04:01:31.042658+0000","last_became_active":"2024-09-21T04:00:01.985607+0000","last_became_peered":"2024-09-21T04:00:01.985607+0000","last_unstale":"2024-09-21T04:01:31.042658+0000","last_undegraded":"2024-09-21T04:01:31.042658+0000","last_fullsized":"2024-09-21T04:01:31.042658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:30.113727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035195+0000","last_change":"2024-09-21T04:00:11.069332+0000","last_active":"2024-09-21T04:01:31.035195+0000","last_peered":"2024-09-21T04:01:31.035195+0000","last_clean":"2024-09-21T04:01:31.035195+0000","last_became_active":"2024-09-21T04:00:11.068832+0000","last_became_peered":"2024-09-21T04:00:11.068832+0000","last_unstale":"2024-09-21T04:01:31.035195+0000","last_undegraded":"2024-09-21T04:01:31.035195+0000","last_fullsized":"2024-09-21T04:01:31.035195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:03.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.294037+0000","last_change":"2024-09-21T04:00:04.004234+0000","last_active":"2024-09-21T04:01:59.294037+0000","last_peered":"2024-09-21T04:01:59.294037+0000","last_clean":"2024-09-21T04:01:59.294037+0000","last_became_active":"2024-09-21T04:00:04.003839+0000","last_became_peered":"2024-09-21T04:00:04.003839+0000","last_unstale":"2024-09-21T04:01:59.294037+0000","last_undegraded":"2024-09-21T04:01:59.294037+0000","last_fullsized":"2024-09-21T04:01:59.294037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.971580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'37","reported_seq":291,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:25.371329+0000","last_change":"2024-09-21T04:00:01.990623+0000","last_active":"2024-09-21T04:02:25.371329+0000","last_peered":"2024-09-21T04:02:25.371329+0000","last_clean":"2024-09-21T04:02:25.371329+0000","last_became_active":"2024-09-21T04:00:01.990030+0000","last_became_peered":"2024-09-21T04:00:01.990030+0000","last_unstale":"2024-09-21T04:02:25.371329+0000","last_undegraded":"2024-09-21T04:02:25.371329+0000","last_fullsized":"2024-09-21T04:02:25.371329+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:07.150261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66461,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":171,"num_write":39,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036459+0000","last_change":"2024-09-21T04:00:11.064198+0000","last_active":"2024-09-21T04:01:31.036459+0000","last_peered":"2024-09-21T04:01:31.036459+0000","last_clean":"2024-09-21T04:01:31.036459+0000","last_became_active":"2024-09-21T04:00:11.063519+0000","last_became_peered":"2024-09-21T04:00:11.063519+0000","last_unstale":"2024-09-21T04:01:31.036459+0000","last_undegraded":"2024-09-21T04:01:31.036459+0000","last_fullsized":"2024-09-21T04:01:31.036459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:16.189027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.323627+0000","last_change":"2024-09-21T04:00:04.009685+0000","last_active":"2024-09-21T04:01:59.323627+0000","last_peered":"2024-09-21T04:01:59.323627+0000","last_clean":"2024-09-21T04:01:59.323627+0000","last_became_active":"2024-09-21T04:00:04.009217+0000","last_became_peered":"2024-09-21T04:00:04.009217+0000","last_unstale":"2024-09-21T04:01:59.323627+0000","last_undegraded":"2024-09-21T04:01:59.323627+0000","last_fullsized":"2024-09-21T04:01:59.323627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:31.780399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035447+0000","last_change":"2024-09-21T04:00:02.164467+0000","last_active":"2024-09-21T04:01:31.035447+0000","last_peered":"2024-09-21T04:01:31.035447+0000","last_clean":"2024-09-21T04:01:31.035447+0000","last_became_active":"2024-09-21T04:00:02.164091+0000","last_became_peered":"2024-09-21T04:00:02.164091+0000","last_unstale":"2024-09-21T04:01:31.035447+0000","last_undegraded":"2024-09-21T04:01:31.035447+0000","last_fullsized":"2024-09-21T04:01:31.035447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:12.327745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293696+0000","last_change":"2024-09-21T04:00:11.058828+0000","last_active":"2024-09-21T04:01:31.293696+0000","last_peered":"2024-09-21T04:01:31.293696+0000","last_clean":"2024-09-21T04:01:31.293696+0000","last_became_active":"2024-09-21T04:00:11.058188+0000","last_became_peered":"2024-09-21T04:00:11.058188+0000","last_unstale":"2024-09-21T04:01:31.293696+0000","last_undegraded":"2024-09-21T04:01:31.293696+0000","last_fullsized":"2024-09-21T04:01:31.293696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.767306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.300341+0000","last_change":"2024-09-21T04:00:04.004693+0000","last_active":"2024-09-21T04:01:59.300341+0000","last_peered":"2024-09-21T04:01:59.300341+0000","last_clean":"2024-09-21T04:01:59.300341+0000","last_became_active":"2024-09-21T04:00:04.004357+0000","last_became_peered":"2024-09-21T04:00:04.004357+0000","last_unstale":"2024-09-21T04:01:59.300341+0000","last_undegraded":"2024-09-21T04:01:59.300341+0000","last_fullsized":"2024-09-21T04:01:59.300341+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040115+0000","last_change":"2024-09-21T04:00:01.987319+0000","last_active":"2024-09-21T04:01:31.040115+0000","last_peered":"2024-09-21T04:01:31.040115+0000","last_clean":"2024-09-21T04:01:31.040115+0000","last_became_active":"2024-09-21T04:00:01.986012+0000","last_became_peered":"2024-09-21T04:00:01.986012+0000","last_unstale":"2024-09-21T04:01:31.040115+0000","last_undegraded":"2024-09-21T04:01:31.040115+0000","last_fullsized":"2024-09-21T04:01:31.040115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:03.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038535+0000","last_change":"2024-09-21T04:00:30.139534+0000","last_active":"2024-09-21T04:01:31.038535+0000","last_peered":"2024-09-21T04:01:31.038535+0000","last_clean":"2024-09-21T04:01:31.038535+0000","last_became_active":"2024-09-21T04:00:30.138954+0000","last_became_peered":"2024-09-21T04:00:30.138954+0000","last_unstale":"2024-09-21T04:01:31.038535+0000","last_undegraded":"2024-09-21T04:01:31.038535+0000","last_fullsized":"2024-09-21T04:01:31.038535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:21.368007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.319940+0000","last_change":"2024-09-21T04:00:04.013737+0000","last_active":"2024-09-21T04:01:59.319940+0000","last_peered":"2024-09-21T04:01:59.319940+0000","last_clean":"2024-09-21T04:01:59.319940+0000","last_became_active":"2024-09-21T04:00:04.012901+0000","last_became_peered":"2024-09-21T04:00:04.012901+0000","last_unstale":"2024-09-21T04:01:59.319940+0000","last_undegraded":"2024-09-21T04:01:59.319940+0000","last_fullsized":"2024-09-21T04:01:59.319940+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:50.952778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":247,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:25.370800+0000","last_change":"2024-09-21T04:00:01.987988+0000","last_active":"2024-09-21T04:02:25.370800+0000","last_peered":"2024-09-21T04:02:25.370800+0000","last_clean":"2024-09-21T04:02:25.370800+0000","last_became_active":"2024-09-21T04:00:01.986593+0000","last_became_peered":"2024-09-21T04:00:01.986593+0000","last_unstale":"2024-09-21T04:02:25.370800+0000","last_undegraded":"2024-09-21T04:02:25.370800+0000","last_fullsized":"2024-09-21T04:02:25.370800+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.256609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":202,"num_read_kb":202,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039250+0000","last_change":"2024-09-21T04:00:11.064937+0000","last_active":"2024-09-21T04:01:31.039250+0000","last_peered":"2024-09-21T04:01:31.039250+0000","last_clean":"2024-09-21T04:01:31.039250+0000","last_became_active":"2024-09-21T04:00:11.063809+0000","last_became_peered":"2024-09-21T04:00:11.063809+0000","last_unstale":"2024-09-21T04:01:31.039250+0000","last_undegraded":"2024-09-21T04:01:31.039250+0000","last_fullsized":"2024-09-21T04:01:31.039250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:00.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.107781+0000","last_change":"2024-09-21T04:00:11.068084+0000","last_active":"2024-09-21T04:01:31.107781+0000","last_peered":"2024-09-21T04:01:31.107781+0000","last_clean":"2024-09-21T04:01:31.107781+0000","last_became_active":"2024-09-21T04:00:11.067587+0000","last_became_peered":"2024-09-21T04:00:11.067587+0000","last_unstale":"2024-09-21T04:01:31.107781+0000","last_undegraded":"2024-09-21T04:01:31.107781+0000","last_fullsized":"2024-09-21T04:01:31.107781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:30.849467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296611+0000","last_change":"2024-09-21T04:00:03.997501+0000","last_active":"2024-09-21T04:01:59.296611+0000","last_peered":"2024-09-21T04:01:59.296611+0000","last_clean":"2024-09-21T04:01:59.296611+0000","last_became_active":"2024-09-21T04:00:03.997100+0000","last_became_peered":"2024-09-21T04:00:03.997100+0000","last_unstale":"2024-09-21T04:01:59.296611+0000","last_undegraded":"2024-09-21T04:01:59.296611+0000","last_fullsized":"2024-09-21T04:01:59.296611+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:31.813970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035055+0000","last_change":"2024-09-21T04:00:01.986224+0000","last_active":"2024-09-21T04:01:31.035055+0000","last_peered":"2024-09-21T04:01:31.035055+0000","last_clean":"2024-09-21T04:01:31.035055+0000","last_became_active":"2024-09-21T04:00:01.985845+0000","last_became_peered":"2024-09-21T04:00:01.985845+0000","last_unstale":"2024-09-21T04:01:31.035055+0000","last_undegraded":"2024-09-21T04:01:31.035055+0000","last_fullsized":"2024-09-21T04:01:31.035055+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:38.895288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037519+0000","last_change":"2024-09-21T04:00:11.067705+0000","last_active":"2024-09-21T04:01:31.037519+0000","last_peered":"2024-09-21T04:01:31.037519+0000","last_clean":"2024-09-21T04:01:31.037519+0000","last_became_active":"2024-09-21T04:00:11.067252+0000","last_became_peered":"2024-09-21T04:00:11.067252+0000","last_unstale":"2024-09-21T04:01:31.037519+0000","last_undegraded":"2024-09-21T04:01:31.037519+0000","last_fullsized":"2024-09-21T04:01:31.037519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:47.003323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296425+0000","last_change":"2024-09-21T04:00:03.996067+0000","last_active":"2024-09-21T04:01:59.296425+0000","last_peered":"2024-09-21T04:01:59.296425+0000","last_clean":"2024-09-21T04:01:59.296425+0000","last_became_active":"2024-09-21T04:00:03.995603+0000","last_became_peered":"2024-09-21T04:00:03.995603+0000","last_unstale":"2024-09-21T04:01:59.296425+0000","last_undegraded":"2024-09-21T04:01:59.296425+0000","last_fullsized":"2024-09-21T04:01:59.296425+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:19.348461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032601+0000","last_change":"2024-09-21T04:00:01.985283+0000","last_active":"2024-09-21T04:01:31.032601+0000","last_peered":"2024-09-21T04:01:31.032601+0000","last_clean":"2024-09-21T04:01:31.032601+0000","last_became_active":"2024-09-21T04:00:01.984860+0000","last_became_peered":"2024-09-21T04:00:01.984860+0000","last_unstale":"2024-09-21T04:01:31.032601+0000","last_undegraded":"2024-09-21T04:01:31.032601+0000","last_fullsized":"2024-09-21T04:01:31.032601+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:38.739987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033620+0000","last_change":"2024-09-21T04:00:30.183241+0000","last_active":"2024-09-21T04:01:31.033620+0000","last_peered":"2024-09-21T04:01:31.033620+0000","last_clean":"2024-09-21T04:01:31.033620+0000","last_became_active":"2024-09-21T04:00:30.182788+0000","last_became_peered":"2024-09-21T04:00:30.182788+0000","last_unstale":"2024-09-21T04:01:31.033620+0000","last_undegraded":"2024-09-21T04:01:31.033620+0000","last_fullsized":"2024-09-21T04:01:31.033620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:47.129478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.305063+0000","last_change":"2024-09-21T04:00:04.004526+0000","last_active":"2024-09-21T04:01:59.305063+0000","last_peered":"2024-09-21T04:01:59.305063+0000","last_clean":"2024-09-21T04:01:59.305063+0000","last_became_active":"2024-09-21T04:00:04.004114+0000","last_became_peered":"2024-09-21T04:00:04.004114+0000","last_unstale":"2024-09-21T04:01:59.305063+0000","last_undegraded":"2024-09-21T04:01:59.305063+0000","last_fullsized":"2024-09-21T04:01:59.305063+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:50.212647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042439+0000","last_change":"2024-09-21T04:00:11.067811+0000","last_active":"2024-09-21T04:01:31.042439+0000","last_peered":"2024-09-21T04:01:31.042439+0000","last_clean":"2024-09-21T04:01:31.042439+0000","last_became_active":"2024-09-21T04:00:11.067280+0000","last_became_peered":"2024-09-21T04:00:11.067280+0000","last_unstale":"2024-09-21T04:01:31.042439+0000","last_undegraded":"2024-09-21T04:01:31.042439+0000","last_fullsized":"2024-09-21T04:01:31.042439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:08.152231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:27.374411+0000","last_change":"2024-09-21T04:00:01.987215+0000","last_active":"2024-09-21T04:02:27.374411+0000","last_peered":"2024-09-21T04:02:27.374411+0000","last_clean":"2024-09-21T04:02:27.374411+0000","last_became_active":"2024-09-21T04:00:01.986738+0000","last_became_peered":"2024-09-21T04:00:01.986738+0000","last_unstale":"2024-09-21T04:02:27.374411+0000","last_undegraded":"2024-09-21T04:02:27.374411+0000","last_fullsized":"2024-09-21T04:02:27.374411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:16.204316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.288559+0000","last_change":"2024-09-21T04:00:04.003232+0000","last_active":"2024-09-21T04:01:59.288559+0000","last_peered":"2024-09-21T04:01:59.288559+0000","last_clean":"2024-09-21T04:01:59.288559+0000","last_became_active":"2024-09-21T04:00:04.002865+0000","last_became_peered":"2024-09-21T04:00:04.002865+0000","last_unstale":"2024-09-21T04:01:59.288559+0000","last_undegraded":"2024-09-21T04:01:59.288559+0000","last_fullsized":"2024-09-21T04:01:59.288559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:29.298836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042636+0000","last_change":"2024-09-21T04:00:11.057591+0000","last_active":"2024-09-21T04:01:31.042636+0000","last_peered":"2024-09-21T04:01:31.042636+0000","last_clean":"2024-09-21T04:01:31.042636+0000","last_became_active":"2024-09-21T04:00:11.057092+0000","last_became_peered":"2024-09-21T04:00:11.057092+0000","last_unstale":"2024-09-21T04:01:31.042636+0000","last_undegraded":"2024-09-21T04:01:31.042636+0000","last_fullsized":"2024-09-21T04:01:31.042636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:47.487649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.297302+0000","last_change":"2024-09-21T04:00:04.010297+0000","last_active":"2024-09-21T04:01:59.297302+0000","last_peered":"2024-09-21T04:01:59.297302+0000","last_clean":"2024-09-21T04:01:59.297302+0000","last_became_active":"2024-09-21T04:00:04.009948+0000","last_became_peered":"2024-09-21T04:00:04.009948+0000","last_unstale":"2024-09-21T04:01:59.297302+0000","last_undegraded":"2024-09-21T04:01:59.297302+0000","last_fullsized":"2024-09-21T04:01:59.297302+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:07.927430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.300581+0000","last_change":"2024-09-21T04:00:04.005564+0000","last_active":"2024-09-21T04:01:59.300581+0000","last_peered":"2024-09-21T04:01:59.300581+0000","last_clean":"2024-09-21T04:01:59.300581+0000","last_became_active":"2024-09-21T04:00:04.005119+0000","last_became_peered":"2024-09-21T04:00:04.005119+0000","last_unstale":"2024-09-21T04:01:59.300581+0000","last_undegraded":"2024-09-21T04:01:59.300581+0000","last_fullsized":"2024-09-21T04:01:59.300581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:05.844333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303659+0000","last_change":"2024-09-21T04:00:03.997004+0000","last_active":"2024-09-21T04:01:59.303659+0000","last_peered":"2024-09-21T04:01:59.303659+0000","last_clean":"2024-09-21T04:01:59.303659+0000","last_became_active":"2024-09-21T04:00:03.996570+0000","last_became_peered":"2024-09-21T04:00:03.996570+0000","last_unstale":"2024-09-21T04:01:59.303659+0000","last_undegraded":"2024-09-21T04:01:59.303659+0000","last_fullsized":"2024-09-21T04:01:59.303659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.301278+0000","last_change":"2024-09-21T04:00:04.005794+0000","last_active":"2024-09-21T04:01:59.301278+0000","last_peered":"2024-09-21T04:01:59.301278+0000","last_clean":"2024-09-21T04:01:59.301278+0000","last_became_active":"2024-09-21T04:00:04.005345+0000","last_became_peered":"2024-09-21T04:00:04.005345+0000","last_unstale":"2024-09-21T04:01:59.301278+0000","last_undegraded":"2024-09-21T04:01:59.301278+0000","last_fullsized":"2024-09-21T04:01:59.301278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:20.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304644+0000","last_change":"2024-09-21T04:00:03.992204+0000","last_active":"2024-09-21T04:01:59.304644+0000","last_peered":"2024-09-21T04:01:59.304644+0000","last_clean":"2024-09-21T04:01:59.304644+0000","last_became_active":"2024-09-21T04:00:03.991826+0000","last_became_peered":"2024-09-21T04:00:03.991826+0000","last_unstale":"2024-09-21T04:01:59.304644+0000","last_undegraded":"2024-09-21T04:01:59.304644+0000","last_fullsized":"2024-09-21T04:01:59.304644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.443227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296485+0000","last_change":"2024-09-21T04:00:04.004401+0000","last_active":"2024-09-21T04:01:59.296485+0000","last_peered":"2024-09-21T04:01:59.296485+0000","last_clean":"2024-09-21T04:01:59.296485+0000","last_became_active":"2024-09-21T04:00:04.003983+0000","last_became_peered":"2024-09-21T04:00:04.003983+0000","last_unstale":"2024-09-21T04:01:59.296485+0000","last_undegraded":"2024-09-21T04:01:59.296485+0000","last_fullsized":"2024-09-21T04:01:59.296485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:06.250069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307069+0000","last_change":"2024-09-21T04:00:03.999692+0000","last_active":"2024-09-21T04:01:59.307069+0000","last_peered":"2024-09-21T04:01:59.307069+0000","last_clean":"2024-09-21T04:01:59.307069+0000","last_became_active":"2024-09-21T04:00:03.999282+0000","last_became_peered":"2024-09-21T04:00:03.999282+0000","last_unstale":"2024-09-21T04:01:59.307069+0000","last_undegraded":"2024-09-21T04:01:59.307069+0000","last_fullsized":"2024-09-21T04:01:59.307069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.323350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304667+0000","last_change":"2024-09-21T04:00:04.002947+0000","last_active":"2024-09-21T04:01:59.304667+0000","last_peered":"2024-09-21T04:01:59.304667+0000","last_clean":"2024-09-21T04:01:59.304667+0000","last_became_active":"2024-09-21T04:00:04.002550+0000","last_became_peered":"2024-09-21T04:00:04.002550+0000","last_unstale":"2024-09-21T04:01:59.304667+0000","last_undegraded":"2024-09-21T04:01:59.304667+0000","last_fullsized":"2024-09-21T04:01:59.304667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:17.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303619+0000","last_change":"2024-09-21T04:00:04.009700+0000","last_active":"2024-09-21T04:01:59.303619+0000","last_peered":"2024-09-21T04:01:59.303619+0000","last_clean":"2024-09-21T04:01:59.303619+0000","last_became_active":"2024-09-21T04:00:04.009311+0000","last_became_peered":"2024-09-21T04:00:04.009311+0000","last_unstale":"2024-09-21T04:01:59.303619+0000","last_undegraded":"2024-09-21T04:01:59.303619+0000","last_fullsized":"2024-09-21T04:01:59.303619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.658543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304365+0000","last_change":"2024-09-21T04:00:04.002975+0000","last_active":"2024-09-21T04:01:59.304365+0000","last_peered":"2024-09-21T04:01:59.304365+0000","last_clean":"2024-09-21T04:01:59.304365+0000","last_became_active":"2024-09-21T04:00:04.002608+0000","last_became_peered":"2024-09-21T04:00:04.002608+0000","last_unstale":"2024-09-21T04:01:59.304365+0000","last_undegraded":"2024-09-21T04:01:59.304365+0000","last_fullsized":"2024-09-21T04:01:59.304365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:13.044615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.320397+0000","last_change":"2024-09-21T04:00:04.010797+0000","last_active":"2024-09-21T04:01:59.320397+0000","last_peered":"2024-09-21T04:01:59.320397+0000","last_clean":"2024-09-21T04:01:59.320397+0000","last_became_active":"2024-09-21T04:00:04.010377+0000","last_became_peered":"2024-09-21T04:00:04.010377+0000","last_unstale":"2024-09-21T04:01:59.320397+0000","last_undegraded":"2024-09-21T04:01:59.320397+0000","last_fullsized":"2024-09-21T04:01:59.320397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:58.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304621+0000","last_change":"2024-09-21T04:00:04.002841+0000","last_active":"2024-09-21T04:01:59.304621+0000","last_peered":"2024-09-21T04:01:59.304621+0000","last_clean":"2024-09-21T04:01:59.304621+0000","last_became_active":"2024-09-21T04:00:04.002491+0000","last_became_peered":"2024-09-21T04:00:04.002491+0000","last_unstale":"2024-09-21T04:01:59.304621+0000","last_undegraded":"2024-09-21T04:01:59.304621+0000","last_fullsized":"2024-09-21T04:01:59.304621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:52.816860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307009+0000","last_change":"2024-09-21T04:00:04.007238+0000","last_active":"2024-09-21T04:01:59.307009+0000","last_peered":"2024-09-21T04:01:59.307009+0000","last_clean":"2024-09-21T04:01:59.307009+0000","last_became_active":"2024-09-21T04:00:04.006898+0000","last_became_peered":"2024-09-21T04:00:04.006898+0000","last_unstale":"2024-09-21T04:01:59.307009+0000","last_undegraded":"2024-09-21T04:01:59.307009+0000","last_fullsized":"2024-09-21T04:01:59.307009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.957214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303318+0000","last_change":"2024-09-21T04:00:03.997131+0000","last_active":"2024-09-21T04:01:59.303318+0000","last_peered":"2024-09-21T04:01:59.303318+0000","last_clean":"2024-09-21T04:01:59.303318+0000","last_became_active":"2024-09-21T04:00:03.996711+0000","last_became_peered":"2024-09-21T04:00:03.996711+0000","last_unstale":"2024-09-21T04:01:59.303318+0000","last_undegraded":"2024-09-21T04:01:59.303318+0000","last_fullsized":"2024-09-21T04:01:59.303318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:25.373743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.316389+0000","last_change":"2024-09-21T04:00:04.004067+0000","last_active":"2024-09-21T04:01:59.316389+0000","last_peered":"2024-09-21T04:01:59.316389+0000","last_clean":"2024-09-21T04:01:59.316389+0000","last_became_active":"2024-09-21T04:00:04.003707+0000","last_became_peered":"2024-09-21T04:00:04.003707+0000","last_unstale":"2024-09-21T04:01:59.316389+0000","last_undegraded":"2024-09-21T04:01:59.316389+0000","last_fullsized":"2024-09-21T04:01:59.316389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:24.148194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.309586+0000","last_change":"2024-09-21T04:00:04.000068+0000","last_active":"2024-09-21T04:01:59.309586+0000","last_peered":"2024-09-21T04:01:59.309586+0000","last_clean":"2024-09-21T04:01:59.309586+0000","last_became_active":"2024-09-21T04:00:03.999709+0000","last_became_peered":"2024-09-21T04:00:03.999709+0000","last_unstale":"2024-09-21T04:01:59.309586+0000","last_undegraded":"2024-09-21T04:01:59.309586+0000","last_fullsized":"2024-09-21T04:01:59.309586+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:51.249309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.318942+0000","last_change":"2024-09-21T04:00:04.011884+0000","last_active":"2024-09-21T04:01:59.318942+0000","last_peered":"2024-09-21T04:01:59.318942+0000","last_clean":"2024-09-21T04:01:59.318942+0000","last_became_active":"2024-09-21T04:00:04.011449+0000","last_became_peered":"2024-09-21T04:00:04.011449+0000","last_unstale":"2024-09-21T04:01:59.318942+0000","last_undegraded":"2024-09-21T04:01:59.318942+0000","last_fullsized":"2024-09-21T04:01:59.318942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:46.948465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.300105+0000","last_change":"2024-09-21T04:00:03.992848+0000","last_active":"2024-09-21T04:01:59.300105+0000","last_peered":"2024-09-21T04:01:59.300105+0000","last_clean":"2024-09-21T04:01:59.300105+0000","last_became_active":"2024-09-21T04:00:03.991096+0000","last_became_peered":"2024-09-21T04:00:03.991096+0000","last_unstale":"2024-09-21T04:01:59.300105+0000","last_undegraded":"2024-09-21T04:01:59.300105+0000","last_fullsized":"2024-09-21T04:01:59.300105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:19.599848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.289632+0000","last_change":"2024-09-21T04:00:04.000380+0000","last_active":"2024-09-21T04:01:59.289632+0000","last_peered":"2024-09-21T04:01:59.289632+0000","last_clean":"2024-09-21T04:01:59.289632+0000","last_became_active":"2024-09-21T04:00:03.999918+0000","last_became_peered":"2024-09-21T04:00:03.999918+0000","last_unstale":"2024-09-21T04:01:59.289632+0000","last_undegraded":"2024-09-21T04:01:59.289632+0000","last_fullsized":"2024-09-21T04:01:59.289632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:25.607882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.290064+0000","last_change":"2024-09-21T04:00:30.138053+0000","last_active":"2024-09-21T04:01:59.290064+0000","last_peered":"2024-09-21T04:01:59.290064+0000","last_clean":"2024-09-21T04:01:59.290064+0000","last_became_active":"2024-09-21T04:00:30.137682+0000","last_became_peered":"2024-09-21T04:00:30.137682+0000","last_unstale":"2024-09-21T04:01:59.290064+0000","last_undegraded":"2024-09-21T04:01:59.290064+0000","last_fullsized":"2024-09-21T04:01:59.290064+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.031655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304151+0000","last_change":"2024-09-21T04:00:04.004313+0000","last_active":"2024-09-21T04:01:59.304151+0000","last_peered":"2024-09-21T04:01:59.304151+0000","last_clean":"2024-09-21T04:01:59.304151+0000","last_became_active":"2024-09-21T04:00:04.003128+0000","last_became_peered":"2024-09-21T04:00:04.003128+0000","last_unstale":"2024-09-21T04:01:59.304151+0000","last_undegraded":"2024-09-21T04:01:59.304151+0000","last_fullsized":"2024-09-21T04:01:59.304151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:43.469449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.310272+0000","last_change":"2024-09-21T04:00:04.017136+0000","last_active":"2024-09-21T04:01:59.310272+0000","last_peered":"2024-09-21T04:01:59.310272+0000","last_clean":"2024-09-21T04:01:59.310272+0000","last_became_active":"2024-09-21T04:00:04.016732+0000","last_became_peered":"2024-09-21T04:00:04.016732+0000","last_unstale":"2024-09-21T04:01:59.310272+0000","last_undegraded":"2024-09-21T04:01:59.310272+0000","last_fullsized":"2024-09-21T04:01:59.310272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:04.021078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.294186+0000","last_change":"2024-09-21T04:00:04.012098+0000","last_active":"2024-09-21T04:01:59.294186+0000","last_peered":"2024-09-21T04:01:59.294186+0000","last_clean":"2024-09-21T04:01:59.294186+0000","last_became_active":"2024-09-21T04:00:04.011681+0000","last_became_peered":"2024-09-21T04:00:04.011681+0000","last_unstale":"2024-09-21T04:01:59.294186+0000","last_undegraded":"2024-09-21T04:01:59.294186+0000","last_fullsized":"2024-09-21T04:01:59.294186+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:59.202312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.319952+0000","last_change":"2024-09-21T04:00:04.017056+0000","last_active":"2024-09-21T04:01:59.319952+0000","last_peered":"2024-09-21T04:01:59.319952+0000","last_clean":"2024-09-21T04:01:59.319952+0000","last_became_active":"2024-09-21T04:00:04.015950+0000","last_became_peered":"2024-09-21T04:00:04.015950+0000","last_unstale":"2024-09-21T04:01:59.319952+0000","last_undegraded":"2024-09-21T04:01:59.319952+0000","last_fullsized":"2024-09-21T04:01:59.319952+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:11.267161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.302011+0000","last_change":"2024-09-21T04:00:04.010314+0000","last_active":"2024-09-21T04:01:59.302011+0000","last_peered":"2024-09-21T04:01:59.302011+0000","last_clean":"2024-09-21T04:01:59.302011+0000","last_became_active":"2024-09-21T04:00:04.009917+0000","last_became_peered":"2024-09-21T04:00:04.009917+0000","last_unstale":"2024-09-21T04:01:59.302011+0000","last_undegraded":"2024-09-21T04:01:59.302011+0000","last_fullsized":"2024-09-21T04:01:59.302011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:32.947079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.306006+0000","last_change":"2024-09-21T04:00:04.007104+0000","last_active":"2024-09-21T04:01:59.306006+0000","last_peered":"2024-09-21T04:01:59.306006+0000","last_clean":"2024-09-21T04:01:59.306006+0000","last_became_active":"2024-09-21T04:00:04.006655+0000","last_became_peered":"2024-09-21T04:00:04.006655+0000","last_unstale":"2024-09-21T04:01:59.306006+0000","last_undegraded":"2024-09-21T04:01:59.306006+0000","last_fullsized":"2024-09-21T04:01:59.306006+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.834305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.294831+0000","last_change":"2024-09-21T04:00:04.007842+0000","last_active":"2024-09-21T04:01:59.294831+0000","last_peered":"2024-09-21T04:01:59.294831+0000","last_clean":"2024-09-21T04:01:59.294831+0000","last_became_active":"2024-09-21T04:00:04.007223+0000","last_became_peered":"2024-09-21T04:00:04.007223+0000","last_unstale":"2024-09-21T04:01:59.294831+0000","last_undegraded":"2024-09-21T04:01:59.294831+0000","last_fullsized":"2024-09-21T04:01:59.294831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:01.501836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304561+0000","last_change":"2024-09-21T04:00:03.997390+0000","last_active":"2024-09-21T04:01:59.304561+0000","last_peered":"2024-09-21T04:01:59.304561+0000","last_clean":"2024-09-21T04:01:59.304561+0000","last_became_active":"2024-09-21T04:00:03.997075+0000","last_became_peered":"2024-09-21T04:00:03.997075+0000","last_unstale":"2024-09-21T04:01:59.304561+0000","last_undegraded":"2024-09-21T04:01:59.304561+0000","last_fullsized":"2024-09-21T04:01:59.304561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:50.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.305966+0000","last_change":"2024-09-21T04:00:04.006203+0000","last_active":"2024-09-21T04:01:59.305966+0000","last_peered":"2024-09-21T04:01:59.305966+0000","last_clean":"2024-09-21T04:01:59.305966+0000","last_became_active":"2024-09-21T04:00:04.005150+0000","last_became_peered":"2024-09-21T04:00:04.005150+0000","last_unstale":"2024-09-21T04:01:59.305966+0000","last_undegraded":"2024-09-21T04:01:59.305966+0000","last_fullsized":"2024-09-21T04:01:59.305966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:17.635568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.308714+0000","last_change":"2024-09-21T04:00:04.011843+0000","last_active":"2024-09-21T04:01:59.308714+0000","last_peered":"2024-09-21T04:01:59.308714+0000","last_clean":"2024-09-21T04:01:59.308714+0000","last_became_active":"2024-09-21T04:00:04.011570+0000","last_became_peered":"2024-09-21T04:00:04.011570+0000","last_unstale":"2024-09-21T04:01:59.308714+0000","last_undegraded":"2024-09-21T04:01:59.308714+0000","last_fullsized":"2024-09-21T04:01:59.308714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:59.883217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304006+0000","last_change":"2024-09-21T04:00:04.002111+0000","last_active":"2024-09-21T04:01:59.304006+0000","last_peered":"2024-09-21T04:01:59.304006+0000","last_clean":"2024-09-21T04:01:59.304006+0000","last_became_active":"2024-09-21T04:00:04.001723+0000","last_became_peered":"2024-09-21T04:00:04.001723+0000","last_unstale":"2024-09-21T04:01:59.304006+0000","last_undegraded":"2024-09-21T04:01:59.304006+0000","last_fullsized":"2024-09-21T04:01:59.304006+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:32.595150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.309262+0000","last_change":"2024-09-21T04:00:03.998822+0000","last_active":"2024-09-21T04:01:59.309262+0000","last_peered":"2024-09-21T04:01:59.309262+0000","last_clean":"2024-09-21T04:01:59.309262+0000","last_became_active":"2024-09-21T04:00:03.998445+0000","last_became_peered":"2024-09-21T04:00:03.998445+0000","last_unstale":"2024-09-21T04:01:59.309262+0000","last_undegraded":"2024-09-21T04:01:59.309262+0000","last_fullsized":"2024-09-21T04:01:59.309262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.090570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74369,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1058,"num_read_kb":608,"num_write":254,"num_write_kb":151,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":222153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":219,"ondisk_log_size":219,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282913,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776170,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":493662,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972399,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":1146939,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135924,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":497688,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":493970,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528383,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1092039,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691908,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":489628,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888138,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":1086135,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051662,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":493170,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247892,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":488804,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444121,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":556807,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574942,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1019904,"data_stored":557119,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":490552,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":68433,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T04:02:31.095 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T04:02:31.361 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:31.626 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:31 smithi022 ceph-mon[31015]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:02:31.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:31 smithi060 ceph-mon[33722]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:02:31.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:31 smithi073 ceph-mon[34443]: from='client.15501 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:02:31.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.863+0000 7f02af291640 1 -- 172.21.15.22:0/631154240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02a810de10 msgr2=0x7f02a8110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.863+0000 7f02af291640 1 --2- 172.21.15.22:0/631154240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02a810de10 0x7f02a8110320 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f02a0009ca0 tx=0x7f02a002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.863+0000 7f02af291640 1 -- 172.21.15.22:0/631154240 shutdown_connections 2024-09-21T04:02:31.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.863+0000 7f02af291640 1 --2- 172.21.15.22:0/631154240 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02a810de10 0x7f02a8110320 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.863+0000 7f02af291640 1 --2- 172.21.15.22:0/631154240 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a8105290 0x7f02a810d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.863+0000 7f02af291640 1 --2- 172.21.15.22:0/631154240 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a8104860 0x7f02a8104c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.863+0000 7f02af291640 1 -- 172.21.15.22:0/631154240 >> 172.21.15.22:0/631154240 conn(0x7f02a8079740 msgr2=0x7f02a8079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:31.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.863+0000 7f02af291640 1 -- 172.21.15.22:0/631154240 shutdown_connections 2024-09-21T04:02:31.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.863+0000 7f02af291640 1 -- 172.21.15.22:0/631154240 wait complete. 2024-09-21T04:02:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02af291640 1 Processor -- start 2024-09-21T04:02:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02af291640 1 -- start start 2024-09-21T04:02:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02af291640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02a8104860 0x7f02a819a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02af291640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a8105290 0x7f02a819a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02af291640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a810de10 0x7f02a819fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02af291640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f02a81139b0 con 0x7f02a8104860 2024-09-21T04:02:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02af291640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02a8113830 con 0x7f02a8105290 2024-09-21T04:02:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02af291640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f02a8113b30 con 0x7f02a810de10 2024-09-21T04:02:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ad02d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02a8104860 0x7f02a819a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ad02d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02a8104860 0x7f02a819a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34040/0 (socket says 172.21.15.22:34040) 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ad02d640 1 -- 172.21.15.22:0/625963175 learned_addr learned my addr 172.21.15.22:0/625963175 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ad82e640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a810de10 0x7f02a819fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ac82c640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a8105290 0x7f02a819a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ad02d640 1 -- 172.21.15.22:0/625963175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a810de10 msgr2=0x7f02a819fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ad02d640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a810de10 0x7f02a819fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ad02d640 1 -- 172.21.15.22:0/625963175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a8105290 msgr2=0x7f02a819a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ad02d640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a8105290 0x7f02a819a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ad02d640 1 -- 172.21.15.22:0/625963175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02a81a02d0 con 0x7f02a8104860 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.864+0000 7f02ac82c640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a8105290 0x7f02a819a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.865+0000 7f02ad02d640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02a8104860 0x7f02a819a360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f02a400d950 tx=0x7f02a400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.865+0000 7f029e7fc640 1 -- 172.21.15.22:0/625963175 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a4017070 con 0x7f02a8104860 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.865+0000 7f029e7fc640 1 -- 172.21.15.22:0/625963175 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f02a4009c30 con 0x7f02a8104860 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.865+0000 7f02af291640 1 -- 172.21.15.22:0/625963175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02a81a05c0 con 0x7f02a8104860 2024-09-21T04:02:31.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.865+0000 7f029e7fc640 1 -- 172.21.15.22:0/625963175 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02a400f620 con 0x7f02a8104860 2024-09-21T04:02:31.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.865+0000 7f02af291640 1 -- 172.21.15.22:0/625963175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02a81a6d20 con 0x7f02a8104860 2024-09-21T04:02:31.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.866+0000 7f02af291640 1 -- 172.21.15.22:0/625963175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a806c1e0 con 0x7f02a8104860 2024-09-21T04:02:31.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.868+0000 7f029e7fc640 1 -- 172.21.15.22:0/625963175 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f02a401a070 con 0x7f02a8104860 2024-09-21T04:02:31.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.869+0000 7f029e7fc640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f02940b6510 0x7f02940b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:31.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.869+0000 7f02ac82c640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f02940b6510 0x7f02940b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:31.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.869+0000 7f029e7fc640 1 -- 172.21.15.22:0/625963175 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f02a40e7200 con 0x7f02a8104860 2024-09-21T04:02:31.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.869+0000 7f02ac82c640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f02940b6510 0x7f02940b8a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f02a810f930 tx=0x7f0298005e50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:31.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:31.872+0000 7f029e7fc640 1 -- 172.21.15.22:0/625963175 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02a4009de0 con 0x7f02a8104860 2024-09-21T04:02:32.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.058+0000 7f02af291640 1 -- 172.21.15.22:0/625963175 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f02a8100c90 con 0x7f02940b6510 2024-09-21T04:02:32.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.064+0000 7f029e7fc640 1 -- 172.21.15.22:0/625963175 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340793 (secure 0 0 0) 0x7f02a8100c90 con 0x7f02940b6510 2024-09-21T04:02:32.070 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:32.071 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-21T04:02:32.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 -- 172.21.15.22:0/625963175 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f02940b6510 msgr2=0x7f02940b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:32.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f02940b6510 0x7f02940b8a20 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f02a810f930 tx=0x7f0298005e50 comp rx=0 tx=0).stop 2024-09-21T04:02:32.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 -- 172.21.15.22:0/625963175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02a8104860 msgr2=0x7f02a819a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:32.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02a8104860 0x7f02a819a360 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f02a400d950 tx=0x7f02a400de10 comp rx=0 tx=0).stop 2024-09-21T04:02:32.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 -- 172.21.15.22:0/625963175 shutdown_connections 2024-09-21T04:02:32.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f02940b6510 0x7f02940b8a20 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:32.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02a810de10 0x7f02a819fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:32.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02a8105290 0x7f02a819a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:32.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 --2- 172.21.15.22:0/625963175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f02a8104860 0x7f02a819a360 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:32.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 -- 172.21.15.22:0/625963175 >> 172.21.15.22:0/625963175 conn(0x7f02a8079740 msgr2=0x7f02a80ff570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:32.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 -- 172.21.15.22:0/625963175 shutdown_connections 2024-09-21T04:02:32.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:32.068+0000 7f02af291640 1 -- 172.21.15.22:0/625963175 wait complete. 2024-09-21T04:02:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:32 smithi060 ceph-mon[33722]: pgmap v376: 129 pgs: 129 active+clean; 650 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T04:02:32.762 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:32 smithi022 ceph-mon[31015]: pgmap v376: 129 pgs: 129 active+clean; 650 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T04:02:32.789 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2024-09-21T04:02:30.955061+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665925,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1171,"num_read_kb":699,"num_write":392,"num_write_kb":2313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951840,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":823,"ondisk_log_size":823,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390016,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551808,"statfs":{"total":1151940427776,"available":1151541051392,"internally_reserved":0,"allocated":11927552,"data_stored":7890806,"data_compressed":496992,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1908,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":139,"num_read_kb":79,"num_write":15,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003637"},"pg_stats":[{"pgid":"2.1f","version":"85'15","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:29.376952+0000","last_change":"2024-09-21T04:00:01.985519+0000","last_active":"2024-09-21T04:02:29.376952+0000","last_peered":"2024-09-21T04:02:29.376952+0000","last_clean":"2024-09-21T04:02:29.376952+0000","last_became_active":"2024-09-21T04:00:01.984904+0000","last_became_peered":"2024-09-21T04:00:01.984904+0000","last_unstale":"2024-09-21T04:02:29.376952+0000","last_undegraded":"2024-09-21T04:02:29.376952+0000","last_fullsized":"2024-09-21T04:02:29.376952+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:20.596034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304394+0000","last_change":"2024-09-21T04:00:04.007864+0000","last_active":"2024-09-21T04:01:59.304394+0000","last_peered":"2024-09-21T04:01:59.304394+0000","last_clean":"2024-09-21T04:01:59.304394+0000","last_became_active":"2024-09-21T04:00:04.007470+0000","last_became_peered":"2024-09-21T04:00:04.007470+0000","last_unstale":"2024-09-21T04:01:59.304394+0000","last_undegraded":"2024-09-21T04:01:59.304394+0000","last_fullsized":"2024-09-21T04:01:59.304394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:11.452170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042202+0000","last_change":"2024-09-21T04:00:11.068152+0000","last_active":"2024-09-21T04:01:31.042202+0000","last_peered":"2024-09-21T04:01:31.042202+0000","last_clean":"2024-09-21T04:01:31.042202+0000","last_became_active":"2024-09-21T04:00:11.067647+0000","last_became_peered":"2024-09-21T04:00:11.067647+0000","last_unstale":"2024-09-21T04:01:31.042202+0000","last_undegraded":"2024-09-21T04:01:31.042202+0000","last_fullsized":"2024-09-21T04:01:31.042202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:35.652827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039714+0000","last_change":"2024-09-21T04:00:02.162198+0000","last_active":"2024-09-21T04:01:31.039714+0000","last_peered":"2024-09-21T04:01:31.039714+0000","last_clean":"2024-09-21T04:01:31.039714+0000","last_became_active":"2024-09-21T04:00:02.161840+0000","last_became_peered":"2024-09-21T04:00:02.161840+0000","last_unstale":"2024-09-21T04:01:31.039714+0000","last_undegraded":"2024-09-21T04:01:31.039714+0000","last_fullsized":"2024-09-21T04:01:31.039714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:31.353273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.308677+0000","last_change":"2024-09-21T04:00:03.997274+0000","last_active":"2024-09-21T04:01:59.308677+0000","last_peered":"2024-09-21T04:01:59.308677+0000","last_clean":"2024-09-21T04:01:59.308677+0000","last_became_active":"2024-09-21T04:00:03.996917+0000","last_became_peered":"2024-09-21T04:00:03.996917+0000","last_unstale":"2024-09-21T04:01:59.308677+0000","last_undegraded":"2024-09-21T04:01:59.308677+0000","last_fullsized":"2024-09-21T04:01:59.308677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:05.700703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293556+0000","last_change":"2024-09-21T04:00:11.058687+0000","last_active":"2024-09-21T04:01:31.293556+0000","last_peered":"2024-09-21T04:01:31.293556+0000","last_clean":"2024-09-21T04:01:31.293556+0000","last_became_active":"2024-09-21T04:00:11.058099+0000","last_became_peered":"2024-09-21T04:00:11.058099+0000","last_unstale":"2024-09-21T04:01:31.293556+0000","last_undegraded":"2024-09-21T04:01:31.293556+0000","last_fullsized":"2024-09-21T04:01:31.293556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:50.332295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.307558+0000","last_change":"2024-09-21T04:01:31.307478+0000","last_active":"2024-09-21T04:01:31.307558+0000","last_peered":"2024-09-21T04:01:31.307558+0000","last_clean":"2024-09-21T04:01:31.307558+0000","last_became_active":"2024-09-21T04:01:31.296040+0000","last_became_peered":"2024-09-21T04:01:31.296040+0000","last_unstale":"2024-09-21T04:01:31.307558+0000","last_undegraded":"2024-09-21T04:01:31.307558+0000","last_fullsized":"2024-09-21T04:01:31.307558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:16.547730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.322752+0000","last_change":"2024-09-21T04:00:04.012120+0000","last_active":"2024-09-21T04:01:59.322752+0000","last_peered":"2024-09-21T04:01:59.322752+0000","last_clean":"2024-09-21T04:01:59.322752+0000","last_became_active":"2024-09-21T04:00:04.011648+0000","last_became_peered":"2024-09-21T04:00:04.011648+0000","last_unstale":"2024-09-21T04:01:59.322752+0000","last_undegraded":"2024-09-21T04:01:59.322752+0000","last_fullsized":"2024-09-21T04:01:59.322752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.716845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293922+0000","last_change":"2024-09-21T04:00:11.059509+0000","last_active":"2024-09-21T04:01:31.293922+0000","last_peered":"2024-09-21T04:01:31.293922+0000","last_clean":"2024-09-21T04:01:31.293922+0000","last_became_active":"2024-09-21T04:00:11.058674+0000","last_became_peered":"2024-09-21T04:00:11.058674+0000","last_unstale":"2024-09-21T04:01:31.293922+0000","last_undegraded":"2024-09-21T04:01:31.293922+0000","last_fullsized":"2024-09-21T04:01:31.293922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:13.078117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039158+0000","last_change":"2024-09-21T04:00:01.987624+0000","last_active":"2024-09-21T04:01:31.039158+0000","last_peered":"2024-09-21T04:01:31.039158+0000","last_clean":"2024-09-21T04:01:31.039158+0000","last_became_active":"2024-09-21T04:00:01.987212+0000","last_became_peered":"2024-09-21T04:00:01.987212+0000","last_unstale":"2024-09-21T04:01:31.039158+0000","last_undegraded":"2024-09-21T04:01:31.039158+0000","last_fullsized":"2024-09-21T04:01:31.039158+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:18.554590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.310276+0000","last_change":"2024-09-21T04:00:04.017507+0000","last_active":"2024-09-21T04:01:59.310276+0000","last_peered":"2024-09-21T04:01:59.310276+0000","last_clean":"2024-09-21T04:01:59.310276+0000","last_became_active":"2024-09-21T04:00:04.017120+0000","last_became_peered":"2024-09-21T04:00:04.017120+0000","last_unstale":"2024-09-21T04:01:59.310276+0000","last_undegraded":"2024-09-21T04:01:59.310276+0000","last_fullsized":"2024-09-21T04:01:59.310276+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:19.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293558+0000","last_change":"2024-09-21T04:00:11.055047+0000","last_active":"2024-09-21T04:01:31.293558+0000","last_peered":"2024-09-21T04:01:31.293558+0000","last_clean":"2024-09-21T04:01:31.293558+0000","last_became_active":"2024-09-21T04:00:11.054504+0000","last_became_peered":"2024-09-21T04:00:11.054504+0000","last_unstale":"2024-09-21T04:01:31.293558+0000","last_undegraded":"2024-09-21T04:01:31.293558+0000","last_fullsized":"2024-09-21T04:01:31.293558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.963011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.312681+0000","last_change":"2024-09-21T04:00:04.012633+0000","last_active":"2024-09-21T04:01:59.312681+0000","last_peered":"2024-09-21T04:01:59.312681+0000","last_clean":"2024-09-21T04:01:59.312681+0000","last_became_active":"2024-09-21T04:00:04.012246+0000","last_became_peered":"2024-09-21T04:00:04.012246+0000","last_unstale":"2024-09-21T04:01:59.312681+0000","last_undegraded":"2024-09-21T04:01:59.312681+0000","last_fullsized":"2024-09-21T04:01:59.312681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:58.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039221+0000","last_change":"2024-09-21T04:00:30.144195+0000","last_active":"2024-09-21T04:01:31.039221+0000","last_peered":"2024-09-21T04:01:31.039221+0000","last_clean":"2024-09-21T04:01:31.039221+0000","last_became_active":"2024-09-21T04:00:30.140690+0000","last_became_peered":"2024-09-21T04:00:30.140690+0000","last_unstale":"2024-09-21T04:01:31.039221+0000","last_undegraded":"2024-09-21T04:01:31.039221+0000","last_fullsized":"2024-09-21T04:01:31.039221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:42.686216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295148+0000","last_change":"2024-09-21T04:00:11.333935+0000","last_active":"2024-09-21T04:01:31.295148+0000","last_peered":"2024-09-21T04:01:31.295148+0000","last_clean":"2024-09-21T04:01:31.295148+0000","last_became_active":"2024-09-21T04:00:11.333336+0000","last_became_peered":"2024-09-21T04:00:11.333336+0000","last_unstale":"2024-09-21T04:01:31.295148+0000","last_undegraded":"2024-09-21T04:01:31.295148+0000","last_fullsized":"2024-09-21T04:01:31.295148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:23.890845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304106+0000","last_change":"2024-09-21T04:00:04.002579+0000","last_active":"2024-09-21T04:01:59.304106+0000","last_peered":"2024-09-21T04:01:59.304106+0000","last_clean":"2024-09-21T04:01:59.304106+0000","last_became_active":"2024-09-21T04:00:04.001926+0000","last_became_peered":"2024-09-21T04:00:04.001926+0000","last_unstale":"2024-09-21T04:01:59.304106+0000","last_undegraded":"2024-09-21T04:01:59.304106+0000","last_fullsized":"2024-09-21T04:01:59.304106+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:11.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'4","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:14.855429+0000","last_change":"2024-09-21T04:00:01.983276+0000","last_active":"2024-09-21T04:02:14.855429+0000","last_peered":"2024-09-21T04:02:14.855429+0000","last_clean":"2024-09-21T04:02:14.855429+0000","last_became_active":"2024-09-21T04:00:01.982828+0000","last_became_peered":"2024-09-21T04:00:01.982828+0000","last_unstale":"2024-09-21T04:02:14.855429+0000","last_undegraded":"2024-09-21T04:02:14.855429+0000","last_fullsized":"2024-09-21T04:02:14.855429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:52.266947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293768+0000","last_change":"2024-09-21T04:00:11.067529+0000","last_active":"2024-09-21T04:01:31.293768+0000","last_peered":"2024-09-21T04:01:31.293768+0000","last_clean":"2024-09-21T04:01:31.293768+0000","last_became_active":"2024-09-21T04:00:11.066975+0000","last_became_peered":"2024-09-21T04:00:11.066975+0000","last_unstale":"2024-09-21T04:01:31.293768+0000","last_undegraded":"2024-09-21T04:01:31.293768+0000","last_fullsized":"2024-09-21T04:01:31.293768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:09.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.302144+0000","last_change":"2024-09-21T04:00:04.005822+0000","last_active":"2024-09-21T04:01:59.302144+0000","last_peered":"2024-09-21T04:01:59.302144+0000","last_clean":"2024-09-21T04:01:59.302144+0000","last_became_active":"2024-09-21T04:00:04.005468+0000","last_became_peered":"2024-09-21T04:00:04.005468+0000","last_unstale":"2024-09-21T04:01:59.302144+0000","last_undegraded":"2024-09-21T04:01:59.302144+0000","last_fullsized":"2024-09-21T04:01:59.302144+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:08.863103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039911+0000","last_change":"2024-09-21T04:00:01.984489+0000","last_active":"2024-09-21T04:01:31.039911+0000","last_peered":"2024-09-21T04:01:31.039911+0000","last_clean":"2024-09-21T04:01:31.039911+0000","last_became_active":"2024-09-21T04:00:01.983873+0000","last_became_peered":"2024-09-21T04:00:01.983873+0000","last_unstale":"2024-09-21T04:01:31.039911+0000","last_undegraded":"2024-09-21T04:01:31.039911+0000","last_fullsized":"2024-09-21T04:01:31.039911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:22.717693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036859+0000","last_change":"2024-09-21T04:00:11.069148+0000","last_active":"2024-09-21T04:01:31.036859+0000","last_peered":"2024-09-21T04:01:31.036859+0000","last_clean":"2024-09-21T04:01:31.036859+0000","last_became_active":"2024-09-21T04:00:11.068723+0000","last_became_peered":"2024-09-21T04:00:11.068723+0000","last_unstale":"2024-09-21T04:01:31.036859+0000","last_undegraded":"2024-09-21T04:01:31.036859+0000","last_fullsized":"2024-09-21T04:01:31.036859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:42.822525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.291688+0000","last_change":"2024-09-21T04:00:04.000526+0000","last_active":"2024-09-21T04:01:59.291688+0000","last_peered":"2024-09-21T04:01:59.291688+0000","last_clean":"2024-09-21T04:01:59.291688+0000","last_became_active":"2024-09-21T04:00:04.000137+0000","last_became_peered":"2024-09-21T04:00:04.000137+0000","last_unstale":"2024-09-21T04:01:59.291688+0000","last_undegraded":"2024-09-21T04:01:59.291688+0000","last_fullsized":"2024-09-21T04:01:59.291688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:12.055499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303435+0000","last_change":"2024-09-21T04:00:02.162359+0000","last_active":"2024-09-21T04:01:31.303435+0000","last_peered":"2024-09-21T04:01:31.303435+0000","last_clean":"2024-09-21T04:01:31.303435+0000","last_became_active":"2024-09-21T04:00:02.161946+0000","last_became_peered":"2024-09-21T04:00:02.161946+0000","last_unstale":"2024-09-21T04:01:31.303435+0000","last_undegraded":"2024-09-21T04:01:31.303435+0000","last_fullsized":"2024-09-21T04:01:31.303435+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:18.841278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294781+0000","last_change":"2024-09-21T04:00:30.138669+0000","last_active":"2024-09-21T04:01:31.294781+0000","last_peered":"2024-09-21T04:01:31.294781+0000","last_clean":"2024-09-21T04:01:31.294781+0000","last_became_active":"2024-09-21T04:00:30.137548+0000","last_became_peered":"2024-09-21T04:00:30.137548+0000","last_unstale":"2024-09-21T04:01:31.294781+0000","last_undegraded":"2024-09-21T04:01:31.294781+0000","last_fullsized":"2024-09-21T04:01:31.294781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:56.867964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304813+0000","last_change":"2024-09-21T04:00:30.396672+0000","last_active":"2024-09-21T04:01:59.304813+0000","last_peered":"2024-09-21T04:01:59.304813+0000","last_clean":"2024-09-21T04:01:59.304813+0000","last_became_active":"2024-09-21T04:00:30.396066+0000","last_became_peered":"2024-09-21T04:00:30.396066+0000","last_unstale":"2024-09-21T04:01:59.304813+0000","last_undegraded":"2024-09-21T04:01:59.304813+0000","last_fullsized":"2024-09-21T04:01:59.304813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:01.582768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295111+0000","last_change":"2024-09-21T04:00:02.213481+0000","last_active":"2024-09-21T04:01:31.295111+0000","last_peered":"2024-09-21T04:01:31.295111+0000","last_clean":"2024-09-21T04:01:31.295111+0000","last_became_active":"2024-09-21T04:00:02.213093+0000","last_became_peered":"2024-09-21T04:00:02.213093+0000","last_unstale":"2024-09-21T04:01:31.295111+0000","last_undegraded":"2024-09-21T04:01:31.295111+0000","last_fullsized":"2024-09-21T04:01:31.295111+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:20.700406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042307+0000","last_change":"2024-09-21T04:00:11.058780+0000","last_active":"2024-09-21T04:01:31.042307+0000","last_peered":"2024-09-21T04:01:31.042307+0000","last_clean":"2024-09-21T04:01:31.042307+0000","last_became_active":"2024-09-21T04:00:11.058309+0000","last_became_peered":"2024-09-21T04:00:11.058309+0000","last_unstale":"2024-09-21T04:01:31.042307+0000","last_undegraded":"2024-09-21T04:01:31.042307+0000","last_fullsized":"2024-09-21T04:01:31.042307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:31.134604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.305244+0000","last_change":"2024-09-21T04:00:04.005954+0000","last_active":"2024-09-21T04:01:59.305244+0000","last_peered":"2024-09-21T04:01:59.305244+0000","last_clean":"2024-09-21T04:01:59.305244+0000","last_became_active":"2024-09-21T04:00:04.005609+0000","last_became_peered":"2024-09-21T04:00:04.005609+0000","last_unstale":"2024-09-21T04:01:59.305244+0000","last_undegraded":"2024-09-21T04:01:59.305244+0000","last_fullsized":"2024-09-21T04:01:59.305244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:52.596627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'16","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:15.667745+0000","last_change":"2024-09-21T04:01:31.047655+0000","last_active":"2024-09-21T04:02:15.667745+0000","last_peered":"2024-09-21T04:02:15.667745+0000","last_clean":"2024-09-21T04:02:15.667745+0000","last_became_active":"2024-09-21T04:01:31.040521+0000","last_became_peered":"2024-09-21T04:01:31.040521+0000","last_unstale":"2024-09-21T04:02:15.667745+0000","last_undegraded":"2024-09-21T04:02:15.667745+0000","last_fullsized":"2024-09-21T04:02:15.667745+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:32.316804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039138+0000","last_change":"2024-09-21T04:00:11.334127+0000","last_active":"2024-09-21T04:01:31.039138+0000","last_peered":"2024-09-21T04:01:31.039138+0000","last_clean":"2024-09-21T04:01:31.039138+0000","last_became_active":"2024-09-21T04:00:11.333601+0000","last_became_peered":"2024-09-21T04:00:11.333601+0000","last_unstale":"2024-09-21T04:01:31.039138+0000","last_undegraded":"2024-09-21T04:01:31.039138+0000","last_fullsized":"2024-09-21T04:01:31.039138+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.114185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.285432+0000","last_change":"2024-09-21T04:00:03.988967+0000","last_active":"2024-09-21T04:01:59.285432+0000","last_peered":"2024-09-21T04:01:59.285432+0000","last_clean":"2024-09-21T04:01:59.285432+0000","last_became_active":"2024-09-21T04:00:03.988617+0000","last_became_peered":"2024-09-21T04:00:03.988617+0000","last_unstale":"2024-09-21T04:01:59.285432+0000","last_undegraded":"2024-09-21T04:01:59.285432+0000","last_fullsized":"2024-09-21T04:01:59.285432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040198+0000","last_change":"2024-09-21T04:00:02.162698+0000","last_active":"2024-09-21T04:01:31.040198+0000","last_peered":"2024-09-21T04:01:31.040198+0000","last_clean":"2024-09-21T04:01:31.040198+0000","last_became_active":"2024-09-21T04:00:02.162254+0000","last_became_peered":"2024-09-21T04:00:02.162254+0000","last_unstale":"2024-09-21T04:01:31.040198+0000","last_undegraded":"2024-09-21T04:01:31.040198+0000","last_fullsized":"2024-09-21T04:01:31.040198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:07.409718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037136+0000","last_change":"2024-09-21T04:00:11.057825+0000","last_active":"2024-09-21T04:01:31.037136+0000","last_peered":"2024-09-21T04:01:31.037136+0000","last_clean":"2024-09-21T04:01:31.037136+0000","last_became_active":"2024-09-21T04:00:11.057308+0000","last_became_peered":"2024-09-21T04:00:11.057308+0000","last_unstale":"2024-09-21T04:01:31.037136+0000","last_undegraded":"2024-09-21T04:01:31.037136+0000","last_fullsized":"2024-09-21T04:01:31.037136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.925835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296292+0000","last_change":"2024-09-21T04:00:03.996631+0000","last_active":"2024-09-21T04:01:59.296292+0000","last_peered":"2024-09-21T04:01:59.296292+0000","last_clean":"2024-09-21T04:01:59.296292+0000","last_became_active":"2024-09-21T04:00:03.996264+0000","last_became_peered":"2024-09-21T04:00:03.996264+0000","last_unstale":"2024-09-21T04:01:59.296292+0000","last_undegraded":"2024-09-21T04:01:59.296292+0000","last_fullsized":"2024-09-21T04:01:59.296292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:27.270843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036962+0000","last_change":"2024-09-21T04:00:02.162450+0000","last_active":"2024-09-21T04:01:31.036962+0000","last_peered":"2024-09-21T04:01:31.036962+0000","last_clean":"2024-09-21T04:01:31.036962+0000","last_became_active":"2024-09-21T04:00:02.161991+0000","last_became_peered":"2024-09-21T04:00:02.161991+0000","last_unstale":"2024-09-21T04:01:31.036962+0000","last_undegraded":"2024-09-21T04:01:31.036962+0000","last_fullsized":"2024-09-21T04:01:31.036962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:09.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039345+0000","last_change":"2024-09-21T04:00:11.333873+0000","last_active":"2024-09-21T04:01:31.039345+0000","last_peered":"2024-09-21T04:01:31.039345+0000","last_clean":"2024-09-21T04:01:31.039345+0000","last_became_active":"2024-09-21T04:00:11.333368+0000","last_became_peered":"2024-09-21T04:00:11.333368+0000","last_unstale":"2024-09-21T04:01:31.039345+0000","last_undegraded":"2024-09-21T04:01:31.039345+0000","last_fullsized":"2024-09-21T04:01:31.039345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:53.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296904+0000","last_change":"2024-09-21T04:00:30.138320+0000","last_active":"2024-09-21T04:01:59.296904+0000","last_peered":"2024-09-21T04:01:59.296904+0000","last_clean":"2024-09-21T04:01:59.296904+0000","last_became_active":"2024-09-21T04:00:30.137866+0000","last_became_peered":"2024-09-21T04:00:30.137866+0000","last_unstale":"2024-09-21T04:01:59.296904+0000","last_undegraded":"2024-09-21T04:01:59.296904+0000","last_fullsized":"2024-09-21T04:01:59.296904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:39.992746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'8","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:27.374403+0000","last_change":"2024-09-21T04:00:01.986355+0000","last_active":"2024-09-21T04:02:27.374403+0000","last_peered":"2024-09-21T04:02:27.374403+0000","last_clean":"2024-09-21T04:02:27.374403+0000","last_became_active":"2024-09-21T04:00:01.985960+0000","last_became_peered":"2024-09-21T04:00:01.985960+0000","last_unstale":"2024-09-21T04:02:27.374403+0000","last_undegraded":"2024-09-21T04:02:27.374403+0000","last_fullsized":"2024-09-21T04:02:27.374403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:08.417218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1597,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033004+0000","last_change":"2024-09-21T04:00:11.066363+0000","last_active":"2024-09-21T04:01:31.033004+0000","last_peered":"2024-09-21T04:01:31.033004+0000","last_clean":"2024-09-21T04:01:31.033004+0000","last_became_active":"2024-09-21T04:00:11.065923+0000","last_became_peered":"2024-09-21T04:00:11.065923+0000","last_unstale":"2024-09-21T04:01:31.033004+0000","last_undegraded":"2024-09-21T04:01:31.033004+0000","last_fullsized":"2024-09-21T04:01:31.033004+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:49.720377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304674+0000","last_change":"2024-09-21T04:00:04.010139+0000","last_active":"2024-09-21T04:01:59.304674+0000","last_peered":"2024-09-21T04:01:59.304674+0000","last_clean":"2024-09-21T04:01:59.304674+0000","last_became_active":"2024-09-21T04:00:04.009764+0000","last_became_peered":"2024-09-21T04:00:04.009764+0000","last_unstale":"2024-09-21T04:01:59.304674+0000","last_undegraded":"2024-09-21T04:01:59.304674+0000","last_fullsized":"2024-09-21T04:01:59.304674+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:08.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:28.376372+0000","last_change":"2024-09-21T04:00:02.162297+0000","last_active":"2024-09-21T04:02:28.376372+0000","last_peered":"2024-09-21T04:02:28.376372+0000","last_clean":"2024-09-21T04:02:28.376372+0000","last_became_active":"2024-09-21T04:00:02.161884+0000","last_became_peered":"2024-09-21T04:00:02.161884+0000","last_unstale":"2024-09-21T04:02:28.376372+0000","last_undegraded":"2024-09-21T04:02:28.376372+0000","last_fullsized":"2024-09-21T04:02:28.376372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:21.108188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033190+0000","last_change":"2024-09-21T04:00:11.335000+0000","last_active":"2024-09-21T04:01:31.033190+0000","last_peered":"2024-09-21T04:01:31.033190+0000","last_clean":"2024-09-21T04:01:31.033190+0000","last_became_active":"2024-09-21T04:00:11.334529+0000","last_became_peered":"2024-09-21T04:00:11.334529+0000","last_unstale":"2024-09-21T04:01:31.033190+0000","last_undegraded":"2024-09-21T04:01:31.033190+0000","last_fullsized":"2024-09-21T04:01:31.033190+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:54.148883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.306427+0000","last_change":"2024-09-21T04:00:03.988089+0000","last_active":"2024-09-21T04:01:59.306427+0000","last_peered":"2024-09-21T04:01:59.306427+0000","last_clean":"2024-09-21T04:01:59.306427+0000","last_became_active":"2024-09-21T04:00:03.987641+0000","last_became_peered":"2024-09-21T04:00:03.987641+0000","last_unstale":"2024-09-21T04:01:59.306427+0000","last_undegraded":"2024-09-21T04:01:59.306427+0000","last_fullsized":"2024-09-21T04:01:59.306427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:46.249510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.047436+0000","last_change":"2024-09-21T04:01:31.046744+0000","last_active":"2024-09-21T04:01:31.047436+0000","last_peered":"2024-09-21T04:01:31.047436+0000","last_clean":"2024-09-21T04:01:31.047436+0000","last_became_active":"2024-09-21T04:01:31.041093+0000","last_became_peered":"2024-09-21T04:01:31.041093+0000","last_unstale":"2024-09-21T04:01:31.047436+0000","last_undegraded":"2024-09-21T04:01:31.047436+0000","last_fullsized":"2024-09-21T04:01:31.047436+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:14.159990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,8],"acting":[11,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035140+0000","last_change":"2024-09-21T04:00:30.349715+0000","last_active":"2024-09-21T04:01:31.035140+0000","last_peered":"2024-09-21T04:01:31.035140+0000","last_clean":"2024-09-21T04:01:31.035140+0000","last_became_active":"2024-09-21T04:00:30.349233+0000","last_became_peered":"2024-09-21T04:00:30.349233+0000","last_unstale":"2024-09-21T04:01:31.035140+0000","last_undegraded":"2024-09-21T04:01:31.035140+0000","last_fullsized":"2024-09-21T04:01:31.035140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.933082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303096+0000","last_change":"2024-09-21T04:00:04.005025+0000","last_active":"2024-09-21T04:01:59.303096+0000","last_peered":"2024-09-21T04:01:59.303096+0000","last_clean":"2024-09-21T04:01:59.303096+0000","last_became_active":"2024-09-21T04:00:04.004697+0000","last_became_peered":"2024-09-21T04:00:04.004697+0000","last_unstale":"2024-09-21T04:01:59.303096+0000","last_undegraded":"2024-09-21T04:01:59.303096+0000","last_fullsized":"2024-09-21T04:01:59.303096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:30.663231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295076+0000","last_change":"2024-09-21T04:00:01.987438+0000","last_active":"2024-09-21T04:01:31.295076+0000","last_peered":"2024-09-21T04:01:31.295076+0000","last_clean":"2024-09-21T04:01:31.295076+0000","last_became_active":"2024-09-21T04:00:01.986995+0000","last_became_peered":"2024-09-21T04:00:01.986995+0000","last_unstale":"2024-09-21T04:01:31.295076+0000","last_undegraded":"2024-09-21T04:01:31.295076+0000","last_fullsized":"2024-09-21T04:01:31.295076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:16.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040093+0000","last_change":"2024-09-21T03:58:47.597000+0000","last_active":"2024-09-21T04:01:31.040093+0000","last_peered":"2024-09-21T04:01:31.040093+0000","last_clean":"2024-09-21T04:01:31.040093+0000","last_became_active":"2024-09-21T03:58:47.590826+0000","last_became_peered":"2024-09-21T03:58:47.590826+0000","last_unstale":"2024-09-21T04:01:31.040093+0000","last_undegraded":"2024-09-21T04:01:31.040093+0000","last_fullsized":"2024-09-21T04:01:31.040093+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_clean_scrub_stamp":"2024-09-21T03:55:20.271286+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:53.813660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040238+0000","last_change":"2024-09-21T04:00:11.057229+0000","last_active":"2024-09-21T04:01:31.040238+0000","last_peered":"2024-09-21T04:01:31.040238+0000","last_clean":"2024-09-21T04:01:31.040238+0000","last_became_active":"2024-09-21T04:00:11.056722+0000","last_became_peered":"2024-09-21T04:00:11.056722+0000","last_unstale":"2024-09-21T04:01:31.040238+0000","last_undegraded":"2024-09-21T04:01:31.040238+0000","last_fullsized":"2024-09-21T04:01:31.040238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:53.311589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.312449+0000","last_change":"2024-09-21T04:00:04.013650+0000","last_active":"2024-09-21T04:01:59.312449+0000","last_peered":"2024-09-21T04:01:59.312449+0000","last_clean":"2024-09-21T04:01:59.312449+0000","last_became_active":"2024-09-21T04:00:04.013284+0000","last_became_peered":"2024-09-21T04:00:04.013284+0000","last_unstale":"2024-09-21T04:01:59.312449+0000","last_undegraded":"2024-09-21T04:01:59.312449+0000","last_fullsized":"2024-09-21T04:01:59.312449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:53.098998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:28.376712+0000","last_change":"2024-09-21T04:00:02.213332+0000","last_active":"2024-09-21T04:02:28.376712+0000","last_peered":"2024-09-21T04:02:28.376712+0000","last_clean":"2024-09-21T04:02:28.376712+0000","last_became_active":"2024-09-21T04:00:02.212853+0000","last_became_peered":"2024-09-21T04:00:02.212853+0000","last_unstale":"2024-09-21T04:02:28.376712+0000","last_undegraded":"2024-09-21T04:02:28.376712+0000","last_fullsized":"2024-09-21T04:02:28.376712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:52.923489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303077+0000","last_change":"2024-09-21T04:00:11.057139+0000","last_active":"2024-09-21T04:01:31.303077+0000","last_peered":"2024-09-21T04:01:31.303077+0000","last_clean":"2024-09-21T04:01:31.303077+0000","last_became_active":"2024-09-21T04:00:11.056549+0000","last_became_peered":"2024-09-21T04:00:11.056549+0000","last_unstale":"2024-09-21T04:01:31.303077+0000","last_undegraded":"2024-09-21T04:01:31.303077+0000","last_fullsized":"2024-09-21T04:01:31.303077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:28.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304521+0000","last_change":"2024-09-21T04:00:30.141278+0000","last_active":"2024-09-21T04:01:59.304521+0000","last_peered":"2024-09-21T04:01:59.304521+0000","last_clean":"2024-09-21T04:01:59.304521+0000","last_became_active":"2024-09-21T04:00:30.140692+0000","last_became_peered":"2024-09-21T04:00:30.140692+0000","last_unstale":"2024-09-21T04:01:59.304521+0000","last_undegraded":"2024-09-21T04:01:59.304521+0000","last_fullsized":"2024-09-21T04:01:59.304521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:15.600486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035507+0000","last_change":"2024-09-21T04:00:01.990532+0000","last_active":"2024-09-21T04:01:31.035507+0000","last_peered":"2024-09-21T04:01:31.035507+0000","last_clean":"2024-09-21T04:01:31.035507+0000","last_became_active":"2024-09-21T04:00:01.990114+0000","last_became_peered":"2024-09-21T04:00:01.990114+0000","last_unstale":"2024-09-21T04:01:31.035507+0000","last_undegraded":"2024-09-21T04:01:31.035507+0000","last_fullsized":"2024-09-21T04:01:31.035507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:51.313576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108185+0000","last_change":"2024-09-21T04:00:30.182161+0000","last_active":"2024-09-21T04:01:31.108185+0000","last_peered":"2024-09-21T04:01:31.108185+0000","last_clean":"2024-09-21T04:01:31.108185+0000","last_became_active":"2024-09-21T04:00:30.181777+0000","last_became_peered":"2024-09-21T04:00:30.181777+0000","last_unstale":"2024-09-21T04:01:31.108185+0000","last_undegraded":"2024-09-21T04:01:31.108185+0000","last_fullsized":"2024-09-21T04:01:31.108185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:35.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307052+0000","last_change":"2024-09-21T04:00:04.006784+0000","last_active":"2024-09-21T04:01:59.307052+0000","last_peered":"2024-09-21T04:01:59.307052+0000","last_clean":"2024-09-21T04:01:59.307052+0000","last_became_active":"2024-09-21T04:00:04.003841+0000","last_became_peered":"2024-09-21T04:00:04.003841+0000","last_unstale":"2024-09-21T04:01:59.307052+0000","last_undegraded":"2024-09-21T04:01:59.307052+0000","last_fullsized":"2024-09-21T04:01:59.307052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:50.088980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033310+0000","last_change":"2024-09-21T04:00:01.986202+0000","last_active":"2024-09-21T04:01:31.033310+0000","last_peered":"2024-09-21T04:01:31.033310+0000","last_clean":"2024-09-21T04:01:31.033310+0000","last_became_active":"2024-09-21T04:00:01.985812+0000","last_became_peered":"2024-09-21T04:00:01.985812+0000","last_unstale":"2024-09-21T04:01:31.033310+0000","last_undegraded":"2024-09-21T04:01:31.033310+0000","last_fullsized":"2024-09-21T04:01:31.033310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:05.777175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034572+0000","last_change":"2024-09-21T04:00:11.057253+0000","last_active":"2024-09-21T04:01:31.034572+0000","last_peered":"2024-09-21T04:01:31.034572+0000","last_clean":"2024-09-21T04:01:31.034572+0000","last_became_active":"2024-09-21T04:00:11.056721+0000","last_became_peered":"2024-09-21T04:00:11.056721+0000","last_unstale":"2024-09-21T04:01:31.034572+0000","last_undegraded":"2024-09-21T04:01:31.034572+0000","last_fullsized":"2024-09-21T04:01:31.034572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:19.202714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304854+0000","last_change":"2024-09-21T04:00:04.003674+0000","last_active":"2024-09-21T04:01:59.304854+0000","last_peered":"2024-09-21T04:01:59.304854+0000","last_clean":"2024-09-21T04:01:59.304854+0000","last_became_active":"2024-09-21T04:00:04.003297+0000","last_became_peered":"2024-09-21T04:00:04.003297+0000","last_unstale":"2024-09-21T04:01:59.304854+0000","last_undegraded":"2024-09-21T04:01:59.304854+0000","last_fullsized":"2024-09-21T04:01:59.304854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.063721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:19.460463+0000","last_change":"2024-09-21T04:00:01.986007+0000","last_active":"2024-09-21T04:02:19.460463+0000","last_peered":"2024-09-21T04:02:19.460463+0000","last_clean":"2024-09-21T04:02:19.460463+0000","last_became_active":"2024-09-21T04:00:01.985582+0000","last_became_peered":"2024-09-21T04:00:01.985582+0000","last_unstale":"2024-09-21T04:02:19.460463+0000","last_undegraded":"2024-09-21T04:02:19.460463+0000","last_fullsized":"2024-09-21T04:02:19.460463+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:48.429307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034852+0000","last_change":"2024-09-21T04:00:11.061522+0000","last_active":"2024-09-21T04:01:31.034852+0000","last_peered":"2024-09-21T04:01:31.034852+0000","last_clean":"2024-09-21T04:01:31.034852+0000","last_became_active":"2024-09-21T04:00:11.060984+0000","last_became_peered":"2024-09-21T04:00:11.060984+0000","last_unstale":"2024-09-21T04:01:31.034852+0000","last_undegraded":"2024-09-21T04:01:31.034852+0000","last_fullsized":"2024-09-21T04:01:31.034852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:51.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.309095+0000","last_change":"2024-09-21T04:00:04.016468+0000","last_active":"2024-09-21T04:01:59.309095+0000","last_peered":"2024-09-21T04:01:59.309095+0000","last_clean":"2024-09-21T04:01:59.309095+0000","last_became_active":"2024-09-21T04:00:04.016177+0000","last_became_peered":"2024-09-21T04:00:04.016177+0000","last_unstale":"2024-09-21T04:01:59.309095+0000","last_undegraded":"2024-09-21T04:01:59.309095+0000","last_fullsized":"2024-09-21T04:01:59.309095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:58.670552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039248+0000","last_change":"2024-09-21T04:00:02.162746+0000","last_active":"2024-09-21T04:01:31.039248+0000","last_peered":"2024-09-21T04:01:31.039248+0000","last_clean":"2024-09-21T04:01:31.039248+0000","last_became_active":"2024-09-21T04:00:02.162121+0000","last_became_peered":"2024-09-21T04:00:02.162121+0000","last_unstale":"2024-09-21T04:01:31.039248+0000","last_undegraded":"2024-09-21T04:01:31.039248+0000","last_fullsized":"2024-09-21T04:01:31.039248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:02.798790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033264+0000","last_change":"2024-09-21T04:00:11.068043+0000","last_active":"2024-09-21T04:01:31.033264+0000","last_peered":"2024-09-21T04:01:31.033264+0000","last_clean":"2024-09-21T04:01:31.033264+0000","last_became_active":"2024-09-21T04:00:11.067553+0000","last_became_peered":"2024-09-21T04:00:11.067553+0000","last_unstale":"2024-09-21T04:01:31.033264+0000","last_undegraded":"2024-09-21T04:01:31.033264+0000","last_fullsized":"2024-09-21T04:01:31.033264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:34.095708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307897+0000","last_change":"2024-09-21T04:00:04.010725+0000","last_active":"2024-09-21T04:01:59.307897+0000","last_peered":"2024-09-21T04:01:59.307897+0000","last_clean":"2024-09-21T04:01:59.307897+0000","last_became_active":"2024-09-21T04:00:04.010295+0000","last_became_peered":"2024-09-21T04:00:04.010295+0000","last_unstale":"2024-09-21T04:01:59.307897+0000","last_undegraded":"2024-09-21T04:01:59.307897+0000","last_fullsized":"2024-09-21T04:01:59.307897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:40.417814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"83'5","reported_seq":151,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:25.371318+0000","last_change":"2024-09-21T04:00:01.985123+0000","last_active":"2024-09-21T04:02:25.371318+0000","last_peered":"2024-09-21T04:02:25.371318+0000","last_clean":"2024-09-21T04:02:25.371318+0000","last_became_active":"2024-09-21T04:00:01.984686+0000","last_became_peered":"2024-09-21T04:00:01.984686+0000","last_unstale":"2024-09-21T04:02:25.371318+0000","last_undegraded":"2024-09-21T04:02:25.371318+0000","last_fullsized":"2024-09-21T04:02:25.371318+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:18.825567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":105,"num_read_kb":3,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036813+0000","last_change":"2024-09-21T04:00:11.068045+0000","last_active":"2024-09-21T04:01:31.036813+0000","last_peered":"2024-09-21T04:01:31.036813+0000","last_clean":"2024-09-21T04:01:31.036813+0000","last_became_active":"2024-09-21T04:00:11.067528+0000","last_became_peered":"2024-09-21T04:00:11.067528+0000","last_unstale":"2024-09-21T04:01:31.036813+0000","last_undegraded":"2024-09-21T04:01:31.036813+0000","last_fullsized":"2024-09-21T04:01:31.036813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:54.054763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.308037+0000","last_change":"2024-09-21T04:00:04.008068+0000","last_active":"2024-09-21T04:01:59.308037+0000","last_peered":"2024-09-21T04:01:59.308037+0000","last_clean":"2024-09-21T04:01:59.308037+0000","last_became_active":"2024-09-21T04:00:04.007611+0000","last_became_peered":"2024-09-21T04:00:04.007611+0000","last_unstale":"2024-09-21T04:01:59.308037+0000","last_undegraded":"2024-09-21T04:01:59.308037+0000","last_fullsized":"2024-09-21T04:01:59.308037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:02.363722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035983+0000","last_change":"2024-09-21T04:00:01.986011+0000","last_active":"2024-09-21T04:01:31.035983+0000","last_peered":"2024-09-21T04:01:31.035983+0000","last_clean":"2024-09-21T04:01:31.035983+0000","last_became_active":"2024-09-21T04:00:01.985637+0000","last_became_peered":"2024-09-21T04:00:01.985637+0000","last_unstale":"2024-09-21T04:01:31.035983+0000","last_undegraded":"2024-09-21T04:01:31.035983+0000","last_fullsized":"2024-09-21T04:01:31.035983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:36.226063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037322+0000","last_change":"2024-09-21T04:00:11.067798+0000","last_active":"2024-09-21T04:01:31.037322+0000","last_peered":"2024-09-21T04:01:31.037322+0000","last_clean":"2024-09-21T04:01:31.037322+0000","last_became_active":"2024-09-21T04:00:11.067319+0000","last_became_peered":"2024-09-21T04:00:11.067319+0000","last_unstale":"2024-09-21T04:01:31.037322+0000","last_undegraded":"2024-09-21T04:01:31.037322+0000","last_fullsized":"2024-09-21T04:01:31.037322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:37.118986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.297180+0000","last_change":"2024-09-21T04:00:04.003222+0000","last_active":"2024-09-21T04:01:59.297180+0000","last_peered":"2024-09-21T04:01:59.297180+0000","last_clean":"2024-09-21T04:01:59.297180+0000","last_became_active":"2024-09-21T04:00:04.002893+0000","last_became_peered":"2024-09-21T04:00:04.002893+0000","last_unstale":"2024-09-21T04:01:59.297180+0000","last_undegraded":"2024-09-21T04:01:59.297180+0000","last_fullsized":"2024-09-21T04:01:59.297180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:18.806695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042658+0000","last_change":"2024-09-21T04:00:01.985978+0000","last_active":"2024-09-21T04:01:31.042658+0000","last_peered":"2024-09-21T04:01:31.042658+0000","last_clean":"2024-09-21T04:01:31.042658+0000","last_became_active":"2024-09-21T04:00:01.985607+0000","last_became_peered":"2024-09-21T04:00:01.985607+0000","last_unstale":"2024-09-21T04:01:31.042658+0000","last_undegraded":"2024-09-21T04:01:31.042658+0000","last_fullsized":"2024-09-21T04:01:31.042658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:30.113727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035195+0000","last_change":"2024-09-21T04:00:11.069332+0000","last_active":"2024-09-21T04:01:31.035195+0000","last_peered":"2024-09-21T04:01:31.035195+0000","last_clean":"2024-09-21T04:01:31.035195+0000","last_became_active":"2024-09-21T04:00:11.068832+0000","last_became_peered":"2024-09-21T04:00:11.068832+0000","last_unstale":"2024-09-21T04:01:31.035195+0000","last_undegraded":"2024-09-21T04:01:31.035195+0000","last_fullsized":"2024-09-21T04:01:31.035195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:03.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.294175+0000","last_change":"2024-09-21T04:00:04.004234+0000","last_active":"2024-09-21T04:01:59.294175+0000","last_peered":"2024-09-21T04:01:59.294175+0000","last_clean":"2024-09-21T04:01:59.294175+0000","last_became_active":"2024-09-21T04:00:04.003839+0000","last_became_peered":"2024-09-21T04:00:04.003839+0000","last_unstale":"2024-09-21T04:01:59.294175+0000","last_undegraded":"2024-09-21T04:01:59.294175+0000","last_fullsized":"2024-09-21T04:01:59.294175+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.971580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'39","reported_seq":304,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:30.379098+0000","last_change":"2024-09-21T04:00:01.990623+0000","last_active":"2024-09-21T04:02:30.379098+0000","last_peered":"2024-09-21T04:02:30.379098+0000","last_clean":"2024-09-21T04:02:30.379098+0000","last_became_active":"2024-09-21T04:00:01.990030+0000","last_became_peered":"2024-09-21T04:00:01.990030+0000","last_unstale":"2024-09-21T04:02:30.379098+0000","last_undegraded":"2024-09-21T04:02:30.379098+0000","last_fullsized":"2024-09-21T04:02:30.379098+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:07.150261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66938,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":177,"num_write":41,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036520+0000","last_change":"2024-09-21T04:00:11.064198+0000","last_active":"2024-09-21T04:01:31.036520+0000","last_peered":"2024-09-21T04:01:31.036520+0000","last_clean":"2024-09-21T04:01:31.036520+0000","last_became_active":"2024-09-21T04:00:11.063519+0000","last_became_peered":"2024-09-21T04:00:11.063519+0000","last_unstale":"2024-09-21T04:01:31.036520+0000","last_undegraded":"2024-09-21T04:01:31.036520+0000","last_fullsized":"2024-09-21T04:01:31.036520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:16.189027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.323627+0000","last_change":"2024-09-21T04:00:04.009685+0000","last_active":"2024-09-21T04:01:59.323627+0000","last_peered":"2024-09-21T04:01:59.323627+0000","last_clean":"2024-09-21T04:01:59.323627+0000","last_became_active":"2024-09-21T04:00:04.009217+0000","last_became_peered":"2024-09-21T04:00:04.009217+0000","last_unstale":"2024-09-21T04:01:59.323627+0000","last_undegraded":"2024-09-21T04:01:59.323627+0000","last_fullsized":"2024-09-21T04:01:59.323627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:31.780399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035447+0000","last_change":"2024-09-21T04:00:02.164467+0000","last_active":"2024-09-21T04:01:31.035447+0000","last_peered":"2024-09-21T04:01:31.035447+0000","last_clean":"2024-09-21T04:01:31.035447+0000","last_became_active":"2024-09-21T04:00:02.164091+0000","last_became_peered":"2024-09-21T04:00:02.164091+0000","last_unstale":"2024-09-21T04:01:31.035447+0000","last_undegraded":"2024-09-21T04:01:31.035447+0000","last_fullsized":"2024-09-21T04:01:31.035447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:12.327745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293696+0000","last_change":"2024-09-21T04:00:11.058828+0000","last_active":"2024-09-21T04:01:31.293696+0000","last_peered":"2024-09-21T04:01:31.293696+0000","last_clean":"2024-09-21T04:01:31.293696+0000","last_became_active":"2024-09-21T04:00:11.058188+0000","last_became_peered":"2024-09-21T04:00:11.058188+0000","last_unstale":"2024-09-21T04:01:31.293696+0000","last_undegraded":"2024-09-21T04:01:31.293696+0000","last_fullsized":"2024-09-21T04:01:31.293696+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.767306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.300695+0000","last_change":"2024-09-21T04:00:04.004693+0000","last_active":"2024-09-21T04:01:59.300695+0000","last_peered":"2024-09-21T04:01:59.300695+0000","last_clean":"2024-09-21T04:01:59.300695+0000","last_became_active":"2024-09-21T04:00:04.004357+0000","last_became_peered":"2024-09-21T04:00:04.004357+0000","last_unstale":"2024-09-21T04:01:59.300695+0000","last_undegraded":"2024-09-21T04:01:59.300695+0000","last_fullsized":"2024-09-21T04:01:59.300695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040115+0000","last_change":"2024-09-21T04:00:01.987319+0000","last_active":"2024-09-21T04:01:31.040115+0000","last_peered":"2024-09-21T04:01:31.040115+0000","last_clean":"2024-09-21T04:01:31.040115+0000","last_became_active":"2024-09-21T04:00:01.986012+0000","last_became_peered":"2024-09-21T04:00:01.986012+0000","last_unstale":"2024-09-21T04:01:31.040115+0000","last_undegraded":"2024-09-21T04:01:31.040115+0000","last_fullsized":"2024-09-21T04:01:31.040115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:03.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038535+0000","last_change":"2024-09-21T04:00:30.139534+0000","last_active":"2024-09-21T04:01:31.038535+0000","last_peered":"2024-09-21T04:01:31.038535+0000","last_clean":"2024-09-21T04:01:31.038535+0000","last_became_active":"2024-09-21T04:00:30.138954+0000","last_became_peered":"2024-09-21T04:00:30.138954+0000","last_unstale":"2024-09-21T04:01:31.038535+0000","last_undegraded":"2024-09-21T04:01:31.038535+0000","last_fullsized":"2024-09-21T04:01:31.038535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:21.368007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.320136+0000","last_change":"2024-09-21T04:00:04.013737+0000","last_active":"2024-09-21T04:01:59.320136+0000","last_peered":"2024-09-21T04:01:59.320136+0000","last_clean":"2024-09-21T04:01:59.320136+0000","last_became_active":"2024-09-21T04:00:04.012901+0000","last_became_peered":"2024-09-21T04:00:04.012901+0000","last_unstale":"2024-09-21T04:01:59.320136+0000","last_undegraded":"2024-09-21T04:01:59.320136+0000","last_fullsized":"2024-09-21T04:01:59.320136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:50.952778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'6","reported_seq":260,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:30.379452+0000","last_change":"2024-09-21T04:00:01.987988+0000","last_active":"2024-09-21T04:02:30.379452+0000","last_peered":"2024-09-21T04:02:30.379452+0000","last_clean":"2024-09-21T04:02:30.379452+0000","last_became_active":"2024-09-21T04:00:01.986593+0000","last_became_peered":"2024-09-21T04:00:01.986593+0000","last_unstale":"2024-09-21T04:02:30.379452+0000","last_undegraded":"2024-09-21T04:02:30.379452+0000","last_fullsized":"2024-09-21T04:02:30.379452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.256609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039250+0000","last_change":"2024-09-21T04:00:11.064937+0000","last_active":"2024-09-21T04:01:31.039250+0000","last_peered":"2024-09-21T04:01:31.039250+0000","last_clean":"2024-09-21T04:01:31.039250+0000","last_became_active":"2024-09-21T04:00:11.063809+0000","last_became_peered":"2024-09-21T04:00:11.063809+0000","last_unstale":"2024-09-21T04:01:31.039250+0000","last_undegraded":"2024-09-21T04:01:31.039250+0000","last_fullsized":"2024-09-21T04:01:31.039250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:00.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.107781+0000","last_change":"2024-09-21T04:00:11.068084+0000","last_active":"2024-09-21T04:01:31.107781+0000","last_peered":"2024-09-21T04:01:31.107781+0000","last_clean":"2024-09-21T04:01:31.107781+0000","last_became_active":"2024-09-21T04:00:11.067587+0000","last_became_peered":"2024-09-21T04:00:11.067587+0000","last_unstale":"2024-09-21T04:01:31.107781+0000","last_undegraded":"2024-09-21T04:01:31.107781+0000","last_fullsized":"2024-09-21T04:01:31.107781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:30.849467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296791+0000","last_change":"2024-09-21T04:00:03.997501+0000","last_active":"2024-09-21T04:01:59.296791+0000","last_peered":"2024-09-21T04:01:59.296791+0000","last_clean":"2024-09-21T04:01:59.296791+0000","last_became_active":"2024-09-21T04:00:03.997100+0000","last_became_peered":"2024-09-21T04:00:03.997100+0000","last_unstale":"2024-09-21T04:01:59.296791+0000","last_undegraded":"2024-09-21T04:01:59.296791+0000","last_fullsized":"2024-09-21T04:01:59.296791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:31.813970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035055+0000","last_change":"2024-09-21T04:00:01.986224+0000","last_active":"2024-09-21T04:01:31.035055+0000","last_peered":"2024-09-21T04:01:31.035055+0000","last_clean":"2024-09-21T04:01:31.035055+0000","last_became_active":"2024-09-21T04:00:01.985845+0000","last_became_peered":"2024-09-21T04:00:01.985845+0000","last_unstale":"2024-09-21T04:01:31.035055+0000","last_undegraded":"2024-09-21T04:01:31.035055+0000","last_fullsized":"2024-09-21T04:01:31.035055+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:38.895288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037519+0000","last_change":"2024-09-21T04:00:11.067705+0000","last_active":"2024-09-21T04:01:31.037519+0000","last_peered":"2024-09-21T04:01:31.037519+0000","last_clean":"2024-09-21T04:01:31.037519+0000","last_became_active":"2024-09-21T04:00:11.067252+0000","last_became_peered":"2024-09-21T04:00:11.067252+0000","last_unstale":"2024-09-21T04:01:31.037519+0000","last_undegraded":"2024-09-21T04:01:31.037519+0000","last_fullsized":"2024-09-21T04:01:31.037519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:47.003323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296425+0000","last_change":"2024-09-21T04:00:03.996067+0000","last_active":"2024-09-21T04:01:59.296425+0000","last_peered":"2024-09-21T04:01:59.296425+0000","last_clean":"2024-09-21T04:01:59.296425+0000","last_became_active":"2024-09-21T04:00:03.995603+0000","last_became_peered":"2024-09-21T04:00:03.995603+0000","last_unstale":"2024-09-21T04:01:59.296425+0000","last_undegraded":"2024-09-21T04:01:59.296425+0000","last_fullsized":"2024-09-21T04:01:59.296425+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:19.348461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032670+0000","last_change":"2024-09-21T04:00:01.985283+0000","last_active":"2024-09-21T04:01:31.032670+0000","last_peered":"2024-09-21T04:01:31.032670+0000","last_clean":"2024-09-21T04:01:31.032670+0000","last_became_active":"2024-09-21T04:00:01.984860+0000","last_became_peered":"2024-09-21T04:00:01.984860+0000","last_unstale":"2024-09-21T04:01:31.032670+0000","last_undegraded":"2024-09-21T04:01:31.032670+0000","last_fullsized":"2024-09-21T04:01:31.032670+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:38.739987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033620+0000","last_change":"2024-09-21T04:00:30.183241+0000","last_active":"2024-09-21T04:01:31.033620+0000","last_peered":"2024-09-21T04:01:31.033620+0000","last_clean":"2024-09-21T04:01:31.033620+0000","last_became_active":"2024-09-21T04:00:30.182788+0000","last_became_peered":"2024-09-21T04:00:30.182788+0000","last_unstale":"2024-09-21T04:01:31.033620+0000","last_undegraded":"2024-09-21T04:01:31.033620+0000","last_fullsized":"2024-09-21T04:01:31.033620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:47.129478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.305063+0000","last_change":"2024-09-21T04:00:04.004526+0000","last_active":"2024-09-21T04:01:59.305063+0000","last_peered":"2024-09-21T04:01:59.305063+0000","last_clean":"2024-09-21T04:01:59.305063+0000","last_became_active":"2024-09-21T04:00:04.004114+0000","last_became_peered":"2024-09-21T04:00:04.004114+0000","last_unstale":"2024-09-21T04:01:59.305063+0000","last_undegraded":"2024-09-21T04:01:59.305063+0000","last_fullsized":"2024-09-21T04:01:59.305063+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:50.212647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042439+0000","last_change":"2024-09-21T04:00:11.067811+0000","last_active":"2024-09-21T04:01:31.042439+0000","last_peered":"2024-09-21T04:01:31.042439+0000","last_clean":"2024-09-21T04:01:31.042439+0000","last_became_active":"2024-09-21T04:00:11.067280+0000","last_became_peered":"2024-09-21T04:00:11.067280+0000","last_unstale":"2024-09-21T04:01:31.042439+0000","last_undegraded":"2024-09-21T04:01:31.042439+0000","last_fullsized":"2024-09-21T04:01:31.042439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:08.152231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":152,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:27.374411+0000","last_change":"2024-09-21T04:00:01.987215+0000","last_active":"2024-09-21T04:02:27.374411+0000","last_peered":"2024-09-21T04:02:27.374411+0000","last_clean":"2024-09-21T04:02:27.374411+0000","last_became_active":"2024-09-21T04:00:01.986738+0000","last_became_peered":"2024-09-21T04:00:01.986738+0000","last_unstale":"2024-09-21T04:02:27.374411+0000","last_undegraded":"2024-09-21T04:02:27.374411+0000","last_fullsized":"2024-09-21T04:02:27.374411+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:16.204316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.288559+0000","last_change":"2024-09-21T04:00:04.003232+0000","last_active":"2024-09-21T04:01:59.288559+0000","last_peered":"2024-09-21T04:01:59.288559+0000","last_clean":"2024-09-21T04:01:59.288559+0000","last_became_active":"2024-09-21T04:00:04.002865+0000","last_became_peered":"2024-09-21T04:00:04.002865+0000","last_unstale":"2024-09-21T04:01:59.288559+0000","last_undegraded":"2024-09-21T04:01:59.288559+0000","last_fullsized":"2024-09-21T04:01:59.288559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:29.298836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042636+0000","last_change":"2024-09-21T04:00:11.057591+0000","last_active":"2024-09-21T04:01:31.042636+0000","last_peered":"2024-09-21T04:01:31.042636+0000","last_clean":"2024-09-21T04:01:31.042636+0000","last_became_active":"2024-09-21T04:00:11.057092+0000","last_became_peered":"2024-09-21T04:00:11.057092+0000","last_unstale":"2024-09-21T04:01:31.042636+0000","last_undegraded":"2024-09-21T04:01:31.042636+0000","last_fullsized":"2024-09-21T04:01:31.042636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:47.487649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.297302+0000","last_change":"2024-09-21T04:00:04.010297+0000","last_active":"2024-09-21T04:01:59.297302+0000","last_peered":"2024-09-21T04:01:59.297302+0000","last_clean":"2024-09-21T04:01:59.297302+0000","last_became_active":"2024-09-21T04:00:04.009948+0000","last_became_peered":"2024-09-21T04:00:04.009948+0000","last_unstale":"2024-09-21T04:01:59.297302+0000","last_undegraded":"2024-09-21T04:01:59.297302+0000","last_fullsized":"2024-09-21T04:01:59.297302+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:07.927430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.300581+0000","last_change":"2024-09-21T04:00:04.005564+0000","last_active":"2024-09-21T04:01:59.300581+0000","last_peered":"2024-09-21T04:01:59.300581+0000","last_clean":"2024-09-21T04:01:59.300581+0000","last_became_active":"2024-09-21T04:00:04.005119+0000","last_became_peered":"2024-09-21T04:00:04.005119+0000","last_unstale":"2024-09-21T04:01:59.300581+0000","last_undegraded":"2024-09-21T04:01:59.300581+0000","last_fullsized":"2024-09-21T04:01:59.300581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:05.844333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303659+0000","last_change":"2024-09-21T04:00:03.997004+0000","last_active":"2024-09-21T04:01:59.303659+0000","last_peered":"2024-09-21T04:01:59.303659+0000","last_clean":"2024-09-21T04:01:59.303659+0000","last_became_active":"2024-09-21T04:00:03.996570+0000","last_became_peered":"2024-09-21T04:00:03.996570+0000","last_unstale":"2024-09-21T04:01:59.303659+0000","last_undegraded":"2024-09-21T04:01:59.303659+0000","last_fullsized":"2024-09-21T04:01:59.303659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.301278+0000","last_change":"2024-09-21T04:00:04.005794+0000","last_active":"2024-09-21T04:01:59.301278+0000","last_peered":"2024-09-21T04:01:59.301278+0000","last_clean":"2024-09-21T04:01:59.301278+0000","last_became_active":"2024-09-21T04:00:04.005345+0000","last_became_peered":"2024-09-21T04:00:04.005345+0000","last_unstale":"2024-09-21T04:01:59.301278+0000","last_undegraded":"2024-09-21T04:01:59.301278+0000","last_fullsized":"2024-09-21T04:01:59.301278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:20.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304644+0000","last_change":"2024-09-21T04:00:03.992204+0000","last_active":"2024-09-21T04:01:59.304644+0000","last_peered":"2024-09-21T04:01:59.304644+0000","last_clean":"2024-09-21T04:01:59.304644+0000","last_became_active":"2024-09-21T04:00:03.991826+0000","last_became_peered":"2024-09-21T04:00:03.991826+0000","last_unstale":"2024-09-21T04:01:59.304644+0000","last_undegraded":"2024-09-21T04:01:59.304644+0000","last_fullsized":"2024-09-21T04:01:59.304644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.443227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296485+0000","last_change":"2024-09-21T04:00:04.004401+0000","last_active":"2024-09-21T04:01:59.296485+0000","last_peered":"2024-09-21T04:01:59.296485+0000","last_clean":"2024-09-21T04:01:59.296485+0000","last_became_active":"2024-09-21T04:00:04.003983+0000","last_became_peered":"2024-09-21T04:00:04.003983+0000","last_unstale":"2024-09-21T04:01:59.296485+0000","last_undegraded":"2024-09-21T04:01:59.296485+0000","last_fullsized":"2024-09-21T04:01:59.296485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:06.250069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307069+0000","last_change":"2024-09-21T04:00:03.999692+0000","last_active":"2024-09-21T04:01:59.307069+0000","last_peered":"2024-09-21T04:01:59.307069+0000","last_clean":"2024-09-21T04:01:59.307069+0000","last_became_active":"2024-09-21T04:00:03.999282+0000","last_became_peered":"2024-09-21T04:00:03.999282+0000","last_unstale":"2024-09-21T04:01:59.307069+0000","last_undegraded":"2024-09-21T04:01:59.307069+0000","last_fullsized":"2024-09-21T04:01:59.307069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.323350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304667+0000","last_change":"2024-09-21T04:00:04.002947+0000","last_active":"2024-09-21T04:01:59.304667+0000","last_peered":"2024-09-21T04:01:59.304667+0000","last_clean":"2024-09-21T04:01:59.304667+0000","last_became_active":"2024-09-21T04:00:04.002550+0000","last_became_peered":"2024-09-21T04:00:04.002550+0000","last_unstale":"2024-09-21T04:01:59.304667+0000","last_undegraded":"2024-09-21T04:01:59.304667+0000","last_fullsized":"2024-09-21T04:01:59.304667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:17.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303619+0000","last_change":"2024-09-21T04:00:04.009700+0000","last_active":"2024-09-21T04:01:59.303619+0000","last_peered":"2024-09-21T04:01:59.303619+0000","last_clean":"2024-09-21T04:01:59.303619+0000","last_became_active":"2024-09-21T04:00:04.009311+0000","last_became_peered":"2024-09-21T04:00:04.009311+0000","last_unstale":"2024-09-21T04:01:59.303619+0000","last_undegraded":"2024-09-21T04:01:59.303619+0000","last_fullsized":"2024-09-21T04:01:59.303619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.658543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304365+0000","last_change":"2024-09-21T04:00:04.002975+0000","last_active":"2024-09-21T04:01:59.304365+0000","last_peered":"2024-09-21T04:01:59.304365+0000","last_clean":"2024-09-21T04:01:59.304365+0000","last_became_active":"2024-09-21T04:00:04.002608+0000","last_became_peered":"2024-09-21T04:00:04.002608+0000","last_unstale":"2024-09-21T04:01:59.304365+0000","last_undegraded":"2024-09-21T04:01:59.304365+0000","last_fullsized":"2024-09-21T04:01:59.304365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:13.044615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.320397+0000","last_change":"2024-09-21T04:00:04.010797+0000","last_active":"2024-09-21T04:01:59.320397+0000","last_peered":"2024-09-21T04:01:59.320397+0000","last_clean":"2024-09-21T04:01:59.320397+0000","last_became_active":"2024-09-21T04:00:04.010377+0000","last_became_peered":"2024-09-21T04:00:04.010377+0000","last_unstale":"2024-09-21T04:01:59.320397+0000","last_undegraded":"2024-09-21T04:01:59.320397+0000","last_fullsized":"2024-09-21T04:01:59.320397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:58.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304621+0000","last_change":"2024-09-21T04:00:04.002841+0000","last_active":"2024-09-21T04:01:59.304621+0000","last_peered":"2024-09-21T04:01:59.304621+0000","last_clean":"2024-09-21T04:01:59.304621+0000","last_became_active":"2024-09-21T04:00:04.002491+0000","last_became_peered":"2024-09-21T04:00:04.002491+0000","last_unstale":"2024-09-21T04:01:59.304621+0000","last_undegraded":"2024-09-21T04:01:59.304621+0000","last_fullsized":"2024-09-21T04:01:59.304621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:52.816860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307009+0000","last_change":"2024-09-21T04:00:04.007238+0000","last_active":"2024-09-21T04:01:59.307009+0000","last_peered":"2024-09-21T04:01:59.307009+0000","last_clean":"2024-09-21T04:01:59.307009+0000","last_became_active":"2024-09-21T04:00:04.006898+0000","last_became_peered":"2024-09-21T04:00:04.006898+0000","last_unstale":"2024-09-21T04:01:59.307009+0000","last_undegraded":"2024-09-21T04:01:59.307009+0000","last_fullsized":"2024-09-21T04:01:59.307009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.957214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303318+0000","last_change":"2024-09-21T04:00:03.997131+0000","last_active":"2024-09-21T04:01:59.303318+0000","last_peered":"2024-09-21T04:01:59.303318+0000","last_clean":"2024-09-21T04:01:59.303318+0000","last_became_active":"2024-09-21T04:00:03.996711+0000","last_became_peered":"2024-09-21T04:00:03.996711+0000","last_unstale":"2024-09-21T04:01:59.303318+0000","last_undegraded":"2024-09-21T04:01:59.303318+0000","last_fullsized":"2024-09-21T04:01:59.303318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:25.373743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.316389+0000","last_change":"2024-09-21T04:00:04.004067+0000","last_active":"2024-09-21T04:01:59.316389+0000","last_peered":"2024-09-21T04:01:59.316389+0000","last_clean":"2024-09-21T04:01:59.316389+0000","last_became_active":"2024-09-21T04:00:04.003707+0000","last_became_peered":"2024-09-21T04:00:04.003707+0000","last_unstale":"2024-09-21T04:01:59.316389+0000","last_undegraded":"2024-09-21T04:01:59.316389+0000","last_fullsized":"2024-09-21T04:01:59.316389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:24.148194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.309586+0000","last_change":"2024-09-21T04:00:04.000068+0000","last_active":"2024-09-21T04:01:59.309586+0000","last_peered":"2024-09-21T04:01:59.309586+0000","last_clean":"2024-09-21T04:01:59.309586+0000","last_became_active":"2024-09-21T04:00:03.999709+0000","last_became_peered":"2024-09-21T04:00:03.999709+0000","last_unstale":"2024-09-21T04:01:59.309586+0000","last_undegraded":"2024-09-21T04:01:59.309586+0000","last_fullsized":"2024-09-21T04:01:59.309586+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:51.249309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.318942+0000","last_change":"2024-09-21T04:00:04.011884+0000","last_active":"2024-09-21T04:01:59.318942+0000","last_peered":"2024-09-21T04:01:59.318942+0000","last_clean":"2024-09-21T04:01:59.318942+0000","last_became_active":"2024-09-21T04:00:04.011449+0000","last_became_peered":"2024-09-21T04:00:04.011449+0000","last_unstale":"2024-09-21T04:01:59.318942+0000","last_undegraded":"2024-09-21T04:01:59.318942+0000","last_fullsized":"2024-09-21T04:01:59.318942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:46.948465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.300105+0000","last_change":"2024-09-21T04:00:03.992848+0000","last_active":"2024-09-21T04:01:59.300105+0000","last_peered":"2024-09-21T04:01:59.300105+0000","last_clean":"2024-09-21T04:01:59.300105+0000","last_became_active":"2024-09-21T04:00:03.991096+0000","last_became_peered":"2024-09-21T04:00:03.991096+0000","last_unstale":"2024-09-21T04:01:59.300105+0000","last_undegraded":"2024-09-21T04:01:59.300105+0000","last_fullsized":"2024-09-21T04:01:59.300105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:19.599848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.289632+0000","last_change":"2024-09-21T04:00:04.000380+0000","last_active":"2024-09-21T04:01:59.289632+0000","last_peered":"2024-09-21T04:01:59.289632+0000","last_clean":"2024-09-21T04:01:59.289632+0000","last_became_active":"2024-09-21T04:00:03.999918+0000","last_became_peered":"2024-09-21T04:00:03.999918+0000","last_unstale":"2024-09-21T04:01:59.289632+0000","last_undegraded":"2024-09-21T04:01:59.289632+0000","last_fullsized":"2024-09-21T04:01:59.289632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:25.607882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.290181+0000","last_change":"2024-09-21T04:00:30.138053+0000","last_active":"2024-09-21T04:01:59.290181+0000","last_peered":"2024-09-21T04:01:59.290181+0000","last_clean":"2024-09-21T04:01:59.290181+0000","last_became_active":"2024-09-21T04:00:30.137682+0000","last_became_peered":"2024-09-21T04:00:30.137682+0000","last_unstale":"2024-09-21T04:01:59.290181+0000","last_undegraded":"2024-09-21T04:01:59.290181+0000","last_fullsized":"2024-09-21T04:01:59.290181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.031655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304151+0000","last_change":"2024-09-21T04:00:04.004313+0000","last_active":"2024-09-21T04:01:59.304151+0000","last_peered":"2024-09-21T04:01:59.304151+0000","last_clean":"2024-09-21T04:01:59.304151+0000","last_became_active":"2024-09-21T04:00:04.003128+0000","last_became_peered":"2024-09-21T04:00:04.003128+0000","last_unstale":"2024-09-21T04:01:59.304151+0000","last_undegraded":"2024-09-21T04:01:59.304151+0000","last_fullsized":"2024-09-21T04:01:59.304151+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:43.469449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.310272+0000","last_change":"2024-09-21T04:00:04.017136+0000","last_active":"2024-09-21T04:01:59.310272+0000","last_peered":"2024-09-21T04:01:59.310272+0000","last_clean":"2024-09-21T04:01:59.310272+0000","last_became_active":"2024-09-21T04:00:04.016732+0000","last_became_peered":"2024-09-21T04:00:04.016732+0000","last_unstale":"2024-09-21T04:01:59.310272+0000","last_undegraded":"2024-09-21T04:01:59.310272+0000","last_fullsized":"2024-09-21T04:01:59.310272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:04.021078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.294402+0000","last_change":"2024-09-21T04:00:04.012098+0000","last_active":"2024-09-21T04:01:59.294402+0000","last_peered":"2024-09-21T04:01:59.294402+0000","last_clean":"2024-09-21T04:01:59.294402+0000","last_became_active":"2024-09-21T04:00:04.011681+0000","last_became_peered":"2024-09-21T04:00:04.011681+0000","last_unstale":"2024-09-21T04:01:59.294402+0000","last_undegraded":"2024-09-21T04:01:59.294402+0000","last_fullsized":"2024-09-21T04:01:59.294402+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:59.202312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.320159+0000","last_change":"2024-09-21T04:00:04.017056+0000","last_active":"2024-09-21T04:01:59.320159+0000","last_peered":"2024-09-21T04:01:59.320159+0000","last_clean":"2024-09-21T04:01:59.320159+0000","last_became_active":"2024-09-21T04:00:04.015950+0000","last_became_peered":"2024-09-21T04:00:04.015950+0000","last_unstale":"2024-09-21T04:01:59.320159+0000","last_undegraded":"2024-09-21T04:01:59.320159+0000","last_fullsized":"2024-09-21T04:01:59.320159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:11.267161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.302011+0000","last_change":"2024-09-21T04:00:04.010314+0000","last_active":"2024-09-21T04:01:59.302011+0000","last_peered":"2024-09-21T04:01:59.302011+0000","last_clean":"2024-09-21T04:01:59.302011+0000","last_became_active":"2024-09-21T04:00:04.009917+0000","last_became_peered":"2024-09-21T04:00:04.009917+0000","last_unstale":"2024-09-21T04:01:59.302011+0000","last_undegraded":"2024-09-21T04:01:59.302011+0000","last_fullsized":"2024-09-21T04:01:59.302011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:32.947079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.306006+0000","last_change":"2024-09-21T04:00:04.007104+0000","last_active":"2024-09-21T04:01:59.306006+0000","last_peered":"2024-09-21T04:01:59.306006+0000","last_clean":"2024-09-21T04:01:59.306006+0000","last_became_active":"2024-09-21T04:00:04.006655+0000","last_became_peered":"2024-09-21T04:00:04.006655+0000","last_unstale":"2024-09-21T04:01:59.306006+0000","last_undegraded":"2024-09-21T04:01:59.306006+0000","last_fullsized":"2024-09-21T04:01:59.306006+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.834305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.294831+0000","last_change":"2024-09-21T04:00:04.007842+0000","last_active":"2024-09-21T04:01:59.294831+0000","last_peered":"2024-09-21T04:01:59.294831+0000","last_clean":"2024-09-21T04:01:59.294831+0000","last_became_active":"2024-09-21T04:00:04.007223+0000","last_became_peered":"2024-09-21T04:00:04.007223+0000","last_unstale":"2024-09-21T04:01:59.294831+0000","last_undegraded":"2024-09-21T04:01:59.294831+0000","last_fullsized":"2024-09-21T04:01:59.294831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:01.501836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304561+0000","last_change":"2024-09-21T04:00:03.997390+0000","last_active":"2024-09-21T04:01:59.304561+0000","last_peered":"2024-09-21T04:01:59.304561+0000","last_clean":"2024-09-21T04:01:59.304561+0000","last_became_active":"2024-09-21T04:00:03.997075+0000","last_became_peered":"2024-09-21T04:00:03.997075+0000","last_unstale":"2024-09-21T04:01:59.304561+0000","last_undegraded":"2024-09-21T04:01:59.304561+0000","last_fullsized":"2024-09-21T04:01:59.304561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:50.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.305966+0000","last_change":"2024-09-21T04:00:04.006203+0000","last_active":"2024-09-21T04:01:59.305966+0000","last_peered":"2024-09-21T04:01:59.305966+0000","last_clean":"2024-09-21T04:01:59.305966+0000","last_became_active":"2024-09-21T04:00:04.005150+0000","last_became_peered":"2024-09-21T04:00:04.005150+0000","last_unstale":"2024-09-21T04:01:59.305966+0000","last_undegraded":"2024-09-21T04:01:59.305966+0000","last_fullsized":"2024-09-21T04:01:59.305966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:17.635568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.308714+0000","last_change":"2024-09-21T04:00:04.011843+0000","last_active":"2024-09-21T04:01:59.308714+0000","last_peered":"2024-09-21T04:01:59.308714+0000","last_clean":"2024-09-21T04:01:59.308714+0000","last_became_active":"2024-09-21T04:00:04.011570+0000","last_became_peered":"2024-09-21T04:00:04.011570+0000","last_unstale":"2024-09-21T04:01:59.308714+0000","last_undegraded":"2024-09-21T04:01:59.308714+0000","last_fullsized":"2024-09-21T04:01:59.308714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:59.883217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304006+0000","last_change":"2024-09-21T04:00:04.002111+0000","last_active":"2024-09-21T04:01:59.304006+0000","last_peered":"2024-09-21T04:01:59.304006+0000","last_clean":"2024-09-21T04:01:59.304006+0000","last_became_active":"2024-09-21T04:00:04.001723+0000","last_became_peered":"2024-09-21T04:00:04.001723+0000","last_unstale":"2024-09-21T04:01:59.304006+0000","last_undegraded":"2024-09-21T04:01:59.304006+0000","last_fullsized":"2024-09-21T04:01:59.304006+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:32.595150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.309262+0000","last_change":"2024-09-21T04:00:03.998822+0000","last_active":"2024-09-21T04:01:59.309262+0000","last_peered":"2024-09-21T04:01:59.309262+0000","last_clean":"2024-09-21T04:01:59.309262+0000","last_became_active":"2024-09-21T04:00:03.998445+0000","last_became_peered":"2024-09-21T04:00:03.998445+0000","last_unstale":"2024-09-21T04:01:59.309262+0000","last_undegraded":"2024-09-21T04:01:59.309262+0000","last_fullsized":"2024-09-21T04:01:59.309262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.090570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75323,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1095,"num_read_kb":635,"num_write":267,"num_write_kb":161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":226446,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282913,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776170,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":493662,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972400,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":1147893,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135925,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":497688,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332154,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":493970,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528383,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1092039,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691909,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":490105,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888138,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":1086135,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051662,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":493170,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247892,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":488804,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444122,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":558238,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1019904,"data_stored":558073,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":491029,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T04:02:32.794 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T04:02:32.795 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph pg dump --format=json 2024-09-21T04:02:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:32 smithi073 ceph-mon[34443]: pgmap v376: 129 pgs: 129 active+clean; 650 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1023 B/s wr, 12 op/s 2024-09-21T04:02:33.052 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.590+0000 7f32ac394640 1 -- 172.21.15.22:0/2465220574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32a4109e10 msgr2=0x7f32a4110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:33.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.590+0000 7f32ac394640 1 --2- 172.21.15.22:0/2465220574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32a4109e10 0x7f32a4110640 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f329c009ca0 tx=0x7f329c02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.590+0000 7f32ac394640 1 -- 172.21.15.22:0/2465220574 shutdown_connections 2024-09-21T04:02:33.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.590+0000 7f32ac394640 1 --2- 172.21.15.22:0/2465220574 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32a4109e10 0x7f32a4110640 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.590+0000 7f32ac394640 1 --2- 172.21.15.22:0/2465220574 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a41094c0 0x7f32a41098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.590+0000 7f32ac394640 1 --2- 172.21.15.22:0/2465220574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32a4103b80 0x7f32a4103f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.590+0000 7f32ac394640 1 -- 172.21.15.22:0/2465220574 >> 172.21.15.22:0/2465220574 conn(0x7f32a40ff610 msgr2=0x7f32a4101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:33.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.590+0000 7f32ac394640 1 -- 172.21.15.22:0/2465220574 shutdown_connections 2024-09-21T04:02:33.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.590+0000 7f32ac394640 1 -- 172.21.15.22:0/2465220574 wait complete. 2024-09-21T04:02:33.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.591+0000 7f32ac394640 1 Processor -- start 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.591+0000 7f32ac394640 1 -- start start 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.591+0000 7f32ac394640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32a4103b80 0x7f32a419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32ac394640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32a41094c0 0x7f32a419a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32ac394640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a4109e10 0x7f32a419fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32ac394640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f32a41139d0 con 0x7f32a41094c0 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32ac394640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f32a4113850 con 0x7f32a4109e10 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32ac394640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f32a4113b50 con 0x7f32a4103b80 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32aa931640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a4109e10 0x7f32a419fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32a992f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32a41094c0 0x7f32a419a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32aa931640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a4109e10 0x7f32a419fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:50086/0 (socket says 172.21.15.22:50086) 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32aa931640 1 -- 172.21.15.22:0/3409955158 learned_addr learned my addr 172.21.15.22:0/3409955158 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:33.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32aa130640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32a4103b80 0x7f32a419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32a992f640 1 -- 172.21.15.22:0/3409955158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32a4103b80 msgr2=0x7f32a419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32a992f640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32a4103b80 0x7f32a419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32a992f640 1 -- 172.21.15.22:0/3409955158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a4109e10 msgr2=0x7f32a419fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32a992f640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a4109e10 0x7f32a419fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32a992f640 1 -- 172.21.15.22:0/3409955158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a41a02f0 con 0x7f32a41094c0 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32aa931640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a4109e10 0x7f32a419fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.592+0000 7f32a992f640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32a41094c0 0x7f32a419a920 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f32a406cc00 tx=0x7f329400b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.593+0000 7f329b7fe640 1 -- 172.21.15.22:0/3409955158 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329401e070 con 0x7f32a41094c0 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.593+0000 7f329b7fe640 1 -- 172.21.15.22:0/3409955158 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f32940198a0 con 0x7f32a41094c0 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.593+0000 7f32ac394640 1 -- 172.21.15.22:0/3409955158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a41a05e0 con 0x7f32a41094c0 2024-09-21T04:02:33.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.593+0000 7f329b7fe640 1 -- 172.21.15.22:0/3409955158 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294018610 con 0x7f32a41094c0 2024-09-21T04:02:33.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.593+0000 7f32ac394640 1 -- 172.21.15.22:0/3409955158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a40755f0 con 0x7f32a41094c0 2024-09-21T04:02:33.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.594+0000 7f32ac394640 1 -- 172.21.15.22:0/3409955158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a4104e00 con 0x7f32a41094c0 2024-09-21T04:02:33.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.596+0000 7f329b7fe640 1 -- 172.21.15.22:0/3409955158 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3294021070 con 0x7f32a41094c0 2024-09-21T04:02:33.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.597+0000 7f329b7fe640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f32900b6510 0x7f32900b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:33.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.597+0000 7f32aa130640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f32900b6510 0x7f32900b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:33.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.597+0000 7f329b7fe640 1 -- 172.21.15.22:0/3409955158 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f32940eb250 con 0x7f32a41094c0 2024-09-21T04:02:33.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.597+0000 7f32aa130640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f32900b6510 0x7f32900b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f32a000bbe0 tx=0x7f32a000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:33.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.600+0000 7f329b7fe640 1 -- 172.21.15.22:0/3409955158 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f32940b5b00 con 0x7f32a41094c0 2024-09-21T04:02:33.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:33 smithi060 ceph-mon[33722]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:02:33.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.787+0000 7f32ac394640 1 -- 172.21.15.22:0/3409955158 --> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f32a4063800 con 0x7f32900b6510 2024-09-21T04:02:33.790 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:33 smithi022 ceph-mon[31015]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:02:33.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.795+0000 7f329b7fe640 1 -- 172.21.15.22:0/3409955158 <== mgr.14150 v2:172.21.15.22:6800/3402236759 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340795 (secure 0 0 0) 0x7f32a4063800 con 0x7f32900b6510 2024-09-21T04:02:33.801 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:33.802 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-09-21T04:02:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 -- 172.21.15.22:0/3409955158 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f32900b6510 msgr2=0x7f32900b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f32900b6510 0x7f32900b8a20 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f32a000bbe0 tx=0x7f32a000b390 comp rx=0 tx=0).stop 2024-09-21T04:02:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 -- 172.21.15.22:0/3409955158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32a41094c0 msgr2=0x7f32a419a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32a41094c0 0x7f32a419a920 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f32a406cc00 tx=0x7f329400b690 comp rx=0 tx=0).stop 2024-09-21T04:02:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 -- 172.21.15.22:0/3409955158 shutdown_connections 2024-09-21T04:02:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f32900b6510 0x7f32900b8a20 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f32a4109e10 0x7f32a419fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32a41094c0 0x7f32a419a920 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 --2- 172.21.15.22:0/3409955158 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f32a4103b80 0x7f32a419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:33.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 -- 172.21.15.22:0/3409955158 >> 172.21.15.22:0/3409955158 conn(0x7f32a40ff610 msgr2=0x7f32a4106ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 -- 172.21.15.22:0/3409955158 shutdown_connections 2024-09-21T04:02:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:33.799+0000 7f32ac394640 1 -- 172.21.15.22:0/3409955158 wait complete. 2024-09-21T04:02:33.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:33 smithi073 ceph-mon[34443]: from='client.15507 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:02:34.485 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":377,"stamp":"2024-09-21T04:02:32.955878+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":666402,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1182,"num_read_kb":700,"num_write":393,"num_write_kb":2314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":23,"num_bytes_recovered":2951840,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":824,"ondisk_log_size":824,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":390016,"kb_used_data":11648,"kb_used_omap":18,"kb_used_meta":378157,"kb_avail":1124551808,"statfs":{"total":1151940427776,"available":1151541051392,"internally_reserved":0,"allocated":11927552,"data_stored":7891760,"data_compressed":496992,"data_compressed_allocated":675840,"data_compressed_original":2850816,"omap_allocated":19143,"internal_metadata":387233081},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2385,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":115,"num_read_kb":55,"num_write":16,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003911"},"pg_stats":[{"pgid":"2.1f","version":"85'15","reported_seq":164,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:29.376952+0000","last_change":"2024-09-21T04:00:01.985519+0000","last_active":"2024-09-21T04:02:29.376952+0000","last_peered":"2024-09-21T04:02:29.376952+0000","last_clean":"2024-09-21T04:02:29.376952+0000","last_became_active":"2024-09-21T04:00:01.984904+0000","last_became_peered":"2024-09-21T04:00:01.984904+0000","last_unstale":"2024-09-21T04:02:29.376952+0000","last_undegraded":"2024-09-21T04:02:29.376952+0000","last_fullsized":"2024-09-21T04:02:29.376952+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:31:20.596034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":107,"num_read_kb":107,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"85'5","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304394+0000","last_change":"2024-09-21T04:00:04.007864+0000","last_active":"2024-09-21T04:01:59.304394+0000","last_peered":"2024-09-21T04:01:59.304394+0000","last_clean":"2024-09-21T04:01:59.304394+0000","last_became_active":"2024-09-21T04:00:04.007470+0000","last_became_peered":"2024-09-21T04:00:04.007470+0000","last_unstale":"2024-09-21T04:01:59.304394+0000","last_undegraded":"2024-09-21T04:01:59.304394+0000","last_fullsized":"2024-09-21T04:01:59.304394+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:37:11.452170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042202+0000","last_change":"2024-09-21T04:00:11.068152+0000","last_active":"2024-09-21T04:01:31.042202+0000","last_peered":"2024-09-21T04:01:31.042202+0000","last_clean":"2024-09-21T04:01:31.042202+0000","last_became_active":"2024-09-21T04:00:11.067647+0000","last_became_peered":"2024-09-21T04:00:11.067647+0000","last_unstale":"2024-09-21T04:01:31.042202+0000","last_undegraded":"2024-09-21T04:01:31.042202+0000","last_fullsized":"2024-09-21T04:01:31.042202+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:37:35.652827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"83'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039714+0000","last_change":"2024-09-21T04:00:02.162198+0000","last_active":"2024-09-21T04:01:31.039714+0000","last_peered":"2024-09-21T04:01:31.039714+0000","last_clean":"2024-09-21T04:01:31.039714+0000","last_became_active":"2024-09-21T04:00:02.161840+0000","last_became_peered":"2024-09-21T04:00:02.161840+0000","last_unstale":"2024-09-21T04:01:31.039714+0000","last_undegraded":"2024-09-21T04:01:31.039714+0000","last_fullsized":"2024-09-21T04:01:31.039714+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:31.353273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.308677+0000","last_change":"2024-09-21T04:00:03.997274+0000","last_active":"2024-09-21T04:01:59.308677+0000","last_peered":"2024-09-21T04:01:59.308677+0000","last_clean":"2024-09-21T04:01:59.308677+0000","last_became_active":"2024-09-21T04:00:03.996917+0000","last_became_peered":"2024-09-21T04:00:03.996917+0000","last_unstale":"2024-09-21T04:01:59.308677+0000","last_undegraded":"2024-09-21T04:01:59.308677+0000","last_fullsized":"2024-09-21T04:01:59.308677+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:11:05.700703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293556+0000","last_change":"2024-09-21T04:00:11.058687+0000","last_active":"2024-09-21T04:01:31.293556+0000","last_peered":"2024-09-21T04:01:31.293556+0000","last_clean":"2024-09-21T04:01:31.293556+0000","last_became_active":"2024-09-21T04:00:11.058099+0000","last_became_peered":"2024-09-21T04:00:11.058099+0000","last_unstale":"2024-09-21T04:01:31.293556+0000","last_undegraded":"2024-09-21T04:01:31.293556+0000","last_fullsized":"2024-09-21T04:01:31.293556+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:05:50.332295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"83'12","reported_seq":77,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.307558+0000","last_change":"2024-09-21T04:01:31.307478+0000","last_active":"2024-09-21T04:01:31.307558+0000","last_peered":"2024-09-21T04:01:31.307558+0000","last_clean":"2024-09-21T04:01:31.307558+0000","last_became_active":"2024-09-21T04:01:31.296040+0000","last_became_peered":"2024-09-21T04:01:31.296040+0000","last_unstale":"2024-09-21T04:01:31.307558+0000","last_undegraded":"2024-09-21T04:01:31.307558+0000","last_fullsized":"2024-09-21T04:01:31.307558+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:53:16.547730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.322752+0000","last_change":"2024-09-21T04:00:04.012120+0000","last_active":"2024-09-21T04:01:59.322752+0000","last_peered":"2024-09-21T04:01:59.322752+0000","last_clean":"2024-09-21T04:01:59.322752+0000","last_became_active":"2024-09-21T04:00:04.011648+0000","last_became_peered":"2024-09-21T04:00:04.011648+0000","last_unstale":"2024-09-21T04:01:59.322752+0000","last_undegraded":"2024-09-21T04:01:59.322752+0000","last_fullsized":"2024-09-21T04:01:59.322752+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:42.716845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293922+0000","last_change":"2024-09-21T04:00:11.059509+0000","last_active":"2024-09-21T04:01:31.293922+0000","last_peered":"2024-09-21T04:01:31.293922+0000","last_clean":"2024-09-21T04:01:31.293922+0000","last_became_active":"2024-09-21T04:00:11.058674+0000","last_became_peered":"2024-09-21T04:00:11.058674+0000","last_unstale":"2024-09-21T04:01:31.293922+0000","last_undegraded":"2024-09-21T04:01:31.293922+0000","last_fullsized":"2024-09-21T04:01:31.293922+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:31:13.078117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039158+0000","last_change":"2024-09-21T04:00:01.987624+0000","last_active":"2024-09-21T04:01:31.039158+0000","last_peered":"2024-09-21T04:01:31.039158+0000","last_clean":"2024-09-21T04:01:31.039158+0000","last_became_active":"2024-09-21T04:00:01.987212+0000","last_became_peered":"2024-09-21T04:00:01.987212+0000","last_unstale":"2024-09-21T04:01:31.039158+0000","last_undegraded":"2024-09-21T04:01:31.039158+0000","last_fullsized":"2024-09-21T04:01:31.039158+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:21:18.554590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"85'15","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.310276+0000","last_change":"2024-09-21T04:00:04.017507+0000","last_active":"2024-09-21T04:01:59.310276+0000","last_peered":"2024-09-21T04:01:59.310276+0000","last_clean":"2024-09-21T04:01:59.310276+0000","last_became_active":"2024-09-21T04:00:04.017120+0000","last_became_peered":"2024-09-21T04:00:04.017120+0000","last_unstale":"2024-09-21T04:01:59.310276+0000","last_undegraded":"2024-09-21T04:01:59.310276+0000","last_fullsized":"2024-09-21T04:01:59.310276+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:19.015436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293558+0000","last_change":"2024-09-21T04:00:11.055047+0000","last_active":"2024-09-21T04:01:31.293558+0000","last_peered":"2024-09-21T04:01:31.293558+0000","last_clean":"2024-09-21T04:01:31.293558+0000","last_became_active":"2024-09-21T04:00:11.054504+0000","last_became_peered":"2024-09-21T04:00:11.054504+0000","last_unstale":"2024-09-21T04:01:31.293558+0000","last_undegraded":"2024-09-21T04:01:31.293558+0000","last_fullsized":"2024-09-21T04:01:31.293558+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:03:32.963011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.312681+0000","last_change":"2024-09-21T04:00:04.012633+0000","last_active":"2024-09-21T04:01:59.312681+0000","last_peered":"2024-09-21T04:01:59.312681+0000","last_clean":"2024-09-21T04:01:59.312681+0000","last_became_active":"2024-09-21T04:00:04.012246+0000","last_became_peered":"2024-09-21T04:00:04.012246+0000","last_unstale":"2024-09-21T04:01:59.312681+0000","last_undegraded":"2024-09-21T04:01:59.312681+0000","last_fullsized":"2024-09-21T04:01:59.312681+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:38:58.501317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"83'4","reported_seq":58,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039221+0000","last_change":"2024-09-21T04:00:30.144195+0000","last_active":"2024-09-21T04:01:31.039221+0000","last_peered":"2024-09-21T04:01:31.039221+0000","last_clean":"2024-09-21T04:01:31.039221+0000","last_became_active":"2024-09-21T04:00:30.140690+0000","last_became_peered":"2024-09-21T04:00:30.140690+0000","last_unstale":"2024-09-21T04:01:31.039221+0000","last_undegraded":"2024-09-21T04:01:31.039221+0000","last_fullsized":"2024-09-21T04:01:31.039221+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:24:42.686216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295148+0000","last_change":"2024-09-21T04:00:11.333935+0000","last_active":"2024-09-21T04:01:31.295148+0000","last_peered":"2024-09-21T04:01:31.295148+0000","last_clean":"2024-09-21T04:01:31.295148+0000","last_became_active":"2024-09-21T04:00:11.333336+0000","last_became_peered":"2024-09-21T04:00:11.333336+0000","last_unstale":"2024-09-21T04:01:31.295148+0000","last_undegraded":"2024-09-21T04:01:31.295148+0000","last_fullsized":"2024-09-21T04:01:31.295148+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:52:23.890845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304106+0000","last_change":"2024-09-21T04:00:04.002579+0000","last_active":"2024-09-21T04:01:59.304106+0000","last_peered":"2024-09-21T04:01:59.304106+0000","last_clean":"2024-09-21T04:01:59.304106+0000","last_became_active":"2024-09-21T04:00:04.001926+0000","last_became_peered":"2024-09-21T04:00:04.001926+0000","last_unstale":"2024-09-21T04:01:59.304106+0000","last_undegraded":"2024-09-21T04:01:59.304106+0000","last_fullsized":"2024-09-21T04:01:59.304106+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:09:11.131665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"85'4","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:14.855429+0000","last_change":"2024-09-21T04:00:01.983276+0000","last_active":"2024-09-21T04:02:14.855429+0000","last_peered":"2024-09-21T04:02:14.855429+0000","last_clean":"2024-09-21T04:02:14.855429+0000","last_became_active":"2024-09-21T04:00:01.982828+0000","last_became_peered":"2024-09-21T04:00:01.982828+0000","last_unstale":"2024-09-21T04:02:14.855429+0000","last_undegraded":"2024-09-21T04:02:14.855429+0000","last_fullsized":"2024-09-21T04:02:14.855429+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:09:52.266947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"83'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293768+0000","last_change":"2024-09-21T04:00:11.067529+0000","last_active":"2024-09-21T04:01:31.293768+0000","last_peered":"2024-09-21T04:01:31.293768+0000","last_clean":"2024-09-21T04:01:31.293768+0000","last_became_active":"2024-09-21T04:00:11.066975+0000","last_became_peered":"2024-09-21T04:00:11.066975+0000","last_unstale":"2024-09-21T04:01:31.293768+0000","last_undegraded":"2024-09-21T04:01:31.293768+0000","last_fullsized":"2024-09-21T04:01:31.293768+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:09.576148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.302144+0000","last_change":"2024-09-21T04:00:04.005822+0000","last_active":"2024-09-21T04:01:59.302144+0000","last_peered":"2024-09-21T04:01:59.302144+0000","last_clean":"2024-09-21T04:01:59.302144+0000","last_became_active":"2024-09-21T04:00:04.005468+0000","last_became_peered":"2024-09-21T04:00:04.005468+0000","last_unstale":"2024-09-21T04:01:59.302144+0000","last_undegraded":"2024-09-21T04:01:59.302144+0000","last_fullsized":"2024-09-21T04:01:59.302144+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:43:08.863103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"83'7","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039911+0000","last_change":"2024-09-21T04:00:01.984489+0000","last_active":"2024-09-21T04:01:31.039911+0000","last_peered":"2024-09-21T04:01:31.039911+0000","last_clean":"2024-09-21T04:01:31.039911+0000","last_became_active":"2024-09-21T04:00:01.983873+0000","last_became_peered":"2024-09-21T04:00:01.983873+0000","last_unstale":"2024-09-21T04:01:31.039911+0000","last_undegraded":"2024-09-21T04:01:31.039911+0000","last_fullsized":"2024-09-21T04:01:31.039911+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:25:22.717693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036859+0000","last_change":"2024-09-21T04:00:11.069148+0000","last_active":"2024-09-21T04:01:31.036859+0000","last_peered":"2024-09-21T04:01:31.036859+0000","last_clean":"2024-09-21T04:01:31.036859+0000","last_became_active":"2024-09-21T04:00:11.068723+0000","last_became_peered":"2024-09-21T04:00:11.068723+0000","last_unstale":"2024-09-21T04:01:31.036859+0000","last_undegraded":"2024-09-21T04:01:31.036859+0000","last_fullsized":"2024-09-21T04:01:31.036859+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:42.822525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"85'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.291688+0000","last_change":"2024-09-21T04:00:04.000526+0000","last_active":"2024-09-21T04:01:59.291688+0000","last_peered":"2024-09-21T04:01:59.291688+0000","last_clean":"2024-09-21T04:01:59.291688+0000","last_became_active":"2024-09-21T04:00:04.000137+0000","last_became_peered":"2024-09-21T04:00:04.000137+0000","last_unstale":"2024-09-21T04:01:59.291688+0000","last_undegraded":"2024-09-21T04:01:59.291688+0000","last_fullsized":"2024-09-21T04:01:59.291688+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:33:12.055499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"83'2","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303435+0000","last_change":"2024-09-21T04:00:02.162359+0000","last_active":"2024-09-21T04:01:31.303435+0000","last_peered":"2024-09-21T04:01:31.303435+0000","last_clean":"2024-09-21T04:01:31.303435+0000","last_became_active":"2024-09-21T04:00:02.161946+0000","last_became_peered":"2024-09-21T04:00:02.161946+0000","last_unstale":"2024-09-21T04:01:31.303435+0000","last_undegraded":"2024-09-21T04:01:31.303435+0000","last_fullsized":"2024-09-21T04:01:31.303435+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:38:18.841278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.294781+0000","last_change":"2024-09-21T04:00:30.138669+0000","last_active":"2024-09-21T04:01:31.294781+0000","last_peered":"2024-09-21T04:01:31.294781+0000","last_clean":"2024-09-21T04:01:31.294781+0000","last_became_active":"2024-09-21T04:00:30.137548+0000","last_became_peered":"2024-09-21T04:00:30.137548+0000","last_unstale":"2024-09-21T04:01:31.294781+0000","last_undegraded":"2024-09-21T04:01:31.294781+0000","last_fullsized":"2024-09-21T04:01:31.294781+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:56.867964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,10,9],"acting":[4,8,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"85'7","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304813+0000","last_change":"2024-09-21T04:00:30.396672+0000","last_active":"2024-09-21T04:01:59.304813+0000","last_peered":"2024-09-21T04:01:59.304813+0000","last_clean":"2024-09-21T04:01:59.304813+0000","last_became_active":"2024-09-21T04:00:30.396066+0000","last_became_peered":"2024-09-21T04:00:30.396066+0000","last_unstale":"2024-09-21T04:01:59.304813+0000","last_undegraded":"2024-09-21T04:01:59.304813+0000","last_fullsized":"2024-09-21T04:01:59.304813+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:04:01.582768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"83'7","reported_seq":50,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295111+0000","last_change":"2024-09-21T04:00:02.213481+0000","last_active":"2024-09-21T04:01:31.295111+0000","last_peered":"2024-09-21T04:01:31.295111+0000","last_clean":"2024-09-21T04:01:31.295111+0000","last_became_active":"2024-09-21T04:00:02.213093+0000","last_became_peered":"2024-09-21T04:00:02.213093+0000","last_unstale":"2024-09-21T04:01:31.295111+0000","last_undegraded":"2024-09-21T04:01:31.295111+0000","last_fullsized":"2024-09-21T04:01:31.295111+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:47:20.700406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042307+0000","last_change":"2024-09-21T04:00:11.058780+0000","last_active":"2024-09-21T04:01:31.042307+0000","last_peered":"2024-09-21T04:01:31.042307+0000","last_clean":"2024-09-21T04:01:31.042307+0000","last_became_active":"2024-09-21T04:00:11.058309+0000","last_became_peered":"2024-09-21T04:00:11.058309+0000","last_unstale":"2024-09-21T04:01:31.042307+0000","last_undegraded":"2024-09-21T04:01:31.042307+0000","last_fullsized":"2024-09-21T04:01:31.042307+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:02:31.134604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"85'5","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.305244+0000","last_change":"2024-09-21T04:00:04.005954+0000","last_active":"2024-09-21T04:01:59.305244+0000","last_peered":"2024-09-21T04:01:59.305244+0000","last_clean":"2024-09-21T04:01:59.305244+0000","last_became_active":"2024-09-21T04:00:04.005609+0000","last_became_peered":"2024-09-21T04:00:04.005609+0000","last_unstale":"2024-09-21T04:01:59.305244+0000","last_undegraded":"2024-09-21T04:01:59.305244+0000","last_fullsized":"2024-09-21T04:01:59.305244+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:02:52.596627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"85'16","reported_seq":75,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:15.667745+0000","last_change":"2024-09-21T04:01:31.047655+0000","last_active":"2024-09-21T04:02:15.667745+0000","last_peered":"2024-09-21T04:02:15.667745+0000","last_clean":"2024-09-21T04:02:15.667745+0000","last_became_active":"2024-09-21T04:01:31.040521+0000","last_became_peered":"2024-09-21T04:01:31.040521+0000","last_unstale":"2024-09-21T04:02:15.667745+0000","last_undegraded":"2024-09-21T04:02:15.667745+0000","last_fullsized":"2024-09-21T04:02:15.667745+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:08:32.316804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":7,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,3],"acting":[9,11,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039138+0000","last_change":"2024-09-21T04:00:11.334127+0000","last_active":"2024-09-21T04:01:31.039138+0000","last_peered":"2024-09-21T04:01:31.039138+0000","last_clean":"2024-09-21T04:01:31.039138+0000","last_became_active":"2024-09-21T04:00:11.333601+0000","last_became_peered":"2024-09-21T04:00:11.333601+0000","last_unstale":"2024-09-21T04:01:31.039138+0000","last_undegraded":"2024-09-21T04:01:31.039138+0000","last_fullsized":"2024-09-21T04:01:31.039138+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:33:10.114185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.285432+0000","last_change":"2024-09-21T04:00:03.988967+0000","last_active":"2024-09-21T04:01:59.285432+0000","last_peered":"2024-09-21T04:01:59.285432+0000","last_clean":"2024-09-21T04:01:59.285432+0000","last_became_active":"2024-09-21T04:00:03.988617+0000","last_became_peered":"2024-09-21T04:00:03.988617+0000","last_unstale":"2024-09-21T04:01:59.285432+0000","last_undegraded":"2024-09-21T04:01:59.285432+0000","last_fullsized":"2024-09-21T04:01:59.285432+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:09:05.963805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"83'4","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040198+0000","last_change":"2024-09-21T04:00:02.162698+0000","last_active":"2024-09-21T04:01:31.040198+0000","last_peered":"2024-09-21T04:01:31.040198+0000","last_clean":"2024-09-21T04:01:31.040198+0000","last_became_active":"2024-09-21T04:00:02.162254+0000","last_became_peered":"2024-09-21T04:00:02.162254+0000","last_unstale":"2024-09-21T04:01:31.040198+0000","last_undegraded":"2024-09-21T04:01:31.040198+0000","last_fullsized":"2024-09-21T04:01:31.040198+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:39:07.409718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037136+0000","last_change":"2024-09-21T04:00:11.057825+0000","last_active":"2024-09-21T04:01:31.037136+0000","last_peered":"2024-09-21T04:01:31.037136+0000","last_clean":"2024-09-21T04:01:31.037136+0000","last_became_active":"2024-09-21T04:00:11.057308+0000","last_became_peered":"2024-09-21T04:00:11.057308+0000","last_unstale":"2024-09-21T04:01:31.037136+0000","last_undegraded":"2024-09-21T04:01:31.037136+0000","last_fullsized":"2024-09-21T04:01:31.037136+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:09:20.925835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"85'4","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296292+0000","last_change":"2024-09-21T04:00:03.996631+0000","last_active":"2024-09-21T04:01:59.296292+0000","last_peered":"2024-09-21T04:01:59.296292+0000","last_clean":"2024-09-21T04:01:59.296292+0000","last_became_active":"2024-09-21T04:00:03.996264+0000","last_became_peered":"2024-09-21T04:00:03.996264+0000","last_unstale":"2024-09-21T04:01:59.296292+0000","last_undegraded":"2024-09-21T04:01:59.296292+0000","last_fullsized":"2024-09-21T04:01:59.296292+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:56:27.270843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"83'1","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036962+0000","last_change":"2024-09-21T04:00:02.162450+0000","last_active":"2024-09-21T04:01:31.036962+0000","last_peered":"2024-09-21T04:01:31.036962+0000","last_clean":"2024-09-21T04:01:31.036962+0000","last_became_active":"2024-09-21T04:00:02.161991+0000","last_became_peered":"2024-09-21T04:00:02.161991+0000","last_unstale":"2024-09-21T04:01:31.036962+0000","last_undegraded":"2024-09-21T04:01:31.036962+0000","last_fullsized":"2024-09-21T04:01:31.036962+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:41:09.862814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039345+0000","last_change":"2024-09-21T04:00:11.333873+0000","last_active":"2024-09-21T04:01:31.039345+0000","last_peered":"2024-09-21T04:01:31.039345+0000","last_clean":"2024-09-21T04:01:31.039345+0000","last_became_active":"2024-09-21T04:00:11.333368+0000","last_became_peered":"2024-09-21T04:00:11.333368+0000","last_unstale":"2024-09-21T04:01:31.039345+0000","last_undegraded":"2024-09-21T04:01:31.039345+0000","last_fullsized":"2024-09-21T04:01:31.039345+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:51:53.049305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"85'7","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296904+0000","last_change":"2024-09-21T04:00:30.138320+0000","last_active":"2024-09-21T04:01:59.296904+0000","last_peered":"2024-09-21T04:01:59.296904+0000","last_clean":"2024-09-21T04:01:59.296904+0000","last_became_active":"2024-09-21T04:00:30.137866+0000","last_became_peered":"2024-09-21T04:00:30.137866+0000","last_unstale":"2024-09-21T04:01:59.296904+0000","last_undegraded":"2024-09-21T04:01:59.296904+0000","last_fullsized":"2024-09-21T04:01:59.296904+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:25:39.992746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"85'8","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:27.374403+0000","last_change":"2024-09-21T04:00:01.986355+0000","last_active":"2024-09-21T04:02:27.374403+0000","last_peered":"2024-09-21T04:02:27.374403+0000","last_clean":"2024-09-21T04:02:27.374403+0000","last_became_active":"2024-09-21T04:00:01.985960+0000","last_became_peered":"2024-09-21T04:00:01.985960+0000","last_unstale":"2024-09-21T04:02:27.374403+0000","last_undegraded":"2024-09-21T04:02:27.374403+0000","last_fullsized":"2024-09-21T04:02:27.374403+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:29:08.417218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1597,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":108,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033004+0000","last_change":"2024-09-21T04:00:11.066363+0000","last_active":"2024-09-21T04:01:31.033004+0000","last_peered":"2024-09-21T04:01:31.033004+0000","last_clean":"2024-09-21T04:01:31.033004+0000","last_became_active":"2024-09-21T04:00:11.065923+0000","last_became_peered":"2024-09-21T04:00:11.065923+0000","last_unstale":"2024-09-21T04:01:31.033004+0000","last_undegraded":"2024-09-21T04:01:31.033004+0000","last_fullsized":"2024-09-21T04:01:31.033004+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:15:49.720377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"85'8","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304674+0000","last_change":"2024-09-21T04:00:04.010139+0000","last_active":"2024-09-21T04:01:59.304674+0000","last_peered":"2024-09-21T04:01:59.304674+0000","last_clean":"2024-09-21T04:01:59.304674+0000","last_became_active":"2024-09-21T04:00:04.009764+0000","last_became_peered":"2024-09-21T04:00:04.009764+0000","last_unstale":"2024-09-21T04:01:59.304674+0000","last_undegraded":"2024-09-21T04:01:59.304674+0000","last_fullsized":"2024-09-21T04:01:59.304674+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:57:08.384286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"85'6","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:28.376372+0000","last_change":"2024-09-21T04:00:02.162297+0000","last_active":"2024-09-21T04:02:28.376372+0000","last_peered":"2024-09-21T04:02:28.376372+0000","last_clean":"2024-09-21T04:02:28.376372+0000","last_became_active":"2024-09-21T04:00:02.161884+0000","last_became_peered":"2024-09-21T04:00:02.161884+0000","last_unstale":"2024-09-21T04:02:28.376372+0000","last_undegraded":"2024-09-21T04:02:28.376372+0000","last_fullsized":"2024-09-21T04:02:28.376372+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:15:21.108188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033190+0000","last_change":"2024-09-21T04:00:11.335000+0000","last_active":"2024-09-21T04:01:31.033190+0000","last_peered":"2024-09-21T04:01:31.033190+0000","last_clean":"2024-09-21T04:01:31.033190+0000","last_became_active":"2024-09-21T04:00:11.334529+0000","last_became_peered":"2024-09-21T04:00:11.334529+0000","last_unstale":"2024-09-21T04:01:31.033190+0000","last_undegraded":"2024-09-21T04:01:31.033190+0000","last_fullsized":"2024-09-21T04:01:31.033190+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:04:54.148883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"85'5","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.306427+0000","last_change":"2024-09-21T04:00:03.988089+0000","last_active":"2024-09-21T04:01:59.306427+0000","last_peered":"2024-09-21T04:01:59.306427+0000","last_clean":"2024-09-21T04:01:59.306427+0000","last_became_active":"2024-09-21T04:00:03.987641+0000","last_became_peered":"2024-09-21T04:00:03.987641+0000","last_unstale":"2024-09-21T04:01:59.306427+0000","last_undegraded":"2024-09-21T04:01:59.306427+0000","last_fullsized":"2024-09-21T04:01:59.306427+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:15:46.249510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"83'4","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.047436+0000","last_change":"2024-09-21T04:01:31.046744+0000","last_active":"2024-09-21T04:01:31.047436+0000","last_peered":"2024-09-21T04:01:31.047436+0000","last_clean":"2024-09-21T04:01:31.047436+0000","last_became_active":"2024-09-21T04:01:31.041093+0000","last_became_peered":"2024-09-21T04:01:31.041093+0000","last_unstale":"2024-09-21T04:01:31.047436+0000","last_undegraded":"2024-09-21T04:01:31.047436+0000","last_fullsized":"2024-09-21T04:01:31.047436+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:45:14.159990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,6,8],"acting":[11,6,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035140+0000","last_change":"2024-09-21T04:00:30.349715+0000","last_active":"2024-09-21T04:01:31.035140+0000","last_peered":"2024-09-21T04:01:31.035140+0000","last_clean":"2024-09-21T04:01:31.035140+0000","last_became_active":"2024-09-21T04:00:30.349233+0000","last_became_peered":"2024-09-21T04:00:30.349233+0000","last_unstale":"2024-09-21T04:01:31.035140+0000","last_undegraded":"2024-09-21T04:01:31.035140+0000","last_fullsized":"2024-09-21T04:01:31.035140+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:10:24.933082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,11,6,10],"acting":[5,11,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303096+0000","last_change":"2024-09-21T04:00:04.005025+0000","last_active":"2024-09-21T04:01:59.303096+0000","last_peered":"2024-09-21T04:01:59.303096+0000","last_clean":"2024-09-21T04:01:59.303096+0000","last_became_active":"2024-09-21T04:00:04.004697+0000","last_became_peered":"2024-09-21T04:00:04.004697+0000","last_unstale":"2024-09-21T04:01:59.303096+0000","last_undegraded":"2024-09-21T04:01:59.303096+0000","last_fullsized":"2024-09-21T04:01:59.303096+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:12:30.663231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"83'6","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.295076+0000","last_change":"2024-09-21T04:00:01.987438+0000","last_active":"2024-09-21T04:01:31.295076+0000","last_peered":"2024-09-21T04:01:31.295076+0000","last_clean":"2024-09-21T04:01:31.295076+0000","last_became_active":"2024-09-21T04:00:01.986995+0000","last_became_peered":"2024-09-21T04:00:01.986995+0000","last_unstale":"2024-09-21T04:01:31.295076+0000","last_undegraded":"2024-09-21T04:01:31.295076+0000","last_fullsized":"2024-09-21T04:01:31.295076+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:33:16.967454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"19'92","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040093+0000","last_change":"2024-09-21T03:58:47.597000+0000","last_active":"2024-09-21T04:01:31.040093+0000","last_peered":"2024-09-21T04:01:31.040093+0000","last_clean":"2024-09-21T04:01:31.040093+0000","last_became_active":"2024-09-21T03:58:47.590826+0000","last_became_peered":"2024-09-21T03:58:47.590826+0000","last_unstale":"2024-09-21T04:01:31.040093+0000","last_undegraded":"2024-09-21T04:01:31.040093+0000","last_fullsized":"2024-09-21T04:01:31.040093+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T03:55:20.271286+0000","last_clean_scrub_stamp":"2024-09-21T03:55:20.271286+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:31:53.813660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"83'1","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040238+0000","last_change":"2024-09-21T04:00:11.057229+0000","last_active":"2024-09-21T04:01:31.040238+0000","last_peered":"2024-09-21T04:01:31.040238+0000","last_clean":"2024-09-21T04:01:31.040238+0000","last_became_active":"2024-09-21T04:00:11.056722+0000","last_became_peered":"2024-09-21T04:00:11.056722+0000","last_unstale":"2024-09-21T04:01:31.040238+0000","last_undegraded":"2024-09-21T04:01:31.040238+0000","last_fullsized":"2024-09-21T04:01:31.040238+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:04:53.311589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.312449+0000","last_change":"2024-09-21T04:00:04.013650+0000","last_active":"2024-09-21T04:01:59.312449+0000","last_peered":"2024-09-21T04:01:59.312449+0000","last_clean":"2024-09-21T04:01:59.312449+0000","last_became_active":"2024-09-21T04:00:04.013284+0000","last_became_peered":"2024-09-21T04:00:04.013284+0000","last_unstale":"2024-09-21T04:01:59.312449+0000","last_undegraded":"2024-09-21T04:01:59.312449+0000","last_fullsized":"2024-09-21T04:01:59.312449+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:36:53.098998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"85'6","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:28.376712+0000","last_change":"2024-09-21T04:00:02.213332+0000","last_active":"2024-09-21T04:02:28.376712+0000","last_peered":"2024-09-21T04:02:28.376712+0000","last_clean":"2024-09-21T04:02:28.376712+0000","last_became_active":"2024-09-21T04:00:02.212853+0000","last_became_peered":"2024-09-21T04:00:02.212853+0000","last_unstale":"2024-09-21T04:02:28.376712+0000","last_undegraded":"2024-09-21T04:02:28.376712+0000","last_fullsized":"2024-09-21T04:02:28.376712+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:33:52.923489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":108,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.303077+0000","last_change":"2024-09-21T04:00:11.057139+0000","last_active":"2024-09-21T04:01:31.303077+0000","last_peered":"2024-09-21T04:01:31.303077+0000","last_clean":"2024-09-21T04:01:31.303077+0000","last_became_active":"2024-09-21T04:00:11.056549+0000","last_became_peered":"2024-09-21T04:00:11.056549+0000","last_unstale":"2024-09-21T04:01:31.303077+0000","last_undegraded":"2024-09-21T04:01:31.303077+0000","last_fullsized":"2024-09-21T04:01:31.303077+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:28.365161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"85'6","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304521+0000","last_change":"2024-09-21T04:00:30.141278+0000","last_active":"2024-09-21T04:01:59.304521+0000","last_peered":"2024-09-21T04:01:59.304521+0000","last_clean":"2024-09-21T04:01:59.304521+0000","last_became_active":"2024-09-21T04:00:30.140692+0000","last_became_peered":"2024-09-21T04:00:30.140692+0000","last_unstale":"2024-09-21T04:01:59.304521+0000","last_undegraded":"2024-09-21T04:01:59.304521+0000","last_fullsized":"2024-09-21T04:01:59.304521+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:34:15.600486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"83'3","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035507+0000","last_change":"2024-09-21T04:00:01.990532+0000","last_active":"2024-09-21T04:01:31.035507+0000","last_peered":"2024-09-21T04:01:31.035507+0000","last_clean":"2024-09-21T04:01:31.035507+0000","last_became_active":"2024-09-21T04:00:01.990114+0000","last_became_peered":"2024-09-21T04:00:01.990114+0000","last_unstale":"2024-09-21T04:01:31.035507+0000","last_undegraded":"2024-09-21T04:01:31.035507+0000","last_fullsized":"2024-09-21T04:01:31.035507+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:51.313576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.108185+0000","last_change":"2024-09-21T04:00:30.182161+0000","last_active":"2024-09-21T04:01:31.108185+0000","last_peered":"2024-09-21T04:01:31.108185+0000","last_clean":"2024-09-21T04:01:31.108185+0000","last_became_active":"2024-09-21T04:00:30.181777+0000","last_became_peered":"2024-09-21T04:00:30.181777+0000","last_unstale":"2024-09-21T04:01:31.108185+0000","last_undegraded":"2024-09-21T04:01:31.108185+0000","last_fullsized":"2024-09-21T04:01:31.108185+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:06:35.498978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307052+0000","last_change":"2024-09-21T04:00:04.006784+0000","last_active":"2024-09-21T04:01:59.307052+0000","last_peered":"2024-09-21T04:01:59.307052+0000","last_clean":"2024-09-21T04:01:59.307052+0000","last_became_active":"2024-09-21T04:00:04.003841+0000","last_became_peered":"2024-09-21T04:00:04.003841+0000","last_unstale":"2024-09-21T04:01:59.307052+0000","last_undegraded":"2024-09-21T04:01:59.307052+0000","last_fullsized":"2024-09-21T04:01:59.307052+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:50.088980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"83'5","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033310+0000","last_change":"2024-09-21T04:00:01.986202+0000","last_active":"2024-09-21T04:01:31.033310+0000","last_peered":"2024-09-21T04:01:31.033310+0000","last_clean":"2024-09-21T04:01:31.033310+0000","last_became_active":"2024-09-21T04:00:01.985812+0000","last_became_peered":"2024-09-21T04:00:01.985812+0000","last_unstale":"2024-09-21T04:01:31.033310+0000","last_undegraded":"2024-09-21T04:01:31.033310+0000","last_fullsized":"2024-09-21T04:01:31.033310+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:39:05.777175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034572+0000","last_change":"2024-09-21T04:00:11.057253+0000","last_active":"2024-09-21T04:01:31.034572+0000","last_peered":"2024-09-21T04:01:31.034572+0000","last_clean":"2024-09-21T04:01:31.034572+0000","last_became_active":"2024-09-21T04:00:11.056721+0000","last_became_peered":"2024-09-21T04:00:11.056721+0000","last_unstale":"2024-09-21T04:01:31.034572+0000","last_undegraded":"2024-09-21T04:01:31.034572+0000","last_fullsized":"2024-09-21T04:01:31.034572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:54:19.202714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"85'5","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304854+0000","last_change":"2024-09-21T04:00:04.003674+0000","last_active":"2024-09-21T04:01:59.304854+0000","last_peered":"2024-09-21T04:01:59.304854+0000","last_clean":"2024-09-21T04:01:59.304854+0000","last_became_active":"2024-09-21T04:00:04.003297+0000","last_became_peered":"2024-09-21T04:00:04.003297+0000","last_unstale":"2024-09-21T04:01:59.304854+0000","last_undegraded":"2024-09-21T04:01:59.304854+0000","last_fullsized":"2024-09-21T04:01:59.304854+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:12:23.063721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"85'3","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:19.460463+0000","last_change":"2024-09-21T04:00:01.986007+0000","last_active":"2024-09-21T04:02:19.460463+0000","last_peered":"2024-09-21T04:02:19.460463+0000","last_clean":"2024-09-21T04:02:19.460463+0000","last_became_active":"2024-09-21T04:00:01.985582+0000","last_became_peered":"2024-09-21T04:00:01.985582+0000","last_unstale":"2024-09-21T04:02:19.460463+0000","last_undegraded":"2024-09-21T04:02:19.460463+0000","last_fullsized":"2024-09-21T04:02:19.460463+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:42:48.429307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.034852+0000","last_change":"2024-09-21T04:00:11.061522+0000","last_active":"2024-09-21T04:01:31.034852+0000","last_peered":"2024-09-21T04:01:31.034852+0000","last_clean":"2024-09-21T04:01:31.034852+0000","last_became_active":"2024-09-21T04:00:11.060984+0000","last_became_peered":"2024-09-21T04:00:11.060984+0000","last_unstale":"2024-09-21T04:01:31.034852+0000","last_undegraded":"2024-09-21T04:01:31.034852+0000","last_fullsized":"2024-09-21T04:01:31.034852+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:53:51.286098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.309095+0000","last_change":"2024-09-21T04:00:04.016468+0000","last_active":"2024-09-21T04:01:59.309095+0000","last_peered":"2024-09-21T04:01:59.309095+0000","last_clean":"2024-09-21T04:01:59.309095+0000","last_became_active":"2024-09-21T04:00:04.016177+0000","last_became_peered":"2024-09-21T04:00:04.016177+0000","last_unstale":"2024-09-21T04:01:59.309095+0000","last_undegraded":"2024-09-21T04:01:59.309095+0000","last_fullsized":"2024-09-21T04:01:59.309095+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:12:58.670552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"83'17","reported_seq":60,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039248+0000","last_change":"2024-09-21T04:00:02.162746+0000","last_active":"2024-09-21T04:01:31.039248+0000","last_peered":"2024-09-21T04:01:31.039248+0000","last_clean":"2024-09-21T04:01:31.039248+0000","last_became_active":"2024-09-21T04:00:02.162121+0000","last_became_peered":"2024-09-21T04:00:02.162121+0000","last_unstale":"2024-09-21T04:01:31.039248+0000","last_undegraded":"2024-09-21T04:01:31.039248+0000","last_fullsized":"2024-09-21T04:01:31.039248+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:52:02.798790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033264+0000","last_change":"2024-09-21T04:00:11.068043+0000","last_active":"2024-09-21T04:01:31.033264+0000","last_peered":"2024-09-21T04:01:31.033264+0000","last_clean":"2024-09-21T04:01:31.033264+0000","last_became_active":"2024-09-21T04:00:11.067553+0000","last_became_peered":"2024-09-21T04:00:11.067553+0000","last_unstale":"2024-09-21T04:01:31.033264+0000","last_undegraded":"2024-09-21T04:01:31.033264+0000","last_fullsized":"2024-09-21T04:01:31.033264+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:28:34.095708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307897+0000","last_change":"2024-09-21T04:00:04.010725+0000","last_active":"2024-09-21T04:01:59.307897+0000","last_peered":"2024-09-21T04:01:59.307897+0000","last_clean":"2024-09-21T04:01:59.307897+0000","last_became_active":"2024-09-21T04:00:04.010295+0000","last_became_peered":"2024-09-21T04:00:04.010295+0000","last_unstale":"2024-09-21T04:01:59.307897+0000","last_undegraded":"2024-09-21T04:01:59.307897+0000","last_fullsized":"2024-09-21T04:01:59.307897+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:33:40.417814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"85'6","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:30.379696+0000","last_change":"2024-09-21T04:00:01.985123+0000","last_active":"2024-09-21T04:02:30.379696+0000","last_peered":"2024-09-21T04:02:30.379696+0000","last_clean":"2024-09-21T04:02:30.379696+0000","last_became_active":"2024-09-21T04:00:01.984686+0000","last_became_peered":"2024-09-21T04:00:01.984686+0000","last_unstale":"2024-09-21T04:02:30.379696+0000","last_undegraded":"2024-09-21T04:02:30.379696+0000","last_fullsized":"2024-09-21T04:02:30.379696+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:13:18.825567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1065,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":111,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036813+0000","last_change":"2024-09-21T04:00:11.068045+0000","last_active":"2024-09-21T04:01:31.036813+0000","last_peered":"2024-09-21T04:01:31.036813+0000","last_clean":"2024-09-21T04:01:31.036813+0000","last_became_active":"2024-09-21T04:00:11.067528+0000","last_became_peered":"2024-09-21T04:00:11.067528+0000","last_unstale":"2024-09-21T04:01:31.036813+0000","last_undegraded":"2024-09-21T04:01:31.036813+0000","last_fullsized":"2024-09-21T04:01:31.036813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:26:54.054763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"85'15","reported_seq":51,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.308037+0000","last_change":"2024-09-21T04:00:04.008068+0000","last_active":"2024-09-21T04:01:59.308037+0000","last_peered":"2024-09-21T04:01:59.308037+0000","last_clean":"2024-09-21T04:01:59.308037+0000","last_became_active":"2024-09-21T04:00:04.007611+0000","last_became_peered":"2024-09-21T04:00:04.007611+0000","last_unstale":"2024-09-21T04:01:59.308037+0000","last_undegraded":"2024-09-21T04:01:59.308037+0000","last_fullsized":"2024-09-21T04:01:59.308037+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:10:02.363722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035983+0000","last_change":"2024-09-21T04:00:01.986011+0000","last_active":"2024-09-21T04:01:31.035983+0000","last_peered":"2024-09-21T04:01:31.035983+0000","last_clean":"2024-09-21T04:01:31.035983+0000","last_became_active":"2024-09-21T04:00:01.985637+0000","last_became_peered":"2024-09-21T04:00:01.985637+0000","last_unstale":"2024-09-21T04:01:31.035983+0000","last_undegraded":"2024-09-21T04:01:31.035983+0000","last_fullsized":"2024-09-21T04:01:31.035983+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:28:36.226063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037486+0000","last_change":"2024-09-21T04:00:11.067798+0000","last_active":"2024-09-21T04:01:31.037486+0000","last_peered":"2024-09-21T04:01:31.037486+0000","last_clean":"2024-09-21T04:01:31.037486+0000","last_became_active":"2024-09-21T04:00:11.067319+0000","last_became_peered":"2024-09-21T04:00:11.067319+0000","last_unstale":"2024-09-21T04:01:31.037486+0000","last_undegraded":"2024-09-21T04:01:31.037486+0000","last_fullsized":"2024-09-21T04:01:31.037486+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:45:37.118986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.297180+0000","last_change":"2024-09-21T04:00:04.003222+0000","last_active":"2024-09-21T04:01:59.297180+0000","last_peered":"2024-09-21T04:01:59.297180+0000","last_clean":"2024-09-21T04:01:59.297180+0000","last_became_active":"2024-09-21T04:00:04.002893+0000","last_became_peered":"2024-09-21T04:00:04.002893+0000","last_unstale":"2024-09-21T04:01:59.297180+0000","last_undegraded":"2024-09-21T04:01:59.297180+0000","last_fullsized":"2024-09-21T04:01:59.297180+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:14:18.806695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"83'9","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042658+0000","last_change":"2024-09-21T04:00:01.985978+0000","last_active":"2024-09-21T04:01:31.042658+0000","last_peered":"2024-09-21T04:01:31.042658+0000","last_clean":"2024-09-21T04:01:31.042658+0000","last_became_active":"2024-09-21T04:00:01.985607+0000","last_became_peered":"2024-09-21T04:00:01.985607+0000","last_unstale":"2024-09-21T04:01:31.042658+0000","last_undegraded":"2024-09-21T04:01:31.042658+0000","last_fullsized":"2024-09-21T04:01:31.042658+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:05:30.113727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035195+0000","last_change":"2024-09-21T04:00:11.069332+0000","last_active":"2024-09-21T04:01:31.035195+0000","last_peered":"2024-09-21T04:01:31.035195+0000","last_clean":"2024-09-21T04:01:31.035195+0000","last_became_active":"2024-09-21T04:00:11.068832+0000","last_became_peered":"2024-09-21T04:00:11.068832+0000","last_unstale":"2024-09-21T04:01:31.035195+0000","last_undegraded":"2024-09-21T04:01:31.035195+0000","last_fullsized":"2024-09-21T04:01:31.035195+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:52:03.290214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"85'6","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.294175+0000","last_change":"2024-09-21T04:00:04.004234+0000","last_active":"2024-09-21T04:01:59.294175+0000","last_peered":"2024-09-21T04:01:59.294175+0000","last_clean":"2024-09-21T04:01:59.294175+0000","last_became_active":"2024-09-21T04:00:04.003839+0000","last_became_peered":"2024-09-21T04:00:04.003839+0000","last_unstale":"2024-09-21T04:01:59.294175+0000","last_undegraded":"2024-09-21T04:01:59.294175+0000","last_fullsized":"2024-09-21T04:01:59.294175+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:27:50.971580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"85'39","reported_seq":304,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:30.379098+0000","last_change":"2024-09-21T04:00:01.990623+0000","last_active":"2024-09-21T04:02:30.379098+0000","last_peered":"2024-09-21T04:02:30.379098+0000","last_clean":"2024-09-21T04:02:30.379098+0000","last_became_active":"2024-09-21T04:00:01.990030+0000","last_became_peered":"2024-09-21T04:00:01.990030+0000","last_unstale":"2024-09-21T04:02:30.379098+0000","last_undegraded":"2024-09-21T04:02:30.379098+0000","last_fullsized":"2024-09-21T04:02:30.379098+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:24:07.150261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66938,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":223,"num_read_kb":177,"num_write":41,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.036520+0000","last_change":"2024-09-21T04:00:11.064198+0000","last_active":"2024-09-21T04:01:31.036520+0000","last_peered":"2024-09-21T04:01:31.036520+0000","last_clean":"2024-09-21T04:01:31.036520+0000","last_became_active":"2024-09-21T04:00:11.063519+0000","last_became_peered":"2024-09-21T04:00:11.063519+0000","last_unstale":"2024-09-21T04:01:31.036520+0000","last_undegraded":"2024-09-21T04:01:31.036520+0000","last_fullsized":"2024-09-21T04:01:31.036520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:03:16.189027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"85'11","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.323627+0000","last_change":"2024-09-21T04:00:04.009685+0000","last_active":"2024-09-21T04:01:59.323627+0000","last_peered":"2024-09-21T04:01:59.323627+0000","last_clean":"2024-09-21T04:01:59.323627+0000","last_became_active":"2024-09-21T04:00:04.009217+0000","last_became_peered":"2024-09-21T04:00:04.009217+0000","last_unstale":"2024-09-21T04:01:59.323627+0000","last_undegraded":"2024-09-21T04:01:59.323627+0000","last_fullsized":"2024-09-21T04:01:59.323627+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:57:31.780399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"83'5","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035447+0000","last_change":"2024-09-21T04:00:02.164467+0000","last_active":"2024-09-21T04:01:31.035447+0000","last_peered":"2024-09-21T04:01:31.035447+0000","last_clean":"2024-09-21T04:01:31.035447+0000","last_became_active":"2024-09-21T04:00:02.164091+0000","last_became_peered":"2024-09-21T04:00:02.164091+0000","last_unstale":"2024-09-21T04:01:31.035447+0000","last_undegraded":"2024-09-21T04:01:31.035447+0000","last_fullsized":"2024-09-21T04:01:31.035447+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:12:12.327745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.293778+0000","last_change":"2024-09-21T04:00:11.058828+0000","last_active":"2024-09-21T04:01:31.293778+0000","last_peered":"2024-09-21T04:01:31.293778+0000","last_clean":"2024-09-21T04:01:31.293778+0000","last_became_active":"2024-09-21T04:00:11.058188+0000","last_became_peered":"2024-09-21T04:00:11.058188+0000","last_unstale":"2024-09-21T04:01:31.293778+0000","last_undegraded":"2024-09-21T04:01:31.293778+0000","last_fullsized":"2024-09-21T04:01:31.293778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:28:17.767306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.300695+0000","last_change":"2024-09-21T04:00:04.004693+0000","last_active":"2024-09-21T04:01:59.300695+0000","last_peered":"2024-09-21T04:01:59.300695+0000","last_clean":"2024-09-21T04:01:59.300695+0000","last_became_active":"2024-09-21T04:00:04.004357+0000","last_became_peered":"2024-09-21T04:00:04.004357+0000","last_unstale":"2024-09-21T04:01:59.300695+0000","last_undegraded":"2024-09-21T04:01:59.300695+0000","last_fullsized":"2024-09-21T04:01:59.300695+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:17:26.515073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"83'4","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.040115+0000","last_change":"2024-09-21T04:00:01.987319+0000","last_active":"2024-09-21T04:01:31.040115+0000","last_peered":"2024-09-21T04:01:31.040115+0000","last_clean":"2024-09-21T04:01:31.040115+0000","last_became_active":"2024-09-21T04:00:01.986012+0000","last_became_peered":"2024-09-21T04:00:01.986012+0000","last_unstale":"2024-09-21T04:01:31.040115+0000","last_undegraded":"2024-09-21T04:01:31.040115+0000","last_fullsized":"2024-09-21T04:01:31.040115+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:19:03.936479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.038535+0000","last_change":"2024-09-21T04:00:30.139534+0000","last_active":"2024-09-21T04:01:31.038535+0000","last_peered":"2024-09-21T04:01:31.038535+0000","last_clean":"2024-09-21T04:01:31.038535+0000","last_became_active":"2024-09-21T04:00:30.138954+0000","last_became_peered":"2024-09-21T04:00:30.138954+0000","last_unstale":"2024-09-21T04:01:31.038535+0000","last_undegraded":"2024-09-21T04:01:31.038535+0000","last_fullsized":"2024-09-21T04:01:31.038535+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:47:21.368007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2,4],"acting":[8,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.16","version":"85'10","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.320136+0000","last_change":"2024-09-21T04:00:04.013737+0000","last_active":"2024-09-21T04:01:59.320136+0000","last_peered":"2024-09-21T04:01:59.320136+0000","last_clean":"2024-09-21T04:01:59.320136+0000","last_became_active":"2024-09-21T04:00:04.012901+0000","last_became_peered":"2024-09-21T04:00:04.012901+0000","last_unstale":"2024-09-21T04:01:59.320136+0000","last_undegraded":"2024-09-21T04:01:59.320136+0000","last_fullsized":"2024-09-21T04:01:59.320136+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:59:50.952778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"85'6","reported_seq":260,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:30.379452+0000","last_change":"2024-09-21T04:00:01.987988+0000","last_active":"2024-09-21T04:02:30.379452+0000","last_peered":"2024-09-21T04:02:30.379452+0000","last_clean":"2024-09-21T04:02:30.379452+0000","last_became_active":"2024-09-21T04:00:01.986593+0000","last_became_peered":"2024-09-21T04:00:01.986593+0000","last_unstale":"2024-09-21T04:02:30.379452+0000","last_undegraded":"2024-09-21T04:02:30.379452+0000","last_fullsized":"2024-09-21T04:02:30.379452+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:52:14.256609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":212,"num_read_kb":212,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.039336+0000","last_change":"2024-09-21T04:00:11.064937+0000","last_active":"2024-09-21T04:01:31.039336+0000","last_peered":"2024-09-21T04:01:31.039336+0000","last_clean":"2024-09-21T04:01:31.039336+0000","last_became_active":"2024-09-21T04:00:11.063809+0000","last_became_peered":"2024-09-21T04:00:11.063809+0000","last_unstale":"2024-09-21T04:01:31.039336+0000","last_undegraded":"2024-09-21T04:01:31.039336+0000","last_fullsized":"2024-09-21T04:01:31.039336+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:24:00.478208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.107781+0000","last_change":"2024-09-21T04:00:11.068084+0000","last_active":"2024-09-21T04:01:31.107781+0000","last_peered":"2024-09-21T04:01:31.107781+0000","last_clean":"2024-09-21T04:01:31.107781+0000","last_became_active":"2024-09-21T04:00:11.067587+0000","last_became_peered":"2024-09-21T04:00:11.067587+0000","last_unstale":"2024-09-21T04:01:31.107781+0000","last_undegraded":"2024-09-21T04:01:31.107781+0000","last_fullsized":"2024-09-21T04:01:31.107781+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T09:02:30.849467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"85'11","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296791+0000","last_change":"2024-09-21T04:00:03.997501+0000","last_active":"2024-09-21T04:01:59.296791+0000","last_peered":"2024-09-21T04:01:59.296791+0000","last_clean":"2024-09-21T04:01:59.296791+0000","last_became_active":"2024-09-21T04:00:03.997100+0000","last_became_peered":"2024-09-21T04:00:03.997100+0000","last_unstale":"2024-09-21T04:01:59.296791+0000","last_undegraded":"2024-09-21T04:01:59.296791+0000","last_fullsized":"2024-09-21T04:01:59.296791+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:51:31.813970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"83'3","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.035055+0000","last_change":"2024-09-21T04:00:01.986224+0000","last_active":"2024-09-21T04:01:31.035055+0000","last_peered":"2024-09-21T04:01:31.035055+0000","last_clean":"2024-09-21T04:01:31.035055+0000","last_became_active":"2024-09-21T04:00:01.985845+0000","last_became_peered":"2024-09-21T04:00:01.985845+0000","last_unstale":"2024-09-21T04:01:31.035055+0000","last_undegraded":"2024-09-21T04:01:31.035055+0000","last_fullsized":"2024-09-21T04:01:31.035055+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:15:38.895288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.037519+0000","last_change":"2024-09-21T04:00:11.067705+0000","last_active":"2024-09-21T04:01:31.037519+0000","last_peered":"2024-09-21T04:01:31.037519+0000","last_clean":"2024-09-21T04:01:31.037519+0000","last_became_active":"2024-09-21T04:00:11.067252+0000","last_became_peered":"2024-09-21T04:00:11.067252+0000","last_unstale":"2024-09-21T04:01:31.037519+0000","last_undegraded":"2024-09-21T04:01:31.037519+0000","last_fullsized":"2024-09-21T04:01:31.037519+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:07:47.003323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.297022+0000","last_change":"2024-09-21T04:00:03.996067+0000","last_active":"2024-09-21T04:01:59.297022+0000","last_peered":"2024-09-21T04:01:59.297022+0000","last_clean":"2024-09-21T04:01:59.297022+0000","last_became_active":"2024-09-21T04:00:03.995603+0000","last_became_peered":"2024-09-21T04:00:03.995603+0000","last_unstale":"2024-09-21T04:01:59.297022+0000","last_undegraded":"2024-09-21T04:01:59.297022+0000","last_fullsized":"2024-09-21T04:01:59.297022+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:05:19.348461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"83'3","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.032670+0000","last_change":"2024-09-21T04:00:01.985283+0000","last_active":"2024-09-21T04:01:31.032670+0000","last_peered":"2024-09-21T04:01:31.032670+0000","last_clean":"2024-09-21T04:01:31.032670+0000","last_became_active":"2024-09-21T04:00:01.984860+0000","last_became_peered":"2024-09-21T04:00:01.984860+0000","last_unstale":"2024-09-21T04:01:31.032670+0000","last_undegraded":"2024-09-21T04:01:31.032670+0000","last_fullsized":"2024-09-21T04:01:31.032670+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:20:38.739987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"83'7","reported_seq":55,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.033620+0000","last_change":"2024-09-21T04:00:30.183241+0000","last_active":"2024-09-21T04:01:31.033620+0000","last_peered":"2024-09-21T04:01:31.033620+0000","last_clean":"2024-09-21T04:01:31.033620+0000","last_became_active":"2024-09-21T04:00:30.182788+0000","last_became_peered":"2024-09-21T04:00:30.182788+0000","last_unstale":"2024-09-21T04:01:31.033620+0000","last_undegraded":"2024-09-21T04:01:31.033620+0000","last_fullsized":"2024-09-21T04:01:31.033620+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:14:47.129478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,6],"acting":[10,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"85'8","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.305063+0000","last_change":"2024-09-21T04:00:04.004526+0000","last_active":"2024-09-21T04:01:59.305063+0000","last_peered":"2024-09-21T04:01:59.305063+0000","last_clean":"2024-09-21T04:01:59.305063+0000","last_became_active":"2024-09-21T04:00:04.004114+0000","last_became_peered":"2024-09-21T04:00:04.004114+0000","last_unstale":"2024-09-21T04:01:59.305063+0000","last_undegraded":"2024-09-21T04:01:59.305063+0000","last_fullsized":"2024-09-21T04:01:59.305063+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:22:50.212647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042439+0000","last_change":"2024-09-21T04:00:11.067811+0000","last_active":"2024-09-21T04:01:31.042439+0000","last_peered":"2024-09-21T04:01:31.042439+0000","last_clean":"2024-09-21T04:01:31.042439+0000","last_became_active":"2024-09-21T04:00:11.067280+0000","last_became_peered":"2024-09-21T04:00:11.067280+0000","last_unstale":"2024-09-21T04:01:31.042439+0000","last_undegraded":"2024-09-21T04:01:31.042439+0000","last_fullsized":"2024-09-21T04:01:31.042439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:34:08.152231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"85'6","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:02:32.383084+0000","last_change":"2024-09-21T04:00:01.987215+0000","last_active":"2024-09-21T04:02:32.383084+0000","last_peered":"2024-09-21T04:02:32.383084+0000","last_clean":"2024-09-21T04:02:32.383084+0000","last_became_active":"2024-09-21T04:00:01.986738+0000","last_became_peered":"2024-09-21T04:00:01.986738+0000","last_unstale":"2024-09-21T04:02:32.383084+0000","last_undegraded":"2024-09-21T04:02:32.383084+0000","last_fullsized":"2024-09-21T04:02:32.383084+0000","mapping_epoch":70,"log_start":"0'0","ondisk_log_start":"0'0","created":70,"last_epoch_clean":71,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:00.959893+0000","last_clean_scrub_stamp":"2024-09-21T04:00:00.959893+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:24:16.204316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1099,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.288559+0000","last_change":"2024-09-21T04:00:04.003232+0000","last_active":"2024-09-21T04:01:59.288559+0000","last_peered":"2024-09-21T04:01:59.288559+0000","last_clean":"2024-09-21T04:01:59.288559+0000","last_became_active":"2024-09-21T04:00:04.002865+0000","last_became_peered":"2024-09-21T04:00:04.002865+0000","last_unstale":"2024-09-21T04:01:59.288559+0000","last_undegraded":"2024-09-21T04:01:59.288559+0000","last_fullsized":"2024-09-21T04:01:59.288559+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:22:29.298836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:31.042636+0000","last_change":"2024-09-21T04:00:11.057591+0000","last_active":"2024-09-21T04:01:31.042636+0000","last_peered":"2024-09-21T04:01:31.042636+0000","last_clean":"2024-09-21T04:01:31.042636+0000","last_became_active":"2024-09-21T04:00:11.057092+0000","last_became_peered":"2024-09-21T04:00:11.057092+0000","last_unstale":"2024-09-21T04:01:31.042636+0000","last_undegraded":"2024-09-21T04:01:31.042636+0000","last_fullsized":"2024-09-21T04:01:31.042636+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:10.035544+0000","last_clean_scrub_stamp":"2024-09-21T04:00:10.035544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:27:47.487649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.297302+0000","last_change":"2024-09-21T04:00:04.010297+0000","last_active":"2024-09-21T04:01:59.297302+0000","last_peered":"2024-09-21T04:01:59.297302+0000","last_clean":"2024-09-21T04:01:59.297302+0000","last_became_active":"2024-09-21T04:00:04.009948+0000","last_became_peered":"2024-09-21T04:00:04.009948+0000","last_unstale":"2024-09-21T04:01:59.297302+0000","last_undegraded":"2024-09-21T04:01:59.297302+0000","last_fullsized":"2024-09-21T04:01:59.297302+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:59:07.927430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"85'12","reported_seq":49,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.300581+0000","last_change":"2024-09-21T04:00:04.005564+0000","last_active":"2024-09-21T04:01:59.300581+0000","last_peered":"2024-09-21T04:01:59.300581+0000","last_clean":"2024-09-21T04:01:59.300581+0000","last_became_active":"2024-09-21T04:00:04.005119+0000","last_became_peered":"2024-09-21T04:00:04.005119+0000","last_unstale":"2024-09-21T04:01:59.300581+0000","last_undegraded":"2024-09-21T04:01:59.300581+0000","last_fullsized":"2024-09-21T04:01:59.300581+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:56:05.844333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303659+0000","last_change":"2024-09-21T04:00:03.997004+0000","last_active":"2024-09-21T04:01:59.303659+0000","last_peered":"2024-09-21T04:01:59.303659+0000","last_clean":"2024-09-21T04:01:59.303659+0000","last_became_active":"2024-09-21T04:00:03.996570+0000","last_became_peered":"2024-09-21T04:00:03.996570+0000","last_unstale":"2024-09-21T04:01:59.303659+0000","last_undegraded":"2024-09-21T04:01:59.303659+0000","last_fullsized":"2024-09-21T04:01:59.303659+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:00:35.438015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.301278+0000","last_change":"2024-09-21T04:00:04.005794+0000","last_active":"2024-09-21T04:01:59.301278+0000","last_peered":"2024-09-21T04:01:59.301278+0000","last_clean":"2024-09-21T04:01:59.301278+0000","last_became_active":"2024-09-21T04:00:04.005345+0000","last_became_peered":"2024-09-21T04:00:04.005345+0000","last_unstale":"2024-09-21T04:01:59.301278+0000","last_undegraded":"2024-09-21T04:01:59.301278+0000","last_fullsized":"2024-09-21T04:01:59.301278+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T04:17:20.726415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304644+0000","last_change":"2024-09-21T04:00:03.992204+0000","last_active":"2024-09-21T04:01:59.304644+0000","last_peered":"2024-09-21T04:01:59.304644+0000","last_clean":"2024-09-21T04:01:59.304644+0000","last_became_active":"2024-09-21T04:00:03.991826+0000","last_became_peered":"2024-09-21T04:00:03.991826+0000","last_unstale":"2024-09-21T04:01:59.304644+0000","last_undegraded":"2024-09-21T04:01:59.304644+0000","last_fullsized":"2024-09-21T04:01:59.304644+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T08:41:08.443227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"85'6","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.296485+0000","last_change":"2024-09-21T04:00:04.004401+0000","last_active":"2024-09-21T04:01:59.296485+0000","last_peered":"2024-09-21T04:01:59.296485+0000","last_clean":"2024-09-21T04:01:59.296485+0000","last_became_active":"2024-09-21T04:00:04.003983+0000","last_became_peered":"2024-09-21T04:00:04.003983+0000","last_unstale":"2024-09-21T04:01:59.296485+0000","last_undegraded":"2024-09-21T04:01:59.296485+0000","last_fullsized":"2024-09-21T04:01:59.296485+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:14:06.250069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"85'15","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307069+0000","last_change":"2024-09-21T04:00:03.999692+0000","last_active":"2024-09-21T04:01:59.307069+0000","last_peered":"2024-09-21T04:01:59.307069+0000","last_clean":"2024-09-21T04:01:59.307069+0000","last_became_active":"2024-09-21T04:00:03.999282+0000","last_became_peered":"2024-09-21T04:00:03.999282+0000","last_unstale":"2024-09-21T04:01:59.307069+0000","last_undegraded":"2024-09-21T04:01:59.307069+0000","last_fullsized":"2024-09-21T04:01:59.307069+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:50:58.323350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"85'2","reported_seq":39,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304667+0000","last_change":"2024-09-21T04:00:04.002947+0000","last_active":"2024-09-21T04:01:59.304667+0000","last_peered":"2024-09-21T04:01:59.304667+0000","last_clean":"2024-09-21T04:01:59.304667+0000","last_became_active":"2024-09-21T04:00:04.002550+0000","last_became_peered":"2024-09-21T04:00:04.002550+0000","last_unstale":"2024-09-21T04:01:59.304667+0000","last_undegraded":"2024-09-21T04:01:59.304667+0000","last_fullsized":"2024-09-21T04:01:59.304667+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:15:17.991513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303619+0000","last_change":"2024-09-21T04:00:04.009700+0000","last_active":"2024-09-21T04:01:59.303619+0000","last_peered":"2024-09-21T04:01:59.303619+0000","last_clean":"2024-09-21T04:01:59.303619+0000","last_became_active":"2024-09-21T04:00:04.009311+0000","last_became_peered":"2024-09-21T04:00:04.009311+0000","last_unstale":"2024-09-21T04:01:59.303619+0000","last_undegraded":"2024-09-21T04:01:59.303619+0000","last_fullsized":"2024-09-21T04:01:59.303619+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:51.658543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304365+0000","last_change":"2024-09-21T04:00:04.002975+0000","last_active":"2024-09-21T04:01:59.304365+0000","last_peered":"2024-09-21T04:01:59.304365+0000","last_clean":"2024-09-21T04:01:59.304365+0000","last_became_active":"2024-09-21T04:00:04.002608+0000","last_became_peered":"2024-09-21T04:00:04.002608+0000","last_unstale":"2024-09-21T04:01:59.304365+0000","last_undegraded":"2024-09-21T04:01:59.304365+0000","last_fullsized":"2024-09-21T04:01:59.304365+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:46:13.044615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"85'10","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.320397+0000","last_change":"2024-09-21T04:00:04.010797+0000","last_active":"2024-09-21T04:01:59.320397+0000","last_peered":"2024-09-21T04:01:59.320397+0000","last_clean":"2024-09-21T04:01:59.320397+0000","last_became_active":"2024-09-21T04:00:04.010377+0000","last_became_peered":"2024-09-21T04:00:04.010377+0000","last_unstale":"2024-09-21T04:01:59.320397+0000","last_undegraded":"2024-09-21T04:01:59.320397+0000","last_fullsized":"2024-09-21T04:01:59.320397+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:36:58.136240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"85'11","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304621+0000","last_change":"2024-09-21T04:00:04.002841+0000","last_active":"2024-09-21T04:01:59.304621+0000","last_peered":"2024-09-21T04:01:59.304621+0000","last_clean":"2024-09-21T04:01:59.304621+0000","last_became_active":"2024-09-21T04:00:04.002491+0000","last_became_peered":"2024-09-21T04:00:04.002491+0000","last_unstale":"2024-09-21T04:01:59.304621+0000","last_undegraded":"2024-09-21T04:01:59.304621+0000","last_fullsized":"2024-09-21T04:01:59.304621+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:57:52.816860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.307009+0000","last_change":"2024-09-21T04:00:04.007238+0000","last_active":"2024-09-21T04:01:59.307009+0000","last_peered":"2024-09-21T04:01:59.307009+0000","last_clean":"2024-09-21T04:01:59.307009+0000","last_became_active":"2024-09-21T04:00:04.006898+0000","last_became_peered":"2024-09-21T04:00:04.006898+0000","last_unstale":"2024-09-21T04:01:59.307009+0000","last_undegraded":"2024-09-21T04:01:59.307009+0000","last_fullsized":"2024-09-21T04:01:59.307009+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:06:03.957214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"85'7","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.303318+0000","last_change":"2024-09-21T04:00:03.997131+0000","last_active":"2024-09-21T04:01:59.303318+0000","last_peered":"2024-09-21T04:01:59.303318+0000","last_clean":"2024-09-21T04:01:59.303318+0000","last_became_active":"2024-09-21T04:00:03.996711+0000","last_became_peered":"2024-09-21T04:00:03.996711+0000","last_unstale":"2024-09-21T04:01:59.303318+0000","last_undegraded":"2024-09-21T04:01:59.303318+0000","last_fullsized":"2024-09-21T04:01:59.303318+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:42:25.373743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"85'10","reported_seq":47,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.316389+0000","last_change":"2024-09-21T04:00:04.004067+0000","last_active":"2024-09-21T04:01:59.316389+0000","last_peered":"2024-09-21T04:01:59.316389+0000","last_clean":"2024-09-21T04:01:59.316389+0000","last_became_active":"2024-09-21T04:00:04.003707+0000","last_became_peered":"2024-09-21T04:00:04.003707+0000","last_unstale":"2024-09-21T04:01:59.316389+0000","last_undegraded":"2024-09-21T04:01:59.316389+0000","last_fullsized":"2024-09-21T04:01:59.316389+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:27:24.148194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.309586+0000","last_change":"2024-09-21T04:00:04.000068+0000","last_active":"2024-09-21T04:01:59.309586+0000","last_peered":"2024-09-21T04:01:59.309586+0000","last_clean":"2024-09-21T04:01:59.309586+0000","last_became_active":"2024-09-21T04:00:03.999709+0000","last_became_peered":"2024-09-21T04:00:03.999709+0000","last_unstale":"2024-09-21T04:01:59.309586+0000","last_undegraded":"2024-09-21T04:01:59.309586+0000","last_fullsized":"2024-09-21T04:01:59.309586+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:11:51.249309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"85'9","reported_seq":46,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.318942+0000","last_change":"2024-09-21T04:00:04.011884+0000","last_active":"2024-09-21T04:01:59.318942+0000","last_peered":"2024-09-21T04:01:59.318942+0000","last_clean":"2024-09-21T04:01:59.318942+0000","last_became_active":"2024-09-21T04:00:04.011449+0000","last_became_peered":"2024-09-21T04:00:04.011449+0000","last_unstale":"2024-09-21T04:01:59.318942+0000","last_undegraded":"2024-09-21T04:01:59.318942+0000","last_fullsized":"2024-09-21T04:01:59.318942+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:46.948465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.300105+0000","last_change":"2024-09-21T04:00:03.992848+0000","last_active":"2024-09-21T04:01:59.300105+0000","last_peered":"2024-09-21T04:01:59.300105+0000","last_clean":"2024-09-21T04:01:59.300105+0000","last_became_active":"2024-09-21T04:00:03.991096+0000","last_became_peered":"2024-09-21T04:00:03.991096+0000","last_unstale":"2024-09-21T04:01:59.300105+0000","last_undegraded":"2024-09-21T04:01:59.300105+0000","last_fullsized":"2024-09-21T04:01:59.300105+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:31:19.599848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.289632+0000","last_change":"2024-09-21T04:00:04.000380+0000","last_active":"2024-09-21T04:01:59.289632+0000","last_peered":"2024-09-21T04:01:59.289632+0000","last_clean":"2024-09-21T04:01:59.289632+0000","last_became_active":"2024-09-21T04:00:03.999918+0000","last_became_peered":"2024-09-21T04:00:03.999918+0000","last_unstale":"2024-09-21T04:01:59.289632+0000","last_undegraded":"2024-09-21T04:01:59.289632+0000","last_fullsized":"2024-09-21T04:01:59.289632+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:53:25.607882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"85'10","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.290181+0000","last_change":"2024-09-21T04:00:30.138053+0000","last_active":"2024-09-21T04:01:59.290181+0000","last_peered":"2024-09-21T04:01:59.290181+0000","last_clean":"2024-09-21T04:01:59.290181+0000","last_became_active":"2024-09-21T04:00:30.137682+0000","last_became_peered":"2024-09-21T04:00:30.137682+0000","last_unstale":"2024-09-21T04:01:59.290181+0000","last_undegraded":"2024-09-21T04:01:59.290181+0000","last_fullsized":"2024-09-21T04:01:59.290181+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:01:50.031655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,9],"acting":[6,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"85'7","reported_seq":44,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.305672+0000","last_change":"2024-09-21T04:00:04.004313+0000","last_active":"2024-09-21T04:01:59.305672+0000","last_peered":"2024-09-21T04:01:59.305672+0000","last_clean":"2024-09-21T04:01:59.305672+0000","last_became_active":"2024-09-21T04:00:04.003128+0000","last_became_peered":"2024-09-21T04:00:04.003128+0000","last_unstale":"2024-09-21T04:01:59.305672+0000","last_undegraded":"2024-09-21T04:01:59.305672+0000","last_fullsized":"2024-09-21T04:01:59.305672+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:43:43.469449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.310272+0000","last_change":"2024-09-21T04:00:04.017136+0000","last_active":"2024-09-21T04:01:59.310272+0000","last_peered":"2024-09-21T04:01:59.310272+0000","last_clean":"2024-09-21T04:01:59.310272+0000","last_became_active":"2024-09-21T04:00:04.016732+0000","last_became_peered":"2024-09-21T04:00:04.016732+0000","last_unstale":"2024-09-21T04:01:59.310272+0000","last_undegraded":"2024-09-21T04:01:59.310272+0000","last_fullsized":"2024-09-21T04:01:59.310272+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:57:04.021078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"85'16","reported_seq":53,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.294402+0000","last_change":"2024-09-21T04:00:04.012098+0000","last_active":"2024-09-21T04:01:59.294402+0000","last_peered":"2024-09-21T04:01:59.294402+0000","last_clean":"2024-09-21T04:01:59.294402+0000","last_became_active":"2024-09-21T04:00:04.011681+0000","last_became_peered":"2024-09-21T04:00:04.011681+0000","last_unstale":"2024-09-21T04:01:59.294402+0000","last_undegraded":"2024-09-21T04:01:59.294402+0000","last_fullsized":"2024-09-21T04:01:59.294402+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T05:01:59.202312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"85'11","reported_seq":48,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.320159+0000","last_change":"2024-09-21T04:00:04.017056+0000","last_active":"2024-09-21T04:01:59.320159+0000","last_peered":"2024-09-21T04:01:59.320159+0000","last_clean":"2024-09-21T04:01:59.320159+0000","last_became_active":"2024-09-21T04:00:04.015950+0000","last_became_peered":"2024-09-21T04:00:04.015950+0000","last_unstale":"2024-09-21T04:01:59.320159+0000","last_undegraded":"2024-09-21T04:01:59.320159+0000","last_fullsized":"2024-09-21T04:01:59.320159+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T11:34:11.267161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"85'9","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.302011+0000","last_change":"2024-09-21T04:00:04.010314+0000","last_active":"2024-09-21T04:01:59.302011+0000","last_peered":"2024-09-21T04:01:59.302011+0000","last_clean":"2024-09-21T04:01:59.302011+0000","last_became_active":"2024-09-21T04:00:04.009917+0000","last_became_peered":"2024-09-21T04:00:04.009917+0000","last_unstale":"2024-09-21T04:01:59.302011+0000","last_undegraded":"2024-09-21T04:01:59.302011+0000","last_fullsized":"2024-09-21T04:01:59.302011+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:07:32.947079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"85'5","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.306006+0000","last_change":"2024-09-21T04:00:04.007104+0000","last_active":"2024-09-21T04:01:59.306006+0000","last_peered":"2024-09-21T04:01:59.306006+0000","last_clean":"2024-09-21T04:01:59.306006+0000","last_became_active":"2024-09-21T04:00:04.006655+0000","last_became_peered":"2024-09-21T04:00:04.006655+0000","last_unstale":"2024-09-21T04:01:59.306006+0000","last_undegraded":"2024-09-21T04:01:59.306006+0000","last_fullsized":"2024-09-21T04:01:59.306006+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T07:59:11.834305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"85'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.294831+0000","last_change":"2024-09-21T04:00:04.007842+0000","last_active":"2024-09-21T04:01:59.294831+0000","last_peered":"2024-09-21T04:01:59.294831+0000","last_clean":"2024-09-21T04:01:59.294831+0000","last_became_active":"2024-09-21T04:00:04.007223+0000","last_became_peered":"2024-09-21T04:00:04.007223+0000","last_unstale":"2024-09-21T04:01:59.294831+0000","last_undegraded":"2024-09-21T04:01:59.294831+0000","last_fullsized":"2024-09-21T04:01:59.294831+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T12:53:01.501836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304561+0000","last_change":"2024-09-21T04:00:03.997390+0000","last_active":"2024-09-21T04:01:59.304561+0000","last_peered":"2024-09-21T04:01:59.304561+0000","last_clean":"2024-09-21T04:01:59.304561+0000","last_became_active":"2024-09-21T04:00:03.997075+0000","last_became_peered":"2024-09-21T04:00:03.997075+0000","last_unstale":"2024-09-21T04:01:59.304561+0000","last_undegraded":"2024-09-21T04:01:59.304561+0000","last_fullsized":"2024-09-21T04:01:59.304561+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T15:18:50.863254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.305966+0000","last_change":"2024-09-21T04:00:04.006203+0000","last_active":"2024-09-21T04:01:59.305966+0000","last_peered":"2024-09-21T04:01:59.305966+0000","last_clean":"2024-09-21T04:01:59.305966+0000","last_became_active":"2024-09-21T04:00:04.005150+0000","last_became_peered":"2024-09-21T04:00:04.005150+0000","last_unstale":"2024-09-21T04:01:59.305966+0000","last_undegraded":"2024-09-21T04:01:59.305966+0000","last_fullsized":"2024-09-21T04:01:59.305966+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T14:34:17.635568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3d","version":"85'7","reported_seq":43,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.308714+0000","last_change":"2024-09-21T04:00:04.011843+0000","last_active":"2024-09-21T04:01:59.308714+0000","last_peered":"2024-09-21T04:01:59.308714+0000","last_clean":"2024-09-21T04:01:59.308714+0000","last_became_active":"2024-09-21T04:00:04.011570+0000","last_became_peered":"2024-09-21T04:00:04.011570+0000","last_unstale":"2024-09-21T04:01:59.308714+0000","last_undegraded":"2024-09-21T04:01:59.308714+0000","last_fullsized":"2024-09-21T04:01:59.308714+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:43:59.883217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"85'4","reported_seq":40,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.304006+0000","last_change":"2024-09-21T04:00:04.002111+0000","last_active":"2024-09-21T04:01:59.304006+0000","last_peered":"2024-09-21T04:01:59.304006+0000","last_clean":"2024-09-21T04:01:59.304006+0000","last_became_active":"2024-09-21T04:00:04.001723+0000","last_became_peered":"2024-09-21T04:00:04.001723+0000","last_unstale":"2024-09-21T04:01:59.304006+0000","last_undegraded":"2024-09-21T04:01:59.304006+0000","last_fullsized":"2024-09-21T04:01:59.304006+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T10:48:32.595150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"85'8","reported_seq":45,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-09-21T04:01:59.309262+0000","last_change":"2024-09-21T04:00:03.998822+0000","last_active":"2024-09-21T04:01:59.309262+0000","last_peered":"2024-09-21T04:01:59.309262+0000","last_clean":"2024-09-21T04:01:59.309262+0000","last_became_active":"2024-09-21T04:00:03.998445+0000","last_became_peered":"2024-09-21T04:00:03.998445+0000","last_unstale":"2024-09-21T04:01:59.309262+0000","last_undegraded":"2024-09-21T04:01:59.309262+0000","last_fullsized":"2024-09-21T04:01:59.309262+0000","mapping_epoch":72,"log_start":"0'0","ondisk_log_start":"0'0","created":72,"last_epoch_clean":73,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T04:00:02.973282+0000","last_clean_scrub_stamp":"2024-09-21T04:00:02.973282+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T06:45:16.090570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75800,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1106,"num_read_kb":636,"num_write":268,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":17,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":227400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":76,"num_read_kb":64,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":4722944,"data_compressed":282913,"data_compressed_allocated":360448,"data_compressed_original":4669440,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":68,"seq":292057776171,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32108,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713044,"statfs":{"total":95995035648,"available":95962157056,"internally_reserved":0,"allocated":946176,"data_stored":494139,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":62,"seq":266287972400,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28100,"kb_used_data":1076,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717052,"statfs":{"total":95995035648,"available":95966261248,"internally_reserved":0,"allocated":1101824,"data_stored":1147893,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":57,"seq":244813135925,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":497688,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":51,"seq":219043332154,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":944,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":966656,"data_stored":493970,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":45,"seq":193273528383,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1019904,"data_stored":1092039,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":40,"seq":171798691909,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36268,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708884,"statfs":{"total":95995035648,"available":95957897216,"internally_reserved":0,"allocated":946176,"data_stored":490105,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":34,"seq":146028888139,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36348,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708804,"statfs":{"total":95995035648,"available":95957815296,"internally_reserved":0,"allocated":1028096,"data_stored":1086135,"data_compressed":68395,"data_compressed_allocated":90112,"data_compressed_original":679936,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":29,"seq":124554051663,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":954368,"data_stored":493647,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":23,"seq":98784247893,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36280,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708872,"statfs":{"total":95995035648,"available":95957884928,"internally_reserved":0,"allocated":958464,"data_stored":488804,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":17,"seq":73014444122,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36360,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708792,"statfs":{"total":95995035648,"available":95957803008,"internally_reserved":0,"allocated":1040384,"data_stored":558238,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1019904,"data_stored":558073,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36292,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708860,"statfs":{"total":95995035648,"available":95957872640,"internally_reserved":0,"allocated":970752,"data_stored":491029,"data_compressed":32423,"data_compressed_allocated":45056,"data_compressed_original":90112,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":34351,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":590368,"data_compressed":35972,"data_compressed_allocated":45056,"data_compressed_original":589824,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69699,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3297,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":69151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1669,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T04:02:34.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:02:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:34 smithi060 ceph-mon[33722]: pgmap v377: 129 pgs: 129 active+clean; 651 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T04:02:34.748 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:34.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:34 smithi022 ceph-mon[31015]: pgmap v377: 129 pgs: 129 active+clean; 651 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T04:02:34.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:34 smithi073 ceph-mon[34443]: pgmap v377: 129 pgs: 129 active+clean; 651 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.1 KiB/s wr, 10 op/s 2024-09-21T04:02:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.257+0000 7f1e2c207640 1 -- 172.21.15.22:0/3725330762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e24102080 msgr2=0x7f1e24102490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.257+0000 7f1e2c207640 1 --2- 172.21.15.22:0/3725330762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e24102080 0x7f1e24102490 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009900 tx=0x7f1e2002a410 comp rx=0 tx=0).stop 2024-09-21T04:02:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.257+0000 7f1e2c207640 1 -- 172.21.15.22:0/3725330762 shutdown_connections 2024-09-21T04:02:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.257+0000 7f1e2c207640 1 --2- 172.21.15.22:0/3725330762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e24109560 0x7f1e24109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.257+0000 7f1e2c207640 1 --2- 172.21.15.22:0/3725330762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e24109eb0 0x7f1e241106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.257+0000 7f1e2c207640 1 --2- 172.21.15.22:0/3725330762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e24102080 0x7f1e24102490 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:35.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.257+0000 7f1e2c207640 1 -- 172.21.15.22:0/3725330762 >> 172.21.15.22:0/3725330762 conn(0x7f1e24079ec0 msgr2=0x7f1e2407a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.257+0000 7f1e2c207640 1 -- 172.21.15.22:0/3725330762 shutdown_connections 2024-09-21T04:02:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.257+0000 7f1e2c207640 1 -- 172.21.15.22:0/3725330762 wait complete. 2024-09-21T04:02:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.258+0000 7f1e2c207640 1 Processor -- start 2024-09-21T04:02:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.258+0000 7f1e2c207640 1 -- start start 2024-09-21T04:02:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e2c207640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e24102080 0x7f1e2419a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e2c207640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e24109560 0x7f1e2419aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e2c207640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e24109eb0 0x7f1e2419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:35.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e2c207640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1e24113a20 con 0x7f1e24102080 2024-09-21T04:02:35.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e2c207640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1e241138a0 con 0x7f1e24109560 2024-09-21T04:02:35.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e2c207640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1e24113ba0 con 0x7f1e24109eb0 2024-09-21T04:02:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e29fa3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e24102080 0x7f1e2419a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e29fa3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e24102080 0x7f1e2419a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34082/0 (socket says 172.21.15.22:34082) 2024-09-21T04:02:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e29fa3640 1 -- 172.21.15.22:0/829449071 learned_addr learned my addr 172.21.15.22:0/829449071 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e297a2640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e24109560 0x7f1e2419aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e2a7a4640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e24109eb0 0x7f1e2419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e29fa3640 1 -- 172.21.15.22:0/829449071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e24109eb0 msgr2=0x7f1e2419fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e29fa3640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e24109eb0 0x7f1e2419fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e29fa3640 1 -- 172.21.15.22:0/829449071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e24109560 msgr2=0x7f1e2419aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:35.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e29fa3640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e24109560 0x7f1e2419aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.259+0000 7f1e29fa3640 1 -- 172.21.15.22:0/829449071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e241a0460 con 0x7f1e24102080 2024-09-21T04:02:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.260+0000 7f1e29fa3640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e24102080 0x7f1e2419a4f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009230 tx=0x7f1e20004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.260+0000 7f1e1affd640 1 -- 172.21.15.22:0/829449071 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2003f030 con 0x7f1e24102080 2024-09-21T04:02:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.260+0000 7f1e1affd640 1 -- 172.21.15.22:0/829449071 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e20003a80 con 0x7f1e24102080 2024-09-21T04:02:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.260+0000 7f1e2c207640 1 -- 172.21.15.22:0/829449071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e241a06f0 con 0x7f1e24102080 2024-09-21T04:02:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.260+0000 7f1e1affd640 1 -- 172.21.15.22:0/829449071 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e20035070 con 0x7f1e24102080 2024-09-21T04:02:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.260+0000 7f1e2c207640 1 -- 172.21.15.22:0/829449071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e241a6eb0 con 0x7f1e24102080 2024-09-21T04:02:35.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.261+0000 7f1e2c207640 1 -- 172.21.15.22:0/829449071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e2406b8f0 con 0x7f1e24102080 2024-09-21T04:02:35.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.263+0000 7f1e1affd640 1 -- 172.21.15.22:0/829449071 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1e20042030 con 0x7f1e24102080 2024-09-21T04:02:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.264+0000 7f1e1affd640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e100b6510 0x7f1e100b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.264+0000 7f1e297a2640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e100b6510 0x7f1e100b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:35.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.264+0000 7f1e1affd640 1 -- 172.21.15.22:0/829449071 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f1e20108170 con 0x7f1e24102080 2024-09-21T04:02:35.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.264+0000 7f1e297a2640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e100b6510 0x7f1e100b8a20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1e24109110 tx=0x7f1e14005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:35.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.267+0000 7f1e1affd640 1 -- 172.21.15.22:0/829449071 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1e200d2a20 con 0x7f1e24102080 2024-09-21T04:02:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.494+0000 7f1e2c207640 1 -- 172.21.15.22:0/829449071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e24102490 con 0x7f1e24102080 2024-09-21T04:02:35.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.495+0000 7f1e1affd640 1 -- 172.21.15.22:0/829449071 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11959 (secure 0 0 0) 0x7f1e24102490 con 0x7f1e24102080 2024-09-21T04:02:35.498 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:35.498 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":29,"btime":"2024-09-21T04:02:29:350242+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:02:29.164822+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:02:35.498 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 29 2024-09-21T04:02:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.497+0000 7f1e2c207640 1 -- 172.21.15.22:0/829449071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e100b6510 msgr2=0x7f1e100b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.497+0000 7f1e2c207640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e100b6510 0x7f1e100b8a20 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1e24109110 tx=0x7f1e14005f90 comp rx=0 tx=0).stop 2024-09-21T04:02:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.497+0000 7f1e2c207640 1 -- 172.21.15.22:0/829449071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e24102080 msgr2=0x7f1e2419a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.497+0000 7f1e2c207640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e24102080 0x7f1e2419a4f0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f1e20009230 tx=0x7f1e20004270 comp rx=0 tx=0).stop 2024-09-21T04:02:35.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.497+0000 7f1e2c207640 1 -- 172.21.15.22:0/829449071 shutdown_connections 2024-09-21T04:02:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.497+0000 7f1e2c207640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1e100b6510 0x7f1e100b8a20 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.497+0000 7f1e2c207640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1e24109eb0 0x7f1e2419fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.497+0000 7f1e2c207640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1e24109560 0x7f1e2419aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.497+0000 7f1e2c207640 1 --2- 172.21.15.22:0/829449071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1e24102080 0x7f1e2419a4f0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.497+0000 7f1e2c207640 1 -- 172.21.15.22:0/829449071 >> 172.21.15.22:0/829449071 conn(0x7f1e24079ec0 msgr2=0x7f1e241076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.498+0000 7f1e2c207640 1 -- 172.21.15.22:0/829449071 shutdown_connections 2024-09-21T04:02:35.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:35.498+0000 7f1e2c207640 1 -- 172.21.15.22:0/829449071 wait complete. 2024-09-21T04:02:35.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:35 smithi060 ceph-mon[33722]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:02:35.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:35 smithi022 ceph-mon[31015]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:02:35.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:35 smithi073 ceph-mon[34443]: from='client.15513 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T04:02:36.203 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:02:36.466 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:36 smithi060 ceph-mon[33722]: pgmap v378: 129 pgs: 129 active+clean; 651 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T04:02:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:36 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/829449071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:36.740 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:36 smithi022 ceph-mon[31015]: pgmap v378: 129 pgs: 129 active+clean; 651 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T04:02:36.740 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:36 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/829449071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:36 smithi073 ceph-mon[34443]: pgmap v378: 129 pgs: 129 active+clean; 651 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.1 KiB/s wr, 11 op/s 2024-09-21T04:02:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:36 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/829449071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:37.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.982+0000 7fe2c3907640 1 -- 172.21.15.22:0/1032174370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2bc1094a0 msgr2=0x7fe2bc1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.982+0000 7fe2c3907640 1 --2- 172.21.15.22:0/1032174370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2bc1094a0 0x7fe2bc1098b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac009900 tx=0x7fe2ac02a3f0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.983+0000 7fe2c3907640 1 -- 172.21.15.22:0/1032174370 shutdown_connections 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.983+0000 7fe2c3907640 1 --2- 172.21.15.22:0/1032174370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc109df0 0x7fe2bc110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.983+0000 7fe2c3907640 1 --2- 172.21.15.22:0/1032174370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2bc1094a0 0x7fe2bc1098b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.983+0000 7fe2c3907640 1 --2- 172.21.15.22:0/1032174370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2bc103b60 0x7fe2bc103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.983+0000 7fe2c3907640 1 -- 172.21.15.22:0/1032174370 >> 172.21.15.22:0/1032174370 conn(0x7fe2bc07b850 msgr2=0x7fe2bc07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.983+0000 7fe2c3907640 1 -- 172.21.15.22:0/1032174370 shutdown_connections 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.983+0000 7fe2c3907640 1 -- 172.21.15.22:0/1032174370 wait complete. 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.983+0000 7fe2c3907640 1 Processor -- start 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.983+0000 7fe2c3907640 1 -- start start 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c3907640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc103b60 0x7fe2bc19a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c3907640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2bc1094a0 0x7fe2bc19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c3907640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2bc109df0 0x7fe2bc19fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c3907640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc113960 con 0x7fe2bc1094a0 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c3907640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc1137e0 con 0x7fe2bc109df0 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c3907640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe2bc113ae0 con 0x7fe2bc103b60 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c0ea2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2bc1094a0 0x7fe2bc19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c0ea2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2bc1094a0 0x7fe2bc19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34102/0 (socket says 172.21.15.22:34102) 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c0ea2640 1 -- 172.21.15.22:0/1347071026 learned_addr learned my addr 172.21.15.22:0/1347071026 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c16a3640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc103b60 0x7fe2bc19a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c1ea4640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2bc109df0 0x7fe2bc19fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c0ea2640 1 -- 172.21.15.22:0/1347071026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc103b60 msgr2=0x7fe2bc19a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c0ea2640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc103b60 0x7fe2bc19a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c0ea2640 1 -- 172.21.15.22:0/1347071026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2bc109df0 msgr2=0x7fe2bc19fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c0ea2640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2bc109df0 0x7fe2bc19fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c0ea2640 1 -- 172.21.15.22:0/1347071026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc1a02e0 con 0x7fe2bc1094a0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.984+0000 7fe2c0ea2640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2bc1094a0 0x7fe2bc19a9d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac005940 tx=0x7fe2ac0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.985+0000 7fe2b27fc640 1 -- 172.21.15.22:0/1347071026 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac03f030 con 0x7fe2bc1094a0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.985+0000 7fe2c3907640 1 -- 172.21.15.22:0/1347071026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc1a0570 con 0x7fe2bc1094a0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.985+0000 7fe2b27fc640 1 -- 172.21.15.22:0/1347071026 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe2ac003a80 con 0x7fe2bc1094a0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.985+0000 7fe2b27fc640 1 -- 172.21.15.22:0/1347071026 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac035070 con 0x7fe2bc1094a0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.985+0000 7fe2c3907640 1 -- 172.21.15.22:0/1347071026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2bc1a0a50 con 0x7fe2bc1094a0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.986+0000 7fe2c3907640 1 -- 172.21.15.22:0/1347071026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2bc103f70 con 0x7fe2bc1094a0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.987+0000 7fe2b27fc640 1 -- 172.21.15.22:0/1347071026 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe2ac042030 con 0x7fe2bc1094a0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.988+0000 7fe2b27fc640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe2a80b6540 0x7fe2a80b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.989+0000 7fe2c16a3640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe2a80b6540 0x7fe2a80b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.989+0000 7fe2b27fc640 1 -- 172.21.15.22:0/1347071026 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fe2ac107f70 con 0x7fe2bc1094a0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.989+0000 7fe2c16a3640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe2a80b6540 0x7fe2a80b8a50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800abe0 tx=0x7fe2b800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:37.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:36.992+0000 7fe2b27fc640 1 -- 172.21.15.22:0/1347071026 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe2ac0ce440 con 0x7fe2bc1094a0 2024-09-21T04:02:37.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.219+0000 7fe2c3907640 1 -- 172.21.15.22:0/1347071026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2bc19b560 con 0x7fe2bc1094a0 2024-09-21T04:02:37.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.220+0000 7fe2b27fc640 1 -- 172.21.15.22:0/1347071026 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11959 (secure 0 0 0) 0x7fe2ac0d2820 con 0x7fe2bc1094a0 2024-09-21T04:02:37.223 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:37.223 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":29,"btime":"2024-09-21T04:02:29:350242+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:02:29.164822+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:02:37.223 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 29 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 -- 172.21.15.22:0/1347071026 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe2a80b6540 msgr2=0x7fe2a80b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe2a80b6540 0x7fe2a80b8a50 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fe2b800abe0 tx=0x7fe2b800a2d0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 -- 172.21.15.22:0/1347071026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2bc1094a0 msgr2=0x7fe2bc19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2bc1094a0 0x7fe2bc19a9d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac005940 tx=0x7fe2ac0040e0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 -- 172.21.15.22:0/1347071026 shutdown_connections 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe2a80b6540 0x7fe2a80b8a50 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe2bc109df0 0x7fe2bc19fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2bc1094a0 0x7fe2bc19a9d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 --2- 172.21.15.22:0/1347071026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe2bc103b60 0x7fe2bc19a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 -- 172.21.15.22:0/1347071026 >> 172.21.15.22:0/1347071026 conn(0x7fe2bc07b850 msgr2=0x7fe2bc1055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 -- 172.21.15.22:0/1347071026 shutdown_connections 2024-09-21T04:02:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:37.222+0000 7fe2c3907640 1 -- 172.21.15.22:0/1347071026 wait complete. 2024-09-21T04:02:37.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:37 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1347071026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:37.706 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:37 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1347071026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:37.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:37 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1347071026' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:38.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:02:38.313 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:38.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:38 smithi060 ceph-mon[33722]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-21T04:02:38.720 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:38 smithi022 ceph-mon[31015]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-21T04:02:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.810+0000 7fd6bb647640 1 -- 172.21.15.22:0/282176636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b4102770 msgr2=0x7fd6b4107b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.810+0000 7fd6bb647640 1 --2- 172.21.15.22:0/282176636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b4102770 0x7fd6b4107b70 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009900 tx=0x7fd6a402a410 comp rx=0 tx=0).stop 2024-09-21T04:02:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.810+0000 7fd6bb647640 1 -- 172.21.15.22:0/282176636 shutdown_connections 2024-09-21T04:02:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.810+0000 7fd6bb647640 1 --2- 172.21.15.22:0/282176636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6b4102b80 0x7fd6b41080b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.810+0000 7fd6bb647640 1 --2- 172.21.15.22:0/282176636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b4102770 0x7fd6b4107b70 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.810+0000 7fd6bb647640 1 --2- 172.21.15.22:0/282176636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6b406b2f0 0x7fd6b4102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.810+0000 7fd6bb647640 1 -- 172.21.15.22:0/282176636 >> 172.21.15.22:0/282176636 conn(0x7fd6b4079e40 msgr2=0x7fd6b407a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.810+0000 7fd6bb647640 1 -- 172.21.15.22:0/282176636 shutdown_connections 2024-09-21T04:02:38.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.810+0000 7fd6bb647640 1 -- 172.21.15.22:0/282176636 wait complete. 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.811+0000 7fd6bb647640 1 Processor -- start 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.811+0000 7fd6bb647640 1 -- start start 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.811+0000 7fd6bb647640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6b406b2f0 0x7fd6b419a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.811+0000 7fd6bb647640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b4102770 0x7fd6b419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.811+0000 7fd6bb647640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6b4102b80 0x7fd6b419fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.811+0000 7fd6bb647640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b41128a0 con 0x7fd6b4102770 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.811+0000 7fd6bb647640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b4112720 con 0x7fd6b406b2f0 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.811+0000 7fd6bb647640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b4112a20 con 0x7fd6b4102b80 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.811+0000 7fd6b8be2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b4102770 0x7fd6b419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b8be2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b4102770 0x7fd6b419a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34114/0 (socket says 172.21.15.22:34114) 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b8be2640 1 -- 172.21.15.22:0/868952192 learned_addr learned my addr 172.21.15.22:0/868952192 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b93e3640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6b406b2f0 0x7fd6b419a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b9be4640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6b4102b80 0x7fd6b419fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b8be2640 1 -- 172.21.15.22:0/868952192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6b4102b80 msgr2=0x7fd6b419fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b8be2640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6b4102b80 0x7fd6b419fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b8be2640 1 -- 172.21.15.22:0/868952192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6b406b2f0 msgr2=0x7fd6b419a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b8be2640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6b406b2f0 0x7fd6b419a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b8be2640 1 -- 172.21.15.22:0/868952192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b41a0370 con 0x7fd6b4102770 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b93e3640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6b406b2f0 0x7fd6b419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6b8be2640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b4102770 0x7fd6b419a9a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4004770 tx=0x7fd6a4004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6aa7fc640 1 -- 172.21.15.22:0/868952192 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a403f030 con 0x7fd6b4102770 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6aa7fc640 1 -- 172.21.15.22:0/868952192 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6a4004440 con 0x7fd6b4102770 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6bb647640 1 -- 172.21.15.22:0/868952192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b41a0600 con 0x7fd6b4102770 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6aa7fc640 1 -- 172.21.15.22:0/868952192 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6a4035070 con 0x7fd6b4102770 2024-09-21T04:02:38.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.812+0000 7fd6bb647640 1 -- 172.21.15.22:0/868952192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b41a6dc0 con 0x7fd6b4102770 2024-09-21T04:02:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.814+0000 7fd6bb647640 1 -- 172.21.15.22:0/868952192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b4102230 con 0x7fd6b4102770 2024-09-21T04:02:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.815+0000 7fd6aa7fc640 1 -- 172.21.15.22:0/868952192 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd6a4042030 con 0x7fd6b4102770 2024-09-21T04:02:38.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.816+0000 7fd6aa7fc640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6a00b6590 0x7fd6a00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.816+0000 7fd6b93e3640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6a00b6590 0x7fd6a00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.816+0000 7fd6aa7fc640 1 -- 172.21.15.22:0/868952192 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fd6a4107f60 con 0x7fd6b4102770 2024-09-21T04:02:38.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.817+0000 7fd6b93e3640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6a00b6590 0x7fd6a00b8aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009c20 tx=0x7fd6b0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:38.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:38.819+0000 7fd6aa7fc640 1 -- 172.21.15.22:0/868952192 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd6a40ce3d0 con 0x7fd6b4102770 2024-09-21T04:02:38.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:38 smithi073 ceph-mon[34443]: pgmap v379: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.5 KiB/s wr, 12 op/s 2024-09-21T04:02:39.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.008+0000 7fd6bb647640 1 -- 172.21.15.22:0/868952192 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd6b402e640 con 0x7fd6b4102770 2024-09-21T04:02:39.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.010+0000 7fd6aa7fc640 1 -- 172.21.15.22:0/868952192 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24751 (secure 0 0 0) 0x7fd6a40d27b0 con 0x7fd6b4102770 2024-09-21T04:02:39.052 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:39.053 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":85,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:01:31.025432+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11},{"from":5,"to":6}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:02:39.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 -- 172.21.15.22:0/868952192 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6a00b6590 msgr2=0x7fd6a00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:39.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6a00b6590 0x7fd6a00b8aa0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fd6b0009c20 tx=0x7fd6b0005f90 comp rx=0 tx=0).stop 2024-09-21T04:02:39.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 -- 172.21.15.22:0/868952192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b4102770 msgr2=0x7fd6b419a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:39.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b4102770 0x7fd6b419a9a0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4004770 tx=0x7fd6a4004040 comp rx=0 tx=0).stop 2024-09-21T04:02:39.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 -- 172.21.15.22:0/868952192 shutdown_connections 2024-09-21T04:02:39.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd6a00b6590 0x7fd6a00b8aa0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:39.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd6b4102b80 0x7fd6b419fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:39.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6b4102770 0x7fd6b419a9a0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:39.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 --2- 172.21.15.22:0/868952192 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd6b406b2f0 0x7fd6b419a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:39.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 -- 172.21.15.22:0/868952192 >> 172.21.15.22:0/868952192 conn(0x7fd6b4079e40 msgr2=0x7fd6b4108cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:39.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 -- 172.21.15.22:0/868952192 shutdown_connections 2024-09-21T04:02:39.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:39.013+0000 7fd6bb647640 1 -- 172.21.15.22:0/868952192 wait complete. 2024-09-21T04:02:39.667 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:39 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/868952192' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:02:39.699 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mon.a --format=json config get run_dir 2024-09-21T04:02:39.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:39 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/868952192' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:02:39.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:39 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/868952192' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:02:39.958 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:40 smithi060 ceph-mon[33722]: pgmap v380: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T04:02:40.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:40 smithi022 ceph-mon[31015]: pgmap v380: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T04:02:40.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:40 smithi073 ceph-mon[34443]: pgmap v380: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-09-21T04:02:41.118 INFO:teuthology.orchestra.run.smithi022.stdout:{"run_dir":"/var/run/ceph"} 2024-09-21T04:02:41.118 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-09-21T04:02:41.119 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 7864 2024-09-21T04:02:41.119 DEBUG:tasks.quiescer:Yielding 2024-09-21T04:02:41.119 INFO:teuthology.run_tasks:Running task exec... 2024-09-21T04:02:41.128 INFO:teuthology.task.exec:Executing custom commands... 2024-09-21T04:02:41.128 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi022.front.sepia.ceph.com 2024-09-21T04:02:41.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-09-21T04:02:41.129 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:02:41.171 INFO:teuthology.orchestra.run.smithi022.stdout:total 0 2024-09-21T04:02:41.183 INFO:teuthology.orchestra.run.smithi022.stdout:Filesystem Size Used Avail Use% Mounted on 2024-09-21T04:02:41.183 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-fuse 1.1T 384M 1.1T 1% /tmp/cephfs 2024-09-21T04:02:41.186 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-09-21T04:02:41.280 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-09-21T04:02:41.322 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-09-21T04:02:41.400 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:41.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.915+0000 7ff6150a5640 1 -- 172.21.15.22:0/4109530563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6101083b0 msgr2=0x7ff6101087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.915+0000 7ff6150a5640 1 --2- 172.21.15.22:0/4109530563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6101083b0 0x7ff6101087c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff604009900 tx=0x7ff60402a410 comp rx=0 tx=0).stop 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.915+0000 7ff6150a5640 1 -- 172.21.15.22:0/4109530563 shutdown_connections 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.915+0000 7ff6150a5640 1 --2- 172.21.15.22:0/4109530563 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff610108d00 0x7ff61010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.915+0000 7ff6150a5640 1 --2- 172.21.15.22:0/4109530563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6101083b0 0x7ff6101087c0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.915+0000 7ff6150a5640 1 --2- 172.21.15.22:0/4109530563 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff610102a70 0x7ff610102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.915+0000 7ff6150a5640 1 -- 172.21.15.22:0/4109530563 >> 172.21.15.22:0/4109530563 conn(0x7ff610079730 msgr2=0x7ff610079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.915+0000 7ff6150a5640 1 -- 172.21.15.22:0/4109530563 shutdown_connections 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.915+0000 7ff6150a5640 1 -- 172.21.15.22:0/4109530563 wait complete. 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.916+0000 7ff6150a5640 1 Processor -- start 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.916+0000 7ff6150a5640 1 -- start start 2024-09-21T04:02:41.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff6150a5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff610102a70 0x7ff61019a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff6150a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6101083b0 0x7ff61019a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff6150a5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff610108d00 0x7ff61019fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff6150a5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff610112820 con 0x7ff6101083b0 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff6150a5640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff6101126a0 con 0x7ff610102a70 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff6150a5640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff6101129a0 con 0x7ff610108d00 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6101083b0 0x7ff61019a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6101083b0 0x7ff61019a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51146/0 (socket says 172.21.15.22:51146) 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60e59c640 1 -- 172.21.15.22:0/2225364590 learned_addr learned my addr 172.21.15.22:0/2225364590 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60f59e640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff610108d00 0x7ff61019fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60ed9d640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff610102a70 0x7ff61019a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60e59c640 1 -- 172.21.15.22:0/2225364590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff610108d00 msgr2=0x7ff61019fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:41.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60e59c640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff610108d00 0x7ff61019fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60e59c640 1 -- 172.21.15.22:0/2225364590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff610102a70 msgr2=0x7ff61019a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60e59c640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff610102a70 0x7ff61019a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60e59c640 1 -- 172.21.15.22:0/2225364590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6101a0310 con 0x7ff6101083b0 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.917+0000 7ff60f59e640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff610108d00 0x7ff61019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.918+0000 7ff60e59c640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6101083b0 0x7ff61019a940 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff604005940 tx=0x7ff604004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.918+0000 7ff5f7fff640 1 -- 172.21.15.22:0/2225364590 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60403f030 con 0x7ff6101083b0 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.918+0000 7ff6150a5640 1 -- 172.21.15.22:0/2225364590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6101a05a0 con 0x7ff6101083b0 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.918+0000 7ff5f7fff640 1 -- 172.21.15.22:0/2225364590 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff604004440 con 0x7ff6101083b0 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.918+0000 7ff5f7fff640 1 -- 172.21.15.22:0/2225364590 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604035070 con 0x7ff6101083b0 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.918+0000 7ff6150a5640 1 -- 172.21.15.22:0/2225364590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6101a6d60 con 0x7ff6101083b0 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.919+0000 7ff6150a5640 1 -- 172.21.15.22:0/2225364590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff610103cf0 con 0x7ff6101083b0 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.922+0000 7ff5f7fff640 1 -- 172.21.15.22:0/2225364590 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff604042030 con 0x7ff6101083b0 2024-09-21T04:02:41.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.923+0000 7ff5f7fff640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff5f80b6510 0x7ff5f80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:41.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.923+0000 7ff60ed9d640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff5f80b6510 0x7ff5f80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:41.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.923+0000 7ff5f7fff640 1 -- 172.21.15.22:0/2225364590 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff604107e80 con 0x7ff6101083b0 2024-09-21T04:02:41.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.923+0000 7ff60ed9d640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff5f80b6510 0x7ff5f80b8a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff600009bd0 tx=0x7ff600005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:41.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:41.925+0000 7ff5f7fff640 1 -- 172.21.15.22:0/2225364590 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff6040d26d0 con 0x7ff6101083b0 2024-09-21T04:02:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.154+0000 7ff6150a5640 1 -- 172.21.15.22:0/2225364590 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff61019b4d0 con 0x7ff6101083b0 2024-09-21T04:02:42.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.155+0000 7ff5f7fff640 1 -- 172.21.15.22:0/2225364590 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11959 (secure 0 0 0) 0x7ff6040d7610 con 0x7ff6101083b0 2024-09-21T04:02:42.158 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:42.158 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":29,"btime":"2024-09-21T04:02:29:350242+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:02:29.164822+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:02:42.158 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 29 2024-09-21T04:02:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 -- 172.21.15.22:0/2225364590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff5f80b6510 msgr2=0x7ff5f80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff5f80b6510 0x7ff5f80b8a20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7ff600009bd0 tx=0x7ff600005f90 comp rx=0 tx=0).stop 2024-09-21T04:02:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 -- 172.21.15.22:0/2225364590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6101083b0 msgr2=0x7ff61019a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6101083b0 0x7ff61019a940 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff604005940 tx=0x7ff604004040 comp rx=0 tx=0).stop 2024-09-21T04:02:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 -- 172.21.15.22:0/2225364590 shutdown_connections 2024-09-21T04:02:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff5f80b6510 0x7ff5f80b8a20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff610108d00 0x7ff61019fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff6101083b0 0x7ff61019a940 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 --2- 172.21.15.22:0/2225364590 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff610102a70 0x7ff61019a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:42.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 -- 172.21.15.22:0/2225364590 >> 172.21.15.22:0/2225364590 conn(0x7ff610079730 msgr2=0x7ff61006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 -- 172.21.15.22:0/2225364590 shutdown_connections 2024-09-21T04:02:42.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:42.157+0000 7ff6150a5640 1 -- 172.21.15.22:0/2225364590 wait complete. 2024-09-21T04:02:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:42 smithi060 ceph-mon[33722]: pgmap v381: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T04:02:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:42 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2225364590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:42.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:42 smithi022 ceph-mon[31015]: pgmap v381: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T04:02:42.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:42 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2225364590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:42.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:42 smithi073 ceph-mon[34443]: pgmap v381: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 1.3 KiB/s wr, 12 op/s 2024-09-21T04:02:42.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:42 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2225364590' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:02:43.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-09-21T04:02:43.576 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-09-21T04:02:43.579 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-09-21T04:02:43.636 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-21T04:00:04.669771+0000', 'modified': '2024-09-21T04:02:29.164822+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 24647, 'mds_1': 24634, 'mds_2': 24617, 'mds_3': 24616, 'mds_4': 24610}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14775': {'gid': 14775, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6839/61235994', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6838', 'nonce': 61235994}, {'type': 'v1', 'addr': '172.21.15.22:6839', 'nonce': 61235994}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14787': {'gid': 14787, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.22:6841/2021253625', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.22:6840', 'nonce': 2021253625}, {'type': 'v1', 'addr': '172.21.15.22:6841', 'nonce': 2021253625}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24566': {'gid': 24566, 'name': 'k', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6833/2373240323', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6832', 'nonce': 2373240323}, {'type': 'v1', 'addr': '172.21.15.60:6833', 'nonce': 2373240323}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24571': {'gid': 24571, 'name': 'l', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.73:6833/1353426950', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6832', 'nonce': 1353426950}, {'type': 'v1', 'addr': '172.21.15.73:6833', 'nonce': 1353426950}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24596': {'gid': 24596, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.60:6835/2092262185', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6834', 'nonce': 2092262185}, {'type': 'v1', 'addr': '172.21.15.60:6835', 'nonce': 2092262185}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24610': {'gid': 24610, 'name': 'f', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.73:6835/4117291653', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6834', 'nonce': 4117291653}, {'type': 'v1', 'addr': '172.21.15.73:6835', 'nonce': 4117291653}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24616': {'gid': 24616, 'name': 'c', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.73:6837/3229670499', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6836', 'nonce': 3229670499}, {'type': 'v1', 'addr': '172.21.15.73:6837', 'nonce': 3229670499}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24617': {'gid': 24617, 'name': 'h', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 17, 'addr': '172.21.15.60:6837/3007306472', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6836', 'nonce': 3007306472}, {'type': 'v1', 'addr': '172.21.15.60:6837', 'nonce': 3007306472}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24634': {'gid': 24634, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.73:6839/1883983314', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.73:6838', 'nonce': 1883983314}, {'type': 'v1', 'addr': '172.21.15.73:6839', 'nonce': 1883983314}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24647': {'gid': 24647, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.60:6839/3182487250', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.60:6838', 'nonce': 3182487250}, {'type': 'v1', 'addr': '172.21.15.60:6839', 'nonce': 3182487250}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24647, 'qdb_cluster': [24610, 24616, 24617, 24634, 24647]} 2024-09-21T04:02:43.636 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-09-21T04:02:43.636 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.f status 2024-09-21T04:02:43.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-21T04:02:43.743 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/: 2024-09-21T04:02:43.744 INFO:teuthology.orchestra.run.smithi022.stdout:total 2 2024-09-21T04:02:43.744 INFO:teuthology.orchestra.run.smithi022.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:02:43.744 INFO:teuthology.orchestra.run.smithi022.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 .. 2024-09-21T04:02:43.744 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 data 2024-09-21T04:02:43.744 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:02:43.744 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data: 2024-09-21T04:02:43.744 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:02:43.744 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:02:43.744 INFO:teuthology.orchestra.run.smithi022.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 .. 2024-09-21T04:02:43.747 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-09-21T04:02:43.833 INFO:teuthology.orchestra.run.smithi022.stdout:[Service] 2024-09-21T04:02:43.833 INFO:teuthology.orchestra.run.smithi022.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-09-21T04:02:43.833 INFO:teuthology.orchestra.run.smithi022.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-09-21T04:02:43.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-09-21T04:02:43.922 INFO:teuthology.orchestra.run.smithi022.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-09-21T04:02:43.966 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.517+0000 7f699915b640 1 -- 172.21.15.22:0/3955986908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f699410de60 msgr2=0x7f6994110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.517+0000 7f699915b640 1 --2- 172.21.15.22:0/3955986908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f699410de60 0x7f6994110330 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f698c009ca0 tx=0x7f698c02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.517+0000 7f699915b640 1 -- 172.21.15.22:0/3955986908 shutdown_connections 2024-09-21T04:02:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.517+0000 7f699915b640 1 --2- 172.21.15.22:0/3955986908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f699410de60 0x7f6994110330 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.517+0000 7f699915b640 1 --2- 172.21.15.22:0/3955986908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6994105380 0x7f699410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.517+0000 7f699915b640 1 --2- 172.21.15.22:0/3955986908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994104a30 0x7f6994104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.517+0000 7f699915b640 1 -- 172.21.15.22:0/3955986908 >> 172.21.15.22:0/3955986908 conn(0x7f6994079790 msgr2=0x7f6994079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.517+0000 7f699915b640 1 -- 172.21.15.22:0/3955986908 shutdown_connections 2024-09-21T04:02:44.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.517+0000 7f699915b640 1 -- 172.21.15.22:0/3955986908 wait complete. 2024-09-21T04:02:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f699915b640 1 Processor -- start 2024-09-21T04:02:44.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f699915b640 1 -- start start 2024-09-21T04:02:44.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f699915b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994104a30 0x7f699419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f699915b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6994105380 0x7f699419a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f699915b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f699410de60 0x7f699419fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f699915b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f69941139a0 con 0x7f699410de60 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f699915b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6994113820 con 0x7f6994105380 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f699915b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6994113b20 con 0x7f6994104a30 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f6992d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994104a30 0x7f699419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f6992d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994104a30 0x7f699419a370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:46818/0 (socket says 172.21.15.22:46818) 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.519+0000 7f6992d9d640 1 -- 172.21.15.22:0/2466030124 learned_addr learned my addr 172.21.15.22:0/2466030124 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f699359e640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f699410de60 0x7f699419fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f699259c640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6994105380 0x7f699419a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f6992d9d640 1 -- 172.21.15.22:0/2466030124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6994105380 msgr2=0x7f699419a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f6992d9d640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6994105380 0x7f699419a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f6992d9d640 1 -- 172.21.15.22:0/2466030124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f699410de60 msgr2=0x7f699419fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f6992d9d640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f699410de60 0x7f699419fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f6992d9d640 1 -- 172.21.15.22:0/2466030124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69941a02e0 con 0x7f6994104a30 2024-09-21T04:02:44.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f6992d9d640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994104a30 0x7f699419a370 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f698400e9f0 tx=0x7f698400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f697bfff640 1 -- 172.21.15.22:0/2466030124 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698400cd80 con 0x7f6994104a30 2024-09-21T04:02:44.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f699915b640 1 -- 172.21.15.22:0/2466030124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69941a05d0 con 0x7f6994104a30 2024-09-21T04:02:44.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f697bfff640 1 -- 172.21.15.22:0/2466030124 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69840108c0 con 0x7f6994104a30 2024-09-21T04:02:44.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.520+0000 7f697bfff640 1 -- 172.21.15.22:0/2466030124 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69840187c0 con 0x7f6994104a30 2024-09-21T04:02:44.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.521+0000 7f699915b640 1 -- 172.21.15.22:0/2466030124 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69941a6d30 con 0x7f6994104a30 2024-09-21T04:02:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.523+0000 7f699f6cf740 1 Processor -- start 2024-09-21T04:02:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699f6cf740 1 -- start start 2024-09-21T04:02:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f697bfff640 1 -- 172.21.15.22:0/2466030124 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6984018960 con 0x7f6994104a30 2024-09-21T04:02:44.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3cebcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 0x557d3cebd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 0x557d3cebd980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699f6cf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557d3ce34c10 con 0x557d3caee0a0 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699f6cf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557d3ce24040 con 0x557d3caf6280 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699f6cf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557d3ce27e50 con 0x557d3cb16f60 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699359e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3cebcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f6992d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 0x557d3cebd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699359e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3cebcf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:46830/0 (socket says 172.21.15.22:46830) 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699359e640 1 -- 172.21.15.22:0/1559919595 learned_addr learned my addr 172.21.15.22:0/1559919595 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699259c640 1 --2- 172.21.15.22:0/1559919595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 0x557d3cebd980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699359e640 1 -- 172.21.15.22:0/1559919595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 msgr2=0x557d3cebd980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699359e640 1 --2- 172.21.15.22:0/1559919595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 0x557d3cebd980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.524+0000 7f699359e640 1 -- 172.21.15.22:0/1559919595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 msgr2=0x557d3cebd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.525+0000 7f699359e640 1 --2- 172.21.15.22:0/1559919595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 0x557d3cebd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.525+0000 7f699359e640 1 -- 172.21.15.22:0/1559919595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d3cb82540 con 0x557d3cb16f60 2024-09-21T04:02:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.525+0000 7f6992d9d640 1 --2- 172.21.15.22:0/1559919595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 0x557d3cebd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.525+0000 7f699359e640 1 --2- 172.21.15.22:0/1559919595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3cebcf00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f698c009ca0 tx=0x7f698c009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ff80554a86e7934 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.525+0000 7f697bfff640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f697c0b6510 0x7f697c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.525+0000 7f69797fa640 1 -- 172.21.15.22:0/1559919595 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c031790 con 0x557d3cb16f60 2024-09-21T04:02:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.526+0000 7f6992d9d640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f697c0b6510 0x7f697c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.526+0000 7f69797fa640 1 -- 172.21.15.22:0/1559919595 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f698c036030 con 0x557d3cb16f60 2024-09-21T04:02:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.526+0000 7f69797fa640 1 -- 172.21.15.22:0/1559919595 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c004330 con 0x557d3cb16f60 2024-09-21T04:02:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.526+0000 7f697bfff640 1 -- 172.21.15.22:0/2466030124 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f69840e7a70 con 0x7f6994104a30 2024-09-21T04:02:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.526+0000 7f699f6cf740 1 -- 172.21.15.22:0/1559919595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 msgr2=0x557d3cebcf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.526+0000 7f6992d9d640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f697c0b6510 0x7f697c0b8a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x557d3cebbb80 tx=0x7f69840eb550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.526+0000 7f699f6cf740 1 --2- 172.21.15.22:0/1559919595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3cebcf00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f698c009ca0 tx=0x7f698c009a20 comp rx=0 tx=0).stop 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.527+0000 7f699f6cf740 1 -- 172.21.15.22:0/1559919595 shutdown_connections 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.527+0000 7f699f6cf740 1 --2- 172.21.15.22:0/1559919595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 0x557d3cebd980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.527+0000 7f699f6cf740 1 --2- 172.21.15.22:0/1559919595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 0x557d3cebd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.527+0000 7f699f6cf740 1 --2- 172.21.15.22:0/1559919595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3cebcf00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.527+0000 7f699f6cf740 1 -- 172.21.15.22:0/1559919595 >> 172.21.15.22:0/1559919595 conn(0x557d3cb0b350 msgr2=0x557d3cebadf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.527+0000 7f699f6cf740 1 -- 172.21.15.22:0/1559919595 shutdown_connections 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.527+0000 7f699f6cf740 1 -- 172.21.15.22:0/1559919595 wait complete. 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.527+0000 7f699f6cf740 1 -- start start 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.527+0000 7f699f6cf740 1 Processor -- start 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 0x557d3cec8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caf6280 0x557d3cec8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3ced47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699f6cf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557d3cc855f0 con 0x557d3caf6280 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699f6cf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557d3cdbf010 con 0x557d3caee0a0 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699f6cf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557d3cecb500 con 0x557d3cb16f60 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699f6cf740 10 client.0 _ll_register_callbacks cb 0x557d3ce1e340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caf6280 0x557d3cec8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 0x557d3cec8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caf6280 0x557d3cec8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51182/0 (socket says 172.21.15.22:51182) 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699259c640 1 -- 172.21.15.22:0/433330995 learned_addr learned my addr 172.21.15.22:0/433330995 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699359e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 0x557d3cec8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:40714/0 (socket says 172.21.15.22:40714) 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699359e640 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3ced47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699359e640 1 -- 172.21.15.22:0/433330995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 msgr2=0x557d3ced47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699359e640 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3ced47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699359e640 1 -- 172.21.15.22:0/433330995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caf6280 msgr2=0x557d3cec8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699359e640 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caf6280 0x557d3cec8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699359e640 1 -- 172.21.15.22:0/433330995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d3cdeca00 con 0x557d3caee0a0 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f699359e640 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 0x557d3cec8980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f698c02ade0 tx=0x7f698c003e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f6b5c57054be6dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.528+0000 7f6976ff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.529+0000 7f6976ff5640 1 -- 172.21.15.22:0/433330995 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c058060 con 0x557d3caee0a0 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.529+0000 7f6976ff5640 1 -- 172.21.15.22:0/433330995 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f698c0046a0 con 0x557d3caee0a0 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.529+0000 7f699f6cf740 1 -- 172.21.15.22:0/433330995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f698c036030 con 0x557d3caee0a0 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.529+0000 7f6976ff5640 1 -- 172.21.15.22:0/433330995 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f698c05f050 con 0x557d3caee0a0 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.529+0000 7f699f6cf740 10 client.25214 fetch_fsmap learned FSMap version 29 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.529+0000 7f699f6cf740 1 -- 172.21.15.22:0/433330995 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d3ced73b0 con 0x557d3caee0a0 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.529+0000 7f6976ff5640 1 -- 172.21.15.22:0/433330995 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f698c036030 con 0x557d3caee0a0 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.530+0000 7f6976ff5640 1 -- 172.21.15.22:0/433330995 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f698c050070 con 0x557d3caee0a0 2024-09-21T04:02:44.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.530+0000 7f699f6cf740 10 client.25214 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.530+0000 7f699f6cf740 10 client.25214 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.530+0000 7f699f6cf740 20 client.25214 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.530+0000 7f699f6cf740 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x557d3cad58e0 0x557d3cedaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.530+0000 7f699f6cf740 4 client.25214 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.530+0000 7f699f6cf740 1 -- 172.21.15.22:0/433330995 --> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557d3ce36b60 con 0x557d3cad58e0 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.530+0000 7f699259c640 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x557d3cad58e0 0x557d3cedaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.531+0000 7f6976ff5640 10 client.25214 ms_handle_connect on v2:172.21.15.73:6834/4117291653 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.531+0000 7f699259c640 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x557d3cad58e0 0x557d3cedaaa0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=6d2db03af064da4a server_cookie=4255108fb411829e in_seq=0 out_seq=0 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.531+0000 7f6976ff5640 1 -- 172.21.15.22:0/433330995 <== mds.4 v2:172.21.15.73:6834/4117291653 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557d3ce36b60 con 0x557d3cad58e0 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.531+0000 7f6976ff5640 10 client.25214 handle_command_reply: tid=0 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 client.25214 shutdown 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 -- 172.21.15.22:0/433330995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 msgr2=0x557d3cec8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 0x557d3cec8980 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f698c02ade0 tx=0x7f698c003e70 comp rx=0 tx=0).stop 2024-09-21T04:02:44.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 -- 172.21.15.22:0/433330995 shutdown_connections 2024-09-21T04:02:44.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x557d3cad58e0 0x557d3cedaaa0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3ced47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caf6280 0x557d3cec8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 --2- 172.21.15.22:0/433330995 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 0x557d3cec8980 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 -- 172.21.15.22:0/433330995 >> 172.21.15.22:0/433330995 conn(0x557d3cb0b350 msgr2=0x557d3cec0090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f6976ff5640 0 client.25214 ms_handle_reset on v2:172.21.15.73:6834/4117291653 2024-09-21T04:02:44.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 -- 172.21.15.22:0/433330995 shutdown_connections 2024-09-21T04:02:44.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 1 -- 172.21.15.22:0/433330995 wait complete. 2024-09-21T04:02:44.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.532+0000 7f699f6cf740 20 client.25214 trim_cache size 0 max 16384 2024-09-21T04:02:44.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.552+0000 7f699f6cf740 1 Processor -- start 2024-09-21T04:02:44.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.552+0000 7f699f6cf740 1 -- start start 2024-09-21T04:02:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 0x557d3cec3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 0x557d3cee3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3cee36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699f6cf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557d3ced8de0 con 0x557d3caee0a0 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699f6cf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557d3ced94b0 con 0x557d3caf6280 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699f6cf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557d3ced9b80 con 0x557d3cb16f60 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 0x557d3cec3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 0x557d3cee3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 0x557d3cec3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51198/0 (socket says 172.21.15.22:51198) 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699359e640 1 -- 172.21.15.22:0/2874329589 learned_addr learned my addr 172.21.15.22:0/2874329589 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699359e640 1 --2- 172.21.15.22:0/2874329589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3cee36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699259c640 1 -- 172.21.15.22:0/2874329589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 msgr2=0x557d3cee36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699259c640 1 --2- 172.21.15.22:0/2874329589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3cee36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699259c640 1 -- 172.21.15.22:0/2874329589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 msgr2=0x557d3cec3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699259c640 1 --2- 172.21.15.22:0/2874329589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 0x557d3cec3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699259c640 1 -- 172.21.15.22:0/2874329589 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557d3cec96b0 con 0x557d3caf6280 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.553+0000 7f699259c640 1 --2- 172.21.15.22:0/2874329589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 0x557d3cee3170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x557d3cedb8e0 tx=0x7f6988005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a71ee6551ececc2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.554+0000 7f6978ff9640 1 -- 172.21.15.22:0/2874329589 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6988010430 con 0x557d3caf6280 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.554+0000 7f6978ff9640 1 -- 172.21.15.22:0/2874329589 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6988010a60 con 0x557d3caf6280 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.554+0000 7f6978ff9640 1 -- 172.21.15.22:0/2874329589 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698801e8f0 con 0x557d3caf6280 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.555+0000 7f699f6cf740 1 -- 172.21.15.22:0/2874329589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 msgr2=0x557d3cee3170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.555+0000 7f699f6cf740 1 --2- 172.21.15.22:0/2874329589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 0x557d3cee3170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x557d3cedb8e0 tx=0x7f6988005f90 comp rx=0 tx=0).stop 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.555+0000 7f699f6cf740 1 -- 172.21.15.22:0/2874329589 shutdown_connections 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.555+0000 7f699f6cf740 1 --2- 172.21.15.22:0/2874329589 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3cb16f60 0x557d3cee36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.555+0000 7f699f6cf740 1 --2- 172.21.15.22:0/2874329589 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caf6280 0x557d3cee3170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.555+0000 7f699f6cf740 1 --2- 172.21.15.22:0/2874329589 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3caee0a0 0x557d3cec3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.555+0000 7f699f6cf740 1 -- 172.21.15.22:0/2874329589 >> 172.21.15.22:0/2874329589 conn(0x557d3cb0b350 msgr2=0x557d3cec3930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.555+0000 7f699f6cf740 1 -- 172.21.15.22:0/2874329589 shutdown_connections 2024-09-21T04:02:44.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.555+0000 7f699f6cf740 1 -- 172.21.15.22:0/2874329589 wait complete. 2024-09-21T04:02:44.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.555+0000 7f699f6cf740 1 -- start start 2024-09-21T04:02:44.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699f6cf740 1 Processor -- start 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 0x557d3cedbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3caf6280 0x557d3cedc190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699f6cf740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3cb16f60 0x557d3cedc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699f6cf740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557d3ceda920 con 0x557d3cb16f60 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699f6cf740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557d3ceda250 con 0x557d3caee0a0 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699f6cf740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557d3cedaff0 con 0x557d3caf6280 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699f6cf740 10 client.0 _ll_register_callbacks cb 0x7f69840eb420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3cb16f60 0x557d3cedc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699359e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3cb16f60 0x557d3cedc6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51212/0 (socket says 172.21.15.22:51212) 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699359e640 1 -- 172.21.15.22:0/3987839772 learned_addr learned my addr 172.21.15.22:0/3987839772 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699259c640 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3caf6280 0x557d3cedc190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699359e640 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 0x557d3cedbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699359e640 1 -- 172.21.15.22:0/3987839772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3caf6280 msgr2=0x557d3cedc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699359e640 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3caf6280 0x557d3cedc190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699359e640 1 -- 172.21.15.22:0/3987839772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 msgr2=0x557d3cedbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699359e640 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 0x557d3cedbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.556+0000 7f699359e640 1 -- 172.21.15.22:0/3987839772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557d3cf48fd0 con 0x557d3cb16f60 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.557+0000 7f699359e640 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3cb16f60 0x557d3cedc6d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f698c009960 tx=0x7f698c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1eef35a959c5af4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.557+0000 7f6976ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.557+0000 7f6976ff5640 1 -- 172.21.15.22:0/3987839772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c0305c0 con 0x557d3cb16f60 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.557+0000 7f6976ff5640 1 -- 172.21.15.22:0/3987839772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f698c004400 con 0x557d3cb16f60 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.557+0000 7f699f6cf740 1 -- 172.21.15.22:0/3987839772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6988010a60 con 0x557d3cb16f60 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.557+0000 7f6976ff5640 1 -- 172.21.15.22:0/3987839772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f698c070050 con 0x557d3cb16f60 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.557+0000 7f699f6cf740 10 client.15555 fetch_fsmap learned FSMap version 29 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.557+0000 7f699f6cf740 1 -- 172.21.15.22:0/3987839772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x557d3cf4a250 con 0x557d3cb16f60 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.557+0000 7f6976ff5640 1 -- 172.21.15.22:0/3987839772 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6988010a60 con 0x557d3cb16f60 2024-09-21T04:02:44.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.558+0000 7f6976ff5640 1 -- 172.21.15.22:0/3987839772 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f698c050070 con 0x557d3cb16f60 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.558+0000 7f699f6cf740 10 client.15555 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.558+0000 7f699f6cf740 10 client.15555 resolve_mds: resolved name 'f' to daemon mds.f 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.558+0000 7f699f6cf740 20 client.15555 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.558+0000 7f699f6cf740 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x557d3caaac90 0x557d3cf4da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.558+0000 7f699f6cf740 4 client.15555 mds_command: new command op to 24610 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.558+0000 7f699f6cf740 1 -- 172.21.15.22:0/3987839772 --> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] -- command(tid 0: {"prefix": "status"}) -- 0x557d3ce32610 con 0x557d3caaac90 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.558+0000 7f699259c640 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x557d3caaac90 0x557d3cf4da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f6976ff5640 10 client.15555 ms_handle_connect on v2:172.21.15.73:6834/4117291653 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699259c640 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x557d3caaac90 0x557d3cf4da00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=26f97502eafd0725 server_cookie=fb5e48ebe895ac32 in_seq=0 out_seq=0 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f6976ff5640 1 -- 172.21.15.22:0/3987839772 <== mds.4 v2:172.21.15.73:6834/4117291653 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x557d3ce32610 con 0x557d3caaac90 2024-09-21T04:02:44.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f6976ff5640 10 client.15555 handle_command_reply: tid=0 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 client.15555 shutdown 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 -- 172.21.15.22:0/3987839772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3cb16f60 msgr2=0x557d3cedc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3cb16f60 0x557d3cedc6d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f698c009960 tx=0x7f698c02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 -- 172.21.15.22:0/3987839772 shutdown_connections 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.73:6834/4117291653,v1:172.21.15.73:6835/4117291653] conn(0x557d3caaac90 0x557d3cf4da00 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557d3caf6280 0x557d3cedc190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557d3cb16f60 0x557d3cedc6d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 --2- 172.21.15.22:0/3987839772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557d3caee0a0 0x557d3cedbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 -- 172.21.15.22:0/3987839772 >> 172.21.15.22:0/3987839772 conn(0x557d3cb0b350 msgr2=0x557d3ceba600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f6976ff5640 0 client.15555 ms_handle_reset on v2:172.21.15.73:6834/4117291653 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 -- 172.21.15.22:0/3987839772 shutdown_connections 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 1 -- 172.21.15.22:0/3987839772 wait complete. 2024-09-21T04:02:44.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.559+0000 7f699f6cf740 20 client.15555 trim_cache size 0 max 16384 2024-09-21T04:02:44.568 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:44.568 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:02:44.568 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 4, 2024-09-21T04:02:44.568 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24610, 2024-09-21T04:02:44.568 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:02:44.568 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:02:44.568 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:02:44.568 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 120.350376817, 2024-09-21T04:02:44.568 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 29, 2024-09-21T04:02:44.568 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:02:44.569 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 85, 2024-09-21T04:02:44.569 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 187.93446061099999 2024-09-21T04:02:44.569 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:44.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 -- 172.21.15.22:0/2466030124 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f697c0b6510 msgr2=0x7f697c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f697c0b6510 0x7f697c0b8a20 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x557d3cebbb80 tx=0x7f69840eb550 comp rx=0 tx=0).stop 2024-09-21T04:02:44.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 -- 172.21.15.22:0/2466030124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994104a30 msgr2=0x7f699419a370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:44.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994104a30 0x7f699419a370 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f698400e9f0 tx=0x7f698400eeb0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 -- 172.21.15.22:0/2466030124 shutdown_connections 2024-09-21T04:02:44.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f697c0b6510 0x7f697c0b8a20 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f699410de60 0x7f699419fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6994105380 0x7f699419a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 --2- 172.21.15.22:0/2466030124 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6994104a30 0x7f699419a370 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:44.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 -- 172.21.15.22:0/2466030124 >> 172.21.15.22:0/2466030124 conn(0x7f6994079790 msgr2=0x7f6994107940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:44.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.560+0000 7f699915b640 1 -- 172.21.15.22:0/2466030124 shutdown_connections 2024-09-21T04:02:44.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:44.561+0000 7f699915b640 1 -- 172.21.15.22:0/2466030124 wait complete. 2024-09-21T04:02:44.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:44 smithi022 ceph-mon[31015]: pgmap v382: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T04:02:44.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:44 smithi073 ceph-mon[34443]: pgmap v382: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T04:02:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:44 smithi060 ceph-mon[33722]: pgmap v382: 129 pgs: 129 active+clean; 655 KiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 9 op/s 2024-09-21T04:02:45.288 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.c status 2024-09-21T04:02:45.579 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:46.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.125+0000 7f67fd399640 1 -- 172.21.15.22:0/1597599696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8102aa0 msgr2=0x7f67f8102eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.125+0000 7f67fd399640 1 --2- 172.21.15.22:0/1597599696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8102aa0 0x7f67f8102eb0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009900 tx=0x7f67e802a410 comp rx=0 tx=0).stop 2024-09-21T04:02:46.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.125+0000 7f67fd399640 1 -- 172.21.15.22:0/1597599696 shutdown_connections 2024-09-21T04:02:46.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.125+0000 7f67fd399640 1 --2- 172.21.15.22:0/1597599696 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67f81083e0 0x7f67f81087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.125+0000 7f67fd399640 1 --2- 172.21.15.22:0/1597599696 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f8108d30 0x7f67f810f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.125+0000 7f67fd399640 1 --2- 172.21.15.22:0/1597599696 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f8102aa0 0x7f67f8102eb0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.125+0000 7f67fd399640 1 -- 172.21.15.22:0/1597599696 >> 172.21.15.22:0/1597599696 conn(0x7f67f80797e0 msgr2=0x7f67f8079bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.125+0000 7f67fd399640 1 -- 172.21.15.22:0/1597599696 shutdown_connections 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.125+0000 7f67fd399640 1 -- 172.21.15.22:0/1597599696 wait complete. 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.126+0000 7f67fd399640 1 Processor -- start 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.126+0000 7f67fd399640 1 -- start start 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67fd399640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f8102aa0 0x7f67f819b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67fd399640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f81083e0 0x7f67f819b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67fd399640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67f8108d30 0x7f67f819bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67fd399640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f67f8112850 con 0x7f67f81083e0 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67fd399640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67f81126d0 con 0x7f67f8102aa0 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67fd399640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f67f81129d0 con 0x7f67f8108d30 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f81083e0 0x7f67f819b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67f6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f8102aa0 0x7f67f819b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f81083e0 0x7f67f819b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51228/0 (socket says 172.21.15.22:51228) 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67f67fc640 1 -- 172.21.15.22:0/3175513957 learned_addr learned my addr 172.21.15.22:0/3175513957 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67f77fe640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67f8108d30 0x7f67f819bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67f6ffd640 1 -- 172.21.15.22:0/3175513957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67f8108d30 msgr2=0x7f67f819bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67f6ffd640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67f8108d30 0x7f67f819bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67f6ffd640 1 -- 172.21.15.22:0/3175513957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f81083e0 msgr2=0x7f67f819b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67f6ffd640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f81083e0 0x7f67f819b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.127+0000 7f67f6ffd640 1 -- 172.21.15.22:0/3175513957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67f81a6470 con 0x7f67f8102aa0 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.128+0000 7f67f6ffd640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f8102aa0 0x7f67f819b1e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67e8005940 tx=0x7f67e8005e10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.128+0000 7f67dffff640 1 -- 172.21.15.22:0/3175513957 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8035070 con 0x7f67f8102aa0 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.128+0000 7f67fd399640 1 -- 172.21.15.22:0/3175513957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67f8198fd0 con 0x7f67f8102aa0 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.128+0000 7f67dffff640 1 -- 172.21.15.22:0/3175513957 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67e80043c0 con 0x7f67f8102aa0 2024-09-21T04:02:46.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.128+0000 7f67dffff640 1 -- 172.21.15.22:0/3175513957 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e8003a50 con 0x7f67f8102aa0 2024-09-21T04:02:46.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.128+0000 7f67fd399640 1 -- 172.21.15.22:0/3175513957 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67f81994b0 con 0x7f67f8102aa0 2024-09-21T04:02:46.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.131+0000 7f680390d740 1 Processor -- start 2024-09-21T04:02:46.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.131+0000 7f680390d740 1 -- start start 2024-09-21T04:02:46.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.131+0000 7f67dffff640 1 -- 172.21.15.22:0/3175513957 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f67e8003c70 con 0x7f67f8102aa0 2024-09-21T04:02:46.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f680390d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0e0f60 0x560eee486f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f680390d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0b80a0 0x560eee487440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f680390d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee487980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f680390d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560eee3fec10 con 0x560eee0e0f60 2024-09-21T04:02:46.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f680390d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560eee3ee040 con 0x560eee0b80a0 2024-09-21T04:02:46.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f680390d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x560eee3f1e50 con 0x560eee0c0280 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f67f6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0b80a0 0x560eee487440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f67f77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0e0f60 0x560eee486f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f67f6ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0b80a0 0x560eee487440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:40750/0 (socket says 172.21.15.22:40750) 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f67f6ffd640 1 -- 172.21.15.22:0/2160459200 learned_addr learned my addr 172.21.15.22:0/2160459200 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f67f77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0e0f60 0x560eee486f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51244/0 (socket says 172.21.15.22:51244) 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f67f67fc640 1 --2- 172.21.15.22:0/2160459200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee487980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f67f77fe640 1 -- 172.21.15.22:0/2160459200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 msgr2=0x560eee487980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.132+0000 7f67f77fe640 1 --2- 172.21.15.22:0/2160459200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee487980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67f77fe640 1 -- 172.21.15.22:0/2160459200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0b80a0 msgr2=0x560eee487440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67f77fe640 1 --2- 172.21.15.22:0/2160459200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0b80a0 0x560eee487440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67f77fe640 1 -- 172.21.15.22:0/2160459200 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eee14c540 con 0x560eee0e0f60 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67f6ffd640 1 --2- 172.21.15.22:0/2160459200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0b80a0 0x560eee487440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67f67fc640 1 --2- 172.21.15.22:0/2160459200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee487980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:46.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67dffff640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67e00b6540 0x7f67e00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67f77fe640 1 --2- 172.21.15.22:0/2160459200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0e0f60 0x560eee486f00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009f10 tx=0x7f67f0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ccfcdd46a65fe9a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67f6ffd640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67e00b6540 0x7f67e00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67dd7fa640 1 -- 172.21.15.22:0/2160459200 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0004d20 con 0x560eee0e0f60 2024-09-21T04:02:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67dffff640 1 -- 172.21.15.22:0/3175513957 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f67e810be80 con 0x7f67f8102aa0 2024-09-21T04:02:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67dd7fa640 1 -- 172.21.15.22:0/2160459200 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67f0004030 con 0x560eee0e0f60 2024-09-21T04:02:46.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.133+0000 7f67dd7fa640 1 -- 172.21.15.22:0/2160459200 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f0005260 con 0x560eee0e0f60 2024-09-21T04:02:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.135+0000 7f680390d740 1 -- 172.21.15.22:0/2160459200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0e0f60 msgr2=0x560eee486f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.135+0000 7f67f6ffd640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67e00b6540 0x7f67e00b8a50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f67e802a930 tx=0x7f67e810f960 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.135+0000 7f680390d740 1 --2- 172.21.15.22:0/2160459200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0e0f60 0x560eee486f00 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009f10 tx=0x7f67f0011810 comp rx=0 tx=0).stop 2024-09-21T04:02:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.135+0000 7f680390d740 1 -- 172.21.15.22:0/2160459200 shutdown_connections 2024-09-21T04:02:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.135+0000 7f680390d740 1 --2- 172.21.15.22:0/2160459200 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee487980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.135+0000 7f680390d740 1 --2- 172.21.15.22:0/2160459200 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0b80a0 0x560eee487440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.135+0000 7f680390d740 1 --2- 172.21.15.22:0/2160459200 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0e0f60 0x560eee486f00 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.135+0000 7f680390d740 1 -- 172.21.15.22:0/2160459200 >> 172.21.15.22:0/2160459200 conn(0x560eee0d5350 msgr2=0x560eee484df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.135+0000 7f680390d740 1 -- 172.21.15.22:0/2160459200 shutdown_connections 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.135+0000 7f680390d740 1 -- 172.21.15.22:0/2160459200 wait complete. 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.136+0000 7f680390d740 1 -- start start 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.136+0000 7f680390d740 1 Processor -- start 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.136+0000 7f680390d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee492a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.136+0000 7f680390d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee492fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee492a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee492a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:46896/0 (socket says 172.21.15.22:46896) 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee492fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee492fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51260/0 (socket says 172.21.15.22:51260) 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f77fe640 1 -- 172.21.15.22:0/2897321613 learned_addr learned my addr 172.21.15.22:0/2897321613 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:46.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f680390d740 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee49e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560eee24f5f0 con 0x560eee0c0280 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560eee389010 con 0x560eee0e0f60 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x560eee4956e0 con 0x560eee0b80a0 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f680390d740 10 client.0 _ll_register_callbacks cb 0x560eee3e8340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f77fe640 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee49e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f77fe640 1 -- 172.21.15.22:0/2897321613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 msgr2=0x560eee49e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f77fe640 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee49e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f77fe640 1 -- 172.21.15.22:0/2897321613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 msgr2=0x560eee492fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f77fe640 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee492fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f77fe640 1 -- 172.21.15.22:0/2897321613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eee3b6a00 con 0x560eee0b80a0 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.137+0000 7f67f67fc640 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee492fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.138+0000 7f67daff5640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.138+0000 7f67f77fe640 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee492a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009d50 tx=0x7f67f0000f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1f25479f14aa394 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.138+0000 7f67daff5640 1 -- 172.21.15.22:0/2897321613 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f002d060 con 0x560eee0b80a0 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.138+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67f0004030 con 0x560eee0b80a0 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.138+0000 7f67daff5640 1 -- 172.21.15.22:0/2897321613 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f67f0005040 con 0x560eee0b80a0 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f67daff5640 1 -- 172.21.15.22:0/2897321613 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f67f0034050 con 0x560eee0b80a0 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f680390d740 10 client.25213 fetch_fsmap learned FSMap version 29 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560eee4a1640 con 0x560eee0b80a0 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f67daff5640 1 -- 172.21.15.22:0/2897321613 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67f00056d0 con 0x560eee0b80a0 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f67daff5640 1 -- 172.21.15.22:0/2897321613 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f67f0018070 con 0x560eee0b80a0 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f680390d740 10 client.25213 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f680390d740 10 client.25213 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f680390d740 20 client.25213 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f680390d740 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x560eee09f8e0 0x560eee4a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f680390d740 4 client.25213 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:46.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 --> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f67f0004030 con 0x560eee09f8e0 2024-09-21T04:02:46.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.139+0000 7f67f67fc640 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x560eee09f8e0 0x560eee4a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.140+0000 7f67f67fc640 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x560eee09f8e0 0x560eee4a4e30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=acb877dc52ab3999 server_cookie=7affecf8843f6fbe in_seq=0 out_seq=0 2024-09-21T04:02:46.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.140+0000 7f67daff5640 10 client.25213 ms_handle_connect on v2:172.21.15.73:6836/3229670499 2024-09-21T04:02:46.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f67daff5640 1 -- 172.21.15.22:0/2897321613 <== mds.3 v2:172.21.15.73:6836/3229670499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f67f0004030 con 0x560eee09f8e0 2024-09-21T04:02:46.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f67daff5640 10 client.25213 handle_command_reply: tid=0 2024-09-21T04:02:46.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 client.25213 shutdown 2024-09-21T04:02:46.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 msgr2=0x560eee492a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee492a70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f67f0009d50 tx=0x7f67f0000f40 comp rx=0 tx=0).stop 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 shutdown_connections 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x560eee09f8e0 0x560eee4a4e30 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee49e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee492fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f67daff5640 0 client.25213 ms_handle_reset on v2:172.21.15.73:6836/3229670499 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 --2- 172.21.15.22:0/2897321613 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee492a70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 >> 172.21.15.22:0/2897321613 conn(0x560eee0d5350 msgr2=0x560eee48a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 shutdown_connections 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 1 -- 172.21.15.22:0/2897321613 wait complete. 2024-09-21T04:02:46.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.141+0000 7f680390d740 20 client.25213 trim_cache size 0 max 16384 2024-09-21T04:02:46.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.163+0000 7f680390d740 1 Processor -- start 2024-09-21T04:02:46.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.163+0000 7f680390d740 1 -- start start 2024-09-21T04:02:46.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.163+0000 7f680390d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0b80a0 0x560eee49e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f680390d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee49ee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f680390d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee48da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f680390d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560eee4a3170 con 0x560eee0b80a0 2024-09-21T04:02:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f680390d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560eee4a3840 con 0x560eee0e0f60 2024-09-21T04:02:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f680390d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x560eee4a3f10 con 0x560eee0c0280 2024-09-21T04:02:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0b80a0 0x560eee49e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee49ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee49ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:46898/0 (socket says 172.21.15.22:46898) 2024-09-21T04:02:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0b80a0 0x560eee49e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51268/0 (socket says 172.21.15.22:51268) 2024-09-21T04:02:46.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f67fc640 1 -- 172.21.15.22:0/724657944 learned_addr learned my addr 172.21.15.22:0/724657944 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f67fc640 1 -- 172.21.15.22:0/724657944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 msgr2=0x560eee48da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f67fc640 1 --2- 172.21.15.22:0/724657944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee48da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f67fc640 1 -- 172.21.15.22:0/724657944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0b80a0 msgr2=0x560eee49e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f67fc640 1 --2- 172.21.15.22:0/724657944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0b80a0 0x560eee49e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f67fc640 1 -- 172.21.15.22:0/724657944 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560eee489d60 con 0x560eee0c0280 2024-09-21T04:02:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.164+0000 7f67f67fc640 1 --2- 172.21.15.22:0/724657944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee49ee80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x560eee4a5530 tx=0x7f67ec005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f75155459c290669 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.165+0000 7f67dcff9640 1 -- 172.21.15.22:0/724657944 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec0106f0 con 0x560eee0c0280 2024-09-21T04:02:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.165+0000 7f67dcff9640 1 -- 172.21.15.22:0/724657944 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67ec010d20 con 0x560eee0c0280 2024-09-21T04:02:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.165+0000 7f67dcff9640 1 -- 172.21.15.22:0/724657944 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ec01ece0 con 0x560eee0c0280 2024-09-21T04:02:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.166+0000 7f680390d740 1 -- 172.21.15.22:0/724657944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 msgr2=0x560eee49ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.166+0000 7f680390d740 1 --2- 172.21.15.22:0/724657944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee49ee80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x560eee4a5530 tx=0x7f67ec005f90 comp rx=0 tx=0).stop 2024-09-21T04:02:46.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.166+0000 7f680390d740 1 -- 172.21.15.22:0/724657944 shutdown_connections 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.166+0000 7f680390d740 1 --2- 172.21.15.22:0/724657944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0c0280 0x560eee49ee80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.166+0000 7f680390d740 1 --2- 172.21.15.22:0/724657944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee48da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.166+0000 7f680390d740 1 --2- 172.21.15.22:0/724657944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0b80a0 0x560eee49e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.166+0000 7f680390d740 1 -- 172.21.15.22:0/724657944 >> 172.21.15.22:0/724657944 conn(0x560eee0d5350 msgr2=0x560eee47fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.166+0000 7f680390d740 1 -- 172.21.15.22:0/724657944 shutdown_connections 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.166+0000 7f680390d740 1 -- 172.21.15.22:0/724657944 wait complete. 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f680390d740 1 -- start start 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f680390d740 1 Processor -- start 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f680390d740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee4ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f680390d740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee4a6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f680390d740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee4a75d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f680390d740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560eee4a4cb0 con 0x560eee0c0280 2024-09-21T04:02:46.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f680390d740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x560eee4a45e0 con 0x560eee0e0f60 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f680390d740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x560eee4a5380 con 0x560eee0b80a0 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f680390d740 10 client.0 _ll_register_callbacks cb 0x7f67e810f830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee4a6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f67f77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee4ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f67f67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee4a6f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51278/0 (socket says 172.21.15.22:51278) 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.167+0000 7f67f67fc640 1 -- 172.21.15.22:0/1554087571 learned_addr learned my addr 172.21.15.22:0/1554087571 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67f77fe640 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee4a75d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67f77fe640 1 -- 172.21.15.22:0/1554087571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 msgr2=0x560eee4a75d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67f77fe640 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee4a75d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67f77fe640 1 -- 172.21.15.22:0/1554087571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 msgr2=0x560eee4a6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67f77fe640 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee4a6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67f77fe640 1 -- 172.21.15.22:0/1554087571 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560eee4859b0 con 0x560eee0b80a0 2024-09-21T04:02:46.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67f77fe640 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee4ada50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f67f0011850 tx=0x7f67f0012f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bb1b8b112e3ace0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67daff5640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67daff5640 1 -- 172.21.15.22:0/1554087571 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f002d070 con 0x560eee0b80a0 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67daff5640 1 -- 172.21.15.22:0/1554087571 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f67f0004560 con 0x560eee0b80a0 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f680390d740 1 -- 172.21.15.22:0/1554087571 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f67ec010d20 con 0x560eee0b80a0 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.168+0000 7f67daff5640 1 -- 172.21.15.22:0/1554087571 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f67f001e040 con 0x560eee0b80a0 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f680390d740 10 client.25219 fetch_fsmap learned FSMap version 29 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f680390d740 1 -- 172.21.15.22:0/1554087571 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560eee510300 con 0x560eee0b80a0 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f67daff5640 1 -- 172.21.15.22:0/1554087571 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67ec010d20 con 0x560eee0b80a0 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f67daff5640 1 -- 172.21.15.22:0/1554087571 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f67f0018040 con 0x560eee0b80a0 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f680390d740 10 client.25219 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f680390d740 10 client.25219 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f680390d740 20 client.25219 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:46.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f680390d740 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x560eee074c90 0x560eee513930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f680390d740 4 client.25219 mds_command: new command op to 24616 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:02:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f680390d740 1 -- 172.21.15.22:0/1554087571 --> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] -- command(tid 0: {"prefix": "status"}) -- 0x560eee400b60 con 0x560eee074c90 2024-09-21T04:02:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.169+0000 7f67f67fc640 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x560eee074c90 0x560eee513930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f67daff5640 10 client.25219 ms_handle_connect on v2:172.21.15.73:6836/3229670499 2024-09-21T04:02:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f67f67fc640 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x560eee074c90 0x560eee513930 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=24ae7389df8d6b2b server_cookie=9a85f67837db5261 in_seq=0 out_seq=0 2024-09-21T04:02:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f67daff5640 1 -- 172.21.15.22:0/1554087571 <== mds.3 v2:172.21.15.73:6836/3229670499 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560eee400b60 con 0x560eee074c90 2024-09-21T04:02:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f67daff5640 10 client.25219 handle_command_reply: tid=0 2024-09-21T04:02:46.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f680390d740 1 client.25219 shutdown 2024-09-21T04:02:46.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f680390d740 1 -- 172.21.15.22:0/1554087571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 msgr2=0x560eee4ada50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f680390d740 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee4ada50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f67f0011850 tx=0x7f67f0012f90 comp rx=0 tx=0).stop 2024-09-21T04:02:46.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f680390d740 1 -- 172.21.15.22:0/1554087571 shutdown_connections 2024-09-21T04:02:46.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f680390d740 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.73:6836/3229670499,v1:172.21.15.73:6837/3229670499] conn(0x560eee074c90 0x560eee513930 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f680390d740 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x560eee0e0f60 0x560eee4a75d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f67daff5640 0 client.25219 ms_handle_reset on v2:172.21.15.73:6836/3229670499 2024-09-21T04:02:46.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.170+0000 7f680390d740 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560eee0c0280 0x560eee4a6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.171+0000 7f680390d740 1 --2- 172.21.15.22:0/1554087571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x560eee0b80a0 0x560eee4ada50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.171+0000 7f680390d740 1 -- 172.21.15.22:0/1554087571 >> 172.21.15.22:0/1554087571 conn(0x560eee0d5350 msgr2=0x560eee47fad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.171+0000 7f680390d740 1 -- 172.21.15.22:0/1554087571 shutdown_connections 2024-09-21T04:02:46.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.171+0000 7f680390d740 1 -- 172.21.15.22:0/1554087571 wait complete. 2024-09-21T04:02:46.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.171+0000 7f680390d740 20 client.25219 trim_cache size 0 max 16384 2024-09-21T04:02:46.178 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:02:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 3, 2024-09-21T04:02:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24616, 2024-09-21T04:02:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:02:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:02:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:02:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 122.96866144400001, 2024-09-21T04:02:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 29, 2024-09-21T04:02:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:02:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 85, 2024-09-21T04:02:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 187.02455726100001 2024-09-21T04:02:46.179 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:46.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.171+0000 7f67fd399640 1 -- 172.21.15.22:0/3175513957 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67e00b6540 msgr2=0x7f67e00b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.171+0000 7f67fd399640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67e00b6540 0x7f67e00b8a50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f67e802a930 tx=0x7f67e810f960 comp rx=0 tx=0).stop 2024-09-21T04:02:46.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.171+0000 7f67fd399640 1 -- 172.21.15.22:0/3175513957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f8102aa0 msgr2=0x7f67f819b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.171+0000 7f67fd399640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f8102aa0 0x7f67f819b1e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67e8005940 tx=0x7f67e8005e10 comp rx=0 tx=0).stop 2024-09-21T04:02:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.172+0000 7f67fd399640 1 -- 172.21.15.22:0/3175513957 shutdown_connections 2024-09-21T04:02:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.172+0000 7f67fd399640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67e00b6540 0x7f67e00b8a50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.172+0000 7f67fd399640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f67f8108d30 0x7f67f819bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.172+0000 7f67fd399640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67f81083e0 0x7f67f819b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.172+0000 7f67fd399640 1 --2- 172.21.15.22:0/3175513957 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67f8102aa0 0x7f67f819b1e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.172+0000 7f67fd399640 1 -- 172.21.15.22:0/3175513957 >> 172.21.15.22:0/3175513957 conn(0x7f67f80797e0 msgr2=0x7f67f81015f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.172+0000 7f67fd399640 1 -- 172.21.15.22:0/3175513957 shutdown_connections 2024-09-21T04:02:46.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:46.172+0000 7f67fd399640 1 -- 172.21.15.22:0/3175513957 wait complete. 2024-09-21T04:02:46.814 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:46 smithi022 ceph-mon[31015]: pgmap v383: 129 pgs: 129 active+clean; 4.7 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 344 KiB/s wr, 10 op/s 2024-09-21T04:02:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:46 smithi073 ceph-mon[34443]: pgmap v383: 129 pgs: 129 active+clean; 4.7 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 344 KiB/s wr, 10 op/s 2024-09-21T04:02:46.880 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.h status 2024-09-21T04:02:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:46 smithi060 ceph-mon[33722]: pgmap v383: 129 pgs: 129 active+clean; 4.7 MiB data, 381 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 344 KiB/s wr, 10 op/s 2024-09-21T04:02:47.168 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:47.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.702+0000 7fadf5639640 1 -- 172.21.15.22:0/1522233715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadf01083e0 msgr2=0x7fadf01087f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:47.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.702+0000 7fadf5639640 1 --2- 172.21.15.22:0/1522233715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadf01083e0 0x7fadf01087f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009900 tx=0x7fadd802a410 comp rx=0 tx=0).stop 2024-09-21T04:02:47.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.702+0000 7fadf5639640 1 -- 172.21.15.22:0/1522233715 shutdown_connections 2024-09-21T04:02:47.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.702+0000 7fadf5639640 1 --2- 172.21.15.22:0/1522233715 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadf01083e0 0x7fadf01087f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.702+0000 7fadf5639640 1 --2- 172.21.15.22:0/1522233715 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadf0108d30 0x7fadf010f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.702+0000 7fadf5639640 1 --2- 172.21.15.22:0/1522233715 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf0102aa0 0x7fadf0102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.702+0000 7fadf5639640 1 -- 172.21.15.22:0/1522233715 >> 172.21.15.22:0/1522233715 conn(0x7fadf0079750 msgr2=0x7fadf0079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:47.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.702+0000 7fadf5639640 1 -- 172.21.15.22:0/1522233715 shutdown_connections 2024-09-21T04:02:47.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.702+0000 7fadf5639640 1 -- 172.21.15.22:0/1522233715 wait complete. 2024-09-21T04:02:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.703+0000 7fadf5639640 1 Processor -- start 2024-09-21T04:02:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.703+0000 7fadf5639640 1 -- start start 2024-09-21T04:02:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadf5639640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf0102aa0 0x7fadf019a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadf5639640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadf01083e0 0x7fadf019a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadf5639640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadf0108d30 0x7fadf019fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadf5639640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fadf01128a0 con 0x7fadf0102aa0 2024-09-21T04:02:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf0102aa0 0x7fadf019a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadf5639640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fadf0112720 con 0x7fadf01083e0 2024-09-21T04:02:47.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadf5639640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fadf0112a20 con 0x7fadf0108d30 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadee7fc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadf01083e0 0x7fadf019a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf0102aa0 0x7fadf019a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51302/0 (socket says 172.21.15.22:51302) 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadeeffd640 1 -- 172.21.15.22:0/377471219 learned_addr learned my addr 172.21.15.22:0/377471219 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadef7fe640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadf0108d30 0x7fadf019fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadeeffd640 1 -- 172.21.15.22:0/377471219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadf0108d30 msgr2=0x7fadf019fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadeeffd640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadf0108d30 0x7fadf019fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadeeffd640 1 -- 172.21.15.22:0/377471219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadf01083e0 msgr2=0x7fadf019a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadeeffd640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadf01083e0 0x7fadf019a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadeeffd640 1 -- 172.21.15.22:0/377471219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadf01a0330 con 0x7fadf0102aa0 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.704+0000 7fadee7fc640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadf01083e0 0x7fadf019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.705+0000 7fadeeffd640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf0102aa0 0x7fadf019a3c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fade0009d50 tx=0x7fade000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.705+0000 7fade7fff640 1 -- 172.21.15.22:0/377471219 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0003b70 con 0x7fadf0102aa0 2024-09-21T04:02:47.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.705+0000 7fade7fff640 1 -- 172.21.15.22:0/377471219 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fade0003d10 con 0x7fadf0102aa0 2024-09-21T04:02:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.705+0000 7fade7fff640 1 -- 172.21.15.22:0/377471219 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade0010850 con 0x7fadf0102aa0 2024-09-21T04:02:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.705+0000 7fadf5639640 1 -- 172.21.15.22:0/377471219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadf01a0620 con 0x7fadf0102aa0 2024-09-21T04:02:47.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.705+0000 7fadf5639640 1 -- 172.21.15.22:0/377471219 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadf01a6d80 con 0x7fadf0102aa0 2024-09-21T04:02:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.708+0000 7fadfbbad740 1 Processor -- start 2024-09-21T04:02:47.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.708+0000 7fadfbbad740 1 -- start start 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9cb4f60 0x5613ea05af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 0x5613ea05b440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea05b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadfbbad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5613e9fd2c10 con 0x5613e9c94280 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadfbbad740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5613e9fc2040 con 0x5613e9c8c0a0 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadfbbad740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5613e9fc5e50 con 0x5613e9cb4f60 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fade7fff640 1 -- 172.21.15.22:0/377471219 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fade0003ec0 con 0x7fadf0102aa0 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadee7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea05b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 0x5613ea05b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadee7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea05b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51314/0 (socket says 172.21.15.22:51314) 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadef7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9cb4f60 0x5613ea05af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.709+0000 7fadee7fc640 1 -- 172.21.15.22:0/1845386299 learned_addr learned my addr 172.21.15.22:0/1845386299 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.710+0000 7fadee7fc640 1 -- 172.21.15.22:0/1845386299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9cb4f60 msgr2=0x5613ea05af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.710+0000 7fadee7fc640 1 --2- 172.21.15.22:0/1845386299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9cb4f60 0x5613ea05af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.710+0000 7fadee7fc640 1 -- 172.21.15.22:0/1845386299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 msgr2=0x5613ea05b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.710+0000 7fadee7fc640 1 --2- 172.21.15.22:0/1845386299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 0x5613ea05b440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.710+0000 7fadee7fc640 1 -- 172.21.15.22:0/1845386299 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613e9d20540 con 0x5613e9c94280 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.710+0000 7fadeeffd640 1 --2- 172.21.15.22:0/1845386299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 0x5613ea05b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.710+0000 7fadee7fc640 1 --2- 172.21.15.22:0/1845386299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea05b980 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fadd8000c00 tx=0x7fadd8032e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca448b3a8b128e60 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.711+0000 7fade57fa640 1 -- 172.21.15.22:0/1845386299 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8035040 con 0x5613e9c94280 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.711+0000 7fade57fa640 1 -- 172.21.15.22:0/1845386299 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadd80044c0 con 0x5613e9c94280 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.711+0000 7fade57fa640 1 -- 172.21.15.22:0/1845386299 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8003d40 con 0x5613e9c94280 2024-09-21T04:02:47.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.711+0000 7fade7fff640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faddc0b6510 0x7faddc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.711+0000 7fade7fff640 1 -- 172.21.15.22:0/377471219 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fade00e7d20 con 0x7fadf0102aa0 2024-09-21T04:02:47.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.711+0000 7fadef7fe640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faddc0b6510 0x7faddc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.712+0000 7fadfbbad740 1 -- 172.21.15.22:0/1845386299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 msgr2=0x5613ea05b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.712+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1845386299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea05b980 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fadd8000c00 tx=0x7fadd8032e30 comp rx=0 tx=0).stop 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.712+0000 7fadfbbad740 1 -- 172.21.15.22:0/1845386299 shutdown_connections 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.712+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1845386299 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea05b980 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.712+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1845386299 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 0x5613ea05b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.712+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1845386299 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9cb4f60 0x5613ea05af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.712+0000 7fadfbbad740 1 -- 172.21.15.22:0/1845386299 >> 172.21.15.22:0/1845386299 conn(0x5613e9ca9350 msgr2=0x5613ea058df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.712+0000 7fadef7fe640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faddc0b6510 0x7faddc0b8a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fade8009da0 tx=0x7fade8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.712+0000 7fadfbbad740 1 -- 172.21.15.22:0/1845386299 shutdown_connections 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.713+0000 7fadfbbad740 1 -- 172.21.15.22:0/1845386299 wait complete. 2024-09-21T04:02:47.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.713+0000 7fadfbbad740 1 -- start start 2024-09-21T04:02:47.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.713+0000 7fadfbbad740 1 Processor -- start 2024-09-21T04:02:47.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.714+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 0x5613ea066a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.714+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea066f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.714+0000 7fadee7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea066f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.714+0000 7fadee7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea066f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51330/0 (socket says 172.21.15.22:51330) 2024-09-21T04:02:47.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.714+0000 7fadee7fc640 1 -- 172.21.15.22:0/1066360910 learned_addr learned my addr 172.21.15.22:0/1066360910 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:47.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.714+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9cb4f60 0x5613ea076db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.714+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5613e9e235f0 con 0x5613e9c94280 2024-09-21T04:02:47.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.714+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5613e9f5d010 con 0x5613e9cb4f60 2024-09-21T04:02:47.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.714+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5613ea06da90 con 0x5613e9c8c0a0 2024-09-21T04:02:47.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.714+0000 7fadfbbad740 10 client.0 _ll_register_callbacks cb 0x5613e9fbc340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:47.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.715+0000 7fadef7fe640 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9cb4f60 0x5613ea076db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.715+0000 7fadeeffd640 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 0x5613ea066a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.716+0000 7fadee7fc640 1 -- 172.21.15.22:0/1066360910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 msgr2=0x5613ea066a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:47.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.716+0000 7fadee7fc640 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 0x5613ea066a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.716+0000 7fadee7fc640 1 -- 172.21.15.22:0/1066360910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9cb4f60 msgr2=0x5613ea076db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:47.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.716+0000 7fadee7fc640 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9cb4f60 0x5613ea076db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.716+0000 7fadee7fc640 1 -- 172.21.15.22:0/1066360910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613e9f8aa00 con 0x5613e9c94280 2024-09-21T04:02:47.719 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.716+0000 7fadeeffd640 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 0x5613ea066a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:47.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.717+0000 7fadee7fc640 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea066f60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009590 tx=0x7fadd80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e7affb4409ab0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:47.720 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.717+0000 7fadd67fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:47.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.717+0000 7fadd67fc640 1 -- 172.21.15.22:0/1066360910 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8035040 con 0x5613e9c94280 2024-09-21T04:02:47.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.717+0000 7fadd67fc640 1 -- 172.21.15.22:0/1066360910 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fadd8050850 con 0x5613e9c94280 2024-09-21T04:02:47.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.718+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5613e9fd4b60 con 0x5613e9c94280 2024-09-21T04:02:47.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.718+0000 7fadd67fc640 1 -- 172.21.15.22:0/1066360910 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fadd8050a50 con 0x5613e9c94280 2024-09-21T04:02:47.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.718+0000 7fadfbbad740 10 client.15585 fetch_fsmap learned FSMap version 29 2024-09-21T04:02:47.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.718+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5613ea0694a0 con 0x5613e9c94280 2024-09-21T04:02:47.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.719+0000 7fadd67fc640 1 -- 172.21.15.22:0/1066360910 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5613e9fd4b60 con 0x5613e9c94280 2024-09-21T04:02:47.722 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.719+0000 7fadd67fc640 1 -- 172.21.15.22:0/1066360910 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fadd8059470 con 0x5613e9c94280 2024-09-21T04:02:47.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.719+0000 7fadfbbad740 10 client.15585 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T04:02:47.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.719+0000 7fadfbbad740 10 client.15585 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T04:02:47.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.719+0000 7fadfbbad740 20 client.15585 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:47.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.719+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x5613e9c738e0 0x5613ea06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.719+0000 7fadfbbad740 4 client.15585 mds_command: new command op to 24617 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:47.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.719+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 --> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613e9fd0610 con 0x5613e9c738e0 2024-09-21T04:02:47.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.719+0000 7fadeeffd640 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x5613e9c738e0 0x5613ea06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.719+0000 7fadd67fc640 10 client.15585 ms_handle_connect on v2:172.21.15.60:6836/3007306472 2024-09-21T04:02:47.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.720+0000 7fadeeffd640 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x5613e9c738e0 0x5613ea06cac0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35bb46d2dd612c68 server_cookie=2231fc7276a1f553 in_seq=0 out_seq=0 2024-09-21T04:02:47.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.720+0000 7fadd67fc640 1 -- 172.21.15.22:0/1066360910 <== mds.2 v2:172.21.15.60:6836/3007306472 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5613e9fd0610 con 0x5613e9c738e0 2024-09-21T04:02:47.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.720+0000 7fadd67fc640 10 client.15585 handle_command_reply: tid=0 2024-09-21T04:02:47.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.720+0000 7fadfbbad740 1 client.15585 shutdown 2024-09-21T04:02:47.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 msgr2=0x5613ea066f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:47.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea066f60 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009590 tx=0x7fadd80095c0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 shutdown_connections 2024-09-21T04:02:47.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x5613e9c738e0 0x5613ea06cac0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadd67fc640 0 client.15585 ms_handle_reset on v2:172.21.15.60:6836/3007306472 2024-09-21T04:02:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9cb4f60 0x5613ea076db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea066f60 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 1 --2- 172.21.15.22:0/1066360910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 0x5613ea066a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 >> 172.21.15.22:0/1066360910 conn(0x5613e9ca9350 msgr2=0x5613ea05e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:47.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 shutdown_connections 2024-09-21T04:02:47.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 1 -- 172.21.15.22:0/1066360910 wait complete. 2024-09-21T04:02:47.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.721+0000 7fadfbbad740 20 client.15585 trim_cache size 0 max 16384 2024-09-21T04:02:47.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadfbbad740 1 Processor -- start 2024-09-21T04:02:47.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadfbbad740 1 -- start start 2024-09-21T04:02:47.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c738e0 0x5613ea076d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 0x5613ea077260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea058710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadfbbad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5613ea06ae00 con 0x5613e9c94280 2024-09-21T04:02:47.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadfbbad740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5613ea06b4d0 con 0x5613e9c738e0 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadfbbad740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5613ea06bba0 con 0x5613e9c8c0a0 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c738e0 0x5613ea076d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c738e0 0x5613ea076d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:40810/0 (socket says 172.21.15.22:40810) 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.744+0000 7fadeeffd640 1 -- 172.21.15.22:0/2526065546 learned_addr learned my addr 172.21.15.22:0/2526065546 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fadef7fe640 1 --2- 172.21.15.22:0/2526065546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea058710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fadee7fc640 1 --2- 172.21.15.22:0/2526065546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 0x5613ea077260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fadeeffd640 1 -- 172.21.15.22:0/2526065546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 msgr2=0x5613ea077260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fadeeffd640 1 --2- 172.21.15.22:0/2526065546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 0x5613ea077260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fadeeffd640 1 -- 172.21.15.22:0/2526065546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 msgr2=0x5613ea058710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fadeeffd640 1 --2- 172.21.15.22:0/2526065546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea058710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fadeeffd640 1 -- 172.21.15.22:0/2526065546 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613ea067ae0 con 0x5613e9c738e0 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fadef7fe640 1 --2- 172.21.15.22:0/2526065546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea058710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fadeeffd640 1 --2- 172.21.15.22:0/2526065546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c738e0 0x5613ea076d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fade00ad7f0 tx=0x7fade00eb800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d6bb32a1dd1f036 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:47.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fade4ff9640 1 -- 172.21.15.22:0/2526065546 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade00ad440 con 0x5613e9c738e0 2024-09-21T04:02:47.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fade4ff9640 1 -- 172.21.15.22:0/2526065546 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5613e9fd0610 con 0x5613e9c738e0 2024-09-21T04:02:47.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.745+0000 7fade4ff9640 1 -- 172.21.15.22:0/2526065546 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fade00a9260 con 0x5613e9c738e0 2024-09-21T04:02:47.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.746+0000 7fadfbbad740 1 -- 172.21.15.22:0/2526065546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c738e0 msgr2=0x5613ea076d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:47.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.746+0000 7fadfbbad740 1 --2- 172.21.15.22:0/2526065546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c738e0 0x5613ea076d20 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fade00ad7f0 tx=0x7fade00eb800 comp rx=0 tx=0).stop 2024-09-21T04:02:47.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.746+0000 7fadfbbad740 1 -- 172.21.15.22:0/2526065546 shutdown_connections 2024-09-21T04:02:47.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.746+0000 7fadfbbad740 1 --2- 172.21.15.22:0/2526065546 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c8c0a0 0x5613ea077260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.746+0000 7fadfbbad740 1 --2- 172.21.15.22:0/2526065546 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c94280 0x5613ea058710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.746+0000 7fadfbbad740 1 --2- 172.21.15.22:0/2526065546 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c738e0 0x5613ea076d20 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.746+0000 7fadfbbad740 1 -- 172.21.15.22:0/2526065546 >> 172.21.15.22:0/2526065546 conn(0x5613e9ca9350 msgr2=0x5613ea0619d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.747+0000 7fadfbbad740 1 -- 172.21.15.22:0/2526065546 shutdown_connections 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.747+0000 7fadfbbad740 1 -- 172.21.15.22:0/2526065546 wait complete. 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.747+0000 7fadfbbad740 1 -- start start 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.747+0000 7fadfbbad740 1 Processor -- start 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c738e0 0x5613ea07b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 0x5613ea07b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadfbbad740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c94280 0x5613ea0e3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadfbbad740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5613ea06c940 con 0x5613e9c738e0 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadfbbad740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5613ea06c270 con 0x5613e9c8c0a0 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadfbbad740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5613ea06d010 con 0x5613e9c94280 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c738e0 0x5613ea07b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadfbbad740 10 client.0 _ll_register_callbacks cb 0x7fadd8040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadeeffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c738e0 0x5613ea07b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51348/0 (socket says 172.21.15.22:51348) 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadeeffd640 1 -- 172.21.15.22:0/461814877 learned_addr learned my addr 172.21.15.22:0/461814877 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadee7fc640 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 0x5613ea07b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadef7fe640 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c94280 0x5613ea0e3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadee7fc640 1 -- 172.21.15.22:0/461814877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c94280 msgr2=0x5613ea0e3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadee7fc640 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c94280 0x5613ea0e3080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadee7fc640 1 -- 172.21.15.22:0/461814877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c738e0 msgr2=0x5613ea07b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadee7fc640 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c738e0 0x5613ea07b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.748+0000 7fadee7fc640 1 -- 172.21.15.22:0/461814877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613ea07be50 con 0x5613e9c8c0a0 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.749+0000 7fadee7fc640 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 0x5613ea07b640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fadd802a930 tx=0x7fadd8059c70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de6aed1a82408dcb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.749+0000 7fadd67fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.749+0000 7fadd67fc640 1 -- 172.21.15.22:0/461814877 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8035070 con 0x5613e9c8c0a0 2024-09-21T04:02:47.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.749+0000 7fadd67fc640 1 -- 172.21.15.22:0/461814877 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fadd8050850 con 0x5613e9c8c0a0 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.749+0000 7fadfbbad740 1 -- 172.21.15.22:0/461814877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5613e9fd0610 con 0x5613e9c8c0a0 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.749+0000 7fadd67fc640 1 -- 172.21.15.22:0/461814877 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fadd8031960 con 0x5613e9c8c0a0 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.749+0000 7fadfbbad740 10 client.25253 fetch_fsmap learned FSMap version 29 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.749+0000 7fadfbbad740 1 -- 172.21.15.22:0/461814877 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5613ea0e44f0 con 0x5613e9c8c0a0 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.750+0000 7fadd67fc640 1 -- 172.21.15.22:0/461814877 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5613e9fd0610 con 0x5613e9c8c0a0 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.750+0000 7fadd67fc640 1 -- 172.21.15.22:0/461814877 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fadd803c440 con 0x5613e9c8c0a0 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.750+0000 7fadfbbad740 10 client.25253 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.750+0000 7fadfbbad740 10 client.25253 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.750+0000 7fadfbbad740 20 client.25253 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.750+0000 7fadfbbad740 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x5613e9cb4f60 0x5613ea0e7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:47.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.750+0000 7fadfbbad740 4 client.25253 mds_command: new command op to 24617 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:02:47.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.750+0000 7fadfbbad740 1 -- 172.21.15.22:0/461814877 --> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] -- command(tid 0: {"prefix": "status"}) -- 0x5613e9fcda40 con 0x5613e9cb4f60 2024-09-21T04:02:47.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.750+0000 7fadeeffd640 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x5613e9cb4f60 0x5613ea0e7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:47.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadd67fc640 10 client.25253 ms_handle_connect on v2:172.21.15.60:6836/3007306472 2024-09-21T04:02:47.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadeeffd640 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x5613e9cb4f60 0x5613ea0e7ce0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b3625cfdb0075ef8 server_cookie=207d07515ee648e in_seq=0 out_seq=0 2024-09-21T04:02:47.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadd67fc640 1 -- 172.21.15.22:0/461814877 <== mds.2 v2:172.21.15.60:6836/3007306472 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5613e9fcda40 con 0x5613e9cb4f60 2024-09-21T04:02:47.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadd67fc640 10 client.25253 handle_command_reply: tid=0 2024-09-21T04:02:47.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadfbbad740 1 client.25253 shutdown 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadfbbad740 1 -- 172.21.15.22:0/461814877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 msgr2=0x5613ea07b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadfbbad740 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 0x5613ea07b640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fadd802a930 tx=0x7fadd8059c70 comp rx=0 tx=0).stop 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadfbbad740 1 -- 172.21.15.22:0/461814877 shutdown_connections 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadfbbad740 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.60:6836/3007306472,v1:172.21.15.60:6837/3007306472] conn(0x5613e9cb4f60 0x5613ea0e7ce0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadfbbad740 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5613e9c94280 0x5613ea0e3080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadfbbad740 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5613e9c8c0a0 0x5613ea07b640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadfbbad740 1 --2- 172.21.15.22:0/461814877 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5613e9c738e0 0x5613ea07b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadfbbad740 1 -- 172.21.15.22:0/461814877 >> 172.21.15.22:0/461814877 conn(0x5613e9ca9350 msgr2=0x5613ea066a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.751+0000 7fadd67fc640 0 client.25253 ms_handle_reset on v2:172.21.15.60:6836/3007306472 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.752+0000 7fadfbbad740 1 -- 172.21.15.22:0/461814877 shutdown_connections 2024-09-21T04:02:47.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.752+0000 7fadfbbad740 1 -- 172.21.15.22:0/461814877 wait complete. 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24617, 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 125.559356503, 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 29, 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 85, 2024-09-21T04:02:47.760 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 185.85838383699999 2024-09-21T04:02:47.761 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:47.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.752+0000 7fadfbbad740 20 client.25253 trim_cache size 0 max 16384 2024-09-21T04:02:47.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.753+0000 7fadf5639640 1 -- 172.21.15.22:0/377471219 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faddc0b6510 msgr2=0x7faddc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:47.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.753+0000 7fadf5639640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faddc0b6510 0x7faddc0b8a20 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fade8009da0 tx=0x7fade8005f90 comp rx=0 tx=0).stop 2024-09-21T04:02:47.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.753+0000 7fadf5639640 1 -- 172.21.15.22:0/377471219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf0102aa0 msgr2=0x7fadf019a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:47.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.753+0000 7fadf5639640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf0102aa0 0x7fadf019a3c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fade0009d50 tx=0x7fade000c6a0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.753+0000 7fadf5639640 1 -- 172.21.15.22:0/377471219 shutdown_connections 2024-09-21T04:02:47.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.753+0000 7fadf5639640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faddc0b6510 0x7faddc0b8a20 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.753+0000 7fadf5639640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fadf0108d30 0x7fadf019fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.753+0000 7fadf5639640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fadf01083e0 0x7fadf019a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.753+0000 7fadf5639640 1 --2- 172.21.15.22:0/377471219 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fadf0102aa0 0x7fadf019a3c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:47.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.753+0000 7fadf5639640 1 -- 172.21.15.22:0/377471219 >> 172.21.15.22:0/377471219 conn(0x7fadf0079750 msgr2=0x7fadf0101b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:47.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.754+0000 7fadf5639640 1 -- 172.21.15.22:0/377471219 shutdown_connections 2024-09-21T04:02:47.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:47.754+0000 7fadf5639640 1 -- 172.21.15.22:0/377471219 wait complete. 2024-09-21T04:02:48.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:48 smithi022 ceph-mon[31015]: pgmap v384: 129 pgs: 129 active+clean; 10 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 832 KiB/s wr, 16 op/s 2024-09-21T04:02:48.661 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.i status 2024-09-21T04:02:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:48 smithi073 ceph-mon[34443]: pgmap v384: 129 pgs: 129 active+clean; 10 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 832 KiB/s wr, 16 op/s 2024-09-21T04:02:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:48 smithi060 ceph-mon[33722]: pgmap v384: 129 pgs: 129 active+clean; 10 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 832 KiB/s wr, 16 op/s 2024-09-21T04:02:48.977 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:49.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.508+0000 7f7a18e95640 1 -- 172.21.15.22:0/1138409853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a14105380 msgr2=0x7f7a1410d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.508+0000 7f7a18e95640 1 --2- 172.21.15.22:0/1138409853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a14105380 0x7f7a1410d8d0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f79fc009900 tx=0x7f79fc02a410 comp rx=0 tx=0).stop 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.508+0000 7f7a18e95640 1 -- 172.21.15.22:0/1138409853 shutdown_connections 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.508+0000 7f7a18e95640 1 --2- 172.21.15.22:0/1138409853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1410de60 0x7f7a14110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.508+0000 7f7a18e95640 1 --2- 172.21.15.22:0/1138409853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a14105380 0x7f7a1410d8d0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.508+0000 7f7a18e95640 1 --2- 172.21.15.22:0/1138409853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14104a30 0x7f7a14104e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.508+0000 7f7a18e95640 1 -- 172.21.15.22:0/1138409853 >> 172.21.15.22:0/1138409853 conn(0x7f7a140797b0 msgr2=0x7f7a14079bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.508+0000 7f7a18e95640 1 -- 172.21.15.22:0/1138409853 shutdown_connections 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.508+0000 7f7a18e95640 1 -- 172.21.15.22:0/1138409853 wait complete. 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a18e95640 1 Processor -- start 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a18e95640 1 -- start start 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a18e95640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14104a30 0x7f7a1419a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a18e95640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a14105380 0x7f7a1419a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a18e95640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1410de60 0x7f7a1419fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a18e95640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14113910 con 0x7f7a14105380 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a18e95640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14113790 con 0x7f7a1410de60 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a18e95640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7a14113a90 con 0x7f7a14104a30 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a0bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a14105380 0x7f7a1419a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a0bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a14105380 0x7f7a1419a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51370/0 (socket says 172.21.15.22:51370) 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a0bfff640 1 -- 172.21.15.22:0/3219613686 learned_addr learned my addr 172.21.15.22:0/3219613686 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a1259c640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14104a30 0x7f7a1419a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.509+0000 7f7a12d9d640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1410de60 0x7f7a1419fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a0bfff640 1 -- 172.21.15.22:0/3219613686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14104a30 msgr2=0x7f7a1419a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14104a30 0x7f7a1419a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a0bfff640 1 -- 172.21.15.22:0/3219613686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1410de60 msgr2=0x7f7a1419fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1410de60 0x7f7a1419fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a0bfff640 1 -- 172.21.15.22:0/3219613686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a141a0310 con 0x7f7a14105380 2024-09-21T04:02:49.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a12d9d640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1410de60 0x7f7a1419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a1259c640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14104a30 0x7f7a1419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a14105380 0x7f7a1419a940 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f79fc004770 tx=0x7f79fc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a0b7fe640 1 -- 172.21.15.22:0/3219613686 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc03f030 con 0x7f7a14105380 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a18e95640 1 -- 172.21.15.22:0/3219613686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a141a05a0 con 0x7f7a14105380 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a0b7fe640 1 -- 172.21.15.22:0/3219613686 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79fc004440 con 0x7f7a14105380 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a0b7fe640 1 -- 172.21.15.22:0/3219613686 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc035070 con 0x7f7a14105380 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.510+0000 7f7a18e95640 1 -- 172.21.15.22:0/3219613686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a141a6d60 con 0x7f7a14105380 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.513+0000 7f7a1f409740 1 Processor -- start 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a1f409740 1 -- start start 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 0x5578d54d1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d51030a0 0x5578d54d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 0x5578d54d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a1f409740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5578d5449c10 con 0x5578d510b280 2024-09-21T04:02:49.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a1f409740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5578d5439040 con 0x5578d512bf60 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a1f409740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5578d543ce50 con 0x5578d51030a0 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a0b7fe640 1 -- 172.21.15.22:0/3219613686 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f79fc042030 con 0x7f7a14105380 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a12d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 0x5578d54d1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a0bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 0x5578d54d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a12d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 0x5578d54d1f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:40830/0 (socket says 172.21.15.22:40830) 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a12d9d640 1 -- 172.21.15.22:0/3881252622 learned_addr learned my addr 172.21.15.22:0/3881252622 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.514+0000 7f7a1259c640 1 --2- 172.21.15.22:0/3881252622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d51030a0 0x5578d54d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a12d9d640 1 -- 172.21.15.22:0/3881252622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d51030a0 msgr2=0x5578d54d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a12d9d640 1 --2- 172.21.15.22:0/3881252622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d51030a0 0x5578d54d2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a12d9d640 1 -- 172.21.15.22:0/3881252622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 msgr2=0x5578d54d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a12d9d640 1 --2- 172.21.15.22:0/3881252622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 0x5578d54d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a12d9d640 1 -- 172.21.15.22:0/3881252622 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578d5197540 con 0x5578d512bf60 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a12d9d640 1 --2- 172.21.15.22:0/3881252622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 0x5578d54d1f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c010750 tx=0x7f7a0c010c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1ce1fbdbfd5d870 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:49.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a08ff9640 1 -- 172.21.15.22:0/3881252622 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c00ead0 con 0x5578d512bf60 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a0b7fe640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7a000b6510 0x7f7a000b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a08ff9640 1 -- 172.21.15.22:0/3881252622 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a0c010e60 con 0x5578d512bf60 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a08ff9640 1 -- 172.21.15.22:0/3881252622 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0c0113e0 con 0x5578d512bf60 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a1259c640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7a000b6510 0x7f7a000b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.515+0000 7f7a0b7fe640 1 -- 172.21.15.22:0/3219613686 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f79fc107980 con 0x7f7a14105380 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.516+0000 7f7a1f409740 1 -- 172.21.15.22:0/3881252622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 msgr2=0x5578d54d1f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.516+0000 7f7a1259c640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7a000b6510 0x7f7a000b8a20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5578d54d0b80 tx=0x7f7a04005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.516+0000 7f7a1f409740 1 --2- 172.21.15.22:0/3881252622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 0x5578d54d1f00 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7a0c010750 tx=0x7f7a0c010c10 comp rx=0 tx=0).stop 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.516+0000 7f7a1f409740 1 -- 172.21.15.22:0/3881252622 shutdown_connections 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.516+0000 7f7a1f409740 1 --2- 172.21.15.22:0/3881252622 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d51030a0 0x5578d54d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.516+0000 7f7a1f409740 1 --2- 172.21.15.22:0/3881252622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 0x5578d54d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.516+0000 7f7a1f409740 1 --2- 172.21.15.22:0/3881252622 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 0x5578d54d1f00 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.516+0000 7f7a1f409740 1 -- 172.21.15.22:0/3881252622 >> 172.21.15.22:0/3881252622 conn(0x5578d5120350 msgr2=0x5578d54cfdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.516+0000 7f7a1f409740 1 -- 172.21.15.22:0/3881252622 shutdown_connections 2024-09-21T04:02:49.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.516+0000 7f7a1f409740 1 -- 172.21.15.22:0/3881252622 wait complete. 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a1f409740 1 -- start start 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a1f409740 1 Processor -- start 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d51030a0 0x5578d54dd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 0x5578d54ddd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d512bf60 0x5578d54e9a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a1f409740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5578d529a5f0 con 0x5578d510b280 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a1f409740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5578d53d4010 con 0x5578d51030a0 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a1f409740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5578d54e06e0 con 0x5578d512bf60 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a1f409740 10 client.0 _ll_register_callbacks cb 0x5578d5433340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a0bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 0x5578d54ddd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a0bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 0x5578d54ddd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51394/0 (socket says 172.21.15.22:51394) 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a0bfff640 1 -- 172.21.15.22:0/2027667431 learned_addr learned my addr 172.21.15.22:0/2027667431 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a12d9d640 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d512bf60 0x5578d54e9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.517+0000 7f7a1259c640 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d51030a0 0x5578d54dd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f7a0bfff640 1 -- 172.21.15.22:0/2027667431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d512bf60 msgr2=0x5578d54e9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d512bf60 0x5578d54e9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f7a0bfff640 1 -- 172.21.15.22:0/2027667431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d51030a0 msgr2=0x5578d54dd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d51030a0 0x5578d54dd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f7a0bfff640 1 -- 172.21.15.22:0/2027667431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578d5401a00 con 0x5578d510b280 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 0x5578d54ddd10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f79fc006010 tx=0x7f79fc0c9cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14e54f6562175d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f79f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2027667431 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc049070 con 0x5578d510b280 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2027667431 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f79fc0d6ee0 con 0x5578d510b280 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f7a1f409740 1 -- 172.21.15.22:0/2027667431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a0c010e60 con 0x5578d510b280 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2027667431 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f79fc0c96a0 con 0x5578d510b280 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f7a1f409740 10 client.15600 fetch_fsmap learned FSMap version 29 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f7a1f409740 1 -- 172.21.15.22:0/2027667431 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5578d54ec5b0 con 0x5578d510b280 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2027667431 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a0c010e60 con 0x5578d510b280 2024-09-21T04:02:49.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.518+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2027667431 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f79fc0c9150 con 0x5578d510b280 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.519+0000 7f7a1f409740 10 client.15600 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.519+0000 7f7a1f409740 10 client.15600 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.519+0000 7f7a1f409740 20 client.15600 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.519+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x5578d50ea8e0 0x5578d54f0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.519+0000 7f7a1f409740 4 client.15600 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.519+0000 7f7a1f409740 1 -- 172.21.15.22:0/2027667431 --> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578d544bb60 con 0x5578d50ea8e0 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.519+0000 7f7a1259c640 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x5578d50ea8e0 0x5578d54f0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.519+0000 7f79f9ffb640 10 client.15600 ms_handle_connect on v2:172.21.15.73:6838/1883983314 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.519+0000 7f7a1259c640 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x5578d50ea8e0 0x5578d54f0060 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bb3ad3693932e63d server_cookie=41fa56adacb920ed in_seq=0 out_seq=0 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2027667431 <== mds.1 v2:172.21.15.73:6838/1883983314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5578d544bb60 con 0x5578d50ea8e0 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f79f9ffb640 10 client.15600 handle_command_reply: tid=0 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 client.15600 shutdown 2024-09-21T04:02:49.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 -- 172.21.15.22:0/2027667431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 msgr2=0x5578d54ddd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 0x5578d54ddd10 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f79fc006010 tx=0x7f79fc0c9cf0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 -- 172.21.15.22:0/2027667431 shutdown_connections 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x5578d50ea8e0 0x5578d54f0060 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d512bf60 0x5578d54e9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d510b280 0x5578d54ddd10 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f79f9ffb640 0 client.15600 ms_handle_reset on v2:172.21.15.73:6838/1883983314 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2027667431 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d51030a0 0x5578d54dd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 -- 172.21.15.22:0/2027667431 >> 172.21.15.22:0/2027667431 conn(0x5578d5120350 msgr2=0x5578d54d5090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 -- 172.21.15.22:0/2027667431 shutdown_connections 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 1 -- 172.21.15.22:0/2027667431 wait complete. 2024-09-21T04:02:49.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.520+0000 7f7a1f409740 20 client.15600 trim_cache size 0 max 16384 2024-09-21T04:02:49.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a1f409740 1 Processor -- start 2024-09-21T04:02:49.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a1f409740 1 -- start start 2024-09-21T04:02:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d51030a0 0x5578d54d8020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 0x5578d54e9970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d512bf60 0x5578d54e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a1f409740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5578d54ee3a0 con 0x5578d512bf60 2024-09-21T04:02:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a1f409740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5578d54eea70 con 0x5578d51030a0 2024-09-21T04:02:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a1f409740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5578d54ef140 con 0x5578d510b280 2024-09-21T04:02:49.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a12d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d512bf60 0x5578d54e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a0bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 0x5578d54e9970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a12d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d512bf60 0x5578d54e9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51404/0 (socket says 172.21.15.22:51404) 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a0bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 0x5578d54e9970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:47004/0 (socket says 172.21.15.22:47004) 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a12d9d640 1 -- 172.21.15.22:0/3463873293 learned_addr learned my addr 172.21.15.22:0/3463873293 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.539+0000 7f7a1259c640 1 --2- 172.21.15.22:0/3463873293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d51030a0 0x5578d54d8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.540+0000 7f7a0bfff640 1 -- 172.21.15.22:0/3463873293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d51030a0 msgr2=0x5578d54d8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.540+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/3463873293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d51030a0 0x5578d54d8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.540+0000 7f7a0bfff640 1 -- 172.21.15.22:0/3463873293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d512bf60 msgr2=0x5578d54e9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.540+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/3463873293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d512bf60 0x5578d54e9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.540+0000 7f7a0bfff640 1 -- 172.21.15.22:0/3463873293 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578d54d4d60 con 0x5578d510b280 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.540+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/3463873293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 0x5578d54e9970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0caa70 tx=0x7f79fc107d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9027841ae4086037 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.540+0000 7f79fbfff640 1 -- 172.21.15.22:0/3463873293 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc049070 con 0x5578d510b280 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.540+0000 7f79fbfff640 1 -- 172.21.15.22:0/3463873293 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79fc0cd310 con 0x5578d510b280 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.540+0000 7f79fbfff640 1 -- 172.21.15.22:0/3463873293 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0ccf70 con 0x5578d510b280 2024-09-21T04:02:49.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 -- 172.21.15.22:0/3463873293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 msgr2=0x5578d54e9970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 --2- 172.21.15.22:0/3463873293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 0x5578d54e9970 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f79fc0caa70 tx=0x7f79fc107d10 comp rx=0 tx=0).stop 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 -- 172.21.15.22:0/3463873293 shutdown_connections 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 --2- 172.21.15.22:0/3463873293 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 0x5578d54e9970 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 --2- 172.21.15.22:0/3463873293 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d512bf60 0x5578d54e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 --2- 172.21.15.22:0/3463873293 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d51030a0 0x5578d54d8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 -- 172.21.15.22:0/3463873293 >> 172.21.15.22:0/3463873293 conn(0x5578d5120350 msgr2=0x5578d54ed900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 -- 172.21.15.22:0/3463873293 shutdown_connections 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 -- 172.21.15.22:0/3463873293 wait complete. 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 -- start start 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.541+0000 7f7a1f409740 1 Processor -- start 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d51030a0 0x5578d54f1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 0x5578d54f1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1f409740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 0x5578d54f1c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1f409740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5578d54efee0 con 0x5578d51030a0 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1f409740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5578d54ef810 con 0x5578d512bf60 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1f409740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5578d54f05b0 con 0x5578d510b280 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1f409740 10 client.0 _ll_register_callbacks cb 0x7f79fc005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d51030a0 0x5578d54f1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d51030a0 0x5578d54f1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:51420/0 (socket says 172.21.15.22:51420) 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1259c640 1 -- 172.21.15.22:0/2718619599 learned_addr learned my addr 172.21.15.22:0/2718619599 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a12d9d640 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 0x5578d54f1c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 0x5578d54f1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1259c640 1 -- 172.21.15.22:0/2718619599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 msgr2=0x5578d54f1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1259c640 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 0x5578d54f1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1259c640 1 -- 172.21.15.22:0/2718619599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 msgr2=0x5578d54f1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:49.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1259c640 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 0x5578d54f1c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1259c640 1 -- 172.21.15.22:0/2718619599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578d555e760 con 0x5578d51030a0 2024-09-21T04:02:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f7a1259c640 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d51030a0 0x5578d54f1210 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x5578d54dffa0 tx=0x7f7a040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7590518f5575c2d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.542+0000 7f79f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2718619599 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a0401f430 con 0x5578d51030a0 2024-09-21T04:02:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2718619599 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7a0401f5d0 con 0x5578d51030a0 2024-09-21T04:02:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f7a1f409740 1 -- 172.21.15.22:0/2718619599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79fc0cd310 con 0x5578d51030a0 2024-09-21T04:02:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2718619599 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7a0401f7d0 con 0x5578d51030a0 2024-09-21T04:02:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f7a1f409740 10 client.15606 fetch_fsmap learned FSMap version 29 2024-09-21T04:02:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f7a1f409740 1 -- 172.21.15.22:0/2718619599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5578d555fa70 con 0x5578d51030a0 2024-09-21T04:02:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2718619599 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f79fc0cd310 con 0x5578d51030a0 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2718619599 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7f7a0402b930 con 0x5578d51030a0 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f7a1f409740 10 client.15606 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f7a1f409740 10 client.15606 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f7a1f409740 20 client.15606 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x5578d50bfc90 0x5578d55633b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f7a1f409740 4 client.15606 mds_command: new command op to 24634 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.543+0000 7f7a1f409740 1 -- 172.21.15.22:0/2718619599 --> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] -- command(tid 0: {"prefix": "status"}) -- 0x5578d5447610 con 0x5578d50bfc90 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x5578d50bfc90 0x5578d55633b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a0bfff640 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x5578d50bfc90 0x5578d55633b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4cfd7a17f6c0e882 server_cookie=18c052c711f41d90 in_seq=0 out_seq=0 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f79f9ffb640 10 client.15606 ms_handle_connect on v2:172.21.15.73:6838/1883983314 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f79f9ffb640 1 -- 172.21.15.22:0/2718619599 <== mds.1 v2:172.21.15.73:6838/1883983314 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5578d5447610 con 0x5578d50bfc90 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f79f9ffb640 10 client.15606 handle_command_reply: tid=0 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a1f409740 1 client.15606 shutdown 2024-09-21T04:02:49.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a1f409740 1 -- 172.21.15.22:0/2718619599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d51030a0 msgr2=0x5578d54f1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d51030a0 0x5578d54f1210 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x5578d54dffa0 tx=0x7f7a040046c0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a1f409740 1 -- 172.21.15.22:0/2718619599 shutdown_connections 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.73:6838/1883983314,v1:172.21.15.73:6839/1883983314] conn(0x5578d50bfc90 0x5578d55633b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5578d510b280 0x5578d54f1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f79f9ffb640 0 client.15606 ms_handle_reset on v2:172.21.15.73:6838/1883983314 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5578d512bf60 0x5578d54f1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a1f409740 1 --2- 172.21.15.22:0/2718619599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5578d51030a0 0x5578d54f1210 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.544+0000 7f7a1f409740 1 -- 172.21.15.22:0/2718619599 >> 172.21.15.22:0/2718619599 conn(0x5578d5120350 msgr2=0x5578d54d8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a1f409740 1 -- 172.21.15.22:0/2718619599 shutdown_connections 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a1f409740 1 -- 172.21.15.22:0/2718619599 wait complete. 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a1f409740 20 client.15606 trim_cache size 0 max 16384 2024-09-21T04:02:49.552 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24634, 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 128.36024707199999, 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 29, 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 85, 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 185.076463993 2024-09-21T04:02:49.553 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 -- 172.21.15.22:0/3219613686 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7a000b6510 msgr2=0x7f7a000b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7a000b6510 0x7f7a000b8a20 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x5578d54d0b80 tx=0x7f7a04005f90 comp rx=0 tx=0).stop 2024-09-21T04:02:49.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 -- 172.21.15.22:0/3219613686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a14105380 msgr2=0x7f7a1419a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a14105380 0x7f7a1419a940 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f79fc004770 tx=0x7f79fc004040 comp rx=0 tx=0).stop 2024-09-21T04:02:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 -- 172.21.15.22:0/3219613686 shutdown_connections 2024-09-21T04:02:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7a000b6510 0x7f7a000b8a20 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7a1410de60 0x7f7a1419fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7a14105380 0x7f7a1419a940 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 --2- 172.21.15.22:0/3219613686 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7a14104a30 0x7f7a1419a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:49.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 -- 172.21.15.22:0/3219613686 >> 172.21.15.22:0/3219613686 conn(0x7f7a140797b0 msgr2=0x7f7a14100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:49.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 -- 172.21.15.22:0/3219613686 shutdown_connections 2024-09-21T04:02:49.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:49.545+0000 7f7a18e95640 1 -- 172.21.15.22:0/3219613686 wait complete. 2024-09-21T04:02:50.338 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph tell mds.b status 2024-09-21T04:02:50.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:50 smithi022 ceph-mon[31015]: pgmap v385: 129 pgs: 129 active+clean; 17 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2024-09-21T04:02:50.599 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:02:50.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:50 smithi073 ceph-mon[34443]: pgmap v385: 129 pgs: 129 active+clean; 17 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2024-09-21T04:02:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:50 smithi060 ceph-mon[33722]: pgmap v385: 129 pgs: 129 active+clean; 17 MiB data, 389 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1.4 MiB/s wr, 27 op/s 2024-09-21T04:02:51.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.098+0000 7fbf00c2d640 1 -- 172.21.15.22:0/2719031804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbefc101fc0 msgr2=0x7fbefc1023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:51.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.098+0000 7fbf00c2d640 1 --2- 172.21.15.22:0/2719031804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbefc101fc0 0x7fbefc1023d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fbeec009900 tx=0x7fbeec02a410 comp rx=0 tx=0).stop 2024-09-21T04:02:51.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.098+0000 7fbf00c2d640 1 -- 172.21.15.22:0/2719031804 shutdown_connections 2024-09-21T04:02:51.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.098+0000 7fbf00c2d640 1 --2- 172.21.15.22:0/2719031804 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbefc109e50 0x7fbefc110680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.098+0000 7fbf00c2d640 1 --2- 172.21.15.22:0/2719031804 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc109500 0x7fbefc109910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.098+0000 7fbf00c2d640 1 --2- 172.21.15.22:0/2719031804 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbefc101fc0 0x7fbefc1023d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.098+0000 7fbf00c2d640 1 -- 172.21.15.22:0/2719031804 >> 172.21.15.22:0/2719031804 conn(0x7fbefc079f90 msgr2=0x7fbefc07a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:51.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.098+0000 7fbf00c2d640 1 -- 172.21.15.22:0/2719031804 shutdown_connections 2024-09-21T04:02:51.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.098+0000 7fbf00c2d640 1 -- 172.21.15.22:0/2719031804 wait complete. 2024-09-21T04:02:51.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.099+0000 7fbf00c2d640 1 Processor -- start 2024-09-21T04:02:51.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.099+0000 7fbf00c2d640 1 -- start start 2024-09-21T04:02:51.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.099+0000 7fbf00c2d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbefc101fc0 0x7fbefc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.099+0000 7fbf00c2d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbefc109500 0x7fbefc19aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.099+0000 7fbf00c2d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc109e50 0x7fbefc19fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.099+0000 7fbf00c2d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc1139c0 con 0x7fbefc109500 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.099+0000 7fbf00c2d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc113840 con 0x7fbefc109e50 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.099+0000 7fbf00c2d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fbefc113b40 con 0x7fbefc101fc0 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbef9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbefc109500 0x7fbefc19aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbefa59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbefc101fc0 0x7fbefc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbef9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbefc109500 0x7fbefc19aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36424/0 (socket says 172.21.15.22:36424) 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbef9d9b640 1 -- 172.21.15.22:0/542666055 learned_addr learned my addr 172.21.15.22:0/542666055 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbefad9d640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc109e50 0x7fbefc19fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbef9d9b640 1 -- 172.21.15.22:0/542666055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbefc101fc0 msgr2=0x7fbefc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbefc101fc0 0x7fbefc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbef9d9b640 1 -- 172.21.15.22:0/542666055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc109e50 msgr2=0x7fbefc19fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc109e50 0x7fbefc19fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbef9d9b640 1 -- 172.21.15.22:0/542666055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbefc1a0420 con 0x7fbefc109500 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbefa59c640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbefc101fc0 0x7fbefc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbefc109500 0x7fbefc19aa50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbef000d740 tx=0x7fbef000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:51.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbeeb7fe640 1 -- 172.21.15.22:0/542666055 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0017070 con 0x7fbefc109500 2024-09-21T04:02:51.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbeeb7fe640 1 -- 172.21.15.22:0/542666055 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbef000de50 con 0x7fbefc109500 2024-09-21T04:02:51.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbf00c2d640 1 -- 172.21.15.22:0/542666055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbefc1a0710 con 0x7fbefc109500 2024-09-21T04:02:51.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.100+0000 7fbeeb7fe640 1 -- 172.21.15.22:0/542666055 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef000f620 con 0x7fbefc109500 2024-09-21T04:02:51.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.101+0000 7fbf00c2d640 1 -- 172.21.15.22:0/542666055 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbefc1a6e70 con 0x7fbefc109500 2024-09-21T04:02:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.103+0000 7fbf071a1740 1 Processor -- start 2024-09-21T04:02:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbf071a1740 1 -- start start 2024-09-21T04:02:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbeeb7fe640 1 -- 172.21.15.22:0/542666055 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fbef001a070 con 0x7fbefc109500 2024-09-21T04:02:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 0x55d569a8bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696bd0a0 0x55d569a8c440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696c5280 0x55d569a8c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbf071a1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d569a03c10 con 0x55d5696bd0a0 2024-09-21T04:02:51.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbf071a1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d5699f3040 con 0x55d5696e5f60 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbf071a1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d5699f6e50 con 0x55d5696c5280 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbefa59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696bd0a0 0x55d569a8c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbefa59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696bd0a0 0x55d569a8c440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36440/0 (socket says 172.21.15.22:36440) 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbefa59c640 1 -- 172.21.15.22:0/4256445972 learned_addr learned my addr 172.21.15.22:0/4256445972 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbefad9d640 1 --2- 172.21.15.22:0/4256445972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 0x55d569a8bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.104+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/4256445972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696c5280 0x55d569a8c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbefa59c640 1 -- 172.21.15.22:0/4256445972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696c5280 msgr2=0x55d569a8c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbefa59c640 1 --2- 172.21.15.22:0/4256445972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696c5280 0x55d569a8c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbefa59c640 1 -- 172.21.15.22:0/4256445972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 msgr2=0x55d569a8bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbefa59c640 1 --2- 172.21.15.22:0/4256445972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 0x55d569a8bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbefa59c640 1 -- 172.21.15.22:0/4256445972 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d569751540 con 0x55d5696bd0a0 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbeeb7fe640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbee40b6510 0x7fbee40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbefa59c640 1 --2- 172.21.15.22:0/4256445972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696bd0a0 0x55d569a8c440 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbeec02a930 tx=0x7fbeec032f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712d570beaa809ce server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbefad9d640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbee40b6510 0x7fbee40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbee8ff9640 1 -- 172.21.15.22:0/4256445972 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec035070 con 0x55d5696bd0a0 2024-09-21T04:02:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbeeb7fe640 1 -- 172.21.15.22:0/542666055 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fbef00e7040 con 0x7fbefc109500 2024-09-21T04:02:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbee8ff9640 1 -- 172.21.15.22:0/4256445972 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbeec0044c0 con 0x55d5696bd0a0 2024-09-21T04:02:51.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.105+0000 7fbee8ff9640 1 -- 172.21.15.22:0/4256445972 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbeec003de0 con 0x55d5696bd0a0 2024-09-21T04:02:51.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.106+0000 7fbf071a1740 1 -- 172.21.15.22:0/4256445972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696bd0a0 msgr2=0x55d569a8c440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:51.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.106+0000 7fbefad9d640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbee40b6510 0x7fbee40b8a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbef4005fd0 tx=0x7fbef4009600 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.106+0000 7fbf071a1740 1 --2- 172.21.15.22:0/4256445972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696bd0a0 0x55d569a8c440 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbeec02a930 tx=0x7fbeec032f70 comp rx=0 tx=0).stop 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.106+0000 7fbf071a1740 1 -- 172.21.15.22:0/4256445972 shutdown_connections 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.106+0000 7fbf071a1740 1 --2- 172.21.15.22:0/4256445972 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696c5280 0x55d569a8c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.106+0000 7fbf071a1740 1 --2- 172.21.15.22:0/4256445972 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696bd0a0 0x55d569a8c440 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.106+0000 7fbf071a1740 1 --2- 172.21.15.22:0/4256445972 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 0x55d569a8bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.106+0000 7fbf071a1740 1 -- 172.21.15.22:0/4256445972 >> 172.21.15.22:0/4256445972 conn(0x55d5696da350 msgr2=0x55d569a89df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.106+0000 7fbf071a1740 1 -- 172.21.15.22:0/4256445972 shutdown_connections 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.106+0000 7fbf071a1740 1 -- 172.21.15.22:0/4256445972 wait complete. 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbf071a1740 1 -- start start 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbf071a1740 1 Processor -- start 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 0x55d569a979c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569a97f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696e5f60 0x55d569aa39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbf071a1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d5698545f0 con 0x55d5696c5280 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbf071a1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d56998e010 con 0x55d5696bd0a0 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbf071a1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d569a9a680 con 0x55d5696e5f60 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbf071a1740 10 client.0 _ll_register_callbacks cb 0x55d5699ed340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbef9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569a97f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbef9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569a97f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36444/0 (socket says 172.21.15.22:36444) 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbef9d9b640 1 -- 172.21.15.22:0/3843081175 learned_addr learned my addr 172.21.15.22:0/3843081175 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbefa59c640 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 0x55d569a979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.107+0000 7fbefad9d640 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696e5f60 0x55d569aa39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbef9d9b640 1 -- 172.21.15.22:0/3843081175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696e5f60 msgr2=0x55d569aa39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696e5f60 0x55d569aa39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbef9d9b640 1 -- 172.21.15.22:0/3843081175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 msgr2=0x55d569a979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 0x55d569a979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbef9d9b640 1 -- 172.21.15.22:0/3843081175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5699bba00 con 0x55d5696c5280 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbefa59c640 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 0x55d569a979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569a97f00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbef00acbc0 tx=0x7fbef00a9590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a249cc15acc6b25f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbee1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbee1ffb640 1 -- 172.21.15.22:0/3843081175 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0021030 con 0x55d5696c5280 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbee1ffb640 1 -- 172.21.15.22:0/3843081175 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fbef00e9310 con 0x55d5696c5280 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbf071a1740 1 -- 172.21.15.22:0/3843081175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d569a05b60 con 0x55d5696c5280 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbee1ffb640 1 -- 172.21.15.22:0/3843081175 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbef00ac810 con 0x55d5696c5280 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbf071a1740 10 client.15618 fetch_fsmap learned FSMap version 29 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbf071a1740 1 -- 172.21.15.22:0/3843081175 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d569aa6630 con 0x55d5696c5280 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.108+0000 7fbee1ffb640 1 -- 172.21.15.22:0/3843081175 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55d569a05b60 con 0x55d5696c5280 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.109+0000 7fbee1ffb640 1 -- 172.21.15.22:0/3843081175 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbef0092ce0 con 0x55d5696c5280 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.109+0000 7fbf071a1740 10 client.15618 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.109+0000 7fbf071a1740 10 client.15618 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T04:02:51.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.109+0000 7fbf071a1740 20 client.15618 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.109+0000 7fbf071a1740 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d5696a48e0 0x55d569aaa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.109+0000 7fbf071a1740 4 client.15618 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.109+0000 7fbf071a1740 1 -- 172.21.15.22:0/3843081175 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d569a01610 con 0x55d5696a48e0 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.109+0000 7fbefa59c640 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d5696a48e0 0x55d569aaa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.110+0000 7fbefa59c640 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d5696a48e0 0x55d569aaa0c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ad56ed6598b70a server_cookie=f4b5f10756f24fd1 in_seq=0 out_seq=0 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.110+0000 7fbee1ffb640 10 client.15618 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.110+0000 7fbee1ffb640 1 -- 172.21.15.22:0/3843081175 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d569a01610 con 0x55d5696a48e0 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.110+0000 7fbee1ffb640 10 client.15618 handle_command_reply: tid=0 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.110+0000 7fbf071a1740 1 client.15618 shutdown 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.110+0000 7fbf071a1740 1 -- 172.21.15.22:0/3843081175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 msgr2=0x55d569a97f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.110+0000 7fbf071a1740 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569a97f00 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fbef00acbc0 tx=0x7fbef00a9590 comp rx=0 tx=0).stop 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.111+0000 7fbf071a1740 1 -- 172.21.15.22:0/3843081175 shutdown_connections 2024-09-21T04:02:51.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.111+0000 7fbf071a1740 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d5696a48e0 0x55d569aaa0c0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.111+0000 7fbf071a1740 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696e5f60 0x55d569aa39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.111+0000 7fbf071a1740 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569a97f00 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.111+0000 7fbf071a1740 1 --2- 172.21.15.22:0/3843081175 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 0x55d569a979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.111+0000 7fbf071a1740 1 -- 172.21.15.22:0/3843081175 >> 172.21.15.22:0/3843081175 conn(0x55d5696da350 msgr2=0x55d569a8f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:51.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.111+0000 7fbee1ffb640 0 client.15618 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:02:51.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.111+0000 7fbf071a1740 1 -- 172.21.15.22:0/3843081175 shutdown_connections 2024-09-21T04:02:51.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.111+0000 7fbf071a1740 1 -- 172.21.15.22:0/3843081175 wait complete. 2024-09-21T04:02:51.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.111+0000 7fbf071a1740 20 client.15618 trim_cache size 0 max 16384 2024-09-21T04:02:51.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.129+0000 7fbf071a1740 1 Processor -- start 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.129+0000 7fbf071a1740 1 -- start start 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.129+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 0x55d569a92020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.129+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aa3940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.129+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696e5f60 0x55d569aa3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.129+0000 7fbf071a1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d569aa8400 con 0x55d5696c5280 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.129+0000 7fbf071a1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d569aa8ad0 con 0x55d5696bd0a0 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.129+0000 7fbf071a1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d569aa91a0 con 0x55d5696e5f60 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.129+0000 7fbef9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aa3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbef9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aa3940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36446/0 (socket says 172.21.15.22:36446) 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbef9d9b640 1 -- 172.21.15.22:0/4069532273 learned_addr learned my addr 172.21.15.22:0/4069532273 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:51.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbefa59c640 1 --2- 172.21.15.22:0/4069532273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 0x55d569a92020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbefad9d640 1 --2- 172.21.15.22:0/4069532273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696e5f60 0x55d569aa3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbef9d9b640 1 -- 172.21.15.22:0/4069532273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696e5f60 msgr2=0x55d569aa3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/4069532273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696e5f60 0x55d569aa3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbef9d9b640 1 -- 172.21.15.22:0/4069532273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 msgr2=0x55d569a92020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/4069532273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 0x55d569a92020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbef9d9b640 1 -- 172.21.15.22:0/4069532273 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d569a8a6e0 con 0x55d5696c5280 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbefa59c640 1 --2- 172.21.15.22:0/4069532273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 0x55d569a92020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/4069532273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aa3940 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbef0096040 tx=0x7fbef000b4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5797006816dcb681 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbee3fff640 1 -- 172.21.15.22:0/4069532273 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0021070 con 0x55d5696c5280 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbee3fff640 1 -- 172.21.15.22:0/4069532273 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbef00a8b60 con 0x55d5696c5280 2024-09-21T04:02:51.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.130+0000 7fbee3fff640 1 -- 172.21.15.22:0/4069532273 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef00ac630 con 0x55d5696c5280 2024-09-21T04:02:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 -- 172.21.15.22:0/4069532273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 msgr2=0x55d569aa3940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 --2- 172.21.15.22:0/4069532273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aa3940 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fbef0096040 tx=0x7fbef000b4c0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 -- 172.21.15.22:0/4069532273 shutdown_connections 2024-09-21T04:02:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 --2- 172.21.15.22:0/4069532273 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696e5f60 0x55d569aa3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 --2- 172.21.15.22:0/4069532273 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aa3940 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 --2- 172.21.15.22:0/4069532273 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696bd0a0 0x55d569a92020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 -- 172.21.15.22:0/4069532273 >> 172.21.15.22:0/4069532273 conn(0x55d5696da350 msgr2=0x55d569a929a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 -- 172.21.15.22:0/4069532273 shutdown_connections 2024-09-21T04:02:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 -- 172.21.15.22:0/4069532273 wait complete. 2024-09-21T04:02:51.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 -- start start 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.131+0000 7fbf071a1740 1 Processor -- start 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696bd0a0 0x55d569aabad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aac090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbf071a1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 0x55d569ab0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbf071a1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d569aa9f40 con 0x55d5696c5280 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbf071a1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d569aa9870 con 0x55d5696e5f60 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbf071a1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d569aaa610 con 0x55d5696bd0a0 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbf071a1740 10 client.0 _ll_register_callbacks cb 0x7fbef0009f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbef9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aac090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbef9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aac090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36456/0 (socket says 172.21.15.22:36456) 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbef9d9b640 1 -- 172.21.15.22:0/646026712 learned_addr learned my addr 172.21.15.22:0/646026712 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbefa59c640 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696bd0a0 0x55d569aabad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbefad9d640 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 0x55d569ab0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbef9d9b640 1 -- 172.21.15.22:0/646026712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696bd0a0 msgr2=0x55d569aabad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696bd0a0 0x55d569aabad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbef9d9b640 1 -- 172.21.15.22:0/646026712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 msgr2=0x55d569ab0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 0x55d569ab0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbef9d9b640 1 -- 172.21.15.22:0/646026712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d569ab15d0 con 0x55d5696c5280 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.132+0000 7fbefad9d640 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 0x55d569ab0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbef9d9b640 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aac090 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbef00ea390 tx=0x7fbef00b6830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71fc4fae0fb6cf76 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbee1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbee1ffb640 1 -- 172.21.15.22:0/646026712 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbef0021070 con 0x55d5696c5280 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbee1ffb640 1 -- 172.21.15.22:0/646026712 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fbef00942c0 con 0x55d5696c5280 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbf071a1740 1 -- 172.21.15.22:0/646026712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbef00a8b60 con 0x55d5696c5280 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbee1ffb640 1 -- 172.21.15.22:0/646026712 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbef00d4040 con 0x55d5696c5280 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbf071a1740 10 client.15624 fetch_fsmap learned FSMap version 29 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbf071a1740 1 -- 172.21.15.22:0/646026712 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d569ab2990 con 0x55d5696c5280 2024-09-21T04:02:51.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbee1ffb640 1 -- 172.21.15.22:0/646026712 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbef00a8b60 con 0x55d5696c5280 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbee1ffb640 1 -- 172.21.15.22:0/646026712 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 29) ==== 8370+0+0 (secure 0 0 0) 0x7fbef0092ce0 con 0x55d5696c5280 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbf071a1740 10 client.15624 fetch_fsmap finished waiting for FSMap version 29 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbf071a1740 10 client.15624 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.133+0000 7fbf071a1740 20 client.15624 populate_metadata read hostname 'smithi022' 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.134+0000 7fbf071a1740 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d569679c90 0x55d569b18060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.134+0000 7fbf071a1740 4 client.15624 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.134+0000 7fbf071a1740 1 -- 172.21.15.22:0/646026712 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "status"}) -- 0x55d5699fea40 con 0x55d569679c90 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.134+0000 7fbefa59c640 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d569679c90 0x55d569b18060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.134+0000 7fbefa59c640 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d569679c90 0x55d569b18060 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=174487f84b63d0da server_cookie=1560ab61a5a4c643 in_seq=0 out_seq=0 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.134+0000 7fbee1ffb640 10 client.15624 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.134+0000 7fbee1ffb640 1 -- 172.21.15.22:0/646026712 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d5699fea40 con 0x55d569679c90 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbee1ffb640 10 client.15624 handle_command_reply: tid=0 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 client.15624 shutdown 2024-09-21T04:02:51.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 -- 172.21.15.22:0/646026712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 msgr2=0x55d569aac090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aac090 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbef00ea390 tx=0x7fbef00b6830 comp rx=0 tx=0).stop 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 -- 172.21.15.22:0/646026712 shutdown_connections 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d569679c90 0x55d569b18060 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d5696e5f60 0x55d569ab0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d5696c5280 0x55d569aac090 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbee1ffb640 0 client.15624 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 --2- 172.21.15.22:0/646026712 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d5696bd0a0 0x55d569aabad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 -- 172.21.15.22:0/646026712 >> 172.21.15.22:0/646026712 conn(0x55d5696da350 msgr2=0x55d569a89600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 -- 172.21.15.22:0/646026712 shutdown_connections 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 1 -- 172.21.15.22:0/646026712 wait complete. 2024-09-21T04:02:51.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf071a1740 20 client.15624 trim_cache size 0 max 16384 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "ae19ad46-77cc-11ef-baf5-efdc52797490", 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 24647, 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 166.134230363, 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 29, 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 85, 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 85, 2024-09-21T04:02:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 177.87561462299999 2024-09-21T04:02:51.144 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:02:51.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf00c2d640 1 -- 172.21.15.22:0/542666055 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbee40b6510 msgr2=0x7fbee40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:51.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf00c2d640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbee40b6510 0x7fbee40b8a20 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fbef4005fd0 tx=0x7fbef4009600 comp rx=0 tx=0).stop 2024-09-21T04:02:51.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf00c2d640 1 -- 172.21.15.22:0/542666055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbefc109500 msgr2=0x7fbefc19aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:02:51.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.135+0000 7fbf00c2d640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbefc109500 0x7fbefc19aa50 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbef000d740 tx=0x7fbef000dc00 comp rx=0 tx=0).stop 2024-09-21T04:02:51.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.136+0000 7fbf00c2d640 1 -- 172.21.15.22:0/542666055 shutdown_connections 2024-09-21T04:02:51.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.136+0000 7fbf00c2d640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fbee40b6510 0x7fbee40b8a20 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.136+0000 7fbf00c2d640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fbefc109e50 0x7fbefc19fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.136+0000 7fbf00c2d640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbefc109500 0x7fbefc19aa50 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.136+0000 7fbf00c2d640 1 --2- 172.21.15.22:0/542666055 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fbefc101fc0 0x7fbefc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:02:51.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.136+0000 7fbf00c2d640 1 -- 172.21.15.22:0/542666055 >> 172.21.15.22:0/542666055 conn(0x7fbefc079f90 msgr2=0x7fbefc1076a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:02:51.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.136+0000 7fbf00c2d640 1 -- 172.21.15.22:0/542666055 shutdown_connections 2024-09-21T04:02:51.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:02:51.136+0000 7fbf00c2d640 1 -- 172.21.15.22:0/542666055 wait complete. 2024-09-21T04:02:51.811 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-09-21T04:02:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:52 smithi022 ceph-mon[31015]: pgmap v386: 129 pgs: 129 active+clean; 27 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 2.7 MiB/s wr, 56 op/s 2024-09-21T04:02:52.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:52 smithi073 ceph-mon[34443]: pgmap v386: 129 pgs: 129 active+clean; 27 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 2.7 MiB/s wr, 56 op/s 2024-09-21T04:02:52.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:52 smithi060 ceph-mon[33722]: pgmap v386: 129 pgs: 129 active+clean; 27 MiB data, 406 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 2.7 MiB/s wr, 56 op/s 2024-09-21T04:02:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:54 smithi022 ceph-mon[31015]: pgmap v387: 129 pgs: 129 active+clean; 30 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 3.2 MiB/s wr, 75 op/s 2024-09-21T04:02:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:54 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:02:54.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:54 smithi073 ceph-mon[34443]: pgmap v387: 129 pgs: 129 active+clean; 30 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 3.2 MiB/s wr, 75 op/s 2024-09-21T04:02:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:54 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:02:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:54 smithi060 ceph-mon[33722]: pgmap v387: 129 pgs: 129 active+clean; 30 MiB data, 417 MiB used, 1.0 TiB / 1.0 TiB avail; 132 KiB/s rd, 3.2 MiB/s wr, 75 op/s 2024-09-21T04:02:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:54 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:02:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:56 smithi022 ceph-mon[31015]: pgmap v388: 129 pgs: 129 active+clean; 31 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 3.6 MiB/s wr, 83 op/s 2024-09-21T04:02:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:56 smithi073 ceph-mon[34443]: pgmap v388: 129 pgs: 129 active+clean; 31 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 3.6 MiB/s wr, 83 op/s 2024-09-21T04:02:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:56 smithi060 ceph-mon[33722]: pgmap v388: 129 pgs: 129 active+clean; 31 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 133 KiB/s rd, 3.6 MiB/s wr, 83 op/s 2024-09-21T04:02:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:58 smithi022 ceph-mon[31015]: pgmap v389: 129 pgs: 129 active+clean; 35 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 3.6 MiB/s wr, 94 op/s 2024-09-21T04:02:58.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:58 smithi073 ceph-mon[34443]: pgmap v389: 129 pgs: 129 active+clean; 35 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 3.6 MiB/s wr, 94 op/s 2024-09-21T04:02:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:58 smithi060 ceph-mon[33722]: pgmap v389: 129 pgs: 129 active+clean; 35 MiB data, 438 MiB used, 1.0 TiB / 1.0 TiB avail; 231 KiB/s rd, 3.6 MiB/s wr, 94 op/s 2024-09-21T04:02:59.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:02:59 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:02:59.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:02:59 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:02:59.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:02:59 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:03:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:00 smithi022 ceph-mon[31015]: pgmap v390: 129 pgs: 129 active+clean; 39 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 3.4 MiB/s wr, 97 op/s 2024-09-21T04:03:00.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:00 smithi073 ceph-mon[34443]: pgmap v390: 129 pgs: 129 active+clean; 39 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 3.4 MiB/s wr, 97 op/s 2024-09-21T04:03:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:00 smithi060 ceph-mon[33722]: pgmap v390: 129 pgs: 129 active+clean; 39 MiB data, 441 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 3.4 MiB/s wr, 97 op/s 2024-09-21T04:03:02.265 INFO:teuthology.orchestra.run.smithi022.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-09-21T04:03:02.268 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/: 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:total 2 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:02 . 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:02 .. 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 data 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data: 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:total 45 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 . 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:02 .. 2024-09-21T04:03:02.592 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 20473350 Sep 21 04:02 base 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 Sep 21 04:02 global 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:03 log 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_commit_ts 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_dynshmem 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 21 04:02 pg_hba.conf 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 21 04:02 pg_ident.conf 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 04:02 pg_logical 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 pg_multixact 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_notify 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_replslot 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_serial 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_snapshots 2024-09-21T04:03:02.593 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_stat 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_stat_tmp 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 pg_subtrans 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_tblspc 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_twophase 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 04:02 PG_VERSION 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:02 pg_wal 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 pg_xact 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 21 04:02 postgresql.auto.conf 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 21 04:02 postgresql.conf 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/base: 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:total 3 2024-09-21T04:03:02.594 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 20473350 Sep 21 04:02 . 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 04:02 1 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 4547072 Sep 21 04:02 13493 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 04:02 13494 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:total 7778 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 04:02 . 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 20473350 Sep 21 04:02 .. 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 112 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 113 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:02 1247 2024-09-21T04:03:02.595 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1247_fsm 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1247_vm 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 04:02 1249 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1249_fsm 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1249_vm 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 04:02 1255 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1255_fsm 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1255_vm 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 04:02 1259 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1259_fsm 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1259_vm 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 04:02 13344 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13344_fsm 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13344_vm 2024-09-21T04:03:02.596 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13346 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13348 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13349_fsm 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349_vm 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13351 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13353 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13354_fsm 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354_vm 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13356 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13358 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13359_fsm 2024-09-21T04:03:02.597 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359_vm 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13361 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13363 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1417 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1418 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 174 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 175 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2187 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2224 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2328 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2336 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2337 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2579 2024-09-21T04:03:02.598 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2600 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2600_fsm 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2600_vm 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2601_fsm 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601_vm 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2602 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2602_fsm 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2602_vm 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2603 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2603_fsm 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2603_vm 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2604 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2605 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2605_fsm 2024-09-21T04:03:02.599 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2605_vm 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2606 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2606_fsm 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2606_vm 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2607 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2607_fsm 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2607_vm 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 04:02 2608 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2608_fsm 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2608_vm 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 04:02 2609 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2609_fsm 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2609_vm 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2610 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2610_fsm 2024-09-21T04:03:02.600 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2610_vm 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2611 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2612_fsm 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612_vm 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2613 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2615_fsm 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615_vm 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2616 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2616_fsm 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2616_vm 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 04:02 2617 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2617_fsm 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2617_vm 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 04:02 2618 2024-09-21T04:03:02.601 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2618_fsm 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2618_vm 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 04:02 2619 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2619_fsm 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2619_vm 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2620 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2650 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2651 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2652 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2653 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2654 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2655 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2656 2024-09-21T04:03:02.602 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2657 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 04:02 2658 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:02 2659 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2660 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2661 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2662 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2663 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2664 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2665 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2666 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2667 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2668 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2669 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2670 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 04:02 2673 2024-09-21T04:03:02.603 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 04:02 2674 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 04:02 2675 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2678 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2679 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2680 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2681 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2682 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2683 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2684 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2685 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2686 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2687 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2688 2024-09-21T04:03:02.604 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2689 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 04:02 2690 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 04:02 2691 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2692 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2693 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2696 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2699 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2701 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2702 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2703 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2704 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2753 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2753_fsm 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2753_vm 2024-09-21T04:03:02.605 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2754 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2755 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2756 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2757 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2830 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2831 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2832 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2833 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2834 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2835 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2836 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2837 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 04:02 2838 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2838_fsm 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2838_vm 2024-09-21T04:03:02.606 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2839 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840_fsm 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2840_vm 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2841 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2995 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2996 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3079_fsm 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079_vm 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3080 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3081 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3085 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3118 2024-09-21T04:03:02.607 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3119 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 04:02 3164 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3256 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3257 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3258 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3350 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3351 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3379 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3380 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3381 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3394 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3394_fsm 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3394_vm 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3395 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3429 2024-09-21T04:03:02.608 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3430 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3431 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3433 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3439 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3440 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3455 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 04:02 3456 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3456_fsm 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3456_vm 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3466 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3467 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3468 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3501 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3502 2024-09-21T04:03:02.609 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3503 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3534 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3541_fsm 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541_vm 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3542 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3574 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3575 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3576 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3596 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3597 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3598 2024-09-21T04:03:02.610 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3599 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3600_fsm 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600_vm 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3601_fsm 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601_vm 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3602_fsm 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602_vm 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603_fsm 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3603_vm 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3604 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3605 2024-09-21T04:03:02.611 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3606 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3607 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3608 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 3609 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3712 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3764_fsm 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764_vm 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3766 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3767 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3997 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4143 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4144 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4145 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4146 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4147 2024-09-21T04:03:02.612 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4148 2024-09-21T04:03:02.613 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4149 2024-09-21T04:03:02.613 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4150 2024-09-21T04:03:02.613 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4151 2024-09-21T04:03:02.613 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4152 2024-09-21T04:03:02.613 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4153 2024-09-21T04:03:02.613 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4154 2024-09-21T04:03:02.613 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4155 2024-09-21T04:03:02.613 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4156 2024-09-21T04:03:02.613 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4157 2024-09-21T04:03:02.613 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4158 2024-09-21T04:03:02.613 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:02 smithi022 ceph-mon[31015]: pgmap v391: 129 pgs: 129 active+clean; 43 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 3.4 MiB/s wr, 98 op/s 2024-09-21T04:03:02.851 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4159 2024-09-21T04:03:02.851 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4160 2024-09-21T04:03:02.851 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4161 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4162 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4163 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4164 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4165 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4166 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4167 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4168 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4169 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4170 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4171 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4172 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4173 2024-09-21T04:03:02.852 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4174 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 5002 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 548 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 549 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6102 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6104 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6106 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6110 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6111 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6112 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6113 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6117 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 826 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 827 2024-09-21T04:03:02.853 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 828 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 04:02 pg_filenode.map 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 04:02 PG_VERSION 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:total 7778 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 4547072 Sep 21 04:02 . 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 20473350 Sep 21 04:02 .. 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 112 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 113 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:02 1247 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1247_fsm 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1247_vm 2024-09-21T04:03:02.854 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 04:02 1249 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1249_fsm 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1249_vm 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 04:02 1255 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1255_fsm 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1255_vm 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 04:02 1259 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1259_fsm 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1259_vm 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 04:02 13344 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13344_fsm 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13344_vm 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13346 2024-09-21T04:03:02.855 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13348 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13349_fsm 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349_vm 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13351 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13353 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13354_fsm 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354_vm 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13356 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13358 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13359_fsm 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359_vm 2024-09-21T04:03:02.856 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13361 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13363 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1417 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1418 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 174 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 175 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2187 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2224 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2328 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2336 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2337 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2579 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2600 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2600_fsm 2024-09-21T04:03:02.857 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2600_vm 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2601_fsm 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601_vm 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2602 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2602_fsm 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2602_vm 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2603 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2603_fsm 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2603_vm 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2604 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2605 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2605_fsm 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2605_vm 2024-09-21T04:03:02.858 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2606 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2606_fsm 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2606_vm 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2607 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2607_fsm 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2607_vm 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 04:02 2608 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2608_fsm 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2608_vm 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 04:02 2609 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2609_fsm 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2609_vm 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2610 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2610_fsm 2024-09-21T04:03:02.859 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2610_vm 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2611 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2612_fsm 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612_vm 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2613 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2615_fsm 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615_vm 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2616 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2616_fsm 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2616_vm 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 04:02 2617 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2617_fsm 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2617_vm 2024-09-21T04:03:02.860 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 04:02 2618 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2618_fsm 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2618_vm 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 04:02 2619 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2619_fsm 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2619_vm 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2620 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2650 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2651 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2652 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2653 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2654 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2655 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2656 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2657 2024-09-21T04:03:02.861 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 04:02 2658 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:02 2659 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2660 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2661 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2662 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2663 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2664 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2665 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2666 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2667 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2668 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2669 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2670 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 04:02 2673 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 04:02 2674 2024-09-21T04:03:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 04:02 2675 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2678 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2679 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2680 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2681 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2682 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2683 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2684 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2685 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2686 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2687 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2688 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2689 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 04:02 2690 2024-09-21T04:03:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 04:02 2691 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2692 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2693 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2696 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2699 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2701 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2702 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2703 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2704 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2753 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2753_fsm 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2753_vm 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2754 2024-09-21T04:03:02.864 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2755 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2756 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2757 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2830 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2831 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2832 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2833 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2834 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2835 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2836 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2837 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 04:02 2838 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2838_fsm 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2838_vm 2024-09-21T04:03:02.865 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2839 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840_fsm 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2840_vm 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2841 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2995 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2996 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3079_fsm 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079_vm 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3080 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3081 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3085 2024-09-21T04:03:02.866 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3118 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3119 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 04:02 3164 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3256 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3257 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3258 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3350 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3351 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3379 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3380 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3381 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3394 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3394_fsm 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3394_vm 2024-09-21T04:03:02.867 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3395 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3429 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3430 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3431 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3433 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3439 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3440 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3455 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 04:02 3456 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3456_fsm 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3456_vm 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3466 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3467 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3468 2024-09-21T04:03:02.868 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3501 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3502 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3503 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3534 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3541_fsm 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541_vm 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3542 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3574 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3575 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3576 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3596 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3597 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3598 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3599 2024-09-21T04:03:02.869 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3600_fsm 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600_vm 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3601_fsm 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601_vm 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3602_fsm 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602_vm 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603_fsm 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3603_vm 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3604 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3605 2024-09-21T04:03:02.870 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3606 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3607 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3608 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 3609 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3712 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3764_fsm 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764_vm 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3766 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3767 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3997 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4143 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4144 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4145 2024-09-21T04:03:02.871 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4146 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4147 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4148 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4149 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4150 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4151 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4152 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4153 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4154 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4155 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4156 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4157 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4158 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4159 2024-09-21T04:03:02.872 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4160 2024-09-21T04:03:02.873 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4161 2024-09-21T04:03:02.873 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4162 2024-09-21T04:03:02.873 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:02 smithi073 ceph-mon[34443]: pgmap v391: 129 pgs: 129 active+clean; 43 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 3.4 MiB/s wr, 98 op/s 2024-09-21T04:03:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:02 smithi060 ceph-mon[33722]: pgmap v391: 129 pgs: 129 active+clean; 43 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 3.4 MiB/s wr, 98 op/s 2024-09-21T04:03:03.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4163 2024-09-21T04:03:03.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4164 2024-09-21T04:03:03.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4165 2024-09-21T04:03:03.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4166 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4167 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4168 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4169 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4170 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4171 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4172 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4173 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4174 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 5002 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 548 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 549 2024-09-21T04:03:03.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6102 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6104 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6106 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6110 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6111 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6112 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6113 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6117 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 826 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 827 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 828 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 04:02 pg_filenode.map 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 04:02 PG_VERSION 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.109 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:total 7778 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 04:02 . 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 20473350 Sep 21 04:02 .. 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 112 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 113 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:02 1247 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1247_fsm 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1247_vm 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 04:02 1249 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1249_fsm 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1249_vm 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 04:02 1255 2024-09-21T04:03:03.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1255_fsm 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1255_vm 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 04:02 1259 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1259_fsm 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1259_vm 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 04:02 13344 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13344_fsm 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13344_vm 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13346 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13348 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13349_fsm 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349_vm 2024-09-21T04:03:03.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13351 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13353 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13354_fsm 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354_vm 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13356 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13358 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13359_fsm 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359_vm 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13361 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13363 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1417 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1418 2024-09-21T04:03:03.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 174 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 175 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2187 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2224 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2328 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2336 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2337 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2579 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2600 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2600_fsm 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2600_vm 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2601_fsm 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601_vm 2024-09-21T04:03:03.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2602 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2602_fsm 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2602_vm 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2603 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2603_fsm 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2603_vm 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2604 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2605 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2605_fsm 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2605_vm 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2606 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2606_fsm 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2606_vm 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2607 2024-09-21T04:03:03.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2607_fsm 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2607_vm 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 04:02 2608 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2608_fsm 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2608_vm 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 04:02 2609 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2609_fsm 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2609_vm 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2610 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2610_fsm 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2610_vm 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2611 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2612_fsm 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612_vm 2024-09-21T04:03:03.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2613 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2615_fsm 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615_vm 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2616 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2616_fsm 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2616_vm 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 04:02 2617 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2617_fsm 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2617_vm 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 04:02 2618 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2618_fsm 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2618_vm 2024-09-21T04:03:03.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 04:02 2619 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2619_fsm 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2619_vm 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2620 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2650 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2651 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2652 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2653 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2654 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2655 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2656 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2657 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 04:02 2658 2024-09-21T04:03:03.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:02 2659 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2660 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2661 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2662 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2663 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2664 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2665 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2666 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2667 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2668 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2669 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2670 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 04:02 2673 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 04:02 2674 2024-09-21T04:03:03.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 04:02 2675 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2678 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2679 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2680 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2681 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2682 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2683 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2684 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2685 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2686 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2687 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2688 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2689 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 04:02 2690 2024-09-21T04:03:03.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 04:02 2691 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2692 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2693 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2696 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2699 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2701 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2702 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2703 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2704 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2753 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2753_fsm 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2753_vm 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2754 2024-09-21T04:03:03.120 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2755 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2756 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2757 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2830 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2831 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2832 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2833 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2834 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2835 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2836 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2837 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 04:02 2838 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2838_fsm 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2838_vm 2024-09-21T04:03:03.121 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2839 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840_fsm 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2840_vm 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2841 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2995 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2996 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3079_fsm 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079_vm 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3080 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3081 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3085 2024-09-21T04:03:03.122 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3118 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3119 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 04:02 3164 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3256 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3257 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3258 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3350 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3351 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3379 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3380 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3381 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3394 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3394_fsm 2024-09-21T04:03:03.123 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3394_vm 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3395 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3429 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3430 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3431 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3433 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3439 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3440 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3455 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 04:02 3456 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3456_fsm 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3456_vm 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3466 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3467 2024-09-21T04:03:03.124 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3468 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3501 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3502 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3503 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3534 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3541_fsm 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541_vm 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3542 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3574 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3575 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3576 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3596 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3597 2024-09-21T04:03:03.125 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3598 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3599 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3600_fsm 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600_vm 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3601_fsm 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601_vm 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3602_fsm 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602_vm 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603_fsm 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3603_vm 2024-09-21T04:03:03.126 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3604 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3605 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3606 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3607 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3608 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 3609 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3712 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3764_fsm 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764_vm 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3766 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3767 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3997 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4143 2024-09-21T04:03:03.127 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4144 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4145 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4146 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4147 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4148 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4149 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4150 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4151 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4152 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4153 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4154 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4155 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4156 2024-09-21T04:03:03.128 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4157 2024-09-21T04:03:03.129 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4158 2024-09-21T04:03:03.129 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4159 2024-09-21T04:03:03.129 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4160 2024-09-21T04:03:03.129 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4161 2024-09-21T04:03:03.129 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4162 2024-09-21T04:03:03.129 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4163 2024-09-21T04:03:03.129 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4164 2024-09-21T04:03:03.129 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4165 2024-09-21T04:03:03.129 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4166 2024-09-21T04:03:03.129 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4167 2024-09-21T04:03:03.152 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4168 2024-09-21T04:03:03.152 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4169 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4170 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4171 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4172 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4173 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4174 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 5002 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 548 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 549 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6102 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6104 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6106 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6110 2024-09-21T04:03:03.153 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6111 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6112 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6113 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6117 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 826 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 827 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 828 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 04:02 pg_filenode.map 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 04:02 PG_VERSION 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/global: 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:total 538 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 Sep 21 04:02 . 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.154 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1213 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1213_fsm 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1213_vm 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1214 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1214_fsm 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1214_vm 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 1232 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 1233 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1260 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1260_fsm 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1260_vm 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1261 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1261_fsm 2024-09-21T04:03:03.155 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1261_vm 2024-09-21T04:03:03.156 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1262 2024-09-21T04:03:03.156 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1262_fsm 2024-09-21T04:03:03.156 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1262_vm 2024-09-21T04:03:03.156 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2396 2024-09-21T04:03:03.156 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2396_fsm 2024-09-21T04:03:03.156 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2396_vm 2024-09-21T04:03:03.156 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2397 2024-09-21T04:03:03.156 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2671 2024-09-21T04:03:03.156 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2672 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2676 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2677 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2694 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2695 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2697 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2698 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2846 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2847 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2964 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2965 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2966 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2967 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3592 2024-09-21T04:03:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3593 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4060 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4061 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4175 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4176 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4177 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4178 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4181 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4182 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4183 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4184 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4185 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4186 2024-09-21T04:03:03.158 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6000 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6001 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6002 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6100 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6114 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6115 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 pg_control 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 04:02 pg_filenode.map 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/log: 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.159 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:03 . 2024-09-21T04:03:03.214 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.215 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:total 3 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 04:02 . 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 mappings 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 04:02 replorigin_checkpoint 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 snapshots 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 04:02 .. 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-21T04:03:03.216 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 04:02 .. 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:total 2 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 . 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 members 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 offsets 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:total 9 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 . 2024-09-21T04:03:03.217 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 .. 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 0000 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:total 9 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 . 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 .. 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 0000 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.218 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.219 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.220 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-21T04:03:03.231 INFO:teuthology.orchestra.run.smithi022.stdout:total 9 2024-09-21T04:03:03.231 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 . 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 0000 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.232 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:total 16386 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:02 . 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:02 000000010000000000000001 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 archive_status 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:02 .. 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:03.233 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-21T04:03:03.234 INFO:teuthology.orchestra.run.smithi022.stdout:total 9 2024-09-21T04:03:03.234 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 . 2024-09-21T04:03:03.234 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 37867035 Sep 21 04:03 .. 2024-09-21T04:03:03.234 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 0000 2024-09-21T04:03:03.235 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-09-21T04:03:03.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-09-21T04:03:03.794 INFO:teuthology.orchestra.run.smithi022.stderr:dropping old tables... 2024-09-21T04:03:03.800 INFO:teuthology.orchestra.run.smithi022.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-09-21T04:03:03.800 INFO:teuthology.orchestra.run.smithi022.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-09-21T04:03:03.800 INFO:teuthology.orchestra.run.smithi022.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-09-21T04:03:03.800 INFO:teuthology.orchestra.run.smithi022.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-09-21T04:03:03.801 INFO:teuthology.orchestra.run.smithi022.stderr:creating tables... 2024-09-21T04:03:03.855 INFO:teuthology.orchestra.run.smithi022.stderr:generating data (client-side)... 2024-09-21T04:03:04.414 INFO:teuthology.orchestra.run.smithi022.stderr:100000 of 3200000 tuples (3%) done (elapsed 0.53 s, remaining 16.55 s) 2024-09-21T04:03:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:04 smithi022 ceph-mon[31015]: pgmap v392: 129 pgs: 129 active+clean; 48 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2024-09-21T04:03:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:04 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:03:04.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:04 smithi073 ceph-mon[34443]: pgmap v392: 129 pgs: 129 active+clean; 48 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2024-09-21T04:03:04.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:04 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:03:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:04 smithi060 ceph-mon[33722]: pgmap v392: 129 pgs: 129 active+clean; 48 MiB data, 463 MiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 2.5 MiB/s wr, 127 op/s 2024-09-21T04:03:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:04 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:03:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:200000 of 3200000 tuples (6%) done (elapsed 1.81 s, remaining 27.22 s) 2024-09-21T04:03:05.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:03:05.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:03:05.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:03:05.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:03:05.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:05.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:03:05.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:03:05.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:03:06.813 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 14.5 2024-09-21T04:03:06.813 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:03:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:06 smithi060 ceph-mon[33722]: pgmap v393: 129 pgs: 129 active+clean; 52 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 2.4 MiB/s wr, 130 op/s 2024-09-21T04:03:06.978 INFO:teuthology.orchestra.run.smithi022.stderr:300000 of 3200000 tuples (9%) done (elapsed 3.10 s, remaining 29.95 s) 2024-09-21T04:03:07.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:06 smithi022 ceph-mon[31015]: pgmap v393: 129 pgs: 129 active+clean; 52 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 2.4 MiB/s wr, 130 op/s 2024-09-21T04:03:07.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:06 smithi073 ceph-mon[34443]: pgmap v393: 129 pgs: 129 active+clean; 52 MiB data, 479 MiB used, 1.0 TiB / 1.0 TiB avail; 574 KiB/s rd, 2.4 MiB/s wr, 130 op/s 2024-09-21T04:03:07.109 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:07.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.702+0000 7ff30efec640 1 -- 172.21.15.22:0/3810189074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff308103b70 msgr2=0x7ff308103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.702+0000 7ff30efec640 1 --2- 172.21.15.22:0/3810189074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff308103b70 0x7ff308103f80 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc009900 tx=0x7ff2fc02a410 comp rx=0 tx=0).stop 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.702+0000 7ff30efec640 1 -- 172.21.15.22:0/3810189074 shutdown_connections 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.702+0000 7ff30efec640 1 --2- 172.21.15.22:0/3810189074 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff3081094b0 0x7ff3081098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.702+0000 7ff30efec640 1 --2- 172.21.15.22:0/3810189074 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff308109e00 0x7ff308110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.702+0000 7ff30efec640 1 --2- 172.21.15.22:0/3810189074 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff308103b70 0x7ff308103f80 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.702+0000 7ff30efec640 1 -- 172.21.15.22:0/3810189074 >> 172.21.15.22:0/3810189074 conn(0x7ff3080ff5e0 msgr2=0x7ff308101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.702+0000 7ff30efec640 1 -- 172.21.15.22:0/3810189074 shutdown_connections 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.702+0000 7ff30efec640 1 -- 172.21.15.22:0/3810189074 wait complete. 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30efec640 1 Processor -- start 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30efec640 1 -- start start 2024-09-21T04:03:07.715 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30efec640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff308103b70 0x7ff30819a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30efec640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3081094b0 0x7ff30819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30efec640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff308109e00 0x7ff30819fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30efec640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff308113970 con 0x7ff308109e00 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30efec640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff3081137f0 con 0x7ff3081094b0 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30efec640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff308113af0 con 0x7ff308103b70 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30d589640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff308109e00 0x7ff30819fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30d589640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff308109e00 0x7ff30819fc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59840/0 (socket says 172.21.15.22:59840) 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30d589640 1 -- 172.21.15.22:0/800055043 learned_addr learned my addr 172.21.15.22:0/800055043 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff307fff640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3081094b0 0x7ff30819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.703+0000 7ff30cd88640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff308103b70 0x7ff30819a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff30d589640 1 -- 172.21.15.22:0/800055043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff308103b70 msgr2=0x7ff30819a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff30d589640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff308103b70 0x7ff30819a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff30d589640 1 -- 172.21.15.22:0/800055043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3081094b0 msgr2=0x7ff30819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff30d589640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3081094b0 0x7ff30819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff30d589640 1 -- 172.21.15.22:0/800055043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3081a0350 con 0x7ff308109e00 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff30d589640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff308109e00 0x7ff30819fc20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff30000eb10 tx=0x7ff30000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff305ffb640 1 -- 172.21.15.22:0/800055043 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300004b20 con 0x7ff308109e00 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff30efec640 1 -- 172.21.15.22:0/800055043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3081a0640 con 0x7ff308109e00 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff305ffb640 1 -- 172.21.15.22:0/800055043 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff300004cc0 con 0x7ff308109e00 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff305ffb640 1 -- 172.21.15.22:0/800055043 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff300010690 con 0x7ff308109e00 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.704+0000 7ff30efec640 1 -- 172.21.15.22:0/800055043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3081a6da0 con 0x7ff308109e00 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.705+0000 7ff30efec640 1 -- 172.21.15.22:0/800055043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff308103f80 con 0x7ff308109e00 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.708+0000 7ff305ffb640 1 -- 172.21.15.22:0/800055043 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff300005000 con 0x7ff308109e00 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.708+0000 7ff305ffb640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff2f80b6510 0x7ff2f80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.708+0000 7ff30cd88640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff2f80b6510 0x7ff2f80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:07.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.709+0000 7ff305ffb640 1 -- 172.21.15.22:0/800055043 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff3000e7e00 con 0x7ff308109e00 2024-09-21T04:03:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.709+0000 7ff30cd88640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff2f80b6510 0x7ff2f80b8a20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0057c0 tx=0x7ff2fc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:07.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.712+0000 7ff305ffb640 1 -- 172.21.15.22:0/800055043 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff300056710 con 0x7ff308109e00 2024-09-21T04:03:07.782 INFO:teuthology.orchestra.run.smithi022.stderr:400000 of 3200000 tuples (12%) done (elapsed 3.90 s, remaining 27.31 s) 2024-09-21T04:03:07.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.979+0000 7ff30efec640 1 -- 172.21.15.22:0/800055043 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff30819b510 con 0x7ff308109e00 2024-09-21T04:03:07.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.980+0000 7ff305ffb640 1 -- 172.21.15.22:0/800055043 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11966 (secure 0 0 0) 0x7ff30819b510 con 0x7ff308109e00 2024-09-21T04:03:07.982 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:07.982 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"btime":"2024-09-21T04:02:58:477506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:02:58.268873+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:03:07.983 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 31 2024-09-21T04:03:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 -- 172.21.15.22:0/800055043 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff2f80b6510 msgr2=0x7ff2f80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff2f80b6510 0x7ff2f80b8a20 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc0057c0 tx=0x7ff2fc0058d0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 -- 172.21.15.22:0/800055043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff308109e00 msgr2=0x7ff30819fc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff308109e00 0x7ff30819fc20 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff30000eb10 tx=0x7ff30000c2d0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 -- 172.21.15.22:0/800055043 shutdown_connections 2024-09-21T04:03:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff2f80b6510 0x7ff2f80b8a20 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff308109e00 0x7ff30819fc20 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff3081094b0 0x7ff30819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 --2- 172.21.15.22:0/800055043 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff308103b70 0x7ff30819a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 -- 172.21.15.22:0/800055043 >> 172.21.15.22:0/800055043 conn(0x7ff3080ff5e0 msgr2=0x7ff308101a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 -- 172.21.15.22:0/800055043 shutdown_connections 2024-09-21T04:03:07.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:07.983+0000 7ff30efec640 1 -- 172.21.15.22:0/800055043 wait complete. 2024-09-21T04:03:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:08 smithi060 ceph-mon[33722]: pgmap v394: 129 pgs: 129 active+clean; 60 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 3.2 MiB/s wr, 125 op/s 2024-09-21T04:03:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:08 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/800055043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:09.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:08 smithi022 ceph-mon[31015]: pgmap v394: 129 pgs: 129 active+clean; 60 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 3.2 MiB/s wr, 125 op/s 2024-09-21T04:03:09.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:08 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/800055043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:09.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:08 smithi073 ceph-mon[34443]: pgmap v394: 129 pgs: 129 active+clean; 60 MiB data, 483 MiB used, 1.0 TiB / 1.0 TiB avail; 575 KiB/s rd, 3.2 MiB/s wr, 125 op/s 2024-09-21T04:03:09.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:08 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/800055043' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:09.158 INFO:teuthology.orchestra.run.smithi022.stderr:500000 of 3200000 tuples (15%) done (elapsed 5.28 s, remaining 28.51 s) 2024-09-21T04:03:10.061 INFO:teuthology.orchestra.run.smithi022.stderr:600000 of 3200000 tuples (18%) done (elapsed 6.18 s, remaining 26.78 s) 2024-09-21T04:03:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:10 smithi060 ceph-mon[33722]: pgmap v395: 129 pgs: 129 active+clean; 93 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 7.5 MiB/s wr, 126 op/s 2024-09-21T04:03:11.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:10 smithi022 ceph-mon[31015]: pgmap v395: 129 pgs: 129 active+clean; 93 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 7.5 MiB/s wr, 126 op/s 2024-09-21T04:03:11.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:10 smithi073 ceph-mon[34443]: pgmap v395: 129 pgs: 129 active+clean; 93 MiB data, 489 MiB used, 1.0 TiB / 1.0 TiB avail; 513 KiB/s rd, 7.5 MiB/s wr, 126 op/s 2024-09-21T04:03:11.369 INFO:teuthology.orchestra.run.smithi022.stderr:700000 of 3200000 tuples (21%) done (elapsed 7.49 s, remaining 26.75 s) 2024-09-21T04:03:11.555 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0' 2024-09-21T04:03:11.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 134.5 --await-for 45.0 2024-09-21T04:03:11.850 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:12.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 -- 172.21.15.22:0/1801075798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c102a80 msgr2=0x7f201c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:12.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 --2- 172.21.15.22:0/1801075798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c102a80 0x7f201c102e90 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f200c009900 tx=0x7f200c02a410 comp rx=0 tx=0).stop 2024-09-21T04:03:12.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 -- 172.21.15.22:0/1801075798 shutdown_connections 2024-09-21T04:03:12.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 --2- 172.21.15.22:0/1801075798 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f201c108d10 0x7f201c10f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 --2- 172.21.15.22:0/1801075798 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f201c1083c0 0x7f201c1087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 --2- 172.21.15.22:0/1801075798 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c102a80 0x7f201c102e90 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 -- 172.21.15.22:0/1801075798 >> 172.21.15.22:0/1801075798 conn(0x7f201c079760 msgr2=0x7f201c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:12.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 -- 172.21.15.22:0/1801075798 shutdown_connections 2024-09-21T04:03:12.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 -- 172.21.15.22:0/1801075798 wait complete. 2024-09-21T04:03:12.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 Processor -- start 2024-09-21T04:03:12.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.379+0000 7f20224ac640 1 -- start start 2024-09-21T04:03:12.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f20224ac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c102a80 0x7f201c19a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f20224ac640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f201c1083c0 0x7f201c19a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f20224ac640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f201c108d10 0x7f201c19fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f20224ac640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f201c112890 con 0x7f201c102a80 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f20224ac640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f201c112710 con 0x7f201c1083c0 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f20224ac640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f201c112a10 con 0x7f201c108d10 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f201bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c102a80 0x7f201c19a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f201bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c102a80 0x7f201c19a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39832/0 (socket says 172.21.15.22:39832) 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f201bfff640 1 -- 172.21.15.22:0/716847303 learned_addr learned my addr 172.21.15.22:0/716847303 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f201b7fe640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f201c1083c0 0x7f201c19a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f2020a49640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f201c108d10 0x7f201c19fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f201bfff640 1 -- 172.21.15.22:0/716847303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f201c108d10 msgr2=0x7f201c19fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f201bfff640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f201c108d10 0x7f201c19fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f201bfff640 1 -- 172.21.15.22:0/716847303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f201c1083c0 msgr2=0x7f201c19a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:12.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.380+0000 7f201bfff640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f201c1083c0 0x7f201c19a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.381+0000 7f201bfff640 1 -- 172.21.15.22:0/716847303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f201c1a0360 con 0x7f201c102a80 2024-09-21T04:03:12.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.381+0000 7f201bfff640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c102a80 0x7f201c19a3f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f200c009230 tx=0x7f200c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:12.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.381+0000 7f20197fa640 1 -- 172.21.15.22:0/716847303 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c03f030 con 0x7f201c102a80 2024-09-21T04:03:12.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.381+0000 7f20197fa640 1 -- 172.21.15.22:0/716847303 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f200c003a80 con 0x7f201c102a80 2024-09-21T04:03:12.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.381+0000 7f20224ac640 1 -- 172.21.15.22:0/716847303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f201c1a05f0 con 0x7f201c102a80 2024-09-21T04:03:12.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.381+0000 7f20197fa640 1 -- 172.21.15.22:0/716847303 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f200c035070 con 0x7f201c102a80 2024-09-21T04:03:12.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.381+0000 7f20224ac640 1 -- 172.21.15.22:0/716847303 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f201c104150 con 0x7f201c102a80 2024-09-21T04:03:12.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.385+0000 7f2028a20740 1 Processor -- start 2024-09-21T04:03:12.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.385+0000 7f2028a20740 1 -- start start 2024-09-21T04:03:12.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.385+0000 7f20197fa640 1 -- 172.21.15.22:0/716847303 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f200c042030 con 0x7f201c102a80 2024-09-21T04:03:12.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.385+0000 7f2028a20740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894590840 0x55d894937600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.385+0000 7f2028a20740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894567980 0x55d894937b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.385+0000 7f2028a20740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 0x55d894938080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.385+0000 7f2028a20740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d8948adb90 con 0x55d894567980 2024-09-21T04:03:12.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.385+0000 7f2028a20740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d89489cfc0 con 0x55d89456fb60 2024-09-21T04:03:12.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.385+0000 7f2028a20740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d8948a0dd0 con 0x55d894590840 2024-09-21T04:03:12.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.386+0000 7f201bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894567980 0x55d894937b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.386+0000 7f201bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894567980 0x55d894937b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39848/0 (socket says 172.21.15.22:39848) 2024-09-21T04:03:12.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.386+0000 7f201bfff640 1 -- 172.21.15.22:0/3854510792 learned_addr learned my addr 172.21.15.22:0/3854510792 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:12.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.386+0000 7f201b7fe640 1 --2- 172.21.15.22:0/3854510792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 0x55d894938080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.386+0000 7f2020a49640 1 --2- 172.21.15.22:0/3854510792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894590840 0x55d894937600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.386+0000 7f2020a49640 1 -- 172.21.15.22:0/3854510792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 msgr2=0x55d894938080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:12.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.386+0000 7f2020a49640 1 --2- 172.21.15.22:0/3854510792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 0x55d894938080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.386+0000 7f2020a49640 1 -- 172.21.15.22:0/3854510792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894567980 msgr2=0x55d894937b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:12.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.386+0000 7f2020a49640 1 --2- 172.21.15.22:0/3854510792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894567980 0x55d894937b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.386+0000 7f2020a49640 1 -- 172.21.15.22:0/3854510792 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d894824060 con 0x55d894590840 2024-09-21T04:03:12.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.387+0000 7f201bfff640 1 --2- 172.21.15.22:0/3854510792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894567980 0x55d894937b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:03:12.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.387+0000 7f2020a49640 1 --2- 172.21.15.22:0/3854510792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894590840 0x55d894937600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2014012440 tx=0x7f201400da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ade557f8a055291 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.387+0000 7f20197fa640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20040b6510 0x7f20040b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.387+0000 7f201bfff640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20040b6510 0x7f20040b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.387+0000 7f20027fc640 1 -- 172.21.15.22:0/3854510792 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201400d4e0 con 0x55d894590840 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.387+0000 7f20027fc640 1 -- 172.21.15.22:0/3854510792 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f201401d070 con 0x55d894590840 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.387+0000 7f20027fc640 1 -- 172.21.15.22:0/3854510792 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014018a80 con 0x55d894590840 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.387+0000 7f20197fa640 1 -- 172.21.15.22:0/716847303 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f200c107e40 con 0x7f201c102a80 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.388+0000 7f2028a20740 1 -- 172.21.15.22:0/3854510792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894590840 msgr2=0x55d894937600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.388+0000 7f201bfff640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20040b6510 0x7f20040b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f200c042f60 tx=0x7f200c10b920 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.388+0000 7f2028a20740 1 --2- 172.21.15.22:0/3854510792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894590840 0x55d894937600 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2014012440 tx=0x7f201400da60 comp rx=0 tx=0).stop 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.388+0000 7f2028a20740 1 -- 172.21.15.22:0/3854510792 shutdown_connections 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.388+0000 7f2028a20740 1 --2- 172.21.15.22:0/3854510792 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 0x55d894938080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.388+0000 7f2028a20740 1 --2- 172.21.15.22:0/3854510792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894567980 0x55d894937b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.388+0000 7f2028a20740 1 --2- 172.21.15.22:0/3854510792 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894590840 0x55d894937600 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.388+0000 7f2028a20740 1 -- 172.21.15.22:0/3854510792 >> 172.21.15.22:0/3854510792 conn(0x55d894584990 msgr2=0x55d8949354f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:12.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.388+0000 7f2028a20740 1 -- 172.21.15.22:0/3854510792 shutdown_connections 2024-09-21T04:03:12.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.388+0000 7f2028a20740 1 -- 172.21.15.22:0/3854510792 wait complete. 2024-09-21T04:03:12.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.389+0000 7f2028a20740 1 -- start start 2024-09-21T04:03:12.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.389+0000 7f2028a20740 1 Processor -- start 2024-09-21T04:03:12.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2028a20740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 0x55d8949431b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2028a20740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d89456fb60 0x55d8949436f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2028a20740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894590840 0x55d89494f070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2028a20740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d8946fe7a0 con 0x55d89456fb60 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2028a20740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d8948420a0 con 0x55d894590840 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2028a20740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d894945d80 con 0x55d894567980 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2028a20740 10 client.0 _ll_register_callbacks cb 0x55d89481f3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d89456fb60 0x55d8949436f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2020a49640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 0x55d8949431b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2020a49640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 0x55d8949431b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:42356/0 (socket says 172.21.15.22:42356) 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2020a49640 1 -- 172.21.15.22:0/3396748243 learned_addr learned my addr 172.21.15.22:0/3396748243 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d89456fb60 0x55d8949436f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39858/0 (socket says 172.21.15.22:39858) 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2020a49640 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894590840 0x55d89494f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2020a49640 1 -- 172.21.15.22:0/3396748243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894590840 msgr2=0x55d89494f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2020a49640 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894590840 0x55d89494f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2020a49640 1 -- 172.21.15.22:0/3396748243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d89456fb60 msgr2=0x55d8949436f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2020a49640 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d89456fb60 0x55d8949436f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.390+0000 7f2020a49640 1 -- 172.21.15.22:0/3396748243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d894830880 con 0x55d894567980 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.391+0000 7f2020a49640 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 0x55d8949431b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2014018760 tx=0x7f2014007040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c757ca498be772b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.391+0000 7f1ffb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.391+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3396748243 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014018a10 con 0x55d894567980 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.391+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3396748243 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f2014018bb0 con 0x55d894567980 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.391+0000 7f2028a20740 1 -- 172.21.15.22:0/3396748243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f201401d070 con 0x55d894567980 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.391+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3396748243 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2014018dd0 con 0x55d894567980 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.391+0000 7f2028a20740 10 client.25285 fetch_fsmap learned FSMap version 31 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.391+0000 7f2028a20740 1 -- 172.21.15.22:0/3396748243 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d89460ab90 con 0x55d894567980 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.391+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3396748243 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f201401d070 con 0x55d894567980 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.392+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3396748243 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 31) ==== 8386+0+0 (secure 0 0 0) 0x7f20140236a0 con 0x55d894567980 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.392+0000 7f2028a20740 10 client.25285 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.392+0000 7f2028a20740 10 client.25285 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.392+0000 7f2028a20740 20 client.25285 populate_metadata read hostname 'smithi022' 2024-09-21T04:03:12.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.392+0000 7f2028a20740 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d89454f1c0 0x55d894955520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.392+0000 7f2028a20740 4 client.25285 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:03:12.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.392+0000 7f2028a20740 1 -- 172.21.15.22:0/3396748243 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d8948afae0 con 0x55d89454f1c0 2024-09-21T04:03:12.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.392+0000 7f201b7fe640 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d89454f1c0 0x55d894955520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.392+0000 7f1ffb7fe640 10 client.25285 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:12.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.392+0000 7f201b7fe640 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d89454f1c0 0x55d894955520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a9c15825021c53c server_cookie=e54c4ba7d2c85241 in_seq=0 out_seq=0 2024-09-21T04:03:12.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3396748243 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d8948afae0 con 0x55d89454f1c0 2024-09-21T04:03:12.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f1ffb7fe640 10 client.25285 handle_command_reply: tid=0 2024-09-21T04:03:12.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f2028a20740 1 client.25285 shutdown 2024-09-21T04:03:12.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f2028a20740 1 -- 172.21.15.22:0/3396748243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 msgr2=0x55d8949431b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:12.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f2028a20740 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 0x55d8949431b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2014018760 tx=0x7f2014007040 comp rx=0 tx=0).stop 2024-09-21T04:03:12.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f2028a20740 1 -- 172.21.15.22:0/3396748243 shutdown_connections 2024-09-21T04:03:12.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f2028a20740 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d89454f1c0 0x55d894955520 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f2028a20740 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894590840 0x55d89494f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f2028a20740 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d89456fb60 0x55d8949436f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f2028a20740 1 --2- 172.21.15.22:0/3396748243 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 0x55d8949431b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.393+0000 7f2028a20740 1 -- 172.21.15.22:0/3396748243 >> 172.21.15.22:0/3396748243 conn(0x55d894584990 msgr2=0x55d89493a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:12.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.394+0000 7f1ffb7fe640 0 client.25285 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:12.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.394+0000 7f2028a20740 1 -- 172.21.15.22:0/3396748243 shutdown_connections 2024-09-21T04:03:12.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.394+0000 7f2028a20740 1 -- 172.21.15.22:0/3396748243 wait complete. 2024-09-21T04:03:12.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.394+0000 7f2028a20740 20 client.25285 trim_cache size 0 max 16384 2024-09-21T04:03:12.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.413+0000 7f2028a20740 1 Processor -- start 2024-09-21T04:03:12.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.413+0000 7f2028a20740 1 -- start start 2024-09-21T04:03:12.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2028a20740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 0x55d89493b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2028a20740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 0x55d894944be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2028a20740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 0x55d8949401a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2028a20740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1ae8d0 con 0x55d894590840 2024-09-21T04:03:12.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2028a20740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1b04d0 con 0x55d89456fb60 2024-09-21T04:03:12.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2028a20740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1aefa0 con 0x55d894567980 2024-09-21T04:03:12.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2020a49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 0x55d8949401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2020a49640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 0x55d8949401a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39864/0 (socket says 172.21.15.22:39864) 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2020a49640 1 -- 172.21.15.22:0/645559466 learned_addr learned my addr 172.21.15.22:0/645559466 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f201b7fe640 1 --2- 172.21.15.22:0/645559466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 0x55d894944be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2020a49640 1 --2- 172.21.15.22:0/645559466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 0x55d89493b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f201b7fe640 1 -- 172.21.15.22:0/645559466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 msgr2=0x55d89493b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f201b7fe640 1 --2- 172.21.15.22:0/645559466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 0x55d89493b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f201b7fe640 1 -- 172.21.15.22:0/645559466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 msgr2=0x55d8949401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f201b7fe640 1 --2- 172.21.15.22:0/645559466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 0x55d8949401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f201b7fe640 1 -- 172.21.15.22:0/645559466 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d894939b20 con 0x55d89456fb60 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f2020a49640 1 --2- 172.21.15.22:0/645559466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 0x55d8949401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.414+0000 7f201b7fe640 1 --2- 172.21.15.22:0/645559466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 0x55d894944be0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f201401a040 tx=0x7f2010011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c3ac77ebd140652 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.415+0000 7f2001ffb640 1 -- 172.21.15.22:0/645559466 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2010004030 con 0x55d89456fb60 2024-09-21T04:03:12.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.415+0000 7f2001ffb640 1 -- 172.21.15.22:0/645559466 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20100035f0 con 0x55d89456fb60 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.415+0000 7f2001ffb640 1 -- 172.21.15.22:0/645559466 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f201001c620 con 0x55d89456fb60 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.416+0000 7f2028a20740 1 -- 172.21.15.22:0/645559466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 msgr2=0x55d894944be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.416+0000 7f2028a20740 1 --2- 172.21.15.22:0/645559466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 0x55d894944be0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f201401a040 tx=0x7f2010011810 comp rx=0 tx=0).stop 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.416+0000 7f2028a20740 1 -- 172.21.15.22:0/645559466 shutdown_connections 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.416+0000 7f2028a20740 1 --2- 172.21.15.22:0/645559466 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 0x55d8949401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.416+0000 7f2028a20740 1 --2- 172.21.15.22:0/645559466 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d89456fb60 0x55d894944be0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.416+0000 7f2028a20740 1 --2- 172.21.15.22:0/645559466 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d894567980 0x55d89493b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.416+0000 7f2028a20740 1 -- 172.21.15.22:0/645559466 >> 172.21.15.22:0/645559466 conn(0x55d894584990 msgr2=0x55d8949444d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.416+0000 7f2028a20740 1 -- 172.21.15.22:0/645559466 shutdown_connections 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.416+0000 7f2028a20740 1 -- 172.21.15.22:0/645559466 wait complete. 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.416+0000 7f2028a20740 1 -- start start 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2028a20740 1 Processor -- start 2024-09-21T04:03:12.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2028a20740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894567980 0x55d89494b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2028a20740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d89456fb60 0x55d894947ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2028a20740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 0x55d894947ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2028a20740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1afd40 con 0x55d894590840 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2028a20740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1af670 con 0x55d894567980 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2028a20740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f201c1ac8b0 con 0x55d89456fb60 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2028a20740 10 client.0 _ll_register_callbacks cb 0x7f200c10b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2020a49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894567980 0x55d89494b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d89456fb60 0x55d894947ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2020a49640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894567980 0x55d89494b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:53234/0 (socket says 172.21.15.22:53234) 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f201b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d89456fb60 0x55d894947ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:42376/0 (socket says 172.21.15.22:42376) 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2020a49640 1 -- 172.21.15.22:0/3847803128 learned_addr learned my addr 172.21.15.22:0/3847803128 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.417+0000 7f2020a49640 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 0x55d894947ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f2020a49640 1 -- 172.21.15.22:0/3847803128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d89456fb60 msgr2=0x55d894947ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:12.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f2020a49640 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d89456fb60 0x55d894947ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f2020a49640 1 -- 172.21.15.22:0/3847803128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 msgr2=0x55d894947ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f2020a49640 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 0x55d894947ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f2020a49640 1 -- 172.21.15.22:0/3847803128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d8949485b0 con 0x55d894567980 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f201b7fe640 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d89456fb60 0x55d894947ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f2020a49640 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894567980 0x55d89494b5f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2014004b90 tx=0x7f201400df10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5894de4bc908131 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f1ffb7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3847803128 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2014023620 con 0x55d894567980 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3847803128 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f2014002030 con 0x55d894567980 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f2028a20740 1 -- 172.21.15.22:0/3847803128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f20100035f0 con 0x55d894567980 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3847803128 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f20140237c0 con 0x55d894567980 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f2028a20740 10 client.25313 fetch_fsmap learned FSMap version 31 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.418+0000 7f2028a20740 1 -- 172.21.15.22:0/3847803128 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55d8949c0c40 con 0x55d894567980 2024-09-21T04:03:12.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.419+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3847803128 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20100035f0 con 0x55d894567980 2024-09-21T04:03:12.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.419+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3847803128 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) ==== 8386+0+0 (secure 0 0 0) 0x7f20140225a0 con 0x55d894567980 2024-09-21T04:03:12.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.419+0000 7f2028a20740 10 client.25313 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T04:03:12.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.419+0000 7f2028a20740 10 client.25313 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:03:12.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.419+0000 7f2028a20740 20 client.25313 populate_metadata read hostname 'smithi022' 2024-09-21T04:03:12.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.419+0000 7f2028a20740 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d894524570 0x55d8949c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:12.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.419+0000 7f2028a20740 4 client.25313 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}] 2024-09-21T04:03:12.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.419+0000 7f2028a20740 1 -- 172.21.15.22:0/3847803128 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 134.5, "await_for": 45.0}) -- 0x55d8948ab590 con 0x55d894524570 2024-09-21T04:03:12.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.419+0000 7f201b7fe640 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d894524570 0x55d8949c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:12.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.419+0000 7f1ffb7fe640 10 client.25313 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:12.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.420+0000 7f201b7fe640 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d894524570 0x55d8949c33f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=708ced64a638c83e server_cookie=4671a31d03524c3d in_seq=0 out_seq=0 2024-09-21T04:03:12.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.795+0000 7f1ffb7fe640 1 -- 172.21.15.22:0/3847803128 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55d8948ab590 con 0x55d894524570 2024-09-21T04:03:12.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f1ffb7fe640 10 client.25313 handle_command_reply: tid=0 2024-09-21T04:03:12.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 client.25313 shutdown 2024-09-21T04:03:12.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 -- 172.21.15.22:0/3847803128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894567980 msgr2=0x55d89494b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:12.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894567980 0x55d89494b5f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2014004b90 tx=0x7f201400df10 comp rx=0 tx=0).stop 2024-09-21T04:03:12.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 -- 172.21.15.22:0/3847803128 shutdown_connections 2024-09-21T04:03:12.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d894524570 0x55d8949c33f0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d89456fb60 0x55d894947ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d894590840 0x55d894947ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 --2- 172.21.15.22:0/3847803128 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d894567980 0x55d89494b5f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f1ffb7fe640 0 client.25313 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 -- 172.21.15.22:0/3847803128 >> 172.21.15.22:0/3847803128 conn(0x55d894584990 msgr2=0x55d894941440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 -- 172.21.15.22:0/3847803128 shutdown_connections 2024-09-21T04:03:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 1 -- 172.21.15.22:0/3847803128 wait complete. 2024-09-21T04:03:12.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.796+0000 7f2028a20740 20 client.25313 trim_cache size 0 max 16384 2024-09-21T04:03:12.800 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:03:12.800 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 31, 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 2, 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "208b52ab": { 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 2, 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 134.5, 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:03:12.801 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:03:12.802 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:03:12.802 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:03:12.802 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:03:12.802 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:03:12.802 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:12.802 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:12.802 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:12.802 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:12.802 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:12.802 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:03:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 -- 172.21.15.22:0/716847303 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20040b6510 msgr2=0x7f20040b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20040b6510 0x7f20040b8a20 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f200c042f60 tx=0x7f200c10b920 comp rx=0 tx=0).stop 2024-09-21T04:03:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 -- 172.21.15.22:0/716847303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c102a80 msgr2=0x7f201c19a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c102a80 0x7f201c19a3f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f200c009230 tx=0x7f200c004270 comp rx=0 tx=0).stop 2024-09-21T04:03:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 -- 172.21.15.22:0/716847303 shutdown_connections 2024-09-21T04:03:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f20040b6510 0x7f20040b8a20 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f201c108d10 0x7f201c19fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f201c1083c0 0x7f201c19a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 --2- 172.21.15.22:0/716847303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f201c102a80 0x7f201c19a3f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:12.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 -- 172.21.15.22:0/716847303 >> 172.21.15.22:0/716847303 conn(0x7f201c079760 msgr2=0x7f201c101b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:12.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 -- 172.21.15.22:0/716847303 shutdown_connections 2024-09-21T04:03:12.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:12.797+0000 7f20224ac640 1 -- 172.21.15.22:0/716847303 wait complete. 2024-09-21T04:03:12.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:12 smithi060 ceph-mon[33722]: pgmap v396: 129 pgs: 129 active+clean; 151 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 17 MiB/s wr, 123 op/s 2024-09-21T04:03:13.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:12 smithi022 ceph-mon[31015]: pgmap v396: 129 pgs: 129 active+clean; 151 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 17 MiB/s wr, 123 op/s 2024-09-21T04:03:13.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:12 smithi073 ceph-mon[34443]: pgmap v396: 129 pgs: 129 active+clean; 151 MiB data, 502 MiB used, 1.0 TiB / 1.0 TiB avail; 511 KiB/s rd, 17 MiB/s wr, 123 op/s 2024-09-21T04:03:13.628 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '208b52ab', quiesce took 6.8 seconds. Will release after: 7.7 2024-09-21T04:03:14.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:14 smithi060 ceph-mon[33722]: pgmap v397: 129 pgs: 129 active+clean; 195 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 24 MiB/s wr, 120 op/s 2024-09-21T04:03:15.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:14 smithi022 ceph-mon[31015]: pgmap v397: 129 pgs: 129 active+clean; 195 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 24 MiB/s wr, 120 op/s 2024-09-21T04:03:15.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:14 smithi073 ceph-mon[34443]: pgmap v397: 129 pgs: 129 active+clean; 195 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 414 KiB/s rd, 24 MiB/s wr, 120 op/s 2024-09-21T04:03:16.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:15 smithi022 ceph-mon[31015]: pgmap v398: 129 pgs: 129 active+clean; 211 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 26 MiB/s wr, 62 op/s 2024-09-21T04:03:16.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:15 smithi073 ceph-mon[34443]: pgmap v398: 129 pgs: 129 active+clean; 211 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 26 MiB/s wr, 62 op/s 2024-09-21T04:03:16.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:15 smithi060 ceph-mon[33722]: pgmap v398: 129 pgs: 129 active+clean; 211 MiB data, 520 MiB used, 1.0 TiB / 1.0 TiB avail; 134 KiB/s rd, 26 MiB/s wr, 62 op/s 2024-09-21T04:03:18.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:18 smithi022 ceph-mon[31015]: pgmap v399: 129 pgs: 129 active+clean; 221 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 27 MiB/s wr, 41 op/s 2024-09-21T04:03:18.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:18 smithi073 ceph-mon[34443]: pgmap v399: 129 pgs: 129 active+clean; 221 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 27 MiB/s wr, 41 op/s 2024-09-21T04:03:18.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:18 smithi060 ceph-mon[33722]: pgmap v399: 129 pgs: 129 active+clean; 221 MiB data, 526 MiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 27 MiB/s wr, 41 op/s 2024-09-21T04:03:20.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:20 smithi022 ceph-mon[31015]: pgmap v400: 129 pgs: 129 active+clean; 227 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 27 MiB/s wr, 40 op/s 2024-09-21T04:03:20.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:20 smithi073 ceph-mon[34443]: pgmap v400: 129 pgs: 129 active+clean; 227 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 27 MiB/s wr, 40 op/s 2024-09-21T04:03:20.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:20 smithi060 ceph-mon[33722]: pgmap v400: 129 pgs: 129 active+clean; 227 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 27 MiB/s wr, 40 op/s 2024-09-21T04:03:21.330 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:03:21.603 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:22.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.106+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1908078109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39a4109e20 msgr2=0x7f39a4110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:22.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.106+0000 7f39aa8d9640 1 --2- 172.21.15.22:0/1908078109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39a4109e20 0x7f39a4110650 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f399c009ca0 tx=0x7f399c02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:03:22.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.106+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1908078109 shutdown_connections 2024-09-21T04:03:22.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.106+0000 7f39aa8d9640 1 --2- 172.21.15.22:0/1908078109 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a41094d0 0x7f39a41098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:22.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.106+0000 7f39aa8d9640 1 --2- 172.21.15.22:0/1908078109 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39a4109e20 0x7f39a4110650 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:22.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.106+0000 7f39aa8d9640 1 --2- 172.21.15.22:0/1908078109 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4103b90 0x7f39a4103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.106+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1908078109 >> 172.21.15.22:0/1908078109 conn(0x7f39a40ff600 msgr2=0x7f39a4101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.106+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1908078109 shutdown_connections 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.106+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1908078109 wait complete. 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39aa8d9640 1 Processor -- start 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39aa8d9640 1 -- start start 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39aa8d9640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4103b90 0x7f39a4075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39aa8d9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39a41094d0 0x7f39a4075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39aa8d9640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4109e20 0x7f39a4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39aa8d9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f39a41139e0 con 0x7f39a41094d0 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39aa8d9640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4113860 con 0x7f39a4103b90 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39aa8d9640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f39a4113b60 con 0x7f39a4109e20 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f399bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39a41094d0 0x7f39a4075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:22.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f399bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39a41094d0 0x7f39a4075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36354/0 (socket says 172.21.15.22:36354) 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f399bfff640 1 -- 172.21.15.22:0/1474339444 learned_addr learned my addr 172.21.15.22:0/1474339444 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39a3fff640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4103b90 0x7f39a4075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39a8e76640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4109e20 0x7f39a4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f399bfff640 1 -- 172.21.15.22:0/1474339444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4109e20 msgr2=0x7f39a4076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f399bfff640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4109e20 0x7f39a4076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f399bfff640 1 -- 172.21.15.22:0/1474339444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4103b90 msgr2=0x7f39a4075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f399bfff640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4103b90 0x7f39a4075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f399bfff640 1 -- 172.21.15.22:0/1474339444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39a41a8730 con 0x7f39a41094d0 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.107+0000 7f39a8e76640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4109e20 0x7f39a4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.108+0000 7f399bfff640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39a41094d0 0x7f39a4075c50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f398c00d740 tx=0x7f398c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.108+0000 7f39a1ffb640 1 -- 172.21.15.22:0/1474339444 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c017070 con 0x7f39a41094d0 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.108+0000 7f39a1ffb640 1 -- 172.21.15.22:0/1474339444 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f398c00de50 con 0x7f39a41094d0 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.108+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1474339444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39a41a8a20 con 0x7f39a41094d0 2024-09-21T04:03:22.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.108+0000 7f39a1ffb640 1 -- 172.21.15.22:0/1474339444 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c00f620 con 0x7f39a41094d0 2024-09-21T04:03:22.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.108+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1474339444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39a41a8fb0 con 0x7f39a41094d0 2024-09-21T04:03:22.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.109+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1474339444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39a4103fa0 con 0x7f39a41094d0 2024-09-21T04:03:22.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.112+0000 7f39a1ffb640 1 -- 172.21.15.22:0/1474339444 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f398c01a070 con 0x7f39a41094d0 2024-09-21T04:03:22.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.113+0000 7f39a1ffb640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39900b6590 0x7f39900b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:22.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.113+0000 7f39a1ffb640 1 -- 172.21.15.22:0/1474339444 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f398c0e7090 con 0x7f39a41094d0 2024-09-21T04:03:22.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.113+0000 7f39a3fff640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39900b6590 0x7f39900b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:22.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.113+0000 7f39a3fff640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39900b6590 0x7f39900b8aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f39a4077160 tx=0x7f3994005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:22.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.116+0000 7f39a1ffb640 1 -- 172.21.15.22:0/1474339444 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f398c0ad580 con 0x7f39a41094d0 2024-09-21T04:03:22.299 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:22 smithi022 ceph-mon[31015]: pgmap v401: 129 pgs: 129 active+clean; 227 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 30 op/s 2024-09-21T04:03:22.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.346+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1474339444 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39a4076a10 con 0x7f39a41094d0 2024-09-21T04:03:22.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.346+0000 7f39a1ffb640 1 -- 172.21.15.22:0/1474339444 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11966 (secure 0 0 0) 0x7f398c0b1960 con 0x7f39a41094d0 2024-09-21T04:03:22.350 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:22.350 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"btime":"2024-09-21T04:02:58:477506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:02:58.268873+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:03:22.350 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 31 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1474339444 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39900b6590 msgr2=0x7f39900b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39900b6590 0x7f39900b8aa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f39a4077160 tx=0x7f3994005f90 comp rx=0 tx=0).stop 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1474339444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39a41094d0 msgr2=0x7f39a4075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39a41094d0 0x7f39a4075c50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f398c00d740 tx=0x7f398c00dc00 comp rx=0 tx=0).stop 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1474339444 shutdown_connections 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39900b6590 0x7f39900b8aa0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f39a4109e20 0x7f39a4076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39a41094d0 0x7f39a4075c50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 --2- 172.21.15.22:0/1474339444 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f39a4103b90 0x7f39a4075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1474339444 >> 172.21.15.22:0/1474339444 conn(0x7f39a40ff600 msgr2=0x7f39a4101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1474339444 shutdown_connections 2024-09-21T04:03:22.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:22.349+0000 7f39aa8d9640 1 -- 172.21.15.22:0/1474339444 wait complete. 2024-09-21T04:03:22.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:22 smithi073 ceph-mon[34443]: pgmap v401: 129 pgs: 129 active+clean; 227 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 30 op/s 2024-09-21T04:03:22.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:22 smithi060 ceph-mon[33722]: pgmap v401: 129 pgs: 129 active+clean; 227 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 22 MiB/s wr, 30 op/s 2024-09-21T04:03:23.114 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id 208b52ab --release --await' 2024-09-21T04:03:23.114 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id 208b52ab --release --await 2024-09-21T04:03:23.328 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:23 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1474339444' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:23.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:23 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1474339444' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:23.378 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:23.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:23 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1474339444' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:23.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.904+0000 7f559d24a640 1 -- 172.21.15.22:0/2548542303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5598108d20 msgr2=0x7f559810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.904+0000 7f559d24a640 1 --2- 172.21.15.22:0/2548542303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5598108d20 0x7f559810f550 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5590009ca0 tx=0x7f559002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.904+0000 7f559d24a640 1 -- 172.21.15.22:0/2548542303 shutdown_connections 2024-09-21T04:03:23.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.904+0000 7f559d24a640 1 --2- 172.21.15.22:0/2548542303 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5598108d20 0x7f559810f550 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.904+0000 7f559d24a640 1 --2- 172.21.15.22:0/2548542303 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f55981083d0 0x7f55981087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.904+0000 7f559d24a640 1 --2- 172.21.15.22:0/2548542303 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5598102ae0 0x7f5598102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.904+0000 7f559d24a640 1 -- 172.21.15.22:0/2548542303 >> 172.21.15.22:0/2548542303 conn(0x7f5598079760 msgr2=0x7f5598079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.904+0000 7f559d24a640 1 -- 172.21.15.22:0/2548542303 shutdown_connections 2024-09-21T04:03:23.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.904+0000 7f559d24a640 1 -- 172.21.15.22:0/2548542303 wait complete. 2024-09-21T04:03:23.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.905+0000 7f559d24a640 1 Processor -- start 2024-09-21T04:03:23.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.905+0000 7f559d24a640 1 -- start start 2024-09-21T04:03:23.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559d24a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5598102ae0 0x7f559819a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559d24a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55981083d0 0x7f559819a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559d24a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5598108d20 0x7f559819fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559d24a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5598112890 con 0x7f5598108d20 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559d24a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5598112710 con 0x7f5598102ae0 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559d24a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5598112a10 con 0x7f55981083d0 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5598108d20 0x7f559819fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5598108d20 0x7f559819fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36370/0 (socket says 172.21.15.22:36370) 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559759e640 1 -- 172.21.15.22:0/4155852473 learned_addr learned my addr 172.21.15.22:0/4155852473 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f5596d9d640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5598102ae0 0x7f559819a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559659c640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55981083d0 0x7f559819a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559759e640 1 -- 172.21.15.22:0/4155852473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55981083d0 msgr2=0x7f559819a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559759e640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55981083d0 0x7f559819a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559759e640 1 -- 172.21.15.22:0/4155852473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5598102ae0 msgr2=0x7f559819a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559759e640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5598102ae0 0x7f559819a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559759e640 1 -- 172.21.15.22:0/4155852473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55981a02a0 con 0x7f5598108d20 2024-09-21T04:03:23.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.906+0000 7f559759e640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5598108d20 0x7f559819fb70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5590005cc0 tx=0x7f5590032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.907+0000 7f557ffff640 1 -- 172.21.15.22:0/4155852473 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590032e00 con 0x7f5598108d20 2024-09-21T04:03:23.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.907+0000 7f559d24a640 1 -- 172.21.15.22:0/4155852473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55981a0530 con 0x7f5598108d20 2024-09-21T04:03:23.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.907+0000 7f557ffff640 1 -- 172.21.15.22:0/4155852473 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f55900044d0 con 0x7f5598108d20 2024-09-21T04:03:23.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.907+0000 7f557ffff640 1 -- 172.21.15.22:0/4155852473 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590030b70 con 0x7f5598108d20 2024-09-21T04:03:23.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.907+0000 7f559d24a640 1 -- 172.21.15.22:0/4155852473 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55981a6cf0 con 0x7f5598108d20 2024-09-21T04:03:23.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.910+0000 7f55a37be740 1 Processor -- start 2024-09-21T04:03:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.910+0000 7f557ffff640 1 -- 172.21.15.22:0/4155852473 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f559004e440 con 0x7f5598108d20 2024-09-21T04:03:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.910+0000 7f55a37be740 1 -- start start 2024-09-21T04:03:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f55a37be740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 0x56220e503510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f55a37be740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 0x56220e503a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f55a37be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e503f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f55a37be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56220e3eedc0 con 0x56220e13c840 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f55a37be740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56220e47b1f0 con 0x56220e15d520 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f55a37be740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56220e46a620 con 0x56220e134660 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f559659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e503f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f559659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e503f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36372/0 (socket says 172.21.15.22:36372) 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f559659c640 1 -- 172.21.15.22:0/3515353245 learned_addr learned my addr 172.21.15.22:0/3515353245 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f559659c640 1 --2- 172.21.15.22:0/3515353245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 0x56220e503510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f5596d9d640 1 --2- 172.21.15.22:0/3515353245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 0x56220e503a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f559659c640 1 -- 172.21.15.22:0/3515353245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 msgr2=0x56220e503a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f559659c640 1 --2- 172.21.15.22:0/3515353245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 0x56220e503a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f559659c640 1 -- 172.21.15.22:0/3515353245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 msgr2=0x56220e503510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f559659c640 1 --2- 172.21.15.22:0/3515353245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 0x56220e503510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f559659c640 1 -- 172.21.15.22:0/3515353245 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56220e432fd0 con 0x56220e13c840 2024-09-21T04:03:23.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f557ffff640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f55800b6510 0x7f55800b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f5596d9d640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f55800b6510 0x7f55800b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.911+0000 7f559659c640 1 --2- 172.21.15.22:0/3515353245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e503f90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f558c011700 tx=0x7f558c00a680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1513d3c73d1aa571 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.912+0000 7f557ffff640 1 -- 172.21.15.22:0/4155852473 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f5590108900 con 0x7f5598108d20 2024-09-21T04:03:23.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.912+0000 7f557d7fa640 1 -- 172.21.15.22:0/3515353245 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c004020 con 0x56220e13c840 2024-09-21T04:03:23.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.912+0000 7f557d7fa640 1 -- 172.21.15.22:0/3515353245 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f558c0054b0 con 0x56220e13c840 2024-09-21T04:03:23.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.912+0000 7f557d7fa640 1 -- 172.21.15.22:0/3515353245 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c0049a0 con 0x56220e13c840 2024-09-21T04:03:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 -- 172.21.15.22:0/3515353245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 msgr2=0x56220e503f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 --2- 172.21.15.22:0/3515353245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e503f90 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f558c011700 tx=0x7f558c00a680 comp rx=0 tx=0).stop 2024-09-21T04:03:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f5596d9d640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f55800b6510 0x7f55800b8a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56220e502190 tx=0x7f558800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 -- 172.21.15.22:0/3515353245 shutdown_connections 2024-09-21T04:03:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 --2- 172.21.15.22:0/3515353245 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 0x56220e503a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 --2- 172.21.15.22:0/3515353245 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e503f90 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 --2- 172.21.15.22:0/3515353245 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 0x56220e503510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 -- 172.21.15.22:0/3515353245 >> 172.21.15.22:0/3515353245 conn(0x56220e151910 msgr2=0x56220e501400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 -- 172.21.15.22:0/3515353245 shutdown_connections 2024-09-21T04:03:23.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 -- 172.21.15.22:0/3515353245 wait complete. 2024-09-21T04:03:23.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 -- start start 2024-09-21T04:03:23.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.913+0000 7f55a37be740 1 Processor -- start 2024-09-21T04:03:23.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f55a37be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e134660 0x56220e50ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f55a37be740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e13c840 0x56220e50f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f55a37be740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e15d520 0x56220e51ae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f55a37be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56220e405300 con 0x56220e134660 2024-09-21T04:03:23.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f55a37be740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56220e46e430 con 0x56220e13c840 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f55a37be740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56220e2cbbb0 con 0x56220e15d520 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f5596d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e134660 0x56220e50ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f5596d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e134660 0x56220e50ebf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36380/0 (socket says 172.21.15.22:36380) 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f5596d9d640 1 -- 172.21.15.22:0/3831000553 learned_addr learned my addr 172.21.15.22:0/3831000553 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f55a37be740 10 client.0 _ll_register_callbacks cb 0x56220e41f120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f559759e640 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e15d520 0x56220e51ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f559659c640 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e13c840 0x56220e50f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f5596d9d640 1 -- 172.21.15.22:0/3831000553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e15d520 msgr2=0x56220e51ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f5596d9d640 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e15d520 0x56220e51ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f5596d9d640 1 -- 172.21.15.22:0/3831000553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e13c840 msgr2=0x56220e50f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f5596d9d640 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e13c840 0x56220e50f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f5596d9d640 1 -- 172.21.15.22:0/3831000553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56220e3f4780 con 0x56220e134660 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f559659c640 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e13c840 0x56220e50f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f5596d9d640 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e134660 0x56220e50ebf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5588003d30 tx=0x7f55880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c354c1405566f559 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.914+0000 7f557aff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.915+0000 7f557aff5640 1 -- 172.21.15.22:0/3831000553 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558802c060 con 0x56220e134660 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.915+0000 7f557aff5640 1 -- 172.21.15.22:0/3831000553 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f5588017030 con 0x56220e134660 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.915+0000 7f55a37be740 1 -- 172.21.15.22:0/3831000553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f558c0054b0 con 0x56220e134660 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.915+0000 7f557aff5640 1 -- 172.21.15.22:0/3831000553 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5588033050 con 0x56220e134660 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.915+0000 7f55a37be740 10 client.15666 fetch_fsmap learned FSMap version 31 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.915+0000 7f55a37be740 1 -- 172.21.15.22:0/3831000553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56220e1c8b00 con 0x56220e134660 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.915+0000 7f557aff5640 1 -- 172.21.15.22:0/3831000553 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f558c0054b0 con 0x56220e134660 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.916+0000 7f557aff5640 1 -- 172.21.15.22:0/3831000553 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8386+0+0 (secure 0 0 0) 0x7f558801c3f0 con 0x56220e134660 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.916+0000 7f55a37be740 10 client.15666 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.916+0000 7f55a37be740 10 client.15666 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:03:23.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.916+0000 7f55a37be740 20 client.15666 populate_metadata read hostname 'smithi022' 2024-09-21T04:03:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.916+0000 7f55a37be740 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56220e11bea0 0x56220e5210b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.916+0000 7f55a37be740 4 client.15666 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:03:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.916+0000 7f55a37be740 1 -- 172.21.15.22:0/3831000553 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56220e47d140 con 0x56220e11bea0 2024-09-21T04:03:23.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.916+0000 7f559659c640 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56220e11bea0 0x56220e5210b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.917+0000 7f559659c640 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56220e11bea0 0x56220e5210b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a3fe02286289ccf7 server_cookie=804f6931b9cb0bf7 in_seq=0 out_seq=0 2024-09-21T04:03:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.917+0000 7f557aff5640 10 client.15666 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f557aff5640 1 -- 172.21.15.22:0/3831000553 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56220e47d140 con 0x56220e11bea0 2024-09-21T04:03:23.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f557aff5640 10 client.15666 handle_command_reply: tid=0 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 client.15666 shutdown 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 -- 172.21.15.22:0/3831000553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e134660 msgr2=0x56220e50ebf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e134660 0x56220e50ebf0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5588003d30 tx=0x7f55880046c0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 -- 172.21.15.22:0/3831000553 shutdown_connections 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56220e11bea0 0x56220e5210b0 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e15d520 0x56220e51ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e13c840 0x56220e50f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 --2- 172.21.15.22:0/3831000553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e134660 0x56220e50ebf0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 -- 172.21.15.22:0/3831000553 >> 172.21.15.22:0/3831000553 conn(0x56220e151910 msgr2=0x56220e5066a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f557aff5640 0 client.15666 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 -- 172.21.15.22:0/3831000553 shutdown_connections 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 1 -- 172.21.15.22:0/3831000553 wait complete. 2024-09-21T04:03:23.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.918+0000 7f55a37be740 20 client.15666 trim_cache size 0 max 16384 2024-09-21T04:03:23.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.935+0000 7f55a37be740 1 Processor -- start 2024-09-21T04:03:23.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.935+0000 7f55a37be740 1 -- start start 2024-09-21T04:03:23.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f55a37be740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e134660 0x56220e50a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f55a37be740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e13c840 0x56220e504f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f55a37be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e15d520 0x56220e50d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f55a37be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f55981b0a40 con 0x56220e15d520 2024-09-21T04:03:23.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f55a37be740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f55981b2640 con 0x56220e134660 2024-09-21T04:03:23.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f55a37be740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f55981b1110 con 0x56220e13c840 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f559759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e15d520 0x56220e50d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f559759e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e15d520 0x56220e50d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36394/0 (socket says 172.21.15.22:36394) 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f559759e640 1 -- 172.21.15.22:0/1862420066 learned_addr learned my addr 172.21.15.22:0/1862420066 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f5596d9d640 1 --2- 172.21.15.22:0/1862420066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e134660 0x56220e50a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f559659c640 1 --2- 172.21.15.22:0/1862420066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e13c840 0x56220e504f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f559759e640 1 -- 172.21.15.22:0/1862420066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e13c840 msgr2=0x56220e504f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f559759e640 1 --2- 172.21.15.22:0/1862420066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e13c840 0x56220e504f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f559759e640 1 -- 172.21.15.22:0/1862420066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e134660 msgr2=0x56220e50a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f559759e640 1 --2- 172.21.15.22:0/1862420066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e134660 0x56220e50a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f559759e640 1 -- 172.21.15.22:0/1862420066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56220e508d00 con 0x56220e15d520 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f5596d9d640 1 --2- 172.21.15.22:0/1862420066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e134660 0x56220e50a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f559759e640 1 --2- 172.21.15.22:0/1862420066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e15d520 0x56220e50d470 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5590030670 tx=0x7f55900ce560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1a6757cc853d20 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.936+0000 7f557cff9640 1 -- 172.21.15.22:0/1862420066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55900ce1e0 con 0x56220e15d520 2024-09-21T04:03:23.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f557cff9640 1 -- 172.21.15.22:0/1862420066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5590036040 con 0x56220e15d520 2024-09-21T04:03:23.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f557cff9640 1 -- 172.21.15.22:0/1862420066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5590004680 con 0x56220e15d520 2024-09-21T04:03:23.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f55a37be740 1 -- 172.21.15.22:0/1862420066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e15d520 msgr2=0x56220e50d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f55a37be740 1 --2- 172.21.15.22:0/1862420066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e15d520 0x56220e50d470 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5590030670 tx=0x7f55900ce560 comp rx=0 tx=0).stop 2024-09-21T04:03:23.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f55a37be740 1 -- 172.21.15.22:0/1862420066 shutdown_connections 2024-09-21T04:03:23.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f55a37be740 1 --2- 172.21.15.22:0/1862420066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e13c840 0x56220e504f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f55a37be740 1 --2- 172.21.15.22:0/1862420066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e15d520 0x56220e50d470 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f55a37be740 1 --2- 172.21.15.22:0/1862420066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e134660 0x56220e50a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f55a37be740 1 -- 172.21.15.22:0/1862420066 >> 172.21.15.22:0/1862420066 conn(0x56220e151910 msgr2=0x56220e50e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f55a37be740 1 -- 172.21.15.22:0/1862420066 shutdown_connections 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.937+0000 7f55a37be740 1 -- 172.21.15.22:0/1862420066 wait complete. 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f55a37be740 1 -- start start 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f55a37be740 1 Processor -- start 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f55a37be740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 0x56220e522360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f55a37be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e5228a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f55a37be740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 0x56220e58a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f55a37be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f55981b1eb0 con 0x56220e13c840 2024-09-21T04:03:23.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f55a37be740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f55981b17e0 con 0x56220e15d520 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f55a37be740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f55981aea20 con 0x56220e134660 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f55a37be740 10 client.0 _ll_register_callbacks cb 0x7f5588004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f559659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e5228a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f5596d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 0x56220e522360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f559659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e5228a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36400/0 (socket says 172.21.15.22:36400) 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f559759e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 0x56220e58a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.938+0000 7f5596d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 0x56220e522360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:37374/0 (socket says 172.21.15.22:37374) 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f559659c640 1 -- 172.21.15.22:0/3218633707 learned_addr learned my addr 172.21.15.22:0/3218633707 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f559659c640 1 -- 172.21.15.22:0/3218633707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 msgr2=0x56220e522360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f559659c640 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 0x56220e522360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f559659c640 1 -- 172.21.15.22:0/3218633707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 msgr2=0x56220e58a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f559659c640 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 0x56220e58a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f559659c640 1 -- 172.21.15.22:0/3218633707 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56220e23f960 con 0x56220e13c840 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f559759e640 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 0x56220e58a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f557aff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f559659c640 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e5228a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f558c00a620 tx=0x7f558c00a6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d3b830d87447c19 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f557aff5640 1 -- 172.21.15.22:0/3218633707 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f558c02b070 con 0x56220e13c840 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f557aff5640 1 -- 172.21.15.22:0/3218633707 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f558c005c40 con 0x56220e13c840 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f55a37be740 1 -- 172.21.15.22:0/3218633707 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5590036040 con 0x56220e13c840 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f557aff5640 1 -- 172.21.15.22:0/3218633707 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f558c037050 con 0x56220e13c840 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.939+0000 7f55a37be740 10 client.15672 fetch_fsmap learned FSMap version 31 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.940+0000 7f55a37be740 1 -- 172.21.15.22:0/3218633707 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56220e58bdb0 con 0x56220e13c840 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.940+0000 7f557aff5640 1 -- 172.21.15.22:0/3218633707 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5590036040 con 0x56220e13c840 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.940+0000 7f557aff5640 1 -- 172.21.15.22:0/3218633707 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8386+0+0 (secure 0 0 0) 0x7f558c00fd00 con 0x56220e13c840 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.940+0000 7f55a37be740 10 client.15672 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T04:03:23.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.940+0000 7f55a37be740 10 client.15672 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:03:23.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.940+0000 7f55a37be740 20 client.15672 populate_metadata read hostname 'smithi022' 2024-09-21T04:03:23.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.940+0000 7f55a37be740 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56220e0f1250 0x56220e58e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:23.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.940+0000 7f55a37be740 4 client.15672 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "208b52ab", "release": true, "await": true}] 2024-09-21T04:03:23.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.940+0000 7f55a37be740 1 -- 172.21.15.22:0/3218633707 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "208b52ab", "release": true, "await": true}) -- 0x56220e478bf0 con 0x56220e0f1250 2024-09-21T04:03:23.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.940+0000 7f5596d9d640 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56220e0f1250 0x56220e58e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:23.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.941+0000 7f557aff5640 10 client.15672 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:23.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.941+0000 7f5596d9d640 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56220e0f1250 0x56220e58e400 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52ec0056bc6990f server_cookie=93d6779d7b368f37 in_seq=0 out_seq=0 2024-09-21T04:03:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.989+0000 7f557aff5640 1 -- 172.21.15.22:0/3218633707 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56220e478bf0 con 0x56220e0f1250 2024-09-21T04:03:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.989+0000 7f557aff5640 10 client.15672 handle_command_reply: tid=0 2024-09-21T04:03:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.989+0000 7f55a37be740 1 client.15672 shutdown 2024-09-21T04:03:23.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.989+0000 7f55a37be740 1 -- 172.21.15.22:0/3218633707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 msgr2=0x56220e5228a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.989+0000 7f55a37be740 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e5228a0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f558c00a620 tx=0x7f558c00a6a0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.989+0000 7f55a37be740 1 -- 172.21.15.22:0/3218633707 shutdown_connections 2024-09-21T04:03:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.990+0000 7f55a37be740 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56220e0f1250 0x56220e58e400 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.990+0000 7f55a37be740 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56220e15d520 0x56220e58a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.990+0000 7f55a37be740 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56220e13c840 0x56220e5228a0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.990+0000 7f55a37be740 1 --2- 172.21.15.22:0/3218633707 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56220e134660 0x56220e522360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.990+0000 7f557aff5640 0 client.15672 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.990+0000 7f55a37be740 1 -- 172.21.15.22:0/3218633707 >> 172.21.15.22:0/3218633707 conn(0x56220e151910 msgr2=0x56220e50e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.990+0000 7f55a37be740 1 -- 172.21.15.22:0/3218633707 shutdown_connections 2024-09-21T04:03:23.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.990+0000 7f55a37be740 1 -- 172.21.15.22:0/3218633707 wait complete. 2024-09-21T04:03:23.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.990+0000 7f55a37be740 20 client.15672 trim_cache size 0 max 16384 2024-09-21T04:03:23.994 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:03:23.994 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 31, 2024-09-21T04:03:23.994 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:03:23.994 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 4, 2024-09-21T04:03:23.994 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:03:23.994 INFO:teuthology.orchestra.run.smithi022.stdout: "208b52ab": { 2024-09-21T04:03:23.994 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 4, 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 134.5, 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:03:23.995 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:23.996 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:23.996 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:23.996 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:23.996 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:23.996 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:03:23.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 -- 172.21.15.22:0/4155852473 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f55800b6510 msgr2=0x7f55800b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f55800b6510 0x7f55800b8a20 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x56220e502190 tx=0x7f558800b390 comp rx=0 tx=0).stop 2024-09-21T04:03:23.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 -- 172.21.15.22:0/4155852473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5598108d20 msgr2=0x7f559819fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:23.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5598108d20 0x7f559819fb70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5590005cc0 tx=0x7f5590032a10 comp rx=0 tx=0).stop 2024-09-21T04:03:23.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 -- 172.21.15.22:0/4155852473 shutdown_connections 2024-09-21T04:03:23.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f55800b6510 0x7f55800b8a20 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f55981083d0 0x7f559819a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5598108d20 0x7f559819fb70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 --2- 172.21.15.22:0/4155852473 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5598102ae0 0x7f559819a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:23.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 -- 172.21.15.22:0/4155852473 >> 172.21.15.22:0/4155852473 conn(0x7f5598079760 msgr2=0x7f5598101aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:23.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 -- 172.21.15.22:0/4155852473 shutdown_connections 2024-09-21T04:03:23.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:23.991+0000 7f559d24a640 1 -- 172.21.15.22:0/4155852473 wait complete. 2024-09-21T04:03:24.091 INFO:teuthology.orchestra.run.smithi022.stderr:800000 of 3200000 tuples (25%) done (elapsed 20.21 s, remaining 60.63 s) 2024-09-21T04:03:24.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:24 smithi022 ceph-mon[31015]: pgmap v402: 129 pgs: 129 active+clean; 229 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 24 op/s 2024-09-21T04:03:24.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:24 smithi073 ceph-mon[34443]: pgmap v402: 129 pgs: 129 active+clean; 229 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 24 op/s 2024-09-21T04:03:24.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:24 smithi060 ceph-mon[33722]: pgmap v402: 129 pgs: 129 active+clean; 229 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 24 op/s 2024-09-21T04:03:24.692 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '208b52ab', total seconds elapsed: 17.9 2024-09-21T04:03:24.921 INFO:teuthology.orchestra.run.smithi022.stderr:900000 of 3200000 tuples (28%) done (elapsed 21.04 s, remaining 53.77 s) 2024-09-21T04:03:26.130 INFO:teuthology.orchestra.run.smithi022.stderr:1000000 of 3200000 tuples (31%) done (elapsed 22.25 s, remaining 48.95 s) 2024-09-21T04:03:26.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:26 smithi022 ceph-mon[31015]: pgmap v403: 129 pgs: 129 active+clean; 233 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-09-21T04:03:26.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:26 smithi073 ceph-mon[34443]: pgmap v403: 129 pgs: 129 active+clean; 233 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-09-21T04:03:26.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:26 smithi060 ceph-mon[33722]: pgmap v403: 129 pgs: 129 active+clean; 233 MiB data, 528 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.7 MiB/s wr, 15 op/s 2024-09-21T04:03:27.391 INFO:teuthology.orchestra.run.smithi022.stderr:1100000 of 3200000 tuples (34%) done (elapsed 23.51 s, remaining 44.88 s) 2024-09-21T04:03:28.227 INFO:teuthology.orchestra.run.smithi022.stderr:1200000 of 3200000 tuples (37%) done (elapsed 24.35 s, remaining 40.58 s) 2024-09-21T04:03:28.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:28 smithi022 ceph-mon[31015]: pgmap v404: 129 pgs: 129 active+clean; 257 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 15 op/s 2024-09-21T04:03:28.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:28 smithi073 ceph-mon[34443]: pgmap v404: 129 pgs: 129 active+clean; 257 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 15 op/s 2024-09-21T04:03:28.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:28 smithi060 ceph-mon[33722]: pgmap v404: 129 pgs: 129 active+clean; 257 MiB data, 532 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.2 MiB/s wr, 15 op/s 2024-09-21T04:03:29.465 INFO:teuthology.orchestra.run.smithi022.stderr:1300000 of 3200000 tuples (40%) done (elapsed 25.59 s, remaining 37.39 s) 2024-09-21T04:03:30.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:30 smithi022 ceph-mon[31015]: pgmap v405: 129 pgs: 129 active+clean; 275 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.9 MiB/s wr, 19 op/s 2024-09-21T04:03:30.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:30 smithi073 ceph-mon[34443]: pgmap v405: 129 pgs: 129 active+clean; 275 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.9 MiB/s wr, 19 op/s 2024-09-21T04:03:30.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:30 smithi060 ceph-mon[33722]: pgmap v405: 129 pgs: 129 active+clean; 275 MiB data, 541 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 8.9 MiB/s wr, 19 op/s 2024-09-21T04:03:30.729 INFO:teuthology.orchestra.run.smithi022.stderr:1400000 of 3200000 tuples (43%) done (elapsed 26.85 s, remaining 34.52 s) 2024-09-21T04:03:31.583 INFO:teuthology.orchestra.run.smithi022.stderr:1500000 of 3200000 tuples (46%) done (elapsed 27.70 s, remaining 31.40 s) 2024-09-21T04:03:32.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:32 smithi022 ceph-mon[31015]: pgmap v406: 129 pgs: 129 active+clean; 323 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 22 op/s 2024-09-21T04:03:32.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:32 smithi073 ceph-mon[34443]: pgmap v406: 129 pgs: 129 active+clean; 323 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 22 op/s 2024-09-21T04:03:32.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:32 smithi060 ceph-mon[33722]: pgmap v406: 129 pgs: 129 active+clean; 323 MiB data, 557 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 16 MiB/s wr, 22 op/s 2024-09-21T04:03:32.891 INFO:teuthology.orchestra.run.smithi022.stderr:1600000 of 3200000 tuples (50%) done (elapsed 29.01 s, remaining 29.01 s) 2024-09-21T04:03:33.677 INFO:teuthology.orchestra.run.smithi022.stderr:1700000 of 3200000 tuples (53%) done (elapsed 29.80 s, remaining 26.29 s) 2024-09-21T04:03:34.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:34 smithi022 ceph-mon[31015]: pgmap v407: 129 pgs: 129 active+clean; 366 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 23 MiB/s wr, 29 op/s 2024-09-21T04:03:34.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:34 smithi073 ceph-mon[34443]: pgmap v407: 129 pgs: 129 active+clean; 366 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 23 MiB/s wr, 29 op/s 2024-09-21T04:03:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:34 smithi060 ceph-mon[33722]: pgmap v407: 129 pgs: 129 active+clean; 366 MiB data, 568 MiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 23 MiB/s wr, 29 op/s 2024-09-21T04:03:34.908 INFO:teuthology.orchestra.run.smithi022.stderr:1800000 of 3200000 tuples (56%) done (elapsed 31.03 s, remaining 24.13 s) 2024-09-21T04:03:36.144 INFO:teuthology.orchestra.run.smithi022.stderr:1900000 of 3200000 tuples (59%) done (elapsed 32.26 s, remaining 22.08 s) 2024-09-21T04:03:36.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:36 smithi022 ceph-mon[31015]: pgmap v408: 129 pgs: 129 active+clean; 410 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 32 op/s 2024-09-21T04:03:36.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:36 smithi073 ceph-mon[34443]: pgmap v408: 129 pgs: 129 active+clean; 410 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 32 op/s 2024-09-21T04:03:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:36 smithi060 ceph-mon[33722]: pgmap v408: 129 pgs: 129 active+clean; 410 MiB data, 577 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 32 op/s 2024-09-21T04:03:37.070 INFO:teuthology.orchestra.run.smithi022.stderr:2000000 of 3200000 tuples (62%) done (elapsed 33.19 s, remaining 19.91 s) 2024-09-21T04:03:38.263 INFO:teuthology.orchestra.run.smithi022.stderr:2100000 of 3200000 tuples (65%) done (elapsed 34.38 s, remaining 18.01 s) 2024-09-21T04:03:38.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:38 smithi022 ceph-mon[31015]: pgmap v409: 129 pgs: 129 active+clean; 450 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 MiB/s wr, 35 op/s 2024-09-21T04:03:38.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:38 smithi073 ceph-mon[34443]: pgmap v409: 129 pgs: 129 active+clean; 450 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 MiB/s wr, 35 op/s 2024-09-21T04:03:38.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:38 smithi060 ceph-mon[33722]: pgmap v409: 129 pgs: 129 active+clean; 450 MiB data, 592 MiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 37 MiB/s wr, 35 op/s 2024-09-21T04:03:39.518 INFO:teuthology.orchestra.run.smithi022.stderr:2200000 of 3200000 tuples (68%) done (elapsed 35.64 s, remaining 16.20 s) 2024-09-21T04:03:40.407 INFO:teuthology.orchestra.run.smithi022.stderr:2300000 of 3200000 tuples (71%) done (elapsed 36.53 s, remaining 14.29 s) 2024-09-21T04:03:40.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:40 smithi022 ceph-mon[31015]: pgmap v410: 129 pgs: 129 active+clean; 486 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 39 MiB/s wr, 40 op/s 2024-09-21T04:03:40.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:40 smithi073 ceph-mon[34443]: pgmap v410: 129 pgs: 129 active+clean; 486 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 39 MiB/s wr, 40 op/s 2024-09-21T04:03:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:40 smithi060 ceph-mon[33722]: pgmap v410: 129 pgs: 129 active+clean; 486 MiB data, 586 MiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 39 MiB/s wr, 40 op/s 2024-09-21T04:03:41.663 INFO:teuthology.orchestra.run.smithi022.stderr:2400000 of 3200000 tuples (75%) done (elapsed 37.78 s, remaining 12.59 s) 2024-09-21T04:03:42.504 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:42 smithi060 ceph-mon[33722]: pgmap v411: 129 pgs: 129 active+clean; 534 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 43 MiB/s wr, 40 op/s 2024-09-21T04:03:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:42 smithi022 ceph-mon[31015]: pgmap v411: 129 pgs: 129 active+clean; 534 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 43 MiB/s wr, 40 op/s 2024-09-21T04:03:42.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:42 smithi073 ceph-mon[34443]: pgmap v411: 129 pgs: 129 active+clean; 534 MiB data, 600 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 43 MiB/s wr, 40 op/s 2024-09-21T04:03:42.913 INFO:teuthology.orchestra.run.smithi022.stderr:2500000 of 3200000 tuples (78%) done (elapsed 39.03 s, remaining 10.93 s) 2024-09-21T04:03:43.717 INFO:teuthology.orchestra.run.smithi022.stderr:2600000 of 3200000 tuples (81%) done (elapsed 39.84 s, remaining 9.19 s) 2024-09-21T04:03:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:44 smithi022 ceph-mon[31015]: pgmap v412: 129 pgs: 129 active+clean; 574 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 MiB/s wr, 40 op/s 2024-09-21T04:03:44.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:44 smithi073 ceph-mon[34443]: pgmap v412: 129 pgs: 129 active+clean; 574 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 MiB/s wr, 40 op/s 2024-09-21T04:03:44.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:44 smithi060 ceph-mon[33722]: pgmap v412: 129 pgs: 129 active+clean; 574 MiB data, 610 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 42 MiB/s wr, 40 op/s 2024-09-21T04:03:45.029 INFO:teuthology.orchestra.run.smithi022.stderr:2700000 of 3200000 tuples (84%) done (elapsed 41.15 s, remaining 7.62 s) 2024-09-21T04:03:45.917 INFO:teuthology.orchestra.run.smithi022.stderr:2800000 of 3200000 tuples (87%) done (elapsed 42.04 s, remaining 6.01 s) 2024-09-21T04:03:46.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:46 smithi022 ceph-mon[31015]: pgmap v413: 129 pgs: 129 active+clean; 616 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 41 MiB/s wr, 35 op/s 2024-09-21T04:03:46.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:46 smithi073 ceph-mon[34443]: pgmap v413: 129 pgs: 129 active+clean; 616 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 41 MiB/s wr, 35 op/s 2024-09-21T04:03:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:46 smithi060 ceph-mon[33722]: pgmap v413: 129 pgs: 129 active+clean; 616 MiB data, 620 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 41 MiB/s wr, 35 op/s 2024-09-21T04:03:47.082 INFO:teuthology.orchestra.run.smithi022.stderr:2900000 of 3200000 tuples (90%) done (elapsed 43.20 s, remaining 4.47 s) 2024-09-21T04:03:48.339 INFO:teuthology.orchestra.run.smithi022.stderr:3000000 of 3200000 tuples (93%) done (elapsed 44.46 s, remaining 2.96 s) 2024-09-21T04:03:48.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:48 smithi022 ceph-mon[31015]: pgmap v414: 129 pgs: 129 active+clean; 642 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 39 MiB/s wr, 34 op/s 2024-09-21T04:03:48.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:48 smithi073 ceph-mon[34443]: pgmap v414: 129 pgs: 129 active+clean; 642 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 39 MiB/s wr, 34 op/s 2024-09-21T04:03:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:48 smithi060 ceph-mon[33722]: pgmap v414: 129 pgs: 129 active+clean; 642 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 39 MiB/s wr, 34 op/s 2024-09-21T04:03:49.202 INFO:teuthology.orchestra.run.smithi022.stderr:3100000 of 3200000 tuples (96%) done (elapsed 45.32 s, remaining 1.46 s) 2024-09-21T04:03:50.499 INFO:teuthology.orchestra.run.smithi022.stderr:3200000 of 3200000 tuples (100%) done (elapsed 46.62 s, remaining 0.00 s) 2024-09-21T04:03:50.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:50 smithi022 ceph-mon[31015]: pgmap v415: 129 pgs: 129 active+clean; 670 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 MiB/s wr, 37 op/s 2024-09-21T04:03:50.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:50 smithi073 ceph-mon[34443]: pgmap v415: 129 pgs: 129 active+clean; 670 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 MiB/s wr, 37 op/s 2024-09-21T04:03:50.605 INFO:teuthology.orchestra.run.smithi022.stderr:vacuuming... 2024-09-21T04:03:50.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:50 smithi060 ceph-mon[33722]: pgmap v415: 129 pgs: 129 active+clean; 670 MiB data, 644 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 MiB/s wr, 37 op/s 2024-09-21T04:03:51.622 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.0 2024-09-21T04:03:51.622 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:03:51.938 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:52.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:52 smithi022 ceph-mon[31015]: pgmap v416: 129 pgs: 129 active+clean; 724 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 MiB/s wr, 36 op/s 2024-09-21T04:03:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.528+0000 7fac4032b640 1 -- 172.21.15.22:0/537026930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac38102a60 msgr2=0x7fac38102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:52.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.528+0000 7fac4032b640 1 --2- 172.21.15.22:0/537026930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac38102a60 0x7fac38102e70 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7fac34009900 tx=0x7fac3402a410 comp rx=0 tx=0).stop 2024-09-21T04:03:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.528+0000 7fac4032b640 1 -- 172.21.15.22:0/537026930 shutdown_connections 2024-09-21T04:03:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.528+0000 7fac4032b640 1 --2- 172.21.15.22:0/537026930 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac381083a0 0x7fac381087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.528+0000 7fac4032b640 1 --2- 172.21.15.22:0/537026930 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac38108cf0 0x7fac3810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.528+0000 7fac4032b640 1 --2- 172.21.15.22:0/537026930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac38102a60 0x7fac38102e70 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.528+0000 7fac4032b640 1 -- 172.21.15.22:0/537026930 >> 172.21.15.22:0/537026930 conn(0x7fac38079730 msgr2=0x7fac38079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.528+0000 7fac4032b640 1 -- 172.21.15.22:0/537026930 shutdown_connections 2024-09-21T04:03:52.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.528+0000 7fac4032b640 1 -- 172.21.15.22:0/537026930 wait complete. 2024-09-21T04:03:52.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.529+0000 7fac4032b640 1 Processor -- start 2024-09-21T04:03:52.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.529+0000 7fac4032b640 1 -- start start 2024-09-21T04:03:52.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac4032b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac38102a60 0x7fac38199260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:52.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac4032b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac381083a0 0x7fac38199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:52.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac4032b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac38108cf0 0x7fac3819eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac4032b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fac38112810 con 0x7fac38108cf0 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac4032b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fac38112690 con 0x7fac381083a0 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac4032b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fac38112990 con 0x7fac38102a60 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac3e0c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac38102a60 0x7fac38199260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac3e8c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac38108cf0 0x7fac3819eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac3e0c7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac38102a60 0x7fac38199260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:35492/0 (socket says 172.21.15.22:35492) 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac3e0c7640 1 -- 172.21.15.22:0/1437980095 learned_addr learned my addr 172.21.15.22:0/1437980095 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac3e8c8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac38108cf0 0x7fac3819eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40824/0 (socket says 172.21.15.22:40824) 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.530+0000 7fac3d8c6640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac381083a0 0x7fac38199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac3d8c6640 1 -- 172.21.15.22:0/1437980095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac38102a60 msgr2=0x7fac38199260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac3d8c6640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac38102a60 0x7fac38199260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:52.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac3d8c6640 1 -- 172.21.15.22:0/1437980095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac38108cf0 msgr2=0x7fac3819eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:52.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac3d8c6640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac38108cf0 0x7fac3819eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:52.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac3d8c6640 1 -- 172.21.15.22:0/1437980095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac3819f1d0 con 0x7fac381083a0 2024-09-21T04:03:52.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac3e8c8640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac38108cf0 0x7fac3819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:03:52.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac3d8c6640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac381083a0 0x7fac38199800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac2800d6a0 tx=0x7fac2800db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:52.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac2f7fe640 1 -- 172.21.15.22:0/1437980095 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28017070 con 0x7fac381083a0 2024-09-21T04:03:52.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac4032b640 1 -- 172.21.15.22:0/1437980095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac3819f4c0 con 0x7fac381083a0 2024-09-21T04:03:52.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac2f7fe640 1 -- 172.21.15.22:0/1437980095 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac28009820 con 0x7fac381083a0 2024-09-21T04:03:52.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac2f7fe640 1 -- 172.21.15.22:0/1437980095 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac28004bc0 con 0x7fac381083a0 2024-09-21T04:03:52.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.531+0000 7fac4032b640 1 -- 172.21.15.22:0/1437980095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac3806ae60 con 0x7fac381083a0 2024-09-21T04:03:52.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.533+0000 7fac4032b640 1 -- 172.21.15.22:0/1437980095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac38102e70 con 0x7fac381083a0 2024-09-21T04:03:52.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.535+0000 7fac2f7fe640 1 -- 172.21.15.22:0/1437980095 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fac28005220 con 0x7fac381083a0 2024-09-21T04:03:52.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.535+0000 7fac2f7fe640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fac240b6510 0x7fac240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:52.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.536+0000 7fac3e0c7640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fac240b6510 0x7fac240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:52.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.536+0000 7fac2f7fe640 1 -- 172.21.15.22:0/1437980095 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fac280e6f40 con 0x7fac381083a0 2024-09-21T04:03:52.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.536+0000 7fac3e0c7640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fac240b6510 0x7fac240b8a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fac34000c00 tx=0x7fac34009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:52.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.538+0000 7fac2f7fe640 1 -- 172.21.15.22:0/1437980095 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fac280b1870 con 0x7fac381083a0 2024-09-21T04:03:52.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:52 smithi073 ceph-mon[34443]: pgmap v416: 129 pgs: 129 active+clean; 724 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 MiB/s wr, 36 op/s 2024-09-21T04:03:52.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:52 smithi060 ceph-mon[33722]: pgmap v416: 129 pgs: 129 active+clean; 724 MiB data, 664 MiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 41 MiB/s wr, 36 op/s 2024-09-21T04:03:52.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.834+0000 7fac4032b640 1 -- 172.21.15.22:0/1437980095 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac3806b7f0 con 0x7fac381083a0 2024-09-21T04:03:52.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.835+0000 7fac2f7fe640 1 -- 172.21.15.22:0/1437980095 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11966 (secure 0 0 0) 0x7fac280b67b0 con 0x7fac381083a0 2024-09-21T04:03:52.838 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:03:52.839 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"btime":"2024-09-21T04:02:58:477506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:02:58.268873+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:03:52.839 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 31 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 -- 172.21.15.22:0/1437980095 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fac240b6510 msgr2=0x7fac240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fac240b6510 0x7fac240b8a20 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fac34000c00 tx=0x7fac34009580 comp rx=0 tx=0).stop 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 -- 172.21.15.22:0/1437980095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac381083a0 msgr2=0x7fac38199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac381083a0 0x7fac38199800 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fac2800d6a0 tx=0x7fac2800db60 comp rx=0 tx=0).stop 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 -- 172.21.15.22:0/1437980095 shutdown_connections 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fac240b6510 0x7fac240b8a20 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fac38108cf0 0x7fac3819eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fac381083a0 0x7fac38199800 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 --2- 172.21.15.22:0/1437980095 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fac38102a60 0x7fac38199260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 -- 172.21.15.22:0/1437980095 >> 172.21.15.22:0/1437980095 conn(0x7fac38079730 msgr2=0x7fac38101540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 -- 172.21.15.22:0/1437980095 shutdown_connections 2024-09-21T04:03:52.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:52.838+0000 7fac4032b640 1 -- 172.21.15.22:0/1437980095 wait complete. 2024-09-21T04:03:53.497 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:53 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1437980095' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:53.530 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0' 2024-09-21T04:03:53.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 137.0 --await-for 45.0 2024-09-21T04:03:53.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:53 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1437980095' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:53.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:53 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1437980095' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:03:53.853 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:03:54.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.417+0000 7f80442ab640 1 -- 172.21.15.22:0/2659858349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f803c10de30 msgr2=0x7f803c110320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:54.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.417+0000 7f80442ab640 1 --2- 172.21.15.22:0/2659858349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f803c10de30 0x7f803c110320 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8034009ca0 tx=0x7f803402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.417+0000 7f80442ab640 1 -- 172.21.15.22:0/2659858349 shutdown_connections 2024-09-21T04:03:54.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.417+0000 7f80442ab640 1 --2- 172.21.15.22:0/2659858349 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f803c105320 0x7f803c10d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.417+0000 7f80442ab640 1 --2- 172.21.15.22:0/2659858349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f803c10de30 0x7f803c110320 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.417+0000 7f80442ab640 1 --2- 172.21.15.22:0/2659858349 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f803c1049d0 0x7f803c104de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.417+0000 7f80442ab640 1 -- 172.21.15.22:0/2659858349 >> 172.21.15.22:0/2659858349 conn(0x7f803c079760 msgr2=0x7f803c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:54.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.417+0000 7f80442ab640 1 -- 172.21.15.22:0/2659858349 shutdown_connections 2024-09-21T04:03:54.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.417+0000 7f80442ab640 1 -- 172.21.15.22:0/2659858349 wait complete. 2024-09-21T04:03:54.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.418+0000 7f80442ab640 1 Processor -- start 2024-09-21T04:03:54.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.418+0000 7f80442ab640 1 -- start start 2024-09-21T04:03:54.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f80442ab640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f803c1049d0 0x7f803c102710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f80442ab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f803c105320 0x7f803c102c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f80442ab640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f803c10de30 0x7f803c103190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f80442ab640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f803c113990 con 0x7f803c105320 2024-09-21T04:03:54.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f80442ab640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f803c113810 con 0x7f803c10de30 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f80442ab640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f803c113b10 con 0x7f803c1049d0 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8041846640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f803c105320 0x7f803c102c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8041846640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f803c105320 0x7f803c102c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40846/0 (socket says 172.21.15.22:40846) 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8041846640 1 -- 172.21.15.22:0/1025714637 learned_addr learned my addr 172.21.15.22:0/1025714637 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8042047640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f803c1049d0 0x7f803c102710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8042848640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f803c10de30 0x7f803c103190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8041846640 1 -- 172.21.15.22:0/1025714637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f803c1049d0 msgr2=0x7f803c102710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8041846640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f803c1049d0 0x7f803c102710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8041846640 1 -- 172.21.15.22:0/1025714637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f803c10de30 msgr2=0x7f803c103190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8041846640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f803c10de30 0x7f803c103190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8041846640 1 -- 172.21.15.22:0/1025714637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f803c1a8680 con 0x7f803c105320 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.419+0000 7f8042047640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f803c1049d0 0x7f803c102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.420+0000 7f8041846640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f803c105320 0x7f803c102c50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f802c00d950 tx=0x7f802c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:54.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.420+0000 7f80337fe640 1 -- 172.21.15.22:0/1025714637 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c017070 con 0x7f803c105320 2024-09-21T04:03:54.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.420+0000 7f80442ab640 1 -- 172.21.15.22:0/1025714637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f803c1a8970 con 0x7f803c105320 2024-09-21T04:03:54.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.420+0000 7f80337fe640 1 -- 172.21.15.22:0/1025714637 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f802c009c30 con 0x7f803c105320 2024-09-21T04:03:54.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.420+0000 7f80442ab640 1 -- 172.21.15.22:0/1025714637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f803c1a8f00 con 0x7f803c105320 2024-09-21T04:03:54.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.420+0000 7f80337fe640 1 -- 172.21.15.22:0/1025714637 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c0047a0 con 0x7f803c105320 2024-09-21T04:03:54.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.422+0000 7f804a81f740 1 Processor -- start 2024-09-21T04:03:54.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f804a81f740 1 -- start start 2024-09-21T04:03:54.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f804a81f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d321840 0x55868d6c8600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f804a81f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d2f8980 0x55868d6c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f804a81f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f804a81f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55868d63eb90 con 0x55868d300b60 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f804a81f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55868d62dfc0 con 0x55868d321840 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f804a81f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55868d631dd0 con 0x55868d2f8980 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f80337fe640 1 -- 172.21.15.22:0/1025714637 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f802c004940 con 0x7f803c105320 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f8042848640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d321840 0x55868d6c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f8042047640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d2f8980 0x55868d6c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f8042848640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d321840 0x55868d6c8600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:41140/0 (socket says 172.21.15.22:41140) 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f8042848640 1 -- 172.21.15.22:0/222460283 learned_addr learned my addr 172.21.15.22:0/222460283 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.423+0000 7f8041846640 1 --2- 172.21.15.22:0/222460283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.424+0000 7f8042848640 1 -- 172.21.15.22:0/222460283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d2f8980 msgr2=0x55868d6c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.424+0000 7f8042848640 1 --2- 172.21.15.22:0/222460283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d2f8980 0x55868d6c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.424+0000 7f8042848640 1 -- 172.21.15.22:0/222460283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 msgr2=0x55868d6c9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:54.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.424+0000 7f8042848640 1 --2- 172.21.15.22:0/222460283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.424+0000 7f8042848640 1 -- 172.21.15.22:0/222460283 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868d5b5060 con 0x55868d321840 2024-09-21T04:03:54.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.424+0000 7f8042047640 1 --2- 172.21.15.22:0/222460283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d2f8980 0x55868d6c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:03:54.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.424+0000 7f8041846640 1 --2- 172.21.15.22:0/222460283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:54.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.424+0000 7f8042848640 1 --2- 172.21.15.22:0/222460283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d321840 0x55868d6c8600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f803402aeb0 tx=0x7f8034031450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a5020c35bee4220 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:54.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.424+0000 7f8030d9a640 1 -- 172.21.15.22:0/222460283 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8034031980 con 0x55868d321840 2024-09-21T04:03:54.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.425+0000 7f80337fe640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f80280b6590 0x7f80280b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.425+0000 7f8030d9a640 1 -- 172.21.15.22:0/222460283 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8034036030 con 0x55868d321840 2024-09-21T04:03:54.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.425+0000 7f8042047640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f80280b6590 0x7f80280b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.425+0000 7f80337fe640 1 -- 172.21.15.22:0/1025714637 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f802c0e7220 con 0x7f803c105320 2024-09-21T04:03:54.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.425+0000 7f8030d9a640 1 -- 172.21.15.22:0/222460283 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80340042a0 con 0x55868d321840 2024-09-21T04:03:54.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f804a81f740 1 -- 172.21.15.22:0/222460283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d321840 msgr2=0x55868d6c8600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f8042047640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f80280b6590 0x7f80280b8aa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8038009fd0 tx=0x7f8038005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f804a81f740 1 --2- 172.21.15.22:0/222460283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d321840 0x55868d6c8600 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f803402aeb0 tx=0x7f8034031450 comp rx=0 tx=0).stop 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f804a81f740 1 -- 172.21.15.22:0/222460283 shutdown_connections 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f804a81f740 1 --2- 172.21.15.22:0/222460283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d2f8980 0x55868d6c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f804a81f740 1 --2- 172.21.15.22:0/222460283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f804a81f740 1 --2- 172.21.15.22:0/222460283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d321840 0x55868d6c8600 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f804a81f740 1 -- 172.21.15.22:0/222460283 >> 172.21.15.22:0/222460283 conn(0x55868d315990 msgr2=0x55868d6c64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f804a81f740 1 -- 172.21.15.22:0/222460283 shutdown_connections 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f804a81f740 1 -- 172.21.15.22:0/222460283 wait complete. 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.426+0000 7f804a81f740 1 -- start start 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f804a81f740 1 Processor -- start 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f804a81f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6d4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f804a81f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6d4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f804a81f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 0x55868d6dff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f804a81f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55868d48f7a0 con 0x55868d300b60 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f804a81f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55868d5d30a0 con 0x55868d2f8980 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f804a81f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55868d6d6c00 con 0x55868d321840 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f804a81f740 10 client.0 _ll_register_callbacks cb 0x55868d5b03c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f8042047640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6d4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f8042047640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6d4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:41148/0 (socket says 172.21.15.22:41148) 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f8041846640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6d4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f8042047640 1 -- 172.21.15.22:0/597389888 learned_addr learned my addr 172.21.15.22:0/597389888 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f8042848640 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 0x55868d6dff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f8042047640 1 -- 172.21.15.22:0/597389888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 msgr2=0x55868d6dff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f8042047640 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 0x55868d6dff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.427+0000 7f8042047640 1 -- 172.21.15.22:0/597389888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 msgr2=0x55868d6d4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:54.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f8042047640 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6d4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f8042047640 1 -- 172.21.15.22:0/597389888 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55868d5c1880 con 0x55868d2f8980 2024-09-21T04:03:54.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f8042848640 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 0x55868d6dff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:03:54.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f8042047640 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6d4120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8038012df0 tx=0x7f8038004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9997b51a0789109b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:54.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f8025ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:03:54.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f8025ffb640 1 -- 172.21.15.22:0/597389888 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8038011940 con 0x55868d2f8980 2024-09-21T04:03:54.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f8025ffb640 1 -- 172.21.15.22:0/597389888 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f8038011ae0 con 0x55868d2f8980 2024-09-21T04:03:54.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f804a81f740 1 -- 172.21.15.22:0/597389888 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8034036030 con 0x55868d2f8980 2024-09-21T04:03:54.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f8025ffb640 1 -- 172.21.15.22:0/597389888 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f8038011ce0 con 0x55868d2f8980 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f804a81f740 10 client.25349 fetch_fsmap learned FSMap version 31 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.428+0000 7f804a81f740 1 -- 172.21.15.22:0/597389888 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55868d39bb90 con 0x55868d2f8980 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.429+0000 7f8025ffb640 1 -- 172.21.15.22:0/597389888 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8034036030 con 0x55868d2f8980 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.429+0000 7f8025ffb640 1 -- 172.21.15.22:0/597389888 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 31) ==== 8386+0+0 (secure 0 0 0) 0x7f8038027070 con 0x55868d2f8980 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.429+0000 7f804a81f740 10 client.25349 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.429+0000 7f804a81f740 10 client.25349 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.429+0000 7f804a81f740 20 client.25349 populate_metadata read hostname 'smithi022' 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.429+0000 7f804a81f740 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55868d2e01c0 0x55868d6e5fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.429+0000 7f804a81f740 4 client.25349 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.429+0000 7f804a81f740 1 -- 172.21.15.22:0/597389888 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55868d640ae0 con 0x55868d2e01c0 2024-09-21T04:03:54.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.429+0000 7f8041846640 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55868d2e01c0 0x55868d6e5fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.430+0000 7f8041846640 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55868d2e01c0 0x55868d6e5fc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4c3ef31440ce38b server_cookie=fcf7916ccefea620 in_seq=0 out_seq=0 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.430+0000 7f8025ffb640 10 client.25349 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.430+0000 7f8025ffb640 1 -- 172.21.15.22:0/597389888 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55868d640ae0 con 0x55868d2e01c0 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.430+0000 7f8025ffb640 10 client.25349 handle_command_reply: tid=0 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.430+0000 7f804a81f740 1 client.25349 shutdown 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.430+0000 7f804a81f740 1 -- 172.21.15.22:0/597389888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 msgr2=0x55868d6d4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.430+0000 7f804a81f740 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6d4120 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8038012df0 tx=0x7f8038004730 comp rx=0 tx=0).stop 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.431+0000 7f804a81f740 1 -- 172.21.15.22:0/597389888 shutdown_connections 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.431+0000 7f804a81f740 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55868d2e01c0 0x55868d6e5fc0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.431+0000 7f804a81f740 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 0x55868d6dff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.431+0000 7f804a81f740 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6d4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.431+0000 7f804a81f740 1 --2- 172.21.15.22:0/597389888 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6d4120 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.431+0000 7f804a81f740 1 -- 172.21.15.22:0/597389888 >> 172.21.15.22:0/597389888 conn(0x55868d315990 msgr2=0x55868d6cb790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:54.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.431+0000 7f8025ffb640 0 client.25349 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:54.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.431+0000 7f804a81f740 1 -- 172.21.15.22:0/597389888 shutdown_connections 2024-09-21T04:03:54.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.431+0000 7f804a81f740 1 -- 172.21.15.22:0/597389888 wait complete. 2024-09-21T04:03:54.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.431+0000 7f804a81f740 20 client.25349 trim_cache size 0 max 16384 2024-09-21T04:03:54.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.452+0000 7f804a81f740 1 Processor -- start 2024-09-21T04:03:54.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.452+0000 7f804a81f740 1 -- start start 2024-09-21T04:03:54.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.453+0000 7f804a81f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.453+0000 7f804a81f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.453+0000 7f804a81f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 0x55868d6d1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.453+0000 7f804a81f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f803c1b2d80 con 0x55868d300b60 2024-09-21T04:03:54.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.453+0000 7f804a81f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f803c1b4980 con 0x55868d2f8980 2024-09-21T04:03:54.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.453+0000 7f804a81f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f803c1b3450 con 0x55868d321840 2024-09-21T04:03:54.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.453+0000 7f8041846640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.453+0000 7f8041846640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40866/0 (socket says 172.21.15.22:40866) 2024-09-21T04:03:54.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.453+0000 7f8041846640 1 -- 172.21.15.22:0/2667693507 learned_addr learned my addr 172.21.15.22:0/2667693507 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:54.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8042848640 1 --2- 172.21.15.22:0/2667693507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 0x55868d6d1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8042047640 1 --2- 172.21.15.22:0/2667693507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8041846640 1 -- 172.21.15.22:0/2667693507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 msgr2=0x55868d6d1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:54.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8041846640 1 --2- 172.21.15.22:0/2667693507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 0x55868d6d1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8041846640 1 -- 172.21.15.22:0/2667693507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 msgr2=0x55868d6c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:54.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8041846640 1 --2- 172.21.15.22:0/2667693507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6c5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8041846640 1 -- 172.21.15.22:0/2667693507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868d6cf7b0 con 0x55868d300b60 2024-09-21T04:03:54.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8042047640 1 --2- 172.21.15.22:0/2667693507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:03:54.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8041846640 1 --2- 172.21.15.22:0/2667693507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c5fe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f802c0acf80 tx=0x7f802c0e7540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52a48cbf1797c794 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:54.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8027fff640 1 -- 172.21.15.22:0/2667693507 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c005680 con 0x55868d300b60 2024-09-21T04:03:54.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8027fff640 1 -- 172.21.15.22:0/2667693507 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f802c0b4e50 con 0x55868d300b60 2024-09-21T04:03:54.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.454+0000 7f8027fff640 1 -- 172.21.15.22:0/2667693507 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f802c0b6a10 con 0x55868d300b60 2024-09-21T04:03:54.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.455+0000 7f804a81f740 1 -- 172.21.15.22:0/2667693507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 msgr2=0x55868d6c5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:54.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.455+0000 7f804a81f740 1 --2- 172.21.15.22:0/2667693507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c5fe0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f802c0acf80 tx=0x7f802c0e7540 comp rx=0 tx=0).stop 2024-09-21T04:03:54.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.455+0000 7f804a81f740 1 -- 172.21.15.22:0/2667693507 shutdown_connections 2024-09-21T04:03:54.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.455+0000 7f804a81f740 1 --2- 172.21.15.22:0/2667693507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d321840 0x55868d6d1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.455+0000 7f804a81f740 1 --2- 172.21.15.22:0/2667693507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d300b60 0x55868d6c5fe0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.455+0000 7f804a81f740 1 --2- 172.21.15.22:0/2667693507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.455+0000 7f804a81f740 1 -- 172.21.15.22:0/2667693507 >> 172.21.15.22:0/2667693507 conn(0x55868d315990 msgr2=0x55868d6d27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:54.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.455+0000 7f804a81f740 1 -- 172.21.15.22:0/2667693507 shutdown_connections 2024-09-21T04:03:54.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.455+0000 7f804a81f740 1 -- 172.21.15.22:0/2667693507 wait complete. 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f804a81f740 1 -- start start 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f804a81f740 1 Processor -- start 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f804a81f740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6d8790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f804a81f740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d300b60 0x55868d6d8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f804a81f740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d321840 0x55868d749990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f804a81f740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f803c1b41f0 con 0x55868d321840 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f804a81f740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f803c1b3b20 con 0x55868d2f8980 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f804a81f740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f803c1b0d60 con 0x55868d300b60 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f804a81f740 10 client.0 _ll_register_callbacks cb 0x7f8038009ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f8042848640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d321840 0x55868d749990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f8042047640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6d8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f8042848640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d321840 0x55868d749990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40874/0 (socket says 172.21.15.22:40874) 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f8042848640 1 -- 172.21.15.22:0/3452116823 learned_addr learned my addr 172.21.15.22:0/3452116823 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:03:54.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.456+0000 7f8041846640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d300b60 0x55868d6d8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.457+0000 7f8042848640 1 -- 172.21.15.22:0/3452116823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d300b60 msgr2=0x55868d6d8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.457+0000 7f8042848640 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d300b60 0x55868d6d8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.457+0000 7f8042848640 1 -- 172.21.15.22:0/3452116823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 msgr2=0x55868d6d8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.457+0000 7f8042848640 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6d8790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.457+0000 7f8042848640 1 -- 172.21.15.22:0/3452116823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55868d74a000 con 0x55868d321840 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.457+0000 7f8042848640 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d321840 0x55868d749990 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8034045000 tx=0x7f8034031bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e704195c602d27b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.457+0000 7f8025ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.457+0000 7f8025ffb640 1 -- 172.21.15.22:0/3452116823 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f803404a040 con 0x55868d321840 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.457+0000 7f8025ffb640 1 -- 172.21.15.22:0/3452116823 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f8034003970 con 0x55868d321840 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.457+0000 7f804a81f740 1 -- 172.21.15.22:0/3452116823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f802c0b4e50 con 0x55868d321840 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f8025ffb640 1 -- 172.21.15.22:0/3452116823 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f803405e050 con 0x55868d321840 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f804a81f740 10 client.15696 fetch_fsmap learned FSMap version 31 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f804a81f740 1 -- 172.21.15.22:0/3452116823 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55868d751270 con 0x55868d321840 2024-09-21T04:03:54.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f8025ffb640 1 -- 172.21.15.22:0/3452116823 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f802c0b4e50 con 0x55868d321840 2024-09-21T04:03:54.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f8025ffb640 1 -- 172.21.15.22:0/3452116823 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8386+0+0 (secure 0 0 0) 0x7f8034043070 con 0x55868d321840 2024-09-21T04:03:54.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f804a81f740 10 client.15696 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T04:03:54.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f804a81f740 10 client.15696 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:03:54.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f804a81f740 20 client.15696 populate_metadata read hostname 'smithi022' 2024-09-21T04:03:54.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f804a81f740 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55868d2b5570 0x55868d753890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:03:54.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f804a81f740 4 client.15696 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}] 2024-09-21T04:03:54.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f804a81f740 1 -- 172.21.15.22:0/3452116823 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.0, "await_for": 45.0}) -- 0x55868d63c590 con 0x55868d2b5570 2024-09-21T04:03:54.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.458+0000 7f8042047640 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55868d2b5570 0x55868d753890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:03:54.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.459+0000 7f8025ffb640 10 client.15696 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:54.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.459+0000 7f8042047640 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55868d2b5570 0x55868d753890 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=913074cdc3cce38 server_cookie=ab9164abfe8ddae5 in_seq=0 out_seq=0 2024-09-21T04:03:54.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:54 smithi022 ceph-mon[31015]: pgmap v417: 129 pgs: 129 active+clean; 772 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 MiB/s wr, 41 op/s 2024-09-21T04:03:54.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:54 smithi073 ceph-mon[34443]: pgmap v417: 129 pgs: 129 active+clean; 772 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 MiB/s wr, 41 op/s 2024-09-21T04:03:54.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f8025ffb640 1 -- 172.21.15.22:0/3452116823 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55868d63c590 con 0x55868d2b5570 2024-09-21T04:03:54.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f8025ffb640 10 client.15696 handle_command_reply: tid=0 2024-09-21T04:03:54.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 client.15696 shutdown 2024-09-21T04:03:54.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 -- 172.21.15.22:0/3452116823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d321840 msgr2=0x55868d749990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:54.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d321840 0x55868d749990 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f8034045000 tx=0x7f8034031bb0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 -- 172.21.15.22:0/3452116823 shutdown_connections 2024-09-21T04:03:54.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55868d2b5570 0x55868d753890 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55868d300b60 0x55868d6d8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f8025ffb640 0 client.15696 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:03:54.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55868d321840 0x55868d749990 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 --2- 172.21.15.22:0/3452116823 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55868d2f8980 0x55868d6d8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 -- 172.21.15.22:0/3452116823 >> 172.21.15.22:0/3452116823 conn(0x55868d315990 msgr2=0x55868d6c9630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:54.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 -- 172.21.15.22:0/3452116823 shutdown_connections 2024-09-21T04:03:54.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 1 -- 172.21.15.22:0/3452116823 wait complete. 2024-09-21T04:03:54.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.675+0000 7f804a81f740 20 client.15696 trim_cache size 0 max 16384 2024-09-21T04:03:54.679 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:03:54.679 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 31, 2024-09-21T04:03:54.679 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:03:54.679 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 6, 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "896e9a65": { 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 6, 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 137.0, 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:03:54.680 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:03:54.681 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:03:54.681 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:03:54.681 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:54.681 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:54.681 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:54.681 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:54.681 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:03:54.681 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:03:54.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 -- 172.21.15.22:0/1025714637 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f80280b6590 msgr2=0x7f80280b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:54.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f80280b6590 0x7f80280b8aa0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8038009fd0 tx=0x7f8038005f90 comp rx=0 tx=0).stop 2024-09-21T04:03:54.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 -- 172.21.15.22:0/1025714637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f803c105320 msgr2=0x7f803c102c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:03:54.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f803c105320 0x7f803c102c50 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f802c00d950 tx=0x7f802c00de10 comp rx=0 tx=0).stop 2024-09-21T04:03:54.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 -- 172.21.15.22:0/1025714637 shutdown_connections 2024-09-21T04:03:54.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f80280b6590 0x7f80280b8aa0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f803c10de30 0x7f803c103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f803c105320 0x7f803c102c50 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 --2- 172.21.15.22:0/1025714637 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f803c1049d0 0x7f803c102710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:03:54.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 -- 172.21.15.22:0/1025714637 >> 172.21.15.22:0/1025714637 conn(0x7f803c079760 msgr2=0x7f803c107970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:03:54.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 -- 172.21.15.22:0/1025714637 shutdown_connections 2024-09-21T04:03:54.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:03:54.676+0000 7f80442ab640 1 -- 172.21.15.22:0/1025714637 wait complete. 2024-09-21T04:03:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:54 smithi060 ceph-mon[33722]: pgmap v417: 129 pgs: 129 active+clean; 772 MiB data, 673 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 44 MiB/s wr, 41 op/s 2024-09-21T04:03:55.355 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '896e9a65', quiesce took 3.7 seconds. Will release after: 13.3 2024-09-21T04:03:56.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:56 smithi022 ceph-mon[31015]: pgmap v418: 129 pgs: 129 active+clean; 780 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 41 op/s 2024-09-21T04:03:56.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:56 smithi073 ceph-mon[34443]: pgmap v418: 129 pgs: 129 active+clean; 780 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 41 op/s 2024-09-21T04:03:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:56 smithi060 ceph-mon[33722]: pgmap v418: 129 pgs: 129 active+clean; 780 MiB data, 660 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 41 op/s 2024-09-21T04:03:58.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:03:58 smithi022 ceph-mon[31015]: pgmap v419: 129 pgs: 129 active+clean; 780 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 39 MiB/s wr, 39 op/s 2024-09-21T04:03:58.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:03:58 smithi073 ceph-mon[34443]: pgmap v419: 129 pgs: 129 active+clean; 780 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 39 MiB/s wr, 39 op/s 2024-09-21T04:03:58.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:03:58 smithi060 ceph-mon[33722]: pgmap v419: 129 pgs: 129 active+clean; 780 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 39 MiB/s wr, 39 op/s 2024-09-21T04:04:00.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:00 smithi022 ceph-mon[31015]: pgmap v420: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 MiB/s wr, 41 op/s 2024-09-21T04:04:00.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:00 smithi073 ceph-mon[34443]: pgmap v420: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 MiB/s wr, 41 op/s 2024-09-21T04:04:00.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:00 smithi060 ceph-mon[33722]: pgmap v420: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 37 MiB/s wr, 41 op/s 2024-09-21T04:04:02.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:02 smithi022 ceph-mon[31015]: pgmap v421: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 MiB/s wr, 36 op/s 2024-09-21T04:04:02.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:02 smithi073 ceph-mon[34443]: pgmap v421: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 MiB/s wr, 36 op/s 2024-09-21T04:04:02.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:02 smithi060 ceph-mon[33722]: pgmap v421: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 33 MiB/s wr, 36 op/s 2024-09-21T04:04:04.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:04 smithi022 ceph-mon[31015]: pgmap v422: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 31 op/s 2024-09-21T04:04:04.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:04 smithi073 ceph-mon[34443]: pgmap v422: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 31 op/s 2024-09-21T04:04:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:04 smithi060 ceph-mon[33722]: pgmap v422: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 22 MiB/s wr, 31 op/s 2024-09-21T04:04:05.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:05 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:04:05.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:05 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:04:05.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:05 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:04:06.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:06 smithi022 ceph-mon[31015]: pgmap v423: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 22 op/s 2024-09-21T04:04:06.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:04:06.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:04:06.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:04:06.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:06 smithi073 ceph-mon[34443]: pgmap v423: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 22 op/s 2024-09-21T04:04:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:04:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:04:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:04:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:06 smithi060 ceph-mon[33722]: pgmap v423: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 13 MiB/s wr, 22 op/s 2024-09-21T04:04:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:04:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:04:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:04:08.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:08 smithi022 ceph-mon[31015]: pgmap v424: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 17 op/s 2024-09-21T04:04:08.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:08 smithi073 ceph-mon[34443]: pgmap v424: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 17 op/s 2024-09-21T04:04:08.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:04:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:08 smithi060 ceph-mon[33722]: pgmap v424: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 8.2 MiB/s wr, 17 op/s 2024-09-21T04:04:08.914 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:09.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.545+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2627194120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d4076100 msgr2=0x7fa1d410fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:09.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.545+0000 7fa1db5c1640 1 --2- 172.21.15.22:0/2627194120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d4076100 0x7fa1d410fba0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009900 tx=0x7fa1c402a3f0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.545+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2627194120 shutdown_connections 2024-09-21T04:04:09.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.545+0000 7fa1db5c1640 1 --2- 172.21.15.22:0/2627194120 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d41100e0 0x7fa1d4112520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.545+0000 7fa1db5c1640 1 --2- 172.21.15.22:0/2627194120 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d4076100 0x7fa1d410fba0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.545+0000 7fa1db5c1640 1 --2- 172.21.15.22:0/2627194120 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d40757b0 0x7fa1d4075bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.545+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2627194120 >> 172.21.15.22:0/2627194120 conn(0x7fa1d40ff590 msgr2=0x7fa1d41019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.545+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2627194120 shutdown_connections 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.545+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2627194120 wait complete. 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1db5c1640 1 Processor -- start 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1db5c1640 1 -- start start 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1db5c1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d40757b0 0x7fa1d419c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1db5c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d4076100 0x7fa1d419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1db5c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d41100e0 0x7fa1d41a1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1db5c1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4115b40 con 0x7fa1d4076100 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1db5c1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d41159c0 con 0x7fa1d40757b0 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1db5c1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d4115cc0 con 0x7fa1d41100e0 2024-09-21T04:04:09.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1d8b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d4076100 0x7fa1d419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1d8b5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d4076100 0x7fa1d419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47966/0 (socket says 172.21.15.22:47966) 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1d8b5c640 1 -- 172.21.15.22:0/2148098138 learned_addr learned my addr 172.21.15.22:0/2148098138 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1d9b5e640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d41100e0 0x7fa1d41a1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.546+0000 7fa1d935d640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d40757b0 0x7fa1d419c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1d8b5c640 1 -- 172.21.15.22:0/2148098138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d41100e0 msgr2=0x7fa1d41a1e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1d8b5c640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d41100e0 0x7fa1d41a1e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1d8b5c640 1 -- 172.21.15.22:0/2148098138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d40757b0 msgr2=0x7fa1d419c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1d8b5c640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d40757b0 0x7fa1d419c5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1d8b5c640 1 -- 172.21.15.22:0/2148098138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d41a24a0 con 0x7fa1d4076100 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1d8b5c640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d4076100 0x7fa1d419cb90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4005940 tx=0x7fa1c40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1ca7fc640 1 -- 172.21.15.22:0/2148098138 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c403f030 con 0x7fa1d4076100 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1ca7fc640 1 -- 172.21.15.22:0/2148098138 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c4003c90 con 0x7fa1d4076100 2024-09-21T04:04:09.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2148098138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d41a2730 con 0x7fa1d4076100 2024-09-21T04:04:09.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1ca7fc640 1 -- 172.21.15.22:0/2148098138 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4035070 con 0x7fa1d4076100 2024-09-21T04:04:09.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.547+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2148098138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d41a2c60 con 0x7fa1d4076100 2024-09-21T04:04:09.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.548+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2148098138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d4075bc0 con 0x7fa1d4076100 2024-09-21T04:04:09.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.550+0000 7fa1ca7fc640 1 -- 172.21.15.22:0/2148098138 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa1c4042030 con 0x7fa1d4076100 2024-09-21T04:04:09.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.550+0000 7fa1ca7fc640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c00b65c0 0x7fa1c00b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:09.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.551+0000 7fa1d935d640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c00b65c0 0x7fa1c00b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:09.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.551+0000 7fa1ca7fc640 1 -- 172.21.15.22:0/2148098138 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa1c4107b60 con 0x7fa1d4076100 2024-09-21T04:04:09.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.552+0000 7fa1d935d640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c00b65c0 0x7fa1c00b8ad0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0005e10 tx=0x7fa1d0005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:09.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.556+0000 7fa1ca7fc640 1 -- 172.21.15.22:0/2148098138 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa1d41a2c60 con 0x7fa1d4076100 2024-09-21T04:04:09.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.785+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2148098138 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa1d402e640 con 0x7fa1d4076100 2024-09-21T04:04:09.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.785+0000 7fa1ca7fc640 1 -- 172.21.15.22:0/2148098138 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+11966 (secure 0 0 0) 0x7fa1c40ce030 con 0x7fa1d4076100 2024-09-21T04:04:09.787 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:04:09.788 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":31,"btime":"2024-09-21T04:02:58:477506+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":31,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:02:58.268873+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:04:09.788 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 31 2024-09-21T04:04:09.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2148098138 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c00b65c0 msgr2=0x7fa1c00b8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c00b65c0 0x7fa1c00b8ad0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0005e10 tx=0x7fa1d0005da0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2148098138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d4076100 msgr2=0x7fa1d419cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d4076100 0x7fa1d419cb90 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4005940 tx=0x7fa1c40042f0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2148098138 shutdown_connections 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c00b65c0 0x7fa1c00b8ad0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d41100e0 0x7fa1d41a1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d4076100 0x7fa1d419cb90 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 --2- 172.21.15.22:0/2148098138 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d40757b0 0x7fa1d419c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2148098138 >> 172.21.15.22:0/2148098138 conn(0x7fa1d40ff590 msgr2=0x7fa1d4112320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2148098138 shutdown_connections 2024-09-21T04:04:09.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:09.788+0000 7fa1db5c1640 1 -- 172.21.15.22:0/2148098138 wait complete. 2024-09-21T04:04:10.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:10 smithi022 ceph-mon[31015]: pgmap v425: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 MiB/s wr, 16 op/s 2024-09-21T04:04:10.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:10 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2148098138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:10.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:10 smithi073 ceph-mon[34443]: pgmap v425: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 MiB/s wr, 16 op/s 2024-09-21T04:04:10.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:10 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2148098138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:10.627 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id 896e9a65 --release --await' 2024-09-21T04:04:10.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id 896e9a65 --release --await 2024-09-21T04:04:10.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:10 smithi060 ceph-mon[33722]: pgmap v425: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 3.5 MiB/s wr, 16 op/s 2024-09-21T04:04:10.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:10 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2148098138' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:10.888 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:11.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.406+0000 7ff73a84d640 1 -- 172.21.15.22:0/3765739455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff734108420 msgr2=0x7ff734108830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:11.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.406+0000 7ff73a84d640 1 --2- 172.21.15.22:0/3765739455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff734108420 0x7ff734108830 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7ff71c009900 tx=0x7ff71c02a410 comp rx=0 tx=0).stop 2024-09-21T04:04:11.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.406+0000 7ff73a84d640 1 -- 172.21.15.22:0/3765739455 shutdown_connections 2024-09-21T04:04:11.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.406+0000 7ff73a84d640 1 --2- 172.21.15.22:0/3765739455 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff734108d70 0x7ff73410f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.406+0000 7ff73a84d640 1 --2- 172.21.15.22:0/3765739455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff734108420 0x7ff734108830 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.406+0000 7ff73a84d640 1 --2- 172.21.15.22:0/3765739455 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff734102ae0 0x7ff734102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.406+0000 7ff73a84d640 1 -- 172.21.15.22:0/3765739455 >> 172.21.15.22:0/3765739455 conn(0x7ff734079770 msgr2=0x7ff734079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:11.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.406+0000 7ff73a84d640 1 -- 172.21.15.22:0/3765739455 shutdown_connections 2024-09-21T04:04:11.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.406+0000 7ff73a84d640 1 -- 172.21.15.22:0/3765739455 wait complete. 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.407+0000 7ff73a84d640 1 Processor -- start 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.407+0000 7ff73a84d640 1 -- start start 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.407+0000 7ff73a84d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff734102ae0 0x7ff734199350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.407+0000 7ff73a84d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff734108420 0x7ff7341998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.407+0000 7ff73a84d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff734108d70 0x7ff73419eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.407+0000 7ff73a84d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341128e0 con 0x7ff734102ae0 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.407+0000 7ff73a84d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff734112760 con 0x7ff734108d70 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.407+0000 7ff73a84d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff734112a60 con 0x7ff734108420 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff733fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff734102ae0 0x7ff734199350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff733fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff734102ae0 0x7ff734199350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40178/0 (socket says 172.21.15.22:40178) 2024-09-21T04:04:11.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff733fff640 1 -- 172.21.15.22:0/2524157740 learned_addr learned my addr 172.21.15.22:0/2524157740 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff72bfff640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff734108420 0x7ff7341998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff738dea640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff734108d70 0x7ff73419eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff733fff640 1 -- 172.21.15.22:0/2524157740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff734108420 msgr2=0x7ff7341998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff733fff640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff734108420 0x7ff7341998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff733fff640 1 -- 172.21.15.22:0/2524157740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff734108d70 msgr2=0x7ff73419eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff733fff640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff734108d70 0x7ff73419eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff733fff640 1 -- 172.21.15.22:0/2524157740 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73419f2c0 con 0x7ff734102ae0 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff738dea640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff734108d70 0x7ff73419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff733fff640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff734102ae0 0x7ff734199350 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff72400d950 tx=0x7ff72400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.408+0000 7ff731ffb640 1 -- 172.21.15.22:0/2524157740 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff724017070 con 0x7ff734102ae0 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.409+0000 7ff731ffb640 1 -- 172.21.15.22:0/2524157740 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff724009c30 con 0x7ff734102ae0 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.409+0000 7ff73a84d640 1 -- 172.21.15.22:0/2524157740 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff73419f5b0 con 0x7ff734102ae0 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.409+0000 7ff731ffb640 1 -- 172.21.15.22:0/2524157740 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72400f620 con 0x7ff734102ae0 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.409+0000 7ff73a84d640 1 -- 172.21.15.22:0/2524157740 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff73406bb60 con 0x7ff734102ae0 2024-09-21T04:04:11.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.411+0000 7ff731ffb640 1 -- 172.21.15.22:0/2524157740 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff724010460 con 0x7ff734102ae0 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.411+0000 7ff740dc1740 1 Processor -- start 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff740dc1740 1 -- start start 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 0x55aeac777510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac777a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac777f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff740dc1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aeac662dc0 con 0x55aeac3b0840 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff740dc1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55aeac6ef1f0 con 0x55aeac3d1520 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff740dc1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55aeac6de620 con 0x55aeac3a8660 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff72bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac777f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff72bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac777f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40190/0 (socket says 172.21.15.22:40190) 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff72bfff640 1 -- 172.21.15.22:0/330755261 learned_addr learned my addr 172.21.15.22:0/330755261 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff738dea640 1 --2- 172.21.15.22:0/330755261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 0x55aeac777510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff733fff640 1 --2- 172.21.15.22:0/330755261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac777a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff72bfff640 1 -- 172.21.15.22:0/330755261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 msgr2=0x55aeac777a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff72bfff640 1 --2- 172.21.15.22:0/330755261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac777a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff72bfff640 1 -- 172.21.15.22:0/330755261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 msgr2=0x55aeac777510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff72bfff640 1 --2- 172.21.15.22:0/330755261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 0x55aeac777510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.412+0000 7ff72bfff640 1 -- 172.21.15.22:0/330755261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeac6a6fd0 con 0x55aeac3b0840 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.413+0000 7ff731ffb640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7200b6510 0x7ff7200b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.413+0000 7ff72bfff640 1 --2- 172.21.15.22:0/330755261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac777f90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0057c0 tx=0x7ff71c031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=343dc485356bd7fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.413+0000 7ff738dea640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7200b6510 0x7ff7200b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.413+0000 7ff731ffb640 1 -- 172.21.15.22:0/2524157740 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff7240e7300 con 0x7ff734102ae0 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.413+0000 7ff72a7fc640 1 -- 172.21.15.22:0/330755261 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c040070 con 0x55aeac3b0840 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.413+0000 7ff72a7fc640 1 -- 172.21.15.22:0/330755261 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff71c031e50 con 0x55aeac3b0840 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.413+0000 7ff72a7fc640 1 -- 172.21.15.22:0/330755261 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c035040 con 0x55aeac3b0840 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.414+0000 7ff740dc1740 1 -- 172.21.15.22:0/330755261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 msgr2=0x55aeac777f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:11.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.414+0000 7ff738dea640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7200b6510 0x7ff7200b8a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff72c005fd0 tx=0x7ff72c009580 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.414+0000 7ff740dc1740 1 --2- 172.21.15.22:0/330755261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac777f90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff71c0057c0 tx=0x7ff71c031ba0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.414+0000 7ff740dc1740 1 -- 172.21.15.22:0/330755261 shutdown_connections 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.414+0000 7ff740dc1740 1 --2- 172.21.15.22:0/330755261 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac777a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.414+0000 7ff740dc1740 1 --2- 172.21.15.22:0/330755261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac777f90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.414+0000 7ff740dc1740 1 --2- 172.21.15.22:0/330755261 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 0x55aeac777510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.414+0000 7ff740dc1740 1 -- 172.21.15.22:0/330755261 >> 172.21.15.22:0/330755261 conn(0x55aeac3c5910 msgr2=0x55aeac775400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.414+0000 7ff740dc1740 1 -- 172.21.15.22:0/330755261 shutdown_connections 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.414+0000 7ff740dc1740 1 -- 172.21.15.22:0/330755261 wait complete. 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff740dc1740 1 -- start start 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff740dc1740 1 Processor -- start 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3a8660 0x55aeac782bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac783100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3d1520 0x55aeac78ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff740dc1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55aeac679300 con 0x55aeac3b0840 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff740dc1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55aeac6e2430 con 0x55aeac3a8660 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff740dc1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55aeac53fbb0 con 0x55aeac3d1520 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff740dc1740 10 client.0 _ll_register_callbacks cb 0x55aeac693120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff72bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac783100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff72bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac783100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40196/0 (socket says 172.21.15.22:40196) 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.415+0000 7ff72bfff640 1 -- 172.21.15.22:0/2242824771 learned_addr learned my addr 172.21.15.22:0/2242824771 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff738dea640 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3d1520 0x55aeac78ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff733fff640 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3a8660 0x55aeac782bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff72bfff640 1 -- 172.21.15.22:0/2242824771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3d1520 msgr2=0x55aeac78ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff72bfff640 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3d1520 0x55aeac78ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff72bfff640 1 -- 172.21.15.22:0/2242824771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3a8660 msgr2=0x55aeac782bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff72bfff640 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3a8660 0x55aeac782bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff72bfff640 1 -- 172.21.15.22:0/2242824771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeac668780 con 0x55aeac3b0840 2024-09-21T04:04:11.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff72bfff640 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac783100 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff71c003730 tx=0x7ff71c031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8633613d159ea7d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff7137fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff7137fe640 1 -- 172.21.15.22:0/2242824771 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c052060 con 0x55aeac3b0840 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff740dc1740 1 -- 172.21.15.22:0/2242824771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff71c031e50 con 0x55aeac3b0840 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff7137fe640 1 -- 172.21.15.22:0/2242824771 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff71c03c850 con 0x55aeac3b0840 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff7137fe640 1 -- 172.21.15.22:0/2242824771 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff71c059050 con 0x55aeac3b0840 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff740dc1740 10 client.15714 fetch_fsmap learned FSMap version 31 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.416+0000 7ff740dc1740 1 -- 172.21.15.22:0/2242824771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55aeac43cb00 con 0x55aeac3b0840 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.417+0000 7ff7137fe640 1 -- 172.21.15.22:0/2242824771 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff71c031e50 con 0x55aeac3b0840 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.417+0000 7ff7137fe640 1 -- 172.21.15.22:0/2242824771 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8386+0+0 (secure 0 0 0) 0x7ff71c0448f0 con 0x55aeac3b0840 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.417+0000 7ff740dc1740 10 client.15714 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.417+0000 7ff740dc1740 10 client.15714 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.417+0000 7ff740dc1740 20 client.15714 populate_metadata read hostname 'smithi022' 2024-09-21T04:04:11.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.417+0000 7ff740dc1740 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55aeac38fea0 0x55aeac794d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.417+0000 7ff740dc1740 4 client.15714 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.417+0000 7ff740dc1740 1 -- 172.21.15.22:0/2242824771 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aeac6f1140 con 0x55aeac38fea0 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.417+0000 7ff733fff640 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55aeac38fea0 0x55aeac794d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.418+0000 7ff733fff640 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55aeac38fea0 0x55aeac794d40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=549148884a1e2e4d server_cookie=6fe6d27b766fc53a in_seq=0 out_seq=0 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.418+0000 7ff7137fe640 10 client.15714 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.418+0000 7ff7137fe640 1 -- 172.21.15.22:0/2242824771 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55aeac6f1140 con 0x55aeac38fea0 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.418+0000 7ff7137fe640 10 client.15714 handle_command_reply: tid=0 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 client.15714 shutdown 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 -- 172.21.15.22:0/2242824771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 msgr2=0x55aeac783100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac783100 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7ff71c003730 tx=0x7ff71c031630 comp rx=0 tx=0).stop 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 -- 172.21.15.22:0/2242824771 shutdown_connections 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55aeac38fea0 0x55aeac794d40 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3d1520 0x55aeac78ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac783100 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 --2- 172.21.15.22:0/2242824771 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3a8660 0x55aeac782bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 -- 172.21.15.22:0/2242824771 >> 172.21.15.22:0/2242824771 conn(0x55aeac3c5910 msgr2=0x55aeac77a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff7137fe640 0 client.15714 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 -- 172.21.15.22:0/2242824771 shutdown_connections 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 1 -- 172.21.15.22:0/2242824771 wait complete. 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.419+0000 7ff740dc1740 20 client.15714 trim_cache size 0 max 16384 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff740dc1740 1 Processor -- start 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff740dc1740 1 -- start start 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac7847f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3b0840 0x55aeac77c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3d1520 0x55aeac77ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff740dc1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b0ac0 con 0x55aeac3d1520 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff740dc1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b26c0 con 0x55aeac3b0840 2024-09-21T04:04:11.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff740dc1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b1190 con 0x55aeac3a8660 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff738dea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3d1520 0x55aeac77ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff738dea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3d1520 0x55aeac77ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40206/0 (socket says 172.21.15.22:40206) 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff738dea640 1 -- 172.21.15.22:0/2972926507 learned_addr learned my addr 172.21.15.22:0/2972926507 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff72bfff640 1 --2- 172.21.15.22:0/2972926507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3b0840 0x55aeac77c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.437+0000 7ff733fff640 1 --2- 172.21.15.22:0/2972926507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac7847f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.438+0000 7ff738dea640 1 -- 172.21.15.22:0/2972926507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 msgr2=0x55aeac7847f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.438+0000 7ff738dea640 1 --2- 172.21.15.22:0/2972926507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac7847f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.438+0000 7ff738dea640 1 -- 172.21.15.22:0/2972926507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3b0840 msgr2=0x55aeac77c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.438+0000 7ff738dea640 1 --2- 172.21.15.22:0/2972926507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3b0840 0x55aeac77c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.438+0000 7ff738dea640 1 -- 172.21.15.22:0/2972926507 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeac4b3960 con 0x55aeac3d1520 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.438+0000 7ff738dea640 1 --2- 172.21.15.22:0/2972926507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3d1520 0x55aeac77ccd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff72c01f6d0 tx=0x7ff72c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68958a7d4119b2a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.438+0000 7ff729ffb640 1 -- 172.21.15.22:0/2972926507 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c01f310 con 0x55aeac3d1520 2024-09-21T04:04:11.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.438+0000 7ff729ffb640 1 -- 172.21.15.22:0/2972926507 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff72c01e8a0 con 0x55aeac3d1520 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.438+0000 7ff729ffb640 1 -- 172.21.15.22:0/2972926507 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff72c027880 con 0x55aeac3d1520 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.439+0000 7ff740dc1740 1 -- 172.21.15.22:0/2972926507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3d1520 msgr2=0x55aeac77ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.439+0000 7ff740dc1740 1 --2- 172.21.15.22:0/2972926507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3d1520 0x55aeac77ccd0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7ff72c01f6d0 tx=0x7ff72c015000 comp rx=0 tx=0).stop 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.439+0000 7ff740dc1740 1 -- 172.21.15.22:0/2972926507 shutdown_connections 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.439+0000 7ff740dc1740 1 --2- 172.21.15.22:0/2972926507 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3d1520 0x55aeac77ccd0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.439+0000 7ff740dc1740 1 --2- 172.21.15.22:0/2972926507 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3b0840 0x55aeac77c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.439+0000 7ff740dc1740 1 --2- 172.21.15.22:0/2972926507 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac7847f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.439+0000 7ff740dc1740 1 -- 172.21.15.22:0/2972926507 >> 172.21.15.22:0/2972926507 conn(0x55aeac3c5910 msgr2=0x55aeac7840e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.439+0000 7ff740dc1740 1 -- 172.21.15.22:0/2972926507 shutdown_connections 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.439+0000 7ff740dc1740 1 -- 172.21.15.22:0/2972926507 wait complete. 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.439+0000 7ff740dc1740 1 -- start start 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff740dc1740 1 Processor -- start 2024-09-21T04:04:11.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac7fa4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac7fa9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff740dc1740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 0x55aeac7faf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff740dc1740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b1f30 con 0x55aeac3b0840 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff740dc1740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341b1860 con 0x55aeac3d1520 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff740dc1740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff7341aeaa0 con 0x55aeac3a8660 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff740dc1740 10 client.0 _ll_register_callbacks cb 0x7ff71c031a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff72bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac7fa9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff72bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac7fa9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:40212/0 (socket says 172.21.15.22:40212) 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff72bfff640 1 -- 172.21.15.22:0/1396417945 learned_addr learned my addr 172.21.15.22:0/1396417945 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff733fff640 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac7fa4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff738dea640 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 0x55aeac7faf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff72bfff640 1 -- 172.21.15.22:0/1396417945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 msgr2=0x55aeac7fa4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:11.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff72bfff640 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac7fa4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff72bfff640 1 -- 172.21.15.22:0/1396417945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 msgr2=0x55aeac7faf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff72bfff640 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 0x55aeac7faf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.440+0000 7ff72bfff640 1 -- 172.21.15.22:0/1396417945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeac795e40 con 0x55aeac3b0840 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff733fff640 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac7fa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff738dea640 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 0x55aeac7faf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff72bfff640 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac7fa9e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff71c001eb0 tx=0x7ff71c009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7c266515890b5dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff7137fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff7137fe640 1 -- 172.21.15.22:0/1396417945 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff71c061070 con 0x55aeac3b0840 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff7137fe640 1 -- 172.21.15.22:0/1396417945 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff71c044810 con 0x55aeac3b0840 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff740dc1740 1 -- 172.21.15.22:0/1396417945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff72c01e8a0 con 0x55aeac3b0840 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff7137fe640 1 -- 172.21.15.22:0/1396417945 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7ff71c06a050 con 0x55aeac3b0840 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff740dc1740 10 client.15720 fetch_fsmap learned FSMap version 31 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff740dc1740 1 -- 172.21.15.22:0/1396417945 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55aeac803bf0 con 0x55aeac3b0840 2024-09-21T04:04:11.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.441+0000 7ff7137fe640 1 -- 172.21.15.22:0/1396417945 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff72c01e8a0 con 0x55aeac3b0840 2024-09-21T04:04:11.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.442+0000 7ff7137fe640 1 -- 172.21.15.22:0/1396417945 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 31) ==== 8386+0+0 (secure 0 0 0) 0x7ff71c064020 con 0x55aeac3b0840 2024-09-21T04:04:11.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.442+0000 7ff740dc1740 10 client.15720 fetch_fsmap finished waiting for FSMap version 31 2024-09-21T04:04:11.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.442+0000 7ff740dc1740 10 client.15720 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:04:11.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.442+0000 7ff740dc1740 20 client.15720 populate_metadata read hostname 'smithi022' 2024-09-21T04:04:11.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.442+0000 7ff740dc1740 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55aeac365250 0x55aeac806460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:11.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.442+0000 7ff740dc1740 4 client.15720 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "896e9a65", "release": true, "await": true}] 2024-09-21T04:04:11.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.442+0000 7ff740dc1740 1 -- 172.21.15.22:0/1396417945 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "896e9a65", "release": true, "await": true}) -- 0x55aeac6ecbf0 con 0x55aeac365250 2024-09-21T04:04:11.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.442+0000 7ff733fff640 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55aeac365250 0x55aeac806460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:11.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.443+0000 7ff7137fe640 10 client.15720 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:04:11.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.443+0000 7ff733fff640 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55aeac365250 0x55aeac806460 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b509ec67e8da54f4 server_cookie=3cb4c5c80d778707 in_seq=0 out_seq=0 2024-09-21T04:04:11.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff7137fe640 1 -- 172.21.15.22:0/1396417945 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55aeac6ecbf0 con 0x55aeac365250 2024-09-21T04:04:11.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff7137fe640 10 client.15720 handle_command_reply: tid=0 2024-09-21T04:04:11.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff740dc1740 1 client.15720 shutdown 2024-09-21T04:04:11.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff740dc1740 1 -- 172.21.15.22:0/1396417945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 msgr2=0x55aeac7fa9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:11.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff740dc1740 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac7fa9e0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7ff71c001eb0 tx=0x7ff71c009520 comp rx=0 tx=0).stop 2024-09-21T04:04:11.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff740dc1740 1 -- 172.21.15.22:0/1396417945 shutdown_connections 2024-09-21T04:04:11.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff740dc1740 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55aeac365250 0x55aeac806460 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff740dc1740 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55aeac3d1520 0x55aeac7faf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff740dc1740 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55aeac3b0840 0x55aeac7fa9e0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff740dc1740 1 --2- 172.21.15.22:0/1396417945 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55aeac3a8660 0x55aeac7fa4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff740dc1740 1 -- 172.21.15.22:0/1396417945 >> 172.21.15.22:0/1396417945 conn(0x55aeac3c5910 msgr2=0x55aeac778f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:11.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.474+0000 7ff7137fe640 0 client.15720 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:04:11.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.475+0000 7ff740dc1740 1 -- 172.21.15.22:0/1396417945 shutdown_connections 2024-09-21T04:04:11.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.475+0000 7ff740dc1740 1 -- 172.21.15.22:0/1396417945 wait complete. 2024-09-21T04:04:11.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.475+0000 7ff740dc1740 20 client.15720 trim_cache size 0 max 16384 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 31, 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 8, 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "896e9a65": { 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 8, 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:04:11.479 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 137.0, 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:04:11.480 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:04:11.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.475+0000 7ff73a84d640 1 -- 172.21.15.22:0/2524157740 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7200b6510 msgr2=0x7ff7200b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:11.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.475+0000 7ff73a84d640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7200b6510 0x7ff7200b8a20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff72c005fd0 tx=0x7ff72c009580 comp rx=0 tx=0).stop 2024-09-21T04:04:11.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.475+0000 7ff73a84d640 1 -- 172.21.15.22:0/2524157740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff734102ae0 msgr2=0x7ff734199350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:11.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.475+0000 7ff73a84d640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff734102ae0 0x7ff734199350 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7ff72400d950 tx=0x7ff72400de10 comp rx=0 tx=0).stop 2024-09-21T04:04:11.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.476+0000 7ff73a84d640 1 -- 172.21.15.22:0/2524157740 shutdown_connections 2024-09-21T04:04:11.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.476+0000 7ff73a84d640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7200b6510 0x7ff7200b8a20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.476+0000 7ff73a84d640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff734108420 0x7ff7341998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.476+0000 7ff73a84d640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff734108d70 0x7ff73419eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.476+0000 7ff73a84d640 1 --2- 172.21.15.22:0/2524157740 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff734102ae0 0x7ff734199350 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.476+0000 7ff73a84d640 1 -- 172.21.15.22:0/2524157740 >> 172.21.15.22:0/2524157740 conn(0x7ff734079770 msgr2=0x7ff734106530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.476+0000 7ff73a84d640 1 -- 172.21.15.22:0/2524157740 shutdown_connections 2024-09-21T04:04:11.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:11.476+0000 7ff73a84d640 1 -- 172.21.15.22:0/2524157740 wait complete. 2024-09-21T04:04:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:12 smithi022 ceph-mon[31015]: pgmap v426: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 411 KiB/s wr, 13 op/s 2024-09-21T04:04:12.394 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '896e9a65', total seconds elapsed: 20.8 2024-09-21T04:04:12.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:12 smithi073 ceph-mon[34443]: pgmap v426: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 411 KiB/s wr, 13 op/s 2024-09-21T04:04:12.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:12 smithi060 ceph-mon[33722]: pgmap v426: 129 pgs: 129 active+clean; 780 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 411 KiB/s wr, 13 op/s 2024-09-21T04:04:14.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:14 smithi022 ceph-mon[31015]: pgmap v427: 129 pgs: 129 active+clean; 781 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2024-09-21T04:04:14.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:14 smithi073 ceph-mon[34443]: pgmap v427: 129 pgs: 129 active+clean; 781 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2024-09-21T04:04:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:14 smithi060 ceph-mon[33722]: pgmap v427: 129 pgs: 129 active+clean; 781 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.0 MiB/s wr, 16 op/s 2024-09-21T04:04:16.524 INFO:teuthology.orchestra.run.smithi022.stderr:creating primary keys... 2024-09-21T04:04:16.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:16 smithi022 ceph-mon[31015]: pgmap v428: 129 pgs: 129 active+clean; 781 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-09-21T04:04:16.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:16 smithi073 ceph-mon[34443]: pgmap v428: 129 pgs: 129 active+clean; 781 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-09-21T04:04:16.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:16 smithi060 ceph-mon[33722]: pgmap v428: 129 pgs: 129 active+clean; 781 MiB data, 671 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 6.7 MiB/s wr, 18 op/s 2024-09-21T04:04:18.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:18 smithi022 ceph-mon[31015]: pgmap v429: 129 pgs: 129 active+clean; 793 MiB data, 680 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 21 op/s 2024-09-21T04:04:18.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:18 smithi073 ceph-mon[34443]: pgmap v429: 129 pgs: 129 active+clean; 793 MiB data, 680 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 21 op/s 2024-09-21T04:04:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:18 smithi060 ceph-mon[33722]: pgmap v429: 129 pgs: 129 active+clean; 793 MiB data, 680 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 13 MiB/s wr, 21 op/s 2024-09-21T04:04:20.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:20 smithi022 ceph-mon[31015]: pgmap v430: 129 pgs: 129 active+clean; 801 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 29 op/s 2024-09-21T04:04:20.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:20 smithi073 ceph-mon[34443]: pgmap v430: 129 pgs: 129 active+clean; 801 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 29 op/s 2024-09-21T04:04:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:20 smithi060 ceph-mon[33722]: pgmap v430: 129 pgs: 129 active+clean; 801 MiB data, 690 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 17 MiB/s wr, 29 op/s 2024-09-21T04:04:22.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:22 smithi022 ceph-mon[31015]: pgmap v431: 129 pgs: 129 active+clean; 850 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 MiB/s wr, 38 op/s 2024-09-21T04:04:22.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:22 smithi073 ceph-mon[34443]: pgmap v431: 129 pgs: 129 active+clean; 850 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 MiB/s wr, 38 op/s 2024-09-21T04:04:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:22 smithi060 ceph-mon[33722]: pgmap v431: 129 pgs: 129 active+clean; 850 MiB data, 715 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 29 MiB/s wr, 38 op/s 2024-09-21T04:04:23.495 INFO:teuthology.orchestra.run.smithi022.stderr:done in 79.70 s (drop tables 0.01 s, create tables 0.05 s, client-side generate 46.75 s, vacuum 25.92 s, primary keys 6.97 s). 2024-09-21T04:04:23.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-09-21T04:04:23.703 INFO:teuthology.orchestra.run.smithi022.stderr:starting vacuum...end. 2024-09-21T04:04:24.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:24 smithi022 ceph-mon[31015]: pgmap v432: 129 pgs: 129 active+clean; 894 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 41 op/s 2024-09-21T04:04:24.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:24 smithi073 ceph-mon[34443]: pgmap v432: 129 pgs: 129 active+clean; 894 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 41 op/s 2024-09-21T04:04:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:24 smithi060 ceph-mon[33722]: pgmap v432: 129 pgs: 129 active+clean; 894 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 36 MiB/s wr, 41 op/s 2024-09-21T04:04:26.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:26 smithi022 ceph-mon[31015]: pgmap v433: 129 pgs: 129 active+clean; 942 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 50 op/s 2024-09-21T04:04:26.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:26 smithi073 ceph-mon[34443]: pgmap v433: 129 pgs: 129 active+clean; 942 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 50 op/s 2024-09-21T04:04:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:26 smithi060 ceph-mon[33722]: pgmap v433: 129 pgs: 129 active+clean; 942 MiB data, 794 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 41 MiB/s wr, 50 op/s 2024-09-21T04:04:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:28 smithi022 ceph-mon[31015]: pgmap v434: 129 pgs: 129 active+clean; 940 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 MiB/s wr, 51 op/s 2024-09-21T04:04:28.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:28 smithi073 ceph-mon[34443]: pgmap v434: 129 pgs: 129 active+clean; 940 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 MiB/s wr, 51 op/s 2024-09-21T04:04:28.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:28 smithi060 ceph-mon[33722]: pgmap v434: 129 pgs: 129 active+clean; 940 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 39 MiB/s wr, 51 op/s 2024-09-21T04:04:28.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 5.0 s, 1669.4 tps, lat 55.492 ms stddev 75.807 2024-09-21T04:04:30.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:30 smithi022 ceph-mon[31015]: pgmap v435: 129 pgs: 129 active+clean; 948 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 34 MiB/s wr, 80 op/s 2024-09-21T04:04:30.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:30 smithi073 ceph-mon[34443]: pgmap v435: 129 pgs: 129 active+clean; 948 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 34 MiB/s wr, 80 op/s 2024-09-21T04:04:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:30 smithi060 ceph-mon[33722]: pgmap v435: 129 pgs: 129 active+clean; 948 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 34 MiB/s wr, 80 op/s 2024-09-21T04:04:32.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:32 smithi022 ceph-mon[31015]: pgmap v436: 129 pgs: 129 active+clean; 936 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 103 op/s 2024-09-21T04:04:32.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:32 smithi073 ceph-mon[34443]: pgmap v436: 129 pgs: 129 active+clean; 936 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 103 op/s 2024-09-21T04:04:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:32 smithi060 ceph-mon[33722]: pgmap v436: 129 pgs: 129 active+clean; 936 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 31 MiB/s wr, 103 op/s 2024-09-21T04:04:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 10.0 s, 1197.8 tps, lat 83.054 ms stddev 27.978 2024-09-21T04:04:34.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:34 smithi022 ceph-mon[31015]: pgmap v437: 129 pgs: 129 active+clean; 936 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 22 MiB/s wr, 254 op/s 2024-09-21T04:04:34.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:34 smithi073 ceph-mon[34443]: pgmap v437: 129 pgs: 129 active+clean; 936 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 22 MiB/s wr, 254 op/s 2024-09-21T04:04:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:34 smithi060 ceph-mon[33722]: pgmap v437: 129 pgs: 129 active+clean; 936 MiB data, 821 MiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 22 MiB/s wr, 254 op/s 2024-09-21T04:04:36.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:36 smithi022 ceph-mon[31015]: pgmap v438: 129 pgs: 129 active+clean; 936 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 16 MiB/s wr, 406 op/s 2024-09-21T04:04:36.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:36 smithi073 ceph-mon[34443]: pgmap v438: 129 pgs: 129 active+clean; 936 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 16 MiB/s wr, 406 op/s 2024-09-21T04:04:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:36 smithi060 ceph-mon[33722]: pgmap v438: 129 pgs: 129 active+clean; 936 MiB data, 810 MiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 16 MiB/s wr, 406 op/s 2024-09-21T04:04:38.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:38 smithi022 ceph-mon[31015]: pgmap v439: 129 pgs: 129 active+clean; 936 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 649 op/s 2024-09-21T04:04:38.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:38 smithi073 ceph-mon[34443]: pgmap v439: 129 pgs: 129 active+clean; 936 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 649 op/s 2024-09-21T04:04:38.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:38 smithi060 ceph-mon[33722]: pgmap v439: 129 pgs: 129 active+clean; 936 MiB data, 911 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 649 op/s 2024-09-21T04:04:38.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 15.0 s, 1148.8 tps, lat 87.143 ms stddev 24.594 2024-09-21T04:04:40.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:40 smithi022 ceph-mon[31015]: pgmap v440: 129 pgs: 129 active+clean; 936 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.6 MiB/s wr, 800 op/s 2024-09-21T04:04:40.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:40 smithi073 ceph-mon[34443]: pgmap v440: 129 pgs: 129 active+clean; 936 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.6 MiB/s wr, 800 op/s 2024-09-21T04:04:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:40 smithi060 ceph-mon[33722]: pgmap v440: 129 pgs: 129 active+clean; 936 MiB data, 1010 MiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 9.6 MiB/s wr, 800 op/s 2024-09-21T04:04:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:42 smithi022 ceph-mon[31015]: pgmap v441: 129 pgs: 129 active+clean; 936 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.7 MiB/s wr, 997 op/s 2024-09-21T04:04:42.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:42 smithi073 ceph-mon[34443]: pgmap v441: 129 pgs: 129 active+clean; 936 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.7 MiB/s wr, 997 op/s 2024-09-21T04:04:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:42 smithi060 ceph-mon[33722]: pgmap v441: 129 pgs: 129 active+clean; 936 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 9.7 MiB/s wr, 997 op/s 2024-09-21T04:04:43.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 20.0 s, 1091.4 tps, lat 91.235 ms stddev 50.262 2024-09-21T04:04:43.966 INFO:tasks.quiescer.fs.[cephfs]:Total duration (55.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T04:04:43.966 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T04:04:43.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:04:44.411 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:44 smithi022 ceph-mon[31015]: pgmap v442: 129 pgs: 129 active+clean; 936 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 1.28k op/s 2024-09-21T04:04:44.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:44 smithi073 ceph-mon[34443]: pgmap v442: 129 pgs: 129 active+clean; 936 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 1.28k op/s 2024-09-21T04:04:44.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:44 smithi060 ceph-mon[33722]: pgmap v442: 129 pgs: 129 active+clean; 936 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 12 MiB/s wr, 1.28k op/s 2024-09-21T04:04:46.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:46 smithi073 ceph-mon[34443]: pgmap v443: 129 pgs: 129 active+clean; 939 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-21T04:04:46.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:46 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:04:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:46 smithi060 ceph-mon[33722]: pgmap v443: 129 pgs: 129 active+clean; 939 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-21T04:04:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:46 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:04:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:46 smithi022 ceph-mon[31015]: pgmap v443: 129 pgs: 129 active+clean; 939 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-21T04:04:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:46 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:04:48.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:48 smithi073 ceph-mon[34443]: pgmap v444: 129 pgs: 129 active+clean; 939 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 1.36k op/s 2024-09-21T04:04:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:48 smithi060 ceph-mon[33722]: pgmap v444: 129 pgs: 129 active+clean; 939 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 1.36k op/s 2024-09-21T04:04:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 25.0 s, 868.2 tps, lat 115.499 ms stddev 68.275 2024-09-21T04:04:48.711 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:48 smithi022 ceph-mon[31015]: pgmap v444: 129 pgs: 129 active+clean; 939 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 MiB/s wr, 1.36k op/s 2024-09-21T04:04:49.488 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:49 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3595156554' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:49.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:49 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3595156554' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:49.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:49 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3595156554' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:04:49.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.834+0000 7fd764b9e640 1 -- 172.21.15.22:0/2004460291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7601083a0 msgr2=0x7fd7601087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.834+0000 7fd764b9e640 1 --2- 172.21.15.22:0/2004460291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7601083a0 0x7fd7601087b0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7fd754009900 tx=0x7fd75402a3f0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.834+0000 7fd764b9e640 1 -- 172.21.15.22:0/2004460291 shutdown_connections 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.834+0000 7fd764b9e640 1 --2- 172.21.15.22:0/2004460291 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd760108cf0 0x7fd76010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.834+0000 7fd764b9e640 1 --2- 172.21.15.22:0/2004460291 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7601083a0 0x7fd7601087b0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.834+0000 7fd764b9e640 1 --2- 172.21.15.22:0/2004460291 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd760102a60 0x7fd760102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.834+0000 7fd764b9e640 1 -- 172.21.15.22:0/2004460291 >> 172.21.15.22:0/2004460291 conn(0x7fd760079730 msgr2=0x7fd760079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.834+0000 7fd764b9e640 1 -- 172.21.15.22:0/2004460291 shutdown_connections 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.834+0000 7fd764b9e640 1 -- 172.21.15.22:0/2004460291 wait complete. 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.835+0000 7fd764b9e640 1 Processor -- start 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.835+0000 7fd764b9e640 1 -- start start 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd764b9e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd760102a60 0x7fd760199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd764b9e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7601083a0 0x7fd7601998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd764b9e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd760108cf0 0x7fd76019eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd764b9e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd760112810 con 0x7fd7601083a0 2024-09-21T04:04:49.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd764b9e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd760112690 con 0x7fd760108cf0 2024-09-21T04:04:49.962 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:04:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd764b9e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd760112990 con 0x7fd760102a60 2024-09-21T04:04:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7601083a0 0x7fd7601998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7601083a0 0x7fd7601998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:44878/0 (socket says 172.21.15.22:44878) 2024-09-21T04:04:49.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75dd9b640 1 -- 172.21.15.22:0/3595156554 learned_addr learned my addr 172.21.15.22:0/3595156554 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75e59c640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd760102a60 0x7fd760199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75ed9d640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd760108cf0 0x7fd76019eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75dd9b640 1 -- 172.21.15.22:0/3595156554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd760102a60 msgr2=0x7fd760199340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75dd9b640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd760102a60 0x7fd760199340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75dd9b640 1 -- 172.21.15.22:0/3595156554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd760108cf0 msgr2=0x7fd76019eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75dd9b640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd760108cf0 0x7fd76019eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75dd9b640 1 -- 172.21.15.22:0/3595156554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76019f1f0 con 0x7fd7601083a0 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.836+0000 7fd75dd9b640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7601083a0 0x7fd7601998e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd754005940 tx=0x7fd7540042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.837+0000 7fd74f7fe640 1 -- 172.21.15.22:0/3595156554 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75403f030 con 0x7fd7601083a0 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.837+0000 7fd764b9e640 1 -- 172.21.15.22:0/3595156554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76019f480 con 0x7fd7601083a0 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.837+0000 7fd74f7fe640 1 -- 172.21.15.22:0/3595156554 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd754003c90 con 0x7fd7601083a0 2024-09-21T04:04:49.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.837+0000 7fd74f7fe640 1 -- 172.21.15.22:0/3595156554 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd754035070 con 0x7fd7601083a0 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.837+0000 7fd764b9e640 1 -- 172.21.15.22:0/3595156554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd76019f960 con 0x7fd7601083a0 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.838+0000 7fd764b9e640 1 -- 172.21.15.22:0/3595156554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd760102e70 con 0x7fd7601083a0 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.839+0000 7fd74f7fe640 1 -- 172.21.15.22:0/3595156554 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd754042030 con 0x7fd7601083a0 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.840+0000 7fd74f7fe640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd7480b6540 0x7fd7480b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.840+0000 7fd75e59c640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd7480b6540 0x7fd7480b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.840+0000 7fd74f7fe640 1 -- 172.21.15.22:0/3595156554 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fd754108070 con 0x7fd7601083a0 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.841+0000 7fd75e59c640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd7480b6540 0x7fd7480b8a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd750005e10 tx=0x7fd750005da0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:48.844+0000 7fd74f7fe640 1 -- 172.21.15.22:0/3595156554 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd7540ce4e0 con 0x7fd7601083a0 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.213+0000 7fd764b9e640 1 -- 172.21.15.22:0/3595156554 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd76019a470 con 0x7fd7601083a0 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.214+0000 7fd74f7fe640 1 -- 172.21.15.22:0/3595156554 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+11967 (secure 0 0 0) 0x7fd76019a470 con 0x7fd7601083a0 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 32 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.218+0000 7fd764b9e640 1 -- 172.21.15.22:0/3595156554 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd7480b6540 msgr2=0x7fd7480b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.218+0000 7fd764b9e640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd7480b6540 0x7fd7480b8a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd750005e10 tx=0x7fd750005da0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.218+0000 7fd764b9e640 1 -- 172.21.15.22:0/3595156554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7601083a0 msgr2=0x7fd7601998e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.218+0000 7fd764b9e640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7601083a0 0x7fd7601998e0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd754005940 tx=0x7fd7540042f0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.965 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":32,"btime":"2024-09-21T04:04:45:341781+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":32,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:04:44.493790+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:04:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.218+0000 7fd764b9e640 1 -- 172.21.15.22:0/3595156554 shutdown_connections 2024-09-21T04:04:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.218+0000 7fd764b9e640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd7480b6540 0x7fd7480b8a50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.218+0000 7fd764b9e640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd760108cf0 0x7fd76019eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.218+0000 7fd764b9e640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd7601083a0 0x7fd7601998e0 secure :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fd754005940 tx=0x7fd7540042f0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.218+0000 7fd764b9e640 1 --2- 172.21.15.22:0/3595156554 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd760102a60 0x7fd760199340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:49.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.218+0000 7fd764b9e640 1 -- 172.21.15.22:0/3595156554 >> 172.21.15.22:0/3595156554 conn(0x7fd760079730 msgr2=0x7fd760104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.219+0000 7fd764b9e640 1 -- 172.21.15.22:0/3595156554 shutdown_connections 2024-09-21T04:04:49.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:49.219+0000 7fd764b9e640 1 -- 172.21.15.22:0/3595156554 wait complete. 2024-09-21T04:04:50.627 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:50 smithi022 ceph-mon[31015]: pgmap v445: 129 pgs: 129 active+clean; 939 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-09-21T04:04:50.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:50 smithi060 ceph-mon[33722]: pgmap v445: 129 pgs: 129 active+clean; 939 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-09-21T04:04:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:50 smithi073 ceph-mon[34443]: pgmap v445: 129 pgs: 129 active+clean; 939 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-09-21T04:04:51.088 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T04:04:51.089 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T04:04:51.554 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:04:51.692 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:51 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:04:51.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:51 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:04:51.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:51 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:04:52.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.194+0000 7f1770fc1640 1 -- 172.21.15.22:0/1119425769 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764030be0 con 0x7f176c107c00 2024-09-21T04:04:52.198 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.195+0000 7f1774227640 1 -- 172.21.15.22:0/1119425769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176c107c00 msgr2=0x7f176c1080e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.195+0000 7f1774227640 1 --2- 172.21.15.22:0/1119425769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176c107c00 0x7f176c1080e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f1764009ca0 tx=0x7f176402a8b0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.196+0000 7f1774227640 1 -- 172.21.15.22:0/1119425769 shutdown_connections 2024-09-21T04:04:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.196+0000 7f1774227640 1 --2- 172.21.15.22:0/1119425769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176c107c00 0x7f176c1080e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.196+0000 7f1774227640 1 --2- 172.21.15.22:0/1119425769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c103110 0x7f176c107640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.196+0000 7f1774227640 1 --2- 172.21.15.22:0/1119425769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f176c1027c0 0x7f176c102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.196+0000 7f1774227640 1 -- 172.21.15.22:0/1119425769 >> 172.21.15.22:0/1119425769 conn(0x7f176c0797c0 msgr2=0x7f176c079bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.196+0000 7f1774227640 1 -- 172.21.15.22:0/1119425769 shutdown_connections 2024-09-21T04:04:52.199 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.196+0000 7f1774227640 1 -- 172.21.15.22:0/1119425769 wait complete. 2024-09-21T04:04:52.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.197+0000 7f1774227640 1 Processor -- start 2024-09-21T04:04:52.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.197+0000 7f1774227640 1 -- start start 2024-09-21T04:04:52.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.197+0000 7f1774227640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176c1027c0 0x7f176c1a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.200 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.197+0000 7f1774227640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c103110 0x7f176c1a0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.197+0000 7f1774227640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f176c107c00 0x7f176c1a6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.197+0000 7f1774227640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f176c119fb0 con 0x7f176c103110 2024-09-21T04:04:52.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.197+0000 7f1774227640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f176c119e30 con 0x7f176c107c00 2024-09-21T04:04:52.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.197+0000 7f1774227640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f176c11a130 con 0x7f176c1027c0 2024-09-21T04:04:52.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.198+0000 7f17717c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c103110 0x7f176c1a0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.198+0000 7f17717c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c103110 0x7f176c1a0ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39784/0 (socket says 172.21.15.22:39784) 2024-09-21T04:04:52.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.198+0000 7f17717c2640 1 -- 172.21.15.22:0/698009304 learned_addr learned my addr 172.21.15.22:0/698009304 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:52.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.198+0000 7f1771fc3640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176c1027c0 0x7f176c1a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.201 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.198+0000 7f17727c4640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f176c107c00 0x7f176c1a6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.198+0000 7f1771fc3640 1 -- 172.21.15.22:0/698009304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f176c107c00 msgr2=0x7f176c1a6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.198+0000 7f1771fc3640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f176c107c00 0x7f176c1a6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.198+0000 7f1771fc3640 1 -- 172.21.15.22:0/698009304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c103110 msgr2=0x7f176c1a0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.198+0000 7f1771fc3640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c103110 0x7f176c1a0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.198+0000 7f1771fc3640 1 -- 172.21.15.22:0/698009304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f176c1a6890 con 0x7f176c1027c0 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.199+0000 7f1771fc3640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176c1027c0 0x7f176c1a0920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f175c00d6d0 tx=0x7f175c00db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.199+0000 7f1762ffd640 1 -- 172.21.15.22:0/698009304 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175c017070 con 0x7f176c1027c0 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.199+0000 7f1774227640 1 -- 172.21.15.22:0/698009304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f176c1a6b80 con 0x7f176c1027c0 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.199+0000 7f1762ffd640 1 -- 172.21.15.22:0/698009304 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f175c009820 con 0x7f176c1027c0 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.199+0000 7f1762ffd640 1 -- 172.21.15.22:0/698009304 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f175c004bc0 con 0x7f176c1027c0 2024-09-21T04:04:52.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.199+0000 7f1774227640 1 -- 172.21.15.22:0/698009304 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f176c1ad2e0 con 0x7f176c1027c0 2024-09-21T04:04:52.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.203+0000 7f1762ffd640 1 -- 172.21.15.22:0/698009304 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f175c005220 con 0x7f176c1027c0 2024-09-21T04:04:52.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.204+0000 7f177a79b740 1 Processor -- start 2024-09-21T04:04:52.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.204+0000 7f177a79b740 1 -- start start 2024-09-21T04:04:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.205+0000 7f1762ffd640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f17580b6590 0x7f17580b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.205+0000 7f177a79b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d7f840 0x5622f1126600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.205+0000 7f177a79b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 0x5622f1126b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.205+0000 7f177a79b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f1127080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.205+0000 7f177a79b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5622f109cb90 con 0x5622f0d7f840 2024-09-21T04:04:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.205+0000 7f17717c2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 0x5622f1126b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.205+0000 7f17717c2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 0x5622f1126b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:41518/0 (socket says 172.21.15.22:41518) 2024-09-21T04:04:52.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.205+0000 7f17717c2640 1 -- 172.21.15.22:0/3014267096 learned_addr learned my addr 172.21.15.22:0/3014267096 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.205+0000 7f177a79b740 1 -- 172.21.15.22:0/3014267096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5622f108bfc0 con 0x5622f0d5eb60 2024-09-21T04:04:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.205+0000 7f177a79b740 1 -- 172.21.15.22:0/3014267096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5622f108fdd0 con 0x5622f0d56980 2024-09-21T04:04:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.206+0000 7f17727c4640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f17580b6590 0x7f17580b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.206+0000 7f17717c2640 1 -- 172.21.15.22:0/3014267096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 msgr2=0x5622f1127080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.206+0000 7f17717c2640 1 --2- 172.21.15.22:0/3014267096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f1127080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.206+0000 7f17717c2640 1 -- 172.21.15.22:0/3014267096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d7f840 msgr2=0x5622f1126600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:52.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.206+0000 7f1762ffd640 1 -- 172.21.15.22:0/698009304 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f175c0e70a0 con 0x7f176c1027c0 2024-09-21T04:04:52.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.207+0000 7f1771fc3640 1 --2- 172.21.15.22:0/3014267096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d7f840 0x5622f1126600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.207+0000 7f17717c2640 1 --2- 172.21.15.22:0/3014267096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d7f840 0x5622f1126600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.207+0000 7f17717c2640 1 -- 172.21.15.22:0/3014267096 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622f1013060 con 0x5622f0d56980 2024-09-21T04:04:52.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.207+0000 7f1771fc3640 1 --2- 172.21.15.22:0/3014267096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d7f840 0x5622f1126600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:04:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.207+0000 7f17717c2640 1 --2- 172.21.15.22:0/3014267096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 0x5622f1126b40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f176800bd10 tx=0x7f17680107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5ad7fd95c9347324 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.207+0000 7f17727c4640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f17580b6590 0x7f17580b8aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1764006010 tx=0x7f1764030ee0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.207+0000 7f1757fff640 1 -- 172.21.15.22:0/3014267096 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176801c680 con 0x5622f0d56980 2024-09-21T04:04:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.207+0000 7f1757fff640 1 -- 172.21.15.22:0/3014267096 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f176801ccb0 con 0x5622f0d56980 2024-09-21T04:04:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.207+0000 7f1757fff640 1 -- 172.21.15.22:0/3014267096 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768011b90 con 0x5622f0d56980 2024-09-21T04:04:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.209+0000 7f177a79b740 1 -- 172.21.15.22:0/3014267096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 msgr2=0x5622f1126b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:52.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.209+0000 7f177a79b740 1 --2- 172.21.15.22:0/3014267096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 0x5622f1126b40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f176800bd10 tx=0x7f17680107a0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.209+0000 7f177a79b740 1 -- 172.21.15.22:0/3014267096 shutdown_connections 2024-09-21T04:04:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.209+0000 7f177a79b740 1 --2- 172.21.15.22:0/3014267096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 0x5622f1126b40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.209+0000 7f177a79b740 1 --2- 172.21.15.22:0/3014267096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f1127080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.209+0000 7f177a79b740 1 --2- 172.21.15.22:0/3014267096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d7f840 0x5622f1126600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.209+0000 7f177a79b740 1 -- 172.21.15.22:0/3014267096 >> 172.21.15.22:0/3014267096 conn(0x5622f0d73990 msgr2=0x5622f11244f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.209+0000 7f177a79b740 1 -- 172.21.15.22:0/3014267096 shutdown_connections 2024-09-21T04:04:52.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.209+0000 7f177a79b740 1 -- 172.21.15.22:0/3014267096 wait complete. 2024-09-21T04:04:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.210+0000 7f177a79b740 1 -- start start 2024-09-21T04:04:52.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.210+0000 7f177a79b740 1 Processor -- start 2024-09-21T04:04:52.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.211+0000 7f177a79b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 0x5622f1132220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.211+0000 7f177a79b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f11327c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.211+0000 7f177a79b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d7f840 0x5622f113e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.211+0000 7f177a79b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5622f0eed7a0 con 0x5622f0d56980 2024-09-21T04:04:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.211+0000 7f177a79b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5622f10310a0 con 0x5622f0d5eb60 2024-09-21T04:04:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.211+0000 7f177a79b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5622f1134de0 con 0x5622f0d7f840 2024-09-21T04:04:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.211+0000 7f177a79b740 10 client.0 _ll_register_callbacks cb 0x5622f100e3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.211+0000 7f17727c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d7f840 0x5622f113e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.211+0000 7f17727c4640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d7f840 0x5622f113e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:41520/0 (socket says 172.21.15.22:41520) 2024-09-21T04:04:52.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.211+0000 7f17727c4640 1 -- 172.21.15.22:0/2550573389 learned_addr learned my addr 172.21.15.22:0/2550573389 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.212+0000 7f17717c2640 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f11327c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.212+0000 7f1771fc3640 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 0x5622f1132220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.212+0000 7f17717c2640 1 -- 172.21.15.22:0/2550573389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d7f840 msgr2=0x5622f113e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.212+0000 7f17717c2640 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d7f840 0x5622f113e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.212+0000 7f17717c2640 1 -- 172.21.15.22:0/2550573389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 msgr2=0x5622f1132220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.212+0000 7f17717c2640 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 0x5622f1132220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.212+0000 7f17717c2640 1 -- 172.21.15.22:0/2550573389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622f101f880 con 0x5622f0d5eb60 2024-09-21T04:04:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.212+0000 7f17717c2640 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f11327c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f176800bce0 tx=0x7f1768011670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e536dc3f5493a476 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.212+0000 7f17557fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:04:52.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.213+0000 7f17557fa640 1 -- 172.21.15.22:0/2550573389 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176802c060 con 0x5622f0d5eb60 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.213+0000 7f17557fa640 1 -- 172.21.15.22:0/2550573389 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f1768011ce0 con 0x5622f0d5eb60 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.213+0000 7f177a79b740 1 -- 172.21.15.22:0/2550573389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f176801ccb0 con 0x5622f0d5eb60 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.213+0000 7f17557fa640 1 -- 172.21.15.22:0/2550573389 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f1768033050 con 0x5622f0d5eb60 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.213+0000 7f177a79b740 10 client.25382 fetch_fsmap learned FSMap version 33 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.213+0000 7f177a79b740 1 -- 172.21.15.22:0/2550573389 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5622f0df9b90 con 0x5622f0d5eb60 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.213+0000 7f17557fa640 1 -- 172.21.15.22:0/2550573389 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f176801ccb0 con 0x5622f0d5eb60 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.214+0000 7f17557fa640 1 -- 172.21.15.22:0/2550573389 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 33) ==== 8402+0+0 (secure 0 0 0) 0x7f176801c940 con 0x5622f0d5eb60 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.214+0000 7f177a79b740 10 client.25382 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.214+0000 7f177a79b740 10 client.25382 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.214+0000 7f177a79b740 20 client.25382 populate_metadata read hostname 'smithi022' 2024-09-21T04:04:52.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.214+0000 7f177a79b740 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5622f0d3e1c0 0x5622f1143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.214+0000 7f177a79b740 4 client.25382 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:04:52.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.214+0000 7f177a79b740 1 -- 172.21.15.22:0/2550573389 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622f109eae0 con 0x5622f0d3e1c0 2024-09-21T04:04:52.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.214+0000 7f1771fc3640 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5622f0d3e1c0 0x5622f1143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.215+0000 7f1771fc3640 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5622f0d3e1c0 0x5622f1143fd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9ee9b65d880e965 server_cookie=4b083a8ee6596de6 in_seq=0 out_seq=0 2024-09-21T04:04:52.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.215+0000 7f17557fa640 10 client.25382 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:04:52.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f17557fa640 1 -- 172.21.15.22:0/2550573389 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5622f109eae0 con 0x5622f0d3e1c0 2024-09-21T04:04:52.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f17557fa640 10 client.25382 handle_command_reply: tid=0 2024-09-21T04:04:52.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f177a79b740 1 client.25382 shutdown 2024-09-21T04:04:52.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f177a79b740 1 -- 172.21.15.22:0/2550573389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 msgr2=0x5622f11327c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:52.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f177a79b740 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f11327c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f176800bce0 tx=0x7f1768011670 comp rx=0 tx=0).stop 2024-09-21T04:04:52.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f177a79b740 1 -- 172.21.15.22:0/2550573389 shutdown_connections 2024-09-21T04:04:52.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f177a79b740 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5622f0d3e1c0 0x5622f1143fd0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f177a79b740 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d7f840 0x5622f113e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f17557fa640 0 client.25382 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:04:52.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f177a79b740 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f11327c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.216+0000 7f177a79b740 1 --2- 172.21.15.22:0/2550573389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 0x5622f1132220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.217+0000 7f177a79b740 1 -- 172.21.15.22:0/2550573389 >> 172.21.15.22:0/2550573389 conn(0x5622f0d73990 msgr2=0x5622f11297e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:52.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.217+0000 7f177a79b740 1 -- 172.21.15.22:0/2550573389 shutdown_connections 2024-09-21T04:04:52.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.217+0000 7f177a79b740 1 -- 172.21.15.22:0/2550573389 wait complete. 2024-09-21T04:04:52.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.217+0000 7f177a79b740 20 client.25382 trim_cache size 0 max 16384 2024-09-21T04:04:52.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.251+0000 7f177a79b740 1 Processor -- start 2024-09-21T04:04:52.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.251+0000 7f177a79b740 1 -- start start 2024-09-21T04:04:52.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f177a79b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d3e1c0 0x5622f112be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f177a79b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 0x5622f1123aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f177a79b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f1123fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f177a79b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f176c1b7140 con 0x5622f0d56980 2024-09-21T04:04:52.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f177a79b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f176c1b8e00 con 0x5622f0d5eb60 2024-09-21T04:04:52.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f177a79b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f176c1b7810 con 0x5622f0d3e1c0 2024-09-21T04:04:52.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f17717c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 0x5622f1123aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f17717c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 0x5622f1123aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39796/0 (socket says 172.21.15.22:39796) 2024-09-21T04:04:52.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f17717c2640 1 -- 172.21.15.22:0/2336860713 learned_addr learned my addr 172.21.15.22:0/2336860713 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:52.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f1771fc3640 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d3e1c0 0x5622f112be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f17727c4640 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f1123fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f17717c2640 1 -- 172.21.15.22:0/2336860713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d3e1c0 msgr2=0x5622f112be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:52.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f17717c2640 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d3e1c0 0x5622f112be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f17717c2640 1 -- 172.21.15.22:0/2336860713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 msgr2=0x5622f1123fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:52.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f17717c2640 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f1123fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.252+0000 7f17717c2640 1 -- 172.21.15.22:0/2336860713 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622f1129460 con 0x5622f0d56980 2024-09-21T04:04:52.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.253+0000 7f1771fc3640 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d3e1c0 0x5622f112be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:04:52.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.253+0000 7f17727c4640 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f1123fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:04:52.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.253+0000 7f17717c2640 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 0x5622f1123aa0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f176800bd10 tx=0x7f176801dfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20e76807ed24668 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:52.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.254+0000 7f17577fe640 1 -- 172.21.15.22:0/2336860713 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f176802c070 con 0x5622f0d56980 2024-09-21T04:04:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.254+0000 7f17577fe640 1 -- 172.21.15.22:0/2336860713 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1768003db0 con 0x5622f0d56980 2024-09-21T04:04:52.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.254+0000 7f17577fe640 1 -- 172.21.15.22:0/2336860713 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1768005360 con 0x5622f0d56980 2024-09-21T04:04:52.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.255+0000 7f177a79b740 1 -- 172.21.15.22:0/2336860713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 msgr2=0x5622f1123aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:52.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.256+0000 7f177a79b740 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 0x5622f1123aa0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f176800bd10 tx=0x7f176801dfb0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.256+0000 7f177a79b740 1 -- 172.21.15.22:0/2336860713 shutdown_connections 2024-09-21T04:04:52.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.256+0000 7f177a79b740 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d5eb60 0x5622f1123fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.256+0000 7f177a79b740 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d56980 0x5622f1123aa0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.256+0000 7f177a79b740 1 --2- 172.21.15.22:0/2336860713 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d3e1c0 0x5622f112be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.256+0000 7f177a79b740 1 -- 172.21.15.22:0/2336860713 >> 172.21.15.22:0/2336860713 conn(0x5622f0d73990 msgr2=0x5622f112b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:52.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.256+0000 7f177a79b740 1 -- 172.21.15.22:0/2336860713 shutdown_connections 2024-09-21T04:04:52.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.256+0000 7f177a79b740 1 -- 172.21.15.22:0/2336860713 wait complete. 2024-09-21T04:04:52.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.257+0000 7f177a79b740 1 -- start start 2024-09-21T04:04:52.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.257+0000 7f177a79b740 1 Processor -- start 2024-09-21T04:04:52.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f177a79b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d3e1c0 0x5622f1147680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f177a79b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 0x5622f1145bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f177a79b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d5eb60 0x5622f11460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f177a79b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f176c1b8670 con 0x5622f0d5eb60 2024-09-21T04:04:52.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f177a79b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f176c1b7ee0 con 0x5622f0d3e1c0 2024-09-21T04:04:52.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f177a79b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f176c1b5120 con 0x5622f0d56980 2024-09-21T04:04:52.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f177a79b740 10 client.0 _ll_register_callbacks cb 0x7f176800bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:04:52.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f1771fc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d3e1c0 0x5622f1147680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f1771fc3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d3e1c0 0x5622f1147680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:34046/0 (socket says 172.21.15.22:34046) 2024-09-21T04:04:52.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f17727c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d5eb60 0x5622f11460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.258+0000 7f1771fc3640 1 -- 172.21.15.22:0/3915508486 learned_addr learned my addr 172.21.15.22:0/3915508486 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:04:52.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.259+0000 7f17727c4640 1 -- 172.21.15.22:0/3915508486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 msgr2=0x5622f1145bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T04:04:52.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.259+0000 7f17727c4640 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 0x5622f1145bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.259+0000 7f17727c4640 1 -- 172.21.15.22:0/3915508486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d3e1c0 msgr2=0x5622f1147680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:04:52.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.259+0000 7f17727c4640 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d3e1c0 0x5622f1147680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.259+0000 7f17727c4640 1 -- 172.21.15.22:0/3915508486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622f1128e90 con 0x5622f0d5eb60 2024-09-21T04:04:52.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.259+0000 7f17727c4640 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d5eb60 0x5622f11460f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1764004af0 tx=0x7f1764005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d227cb4d1c8c9350 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:04:52.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.260+0000 7f17557fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:04:52.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.260+0000 7f17557fa640 1 -- 172.21.15.22:0/3915508486 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1764004240 con 0x5622f0d5eb60 2024-09-21T04:04:52.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.260+0000 7f17557fa640 1 -- 172.21.15.22:0/3915508486 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f17640043e0 con 0x5622f0d5eb60 2024-09-21T04:04:52.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.260+0000 7f177a79b740 1 -- 172.21.15.22:0/3915508486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1768003db0 con 0x5622f0d5eb60 2024-09-21T04:04:52.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.261+0000 7f17557fa640 1 -- 172.21.15.22:0/3915508486 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f17640045e0 con 0x5622f0d5eb60 2024-09-21T04:04:52.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.261+0000 7f177a79b740 10 client.15741 fetch_fsmap learned FSMap version 33 2024-09-21T04:04:52.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.261+0000 7f177a79b740 1 -- 172.21.15.22:0/3915508486 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5622f11af340 con 0x5622f0d5eb60 2024-09-21T04:04:52.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.262+0000 7f17557fa640 1 -- 172.21.15.22:0/3915508486 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1764004780 con 0x5622f0d5eb60 2024-09-21T04:04:52.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.262+0000 7f17557fa640 1 -- 172.21.15.22:0/3915508486 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 33) ==== 8402+0+0 (secure 0 0 0) 0x7f1764051020 con 0x5622f0d5eb60 2024-09-21T04:04:52.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.262+0000 7f177a79b740 10 client.15741 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T04:04:52.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.262+0000 7f177a79b740 10 client.15741 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:04:52.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.262+0000 7f177a79b740 20 client.15741 populate_metadata read hostname 'smithi022' 2024-09-21T04:04:52.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.263+0000 7f177a79b740 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5622f0d7f840 0x5622f11b1be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:04:52.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.263+0000 7f177a79b740 4 client.15741 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T04:04:52.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.263+0000 7f177a79b740 1 -- 172.21.15.22:0/3915508486 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x7f1768003db0 con 0x5622f0d7f840 2024-09-21T04:04:52.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.263+0000 7f1771fc3640 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5622f0d7f840 0x5622f11b1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:04:52.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.264+0000 7f17557fa640 10 client.15741 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:04:52.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.264+0000 7f1771fc3640 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5622f0d7f840 0x5622f11b1be0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e3ff0fc36cda1a4 server_cookie=57abe7e94f5ee686 in_seq=0 out_seq=0 2024-09-21T04:04:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f17557fa640 1 -- 172.21.15.22:0/3915508486 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f1768003db0 con 0x5622f0d7f840 2024-09-21T04:04:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f17557fa640 10 client.15741 handle_command_reply: tid=0 2024-09-21T04:04:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f177a79b740 1 client.15741 shutdown 2024-09-21T04:04:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f177a79b740 1 -- 172.21.15.22:0/3915508486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d5eb60 msgr2=0x5622f11460f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f177a79b740 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d5eb60 0x5622f11460f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f1764004af0 tx=0x7f1764005d80 comp rx=0 tx=0).stop 2024-09-21T04:04:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f177a79b740 1 -- 172.21.15.22:0/3915508486 shutdown_connections 2024-09-21T04:04:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f177a79b740 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5622f0d7f840 0x5622f11b1be0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f177a79b740 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5622f0d56980 0x5622f1145bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f177a79b740 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5622f0d5eb60 0x5622f11460f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f177a79b740 1 --2- 172.21.15.22:0/3915508486 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5622f0d3e1c0 0x5622f1147680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f17557fa640 0 client.15741 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:04:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f177a79b740 1 -- 172.21.15.22:0/3915508486 >> 172.21.15.22:0/3915508486 conn(0x5622f0d73990 msgr2=0x5622f1127630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.473+0000 7f177a79b740 1 -- 172.21.15.22:0/3915508486 shutdown_connections 2024-09-21T04:04:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f177a79b740 1 -- 172.21.15.22:0/3915508486 wait complete. 2024-09-21T04:04:52.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f177a79b740 20 client.15741 trim_cache size 0 max 16384 2024-09-21T04:04:52.478 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:04:52.479 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 33, 2024-09-21T04:04:52.479 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:04:52.479 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 10, 2024-09-21T04:04:52.479 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:04:52.479 INFO:teuthology.orchestra.run.smithi022.stdout: "78525e87": { 2024-09-21T04:04:52.479 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 10, 2024-09-21T04:04:52.479 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:04:52.479 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:04:52.479 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:04:52.479 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 147.8, 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:04:52.480 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:04:52.481 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:04:52.481 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:04:52.481 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:04:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 -- 172.21.15.22:0/698009304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f17580b6590 msgr2=0x7f17580b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:52.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f17580b6590 0x7f17580b8aa0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f1764006010 tx=0x7f1764030ee0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 -- 172.21.15.22:0/698009304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176c1027c0 msgr2=0x7f176c1a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:04:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176c1027c0 0x7f176c1a0920 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f175c00d6d0 tx=0x7f175c00db90 comp rx=0 tx=0).stop 2024-09-21T04:04:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 -- 172.21.15.22:0/698009304 shutdown_connections 2024-09-21T04:04:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f17580b6590 0x7f17580b8aa0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f176c107c00 0x7f176c1a6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f176c103110 0x7f176c1a0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 --2- 172.21.15.22:0/698009304 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f176c1027c0 0x7f176c1a0920 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:04:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 -- 172.21.15.22:0/698009304 >> 172.21.15.22:0/698009304 conn(0x7f176c0797c0 msgr2=0x7f176c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:04:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 -- 172.21.15.22:0/698009304 shutdown_connections 2024-09-21T04:04:52.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:04:52.474+0000 7f1774227640 1 -- 172.21.15.22:0/698009304 wait complete. 2024-09-21T04:04:52.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:52 smithi060 ceph-mon[33722]: pgmap v446: 129 pgs: 129 active+clean; 939 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 1.24k op/s 2024-09-21T04:04:52.775 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:52 smithi022 ceph-mon[31015]: pgmap v446: 129 pgs: 129 active+clean; 939 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 1.24k op/s 2024-09-21T04:04:52.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:52 smithi073 ceph-mon[34443]: pgmap v446: 129 pgs: 129 active+clean; 939 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 11 MiB/s wr, 1.24k op/s 2024-09-21T04:04:53.593 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '78525e87', quiesce took 9.6 seconds. Will release after: 18.200000000000003 2024-09-21T04:04:53.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 30.0 s, 555.7 tps, lat 128.770 ms stddev 162.854 2024-09-21T04:04:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:54 smithi060 ceph-mon[33722]: pgmap v447: 129 pgs: 129 active+clean; 939 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-09-21T04:04:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:54 smithi022 ceph-mon[31015]: pgmap v447: 129 pgs: 129 active+clean; 939 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-09-21T04:04:54.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:54 smithi073 ceph-mon[34443]: pgmap v447: 129 pgs: 129 active+clean; 939 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 11 MiB/s wr, 1.23k op/s 2024-09-21T04:04:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:56 smithi060 ceph-mon[33722]: pgmap v448: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2024-09-21T04:04:56.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:56 smithi022 ceph-mon[31015]: pgmap v448: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2024-09-21T04:04:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:56 smithi073 ceph-mon[34443]: pgmap v448: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 10 MiB/s wr, 1.01k op/s 2024-09-21T04:04:58.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:04:58 smithi060 ceph-mon[33722]: pgmap v449: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 859 op/s 2024-09-21T04:04:58.705 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 35.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:04:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:04:58 smithi022 ceph-mon[31015]: pgmap v449: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 859 op/s 2024-09-21T04:04:58.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:04:58 smithi073 ceph-mon[34443]: pgmap v449: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 859 op/s 2024-09-21T04:05:00.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:00 smithi060 ceph-mon[33722]: pgmap v450: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 645 op/s 2024-09-21T04:05:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:00 smithi022 ceph-mon[31015]: pgmap v450: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 645 op/s 2024-09-21T04:05:00.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:00 smithi073 ceph-mon[34443]: pgmap v450: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.7 MiB/s wr, 645 op/s 2024-09-21T04:05:02.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:02 smithi060 ceph-mon[33722]: pgmap v451: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 527 op/s 2024-09-21T04:05:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:02 smithi022 ceph-mon[31015]: pgmap v451: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 527 op/s 2024-09-21T04:05:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:02 smithi073 ceph-mon[34443]: pgmap v451: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.7 MiB/s wr, 527 op/s 2024-09-21T04:05:03.705 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 40.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:05:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:04 smithi060 ceph-mon[33722]: pgmap v452: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.5 MiB/s wr, 373 op/s 2024-09-21T04:05:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:04 smithi022 ceph-mon[31015]: pgmap v452: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.5 MiB/s wr, 373 op/s 2024-09-21T04:05:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:04 smithi073 ceph-mon[34443]: pgmap v452: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 4.5 MiB/s wr, 373 op/s 2024-09-21T04:05:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:06 smithi060 ceph-mon[33722]: pgmap v453: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.6 MiB/s wr, 156 op/s 2024-09-21T04:05:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:05:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:05:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:05:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:05:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:06 smithi022 ceph-mon[31015]: pgmap v453: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.6 MiB/s wr, 156 op/s 2024-09-21T04:05:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:05:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:05:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:05:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:05:06.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:06 smithi073 ceph-mon[34443]: pgmap v453: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.6 MiB/s wr, 156 op/s 2024-09-21T04:05:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:05:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:05:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:05:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:05:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:08 smithi060 ceph-mon[33722]: pgmap v454: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 486 KiB/s wr, 71 op/s 2024-09-21T04:05:08.707 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 45.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:05:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:08 smithi022 ceph-mon[31015]: pgmap v454: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 486 KiB/s wr, 71 op/s 2024-09-21T04:05:08.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:08 smithi073 ceph-mon[34443]: pgmap v454: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 486 KiB/s wr, 71 op/s 2024-09-21T04:05:10.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:10 smithi060 ceph-mon[33722]: pgmap v455: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 213 KiB/s wr, 37 op/s 2024-09-21T04:05:10.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:10 smithi022 ceph-mon[31015]: pgmap v455: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 213 KiB/s wr, 37 op/s 2024-09-21T04:05:10.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:10 smithi073 ceph-mon[34443]: pgmap v455: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 213 KiB/s wr, 37 op/s 2024-09-21T04:05:11.793 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:05:12.066 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:12.476 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:12 smithi022 ceph-mon[31015]: pgmap v456: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 205 KiB/s wr, 38 op/s 2024-09-21T04:05:12.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 -- 172.21.15.22:0/2602425853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7e01083d0 msgr2=0x7ff7e01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 --2- 172.21.15.22:0/2602425853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7e01083d0 0x7ff7e01087e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8009900 tx=0x7ff7c802a410 comp rx=0 tx=0).stop 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 -- 172.21.15.22:0/2602425853 shutdown_connections 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 --2- 172.21.15.22:0/2602425853 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7e0108d20 0x7ff7e010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 --2- 172.21.15.22:0/2602425853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7e01083d0 0x7ff7e01087e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 --2- 172.21.15.22:0/2602425853 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e0102ae0 0x7ff7e0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 -- 172.21.15.22:0/2602425853 >> 172.21.15.22:0/2602425853 conn(0x7ff7e0079760 msgr2=0x7ff7e0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 -- 172.21.15.22:0/2602425853 shutdown_connections 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 -- 172.21.15.22:0/2602425853 wait complete. 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 Processor -- start 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.567+0000 7ff7e63dc640 1 -- start start 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7e63dc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7e0102ae0 0x7ff7e019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:12.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7e63dc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e01083d0 0x7ff7e019a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7e63dc640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7e0108d20 0x7ff7e019fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7e63dc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e0113960 con 0x7ff7e0102ae0 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7e63dc640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e01137e0 con 0x7ff7e0108d20 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7e63dc640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff7e0113ae0 con 0x7ff7e01083d0 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7dffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7e0102ae0 0x7ff7e019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7dffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7e0102ae0 0x7ff7e019a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42004/0 (socket says 172.21.15.22:42004) 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7dffff640 1 -- 172.21.15.22:0/4032830878 learned_addr learned my addr 172.21.15.22:0/4032830878 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7d7fff640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e01083d0 0x7ff7e019a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7e4979640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7e0108d20 0x7ff7e019fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7dffff640 1 -- 172.21.15.22:0/4032830878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e01083d0 msgr2=0x7ff7e019a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7dffff640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e01083d0 0x7ff7e019a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7dffff640 1 -- 172.21.15.22:0/4032830878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7e0108d20 msgr2=0x7ff7e019fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:12.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7dffff640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7e0108d20 0x7ff7e019fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7dffff640 1 -- 172.21.15.22:0/4032830878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7e01a0340 con 0x7ff7e0102ae0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.568+0000 7ff7dffff640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7e0102ae0 0x7ff7e019a3d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000d950 tx=0x7ff7d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.569+0000 7ff7ddffb640 1 -- 172.21.15.22:0/4032830878 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d0017070 con 0x7ff7e0102ae0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.569+0000 7ff7e63dc640 1 -- 172.21.15.22:0/4032830878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7e01a0630 con 0x7ff7e0102ae0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.569+0000 7ff7ddffb640 1 -- 172.21.15.22:0/4032830878 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff7d0009c30 con 0x7ff7e0102ae0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.569+0000 7ff7ddffb640 1 -- 172.21.15.22:0/4032830878 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7d000f620 con 0x7ff7e0102ae0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.569+0000 7ff7e63dc640 1 -- 172.21.15.22:0/4032830878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7e01a6d90 con 0x7ff7e0102ae0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.570+0000 7ff7e63dc640 1 -- 172.21.15.22:0/4032830878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7e0103d10 con 0x7ff7e0102ae0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.571+0000 7ff7ddffb640 1 -- 172.21.15.22:0/4032830878 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff7d0005030 con 0x7ff7e0102ae0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.572+0000 7ff7ddffb640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7cc0b6510 0x7ff7cc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.572+0000 7ff7d7fff640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7cc0b6510 0x7ff7cc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.572+0000 7ff7ddffb640 1 -- 172.21.15.22:0/4032830878 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff7d00e73b0 con 0x7ff7e0102ae0 2024-09-21T04:05:12.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.573+0000 7ff7d7fff640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7cc0b6510 0x7ff7cc0b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8006010 tx=0x7ff7c8032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:12.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.575+0000 7ff7ddffb640 1 -- 172.21.15.22:0/4032830878 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff7d00ad820 con 0x7ff7e0102ae0 2024-09-21T04:05:12.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:12 smithi060 ceph-mon[33722]: pgmap v456: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 205 KiB/s wr, 38 op/s 2024-09-21T04:05:12.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.802+0000 7ff7e63dc640 1 -- 172.21.15.22:0/4032830878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff7e0102ef0 con 0x7ff7e0102ae0 2024-09-21T04:05:12.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.803+0000 7ff7ddffb640 1 -- 172.21.15.22:0/4032830878 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11973 (secure 0 0 0) 0x7ff7d0009de0 con 0x7ff7e0102ae0 2024-09-21T04:05:12.806 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:05:12.806 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":33,"btime":"2024-09-21T04:04:50:361671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:04:49.494310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:05:12.806 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 33 2024-09-21T04:05:12.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 -- 172.21.15.22:0/4032830878 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7cc0b6510 msgr2=0x7ff7cc0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:12.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7cc0b6510 0x7ff7cc0b8a20 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7ff7c8006010 tx=0x7ff7c8032c80 comp rx=0 tx=0).stop 2024-09-21T04:05:12.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 -- 172.21.15.22:0/4032830878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7e0102ae0 msgr2=0x7ff7e019a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:12.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7e0102ae0 0x7ff7e019a3d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff7d000d950 tx=0x7ff7d000de10 comp rx=0 tx=0).stop 2024-09-21T04:05:12.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 -- 172.21.15.22:0/4032830878 shutdown_connections 2024-09-21T04:05:12.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff7cc0b6510 0x7ff7cc0b8a20 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:12.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff7e01083d0 0x7ff7e019a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:12.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff7e0108d20 0x7ff7e019fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:12.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 --2- 172.21.15.22:0/4032830878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7e0102ae0 0x7ff7e019a3d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:12.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 -- 172.21.15.22:0/4032830878 >> 172.21.15.22:0/4032830878 conn(0x7ff7e0079760 msgr2=0x7ff7e0105340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:12.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 -- 172.21.15.22:0/4032830878 shutdown_connections 2024-09-21T04:05:12.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:12.805+0000 7ff7e63dc640 1 -- 172.21.15.22:0/4032830878 wait complete. 2024-09-21T04:05:12.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:12 smithi073 ceph-mon[34443]: pgmap v456: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 205 KiB/s wr, 38 op/s 2024-09-21T04:05:13.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:13 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/4032830878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:13.673 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id 78525e87 --release --await' 2024-09-21T04:05:13.674 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id 78525e87 --release --await 2024-09-21T04:05:13.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:13 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/4032830878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:13.707 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 50.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:05:13.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:13 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/4032830878' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:13.934 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:14.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.448+0000 7faf38205640 1 -- 172.21.15.22:0/4061142066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30103b80 msgr2=0x7faf30103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:14.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.448+0000 7faf38205640 1 --2- 172.21.15.22:0/4061142066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30103b80 0x7faf30103f90 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009900 tx=0x7faf2c02a410 comp rx=0 tx=0).stop 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.448+0000 7faf38205640 1 -- 172.21.15.22:0/4061142066 shutdown_connections 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.448+0000 7faf38205640 1 --2- 172.21.15.22:0/4061142066 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf301094c0 0x7faf301098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.448+0000 7faf38205640 1 --2- 172.21.15.22:0/4061142066 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30109e10 0x7faf30110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.448+0000 7faf38205640 1 --2- 172.21.15.22:0/4061142066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30103b80 0x7faf30103f90 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.448+0000 7faf38205640 1 -- 172.21.15.22:0/4061142066 >> 172.21.15.22:0/4061142066 conn(0x7faf300ff610 msgr2=0x7faf30101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.448+0000 7faf38205640 1 -- 172.21.15.22:0/4061142066 shutdown_connections 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.448+0000 7faf38205640 1 -- 172.21.15.22:0/4061142066 wait complete. 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf38205640 1 Processor -- start 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf38205640 1 -- start start 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf38205640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30103b80 0x7faf3019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf38205640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf301094c0 0x7faf3019aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf38205640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30109e10 0x7faf3019fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf38205640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf30113a40 con 0x7faf30103b80 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf38205640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf301138c0 con 0x7faf30109e10 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf38205640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faf30113bc0 con 0x7faf301094c0 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf35fa1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30103b80 0x7faf3019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf35fa1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30103b80 0x7faf3019a510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42024/0 (socket says 172.21.15.22:42024) 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf35fa1640 1 -- 172.21.15.22:0/2132272873 learned_addr learned my addr 172.21.15.22:0/2132272873 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf367a2640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30109e10 0x7faf3019fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.449+0000 7faf357a0640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf301094c0 0x7faf3019aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf35fa1640 1 -- 172.21.15.22:0/2132272873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf301094c0 msgr2=0x7faf3019aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf35fa1640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf301094c0 0x7faf3019aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf35fa1640 1 -- 172.21.15.22:0/2132272873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30109e10 msgr2=0x7faf3019fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf35fa1640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30109e10 0x7faf3019fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf35fa1640 1 -- 172.21.15.22:0/2132272873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf301a0480 con 0x7faf30103b80 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf35fa1640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30103b80 0x7faf3019a510 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009a20 tx=0x7faf2c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf26ffd640 1 -- 172.21.15.22:0/2132272873 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c03f030 con 0x7faf30103b80 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf38205640 1 -- 172.21.15.22:0/2132272873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf301a0710 con 0x7faf30103b80 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf26ffd640 1 -- 172.21.15.22:0/2132272873 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf2c0035f0 con 0x7faf30103b80 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf26ffd640 1 -- 172.21.15.22:0/2132272873 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c035070 con 0x7faf30103b80 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.450+0000 7faf38205640 1 -- 172.21.15.22:0/2132272873 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf301a6ed0 con 0x7faf30103b80 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.453+0000 7faf3e779740 1 Processor -- start 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.453+0000 7faf3e779740 1 -- start start 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf3e779740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7846520 0x557fa7bec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf3e779740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7beca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf3e779740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 0x557fa7becf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf3e779740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557fa7ad7dc0 con 0x557fa781d660 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf3e779740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557fa7b641f0 con 0x557fa7825840 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf3e779740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557fa7b53620 con 0x557fa7846520 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf26ffd640 1 -- 172.21.15.22:0/2132272873 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7faf2c003a60 con 0x7faf30103b80 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf35fa1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7beca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf35fa1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7beca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42028/0 (socket says 172.21.15.22:42028) 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf35fa1640 1 -- 172.21.15.22:0/3836686389 learned_addr learned my addr 172.21.15.22:0/3836686389 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf357a0640 1 --2- 172.21.15.22:0/3836686389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 0x557fa7becf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf367a2640 1 --2- 172.21.15.22:0/3836686389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7846520 0x557fa7bec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf35fa1640 1 -- 172.21.15.22:0/3836686389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7846520 msgr2=0x557fa7bec510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf35fa1640 1 --2- 172.21.15.22:0/3836686389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7846520 0x557fa7bec510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf35fa1640 1 -- 172.21.15.22:0/3836686389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 msgr2=0x557fa7becf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf35fa1640 1 --2- 172.21.15.22:0/3836686389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 0x557fa7becf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf35fa1640 1 -- 172.21.15.22:0/3836686389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fa7b1bfd0 con 0x557fa781d660 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.454+0000 7faf357a0640 1 --2- 172.21.15.22:0/3836686389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 0x557fa7becf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.455+0000 7faf35fa1640 1 --2- 172.21.15.22:0/3836686389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7beca50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf2c1104c0 tx=0x7faf2c1105b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=373eee5fac2cc3b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.455+0000 7faf26ffd640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faf1c0b6510 0x7faf1c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.455+0000 7faf1bfff640 1 -- 172.21.15.22:0/3836686389 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c110e20 con 0x557fa781d660 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.455+0000 7faf1bfff640 1 -- 172.21.15.22:0/3836686389 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf2c115030 con 0x557fa781d660 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.455+0000 7faf1bfff640 1 -- 172.21.15.22:0/3836686389 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0cd810 con 0x557fa781d660 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.455+0000 7faf367a2640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faf1c0b6510 0x7faf1c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.455+0000 7faf26ffd640 1 -- 172.21.15.22:0/2132272873 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7faf2c1082d0 con 0x7faf30103b80 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf3e779740 1 -- 172.21.15.22:0/3836686389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 msgr2=0x557fa7beca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf367a2640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faf1c0b6510 0x7faf1c0b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b4d0 tx=0x7faf2800e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf3e779740 1 --2- 172.21.15.22:0/3836686389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7beca50 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7faf2c1104c0 tx=0x7faf2c1105b0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf3e779740 1 -- 172.21.15.22:0/3836686389 shutdown_connections 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf3e779740 1 --2- 172.21.15.22:0/3836686389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 0x557fa7becf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf3e779740 1 --2- 172.21.15.22:0/3836686389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7beca50 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf3e779740 1 --2- 172.21.15.22:0/3836686389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7846520 0x557fa7bec510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf3e779740 1 -- 172.21.15.22:0/3836686389 >> 172.21.15.22:0/3836686389 conn(0x557fa783a910 msgr2=0x557fa7bea400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf3e779740 1 -- 172.21.15.22:0/3836686389 shutdown_connections 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf3e779740 1 -- 172.21.15.22:0/3836686389 wait complete. 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.456+0000 7faf3e779740 1 -- start start 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf3e779740 1 Processor -- start 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf3e779740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa781d660 0x557fa7bf7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf3e779740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 0x557fa7bf80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf3e779740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa7846520 0x557fa7c03b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf3e779740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557fa7aee300 con 0x557fa7846520 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf3e779740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557fa7b57430 con 0x557fa7825840 2024-09-21T04:05:14.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf3e779740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557fa79b4bb0 con 0x557fa781d660 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf3e779740 10 client.0 _ll_register_callbacks cb 0x557fa7b08120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf367a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa7846520 0x557fa7c03b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf367a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa7846520 0x557fa7c03b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42044/0 (socket says 172.21.15.22:42044) 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf367a2640 1 -- 172.21.15.22:0/3620871161 learned_addr learned my addr 172.21.15.22:0/3620871161 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf35fa1640 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa781d660 0x557fa7bf7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.457+0000 7faf357a0640 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 0x557fa7bf80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf367a2640 1 -- 172.21.15.22:0/3620871161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa781d660 msgr2=0x557fa7bf7ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf367a2640 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa781d660 0x557fa7bf7ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf367a2640 1 -- 172.21.15.22:0/3620871161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 msgr2=0x557fa7bf80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf367a2640 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 0x557fa7bf80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf367a2640 1 -- 172.21.15.22:0/3620871161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fa7add780 con 0x557fa7846520 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf367a2640 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa7846520 0x557fa7c03b90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7faf28018b80 tx=0x7faf28004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6769e99297252e2b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:14.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf197fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf197fa640 1 -- 172.21.15.22:0/3620871161 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf28028060 con 0x557fa7846520 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf197fa640 1 -- 172.21.15.22:0/3620871161 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7faf280233f0 con 0x557fa7846520 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf3e779740 1 -- 172.21.15.22:0/3620871161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf2c115030 con 0x557fa7846520 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf197fa640 1 -- 172.21.15.22:0/3620871161 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7faf2802f050 con 0x557fa7846520 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf3e779740 10 client.15759 fetch_fsmap learned FSMap version 33 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.458+0000 7faf3e779740 1 -- 172.21.15.22:0/3620871161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557fa78b1b00 con 0x557fa7846520 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.459+0000 7faf197fa640 1 -- 172.21.15.22:0/3620871161 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf2c115030 con 0x557fa7846520 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.459+0000 7faf197fa640 1 -- 172.21.15.22:0/3620871161 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 33) ==== 8402+0+0 (secure 0 0 0) 0x7faf28022070 con 0x557fa7846520 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.459+0000 7faf3e779740 10 client.15759 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.459+0000 7faf3e779740 10 client.15759 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.459+0000 7faf3e779740 20 client.15759 populate_metadata read hostname 'smithi022' 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.459+0000 7faf3e779740 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557fa7804ea0 0x557fa7c09d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.459+0000 7faf3e779740 4 client.15759 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:05:14.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.459+0000 7faf3e779740 1 -- 172.21.15.22:0/3620871161 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557fa7b66140 con 0x557fa7804ea0 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.459+0000 7faf35fa1640 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557fa7804ea0 0x557fa7c09d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.460+0000 7faf35fa1640 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557fa7804ea0 0x557fa7c09d40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e878f4c7184550d server_cookie=ac210cb4ab10c76d in_seq=0 out_seq=0 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.460+0000 7faf197fa640 10 client.15759 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.460+0000 7faf197fa640 1 -- 172.21.15.22:0/3620871161 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557fa7b66140 con 0x557fa7804ea0 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.460+0000 7faf197fa640 10 client.15759 handle_command_reply: tid=0 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 client.15759 shutdown 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 -- 172.21.15.22:0/3620871161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa7846520 msgr2=0x557fa7c03b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa7846520 0x557fa7c03b90 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7faf28018b80 tx=0x7faf28004b50 comp rx=0 tx=0).stop 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 -- 172.21.15.22:0/3620871161 shutdown_connections 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557fa7804ea0 0x557fa7c09d40 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa7846520 0x557fa7c03b90 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7825840 0x557fa7bf80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 --2- 172.21.15.22:0/3620871161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa781d660 0x557fa7bf7ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 -- 172.21.15.22:0/3620871161 >> 172.21.15.22:0/3620871161 conn(0x557fa783a910 msgr2=0x557fa7bef6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:14.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf197fa640 0 client.15759 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:14.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 -- 172.21.15.22:0/3620871161 shutdown_connections 2024-09-21T04:05:14.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 1 -- 172.21.15.22:0/3620871161 wait complete. 2024-09-21T04:05:14.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.461+0000 7faf3e779740 20 client.15759 trim_cache size 0 max 16384 2024-09-21T04:05:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.478+0000 7faf3e779740 1 Processor -- start 2024-09-21T04:05:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.478+0000 7faf3e779740 1 -- start start 2024-09-21T04:05:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf3e779740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf3e779740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 0x557fa7bf97d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf3e779740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 0x557fa7c0f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf3e779740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf301b0c50 con 0x557fa781d660 2024-09-21T04:05:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf3e779740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf301b2910 con 0x557fa7846520 2024-09-21T04:05:14.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf3e779740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faf301b1320 con 0x557fa7825840 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf35fa1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf35fa1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c039a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42052/0 (socket says 172.21.15.22:42052) 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf35fa1640 1 -- 172.21.15.22:0/310147914 learned_addr learned my addr 172.21.15.22:0/310147914 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf357a0640 1 --2- 172.21.15.22:0/310147914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 0x557fa7bf97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf367a2640 1 --2- 172.21.15.22:0/310147914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 0x557fa7c0f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf35fa1640 1 -- 172.21.15.22:0/310147914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 msgr2=0x557fa7bf97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf35fa1640 1 --2- 172.21.15.22:0/310147914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 0x557fa7bf97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf35fa1640 1 -- 172.21.15.22:0/310147914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 msgr2=0x557fa7c0f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf35fa1640 1 --2- 172.21.15.22:0/310147914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 0x557fa7c0f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf35fa1640 1 -- 172.21.15.22:0/310147914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fa7928960 con 0x557fa781d660 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.479+0000 7faf367a2640 1 --2- 172.21.15.22:0/310147914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 0x557fa7c0f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:14.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.480+0000 7faf35fa1640 1 --2- 172.21.15.22:0/310147914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c039a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faf2c105a60 tx=0x7faf2c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=725060122c66b8b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.480+0000 7faf1b7fe640 1 -- 172.21.15.22:0/310147914 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0f00e0 con 0x557fa781d660 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.480+0000 7faf1b7fe640 1 -- 172.21.15.22:0/310147914 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf2c115040 con 0x557fa781d660 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.480+0000 7faf1b7fe640 1 -- 172.21.15.22:0/310147914 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c0f1170 con 0x557fa781d660 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 -- 172.21.15.22:0/310147914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 msgr2=0x557fa7c039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 --2- 172.21.15.22:0/310147914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c039a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7faf2c105a60 tx=0x7faf2c02a410 comp rx=0 tx=0).stop 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 -- 172.21.15.22:0/310147914 shutdown_connections 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 --2- 172.21.15.22:0/310147914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 0x557fa7bf97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 --2- 172.21.15.22:0/310147914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 0x557fa7c0f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 --2- 172.21.15.22:0/310147914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c039a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 -- 172.21.15.22:0/310147914 >> 172.21.15.22:0/310147914 conn(0x557fa783a910 msgr2=0x557fa7bf90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 -- 172.21.15.22:0/310147914 shutdown_connections 2024-09-21T04:05:14.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 -- 172.21.15.22:0/310147914 wait complete. 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 -- start start 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.481+0000 7faf3e779740 1 Processor -- start 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf3e779740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c6c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf3e779740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 0x557fa7c6cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf3e779740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 0x557fa7bfe310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf3e779740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf301b2180 con 0x557fa781d660 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf3e779740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faf301b19f0 con 0x557fa7846520 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf3e779740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faf301aec30 con 0x557fa7825840 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf3e779740 10 client.0 _ll_register_callbacks cb 0x7faf28009d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf35fa1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c6c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf35fa1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c6c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42056/0 (socket says 172.21.15.22:42056) 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf35fa1640 1 -- 172.21.15.22:0/1520549101 learned_addr learned my addr 172.21.15.22:0/1520549101 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf357a0640 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 0x557fa7c6cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf367a2640 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 0x557fa7bfe310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf35fa1640 1 -- 172.21.15.22:0/1520549101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 msgr2=0x557fa7c6cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf35fa1640 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 0x557fa7c6cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf35fa1640 1 -- 172.21.15.22:0/1520549101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 msgr2=0x557fa7bfe310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf35fa1640 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 0x557fa7bfe310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf35fa1640 1 -- 172.21.15.22:0/1520549101 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fa7bfea80 con 0x557fa781d660 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf367a2640 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 0x557fa7bfe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf357a0640 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 0x557fa7c6cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf35fa1640 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c6c9f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faf2c03d040 tx=0x7faf2c10bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2111a16994ec807 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.482+0000 7faf197fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf197fa640 1 -- 172.21.15.22:0/1520549101 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf2c049050 con 0x557fa781d660 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf197fa640 1 -- 172.21.15.22:0/1520549101 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7faf2c105a90 con 0x557fa781d660 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf3e779740 1 -- 172.21.15.22:0/1520549101 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faf2c115040 con 0x557fa781d660 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf197fa640 1 -- 172.21.15.22:0/1520549101 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7faf2c0f1340 con 0x557fa781d660 2024-09-21T04:05:14.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf3e779740 10 client.15765 fetch_fsmap learned FSMap version 33 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf3e779740 1 -- 172.21.15.22:0/1520549101 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x557fa7c75280 con 0x557fa781d660 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf197fa640 1 -- 172.21.15.22:0/1520549101 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faf2c115040 con 0x557fa781d660 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf197fa640 1 -- 172.21.15.22:0/1520549101 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 33) ==== 8402+0+0 (secure 0 0 0) 0x7faf2c0ca310 con 0x557fa781d660 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf3e779740 10 client.15765 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf3e779740 10 client.15765 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf3e779740 20 client.15765 populate_metadata read hostname 'smithi022' 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf3e779740 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557fa77da250 0x557fa7c77740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf3e779740 4 client.15765 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "78525e87", "release": true, "await": true}] 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.483+0000 7faf3e779740 1 -- 172.21.15.22:0/1520549101 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "78525e87", "release": true, "await": true}) -- 0x557fa7b61bf0 con 0x557fa77da250 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.484+0000 7faf357a0640 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557fa77da250 0x557fa7c77740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.484+0000 7faf357a0640 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557fa77da250 0x557fa7c77740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5f629a5707b785c server_cookie=2683079f2ec73bc3 in_seq=0 out_seq=0 2024-09-21T04:05:14.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.484+0000 7faf197fa640 10 client.15765 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:14.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.527+0000 7faf197fa640 1 -- 172.21.15.22:0/1520549101 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557fa7b61bf0 con 0x557fa77da250 2024-09-21T04:05:14.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.527+0000 7faf197fa640 10 client.15765 handle_command_reply: tid=0 2024-09-21T04:05:14.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.527+0000 7faf3e779740 1 client.15765 shutdown 2024-09-21T04:05:14.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 1 -- 172.21.15.22:0/1520549101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 msgr2=0x557fa7c6c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:14.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c6c9f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7faf2c03d040 tx=0x7faf2c10bc80 comp rx=0 tx=0).stop 2024-09-21T04:05:14.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 1 -- 172.21.15.22:0/1520549101 shutdown_connections 2024-09-21T04:05:14.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557fa77da250 0x557fa7c77740 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557fa7825840 0x557fa7c6cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557fa7846520 0x557fa7bfe310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf197fa640 0 client.15765 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:14.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 1 --2- 172.21.15.22:0/1520549101 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557fa781d660 0x557fa7c6c9f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 1 -- 172.21.15.22:0/1520549101 >> 172.21.15.22:0/1520549101 conn(0x557fa783a910 msgr2=0x557fa7bf9980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 1 -- 172.21.15.22:0/1520549101 shutdown_connections 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 1 -- 172.21.15.22:0/1520549101 wait complete. 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 33, 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 12, 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stdout: "78525e87": { 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 12, 2024-09-21T04:05:14.532 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 147.8, 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:05:14.533 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:14.534 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:14.534 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:14.534 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:14.534 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:14.534 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:05:14.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.528+0000 7faf3e779740 20 client.15765 trim_cache size 0 max 16384 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 -- 172.21.15.22:0/2132272873 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faf1c0b6510 msgr2=0x7faf1c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faf1c0b6510 0x7faf1c0b8a20 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7faf2800b4d0 tx=0x7faf2800e040 comp rx=0 tx=0).stop 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 -- 172.21.15.22:0/2132272873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30103b80 msgr2=0x7faf3019a510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30103b80 0x7faf3019a510 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7faf2c009a20 tx=0x7faf2c004270 comp rx=0 tx=0).stop 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 -- 172.21.15.22:0/2132272873 shutdown_connections 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faf1c0b6510 0x7faf1c0b8a20 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faf301094c0 0x7faf3019aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faf30109e10 0x7faf3019fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 --2- 172.21.15.22:0/2132272873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf30103b80 0x7faf3019a510 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 -- 172.21.15.22:0/2132272873 >> 172.21.15.22:0/2132272873 conn(0x7faf300ff610 msgr2=0x7faf30101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 -- 172.21.15.22:0/2132272873 shutdown_connections 2024-09-21T04:05:14.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:14.529+0000 7faf38205640 1 -- 172.21.15.22:0/2132272873 wait complete. 2024-09-21T04:05:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:14 smithi060 ceph-mon[33722]: pgmap v457: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 155 KiB/s wr, 29 op/s 2024-09-21T04:05:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:14 smithi022 ceph-mon[31015]: pgmap v457: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 155 KiB/s wr, 29 op/s 2024-09-21T04:05:14.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:14 smithi073 ceph-mon[34443]: pgmap v457: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 155 KiB/s wr, 29 op/s 2024-09-21T04:05:15.454 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '78525e87', total seconds elapsed: 31.5 2024-09-21T04:05:15.455 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 27.8 2024-09-21T04:05:15.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:05:15.968 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:16.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.621+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2159744284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f0110230 msgr2=0x7f11f0116a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:16.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.621+0000 7f11f5c5a640 1 --2- 172.21.15.22:0/2159744284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f0110230 0x7f11f0116a60 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009ca0 tx=0x7f11e802a8d0 comp rx=0 tx=0).stop 2024-09-21T04:05:16.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.621+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2159744284 shutdown_connections 2024-09-21T04:05:16.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.621+0000 7f11f5c5a640 1 --2- 172.21.15.22:0/2159744284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f0110230 0x7f11f0116a60 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:16.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.621+0000 7f11f5c5a640 1 --2- 172.21.15.22:0/2159744284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11f010f8e0 0x7f11f010fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:16.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.621+0000 7f11f5c5a640 1 --2- 172.21.15.22:0/2159744284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f0109fa0 0x7f11f010a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:16.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.621+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2159744284 >> 172.21.15.22:0/2159744284 conn(0x7f11f0079580 msgr2=0x7f11f01081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:16.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.622+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2159744284 shutdown_connections 2024-09-21T04:05:16.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.622+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2159744284 wait complete. 2024-09-21T04:05:16.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.624+0000 7f11f5c5a640 1 Processor -- start 2024-09-21T04:05:16.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.624+0000 7f11f5c5a640 1 -- start start 2024-09-21T04:05:16.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.624+0000 7f11f5c5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f0109fa0 0x7f11f01a0700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:16.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.625+0000 7f11f5c5a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11f010f8e0 0x7f11f01a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:16.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.625+0000 7f11f5c5a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f0110230 0x7f11f01a5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:16.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.625+0000 7f11f5c5a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f11f0119de0 con 0x7f11f0109fa0 2024-09-21T04:05:16.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.625+0000 7f11f5c5a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f11f0119c60 con 0x7f11f010f8e0 2024-09-21T04:05:16.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.625+0000 7f11f5c5a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f11f0119f60 con 0x7f11f0110230 2024-09-21T04:05:16.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.625+0000 7f11f4c58640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f0109fa0 0x7f11f01a0700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:16.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.625+0000 7f11f4c58640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f0109fa0 0x7f11f01a0700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42076/0 (socket says 172.21.15.22:42076) 2024-09-21T04:05:16.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.625+0000 7f11f4c58640 1 -- 172.21.15.22:0/2655624479 learned_addr learned my addr 172.21.15.22:0/2655624479 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:16.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.625+0000 7f11effff640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11f010f8e0 0x7f11f01a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:16.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.625+0000 7f11f5459640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f0110230 0x7f11f01a5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:16.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.626+0000 7f11f5459640 1 -- 172.21.15.22:0/2655624479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11f010f8e0 msgr2=0x7f11f01a0ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:16.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.626+0000 7f11f5459640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11f010f8e0 0x7f11f01a0ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:16.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.626+0000 7f11f5459640 1 -- 172.21.15.22:0/2655624479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f0109fa0 msgr2=0x7f11f01a0700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:16.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.626+0000 7f11f5459640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f0109fa0 0x7f11f01a0700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:16.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.626+0000 7f11f5459640 1 -- 172.21.15.22:0/2655624479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11f01a6670 con 0x7f11f0110230 2024-09-21T04:05:16.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.626+0000 7f11effff640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11f010f8e0 0x7f11f01a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:05:16.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.626+0000 7f11f5459640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f0110230 0x7f11f01a5f40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009bf0 tx=0x7f11e8032d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:16.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.626+0000 7f11edffb640 1 -- 172.21.15.22:0/2655624479 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8004040 con 0x7f11f0110230 2024-09-21T04:05:16.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.627+0000 7f11edffb640 1 -- 172.21.15.22:0/2655624479 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11e8004670 con 0x7f11f0110230 2024-09-21T04:05:16.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.627+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2655624479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11f01a6900 con 0x7f11f0110230 2024-09-21T04:05:16.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.627+0000 7f11edffb640 1 -- 172.21.15.22:0/2655624479 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11e8030e40 con 0x7f11f0110230 2024-09-21T04:05:16.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.627+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2655624479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11f01ad0c0 con 0x7f11f0110230 2024-09-21T04:05:16.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.630+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2655624479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11f01a1830 con 0x7f11f0110230 2024-09-21T04:05:16.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.633+0000 7f11edffb640 1 -- 172.21.15.22:0/2655624479 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f11e80305d0 con 0x7f11f0110230 2024-09-21T04:05:16.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.634+0000 7f11edffb640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f11e00b66e0 0x7f11e00b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:16.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.634+0000 7f11edffb640 1 -- 172.21.15.22:0/2655624479 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f11e8108950 con 0x7f11f0110230 2024-09-21T04:05:16.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.635+0000 7f11f4c58640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f11e00b66e0 0x7f11e00b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:16.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.636+0000 7f11f4c58640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f11e00b66e0 0x7f11e00b8bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f11e4005fd0 tx=0x7f11e400b2c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:16.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:16.636+0000 7f11edffb640 1 -- 172.21.15.22:0/2655624479 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f11e80cee40 con 0x7f11f0110230 2024-09-21T04:05:16.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:16 smithi060 ceph-mon[33722]: pgmap v458: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 183 KiB/s wr, 31 op/s 2024-09-21T04:05:16.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:16 smithi022 ceph-mon[31015]: pgmap v458: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 183 KiB/s wr, 31 op/s 2024-09-21T04:05:16.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:16 smithi073 ceph-mon[34443]: pgmap v458: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 183 KiB/s wr, 31 op/s 2024-09-21T04:05:17.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.076+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2655624479 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f11f01ad490 con 0x7f11f0110230 2024-09-21T04:05:17.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.077+0000 7f11edffb640 1 -- 172.21.15.22:0/2655624479 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11973 (secure 0 0 0) 0x7f11e8004820 con 0x7f11f0110230 2024-09-21T04:05:17.080 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:05:17.080 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":33,"btime":"2024-09-21T04:04:50:361671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:04:49.494310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:05:17.081 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 33 2024-09-21T04:05:17.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.082+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2655624479 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f11e00b66e0 msgr2=0x7f11e00b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:17.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.082+0000 7f11f5c5a640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f11e00b66e0 0x7f11e00b8bf0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f11e4005fd0 tx=0x7f11e400b2c0 comp rx=0 tx=0).stop 2024-09-21T04:05:17.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.082+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2655624479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f0110230 msgr2=0x7f11f01a5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:17.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.082+0000 7f11f5c5a640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f0110230 0x7f11f01a5f40 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f11e8009bf0 tx=0x7f11e8032d10 comp rx=0 tx=0).stop 2024-09-21T04:05:17.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.082+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2655624479 shutdown_connections 2024-09-21T04:05:17.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.082+0000 7f11f5c5a640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f11e00b66e0 0x7f11e00b8bf0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:17.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.082+0000 7f11f5c5a640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f11f0110230 0x7f11f01a5f40 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:17.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.082+0000 7f11f5c5a640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f11f010f8e0 0x7f11f01a0ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:17.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.082+0000 7f11f5c5a640 1 --2- 172.21.15.22:0/2655624479 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f11f0109fa0 0x7f11f01a0700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:17.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.082+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2655624479 >> 172.21.15.22:0/2655624479 conn(0x7f11f0079580 msgr2=0x7f11f01082e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:17.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.083+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2655624479 shutdown_connections 2024-09-21T04:05:17.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:17.083+0000 7f11f5c5a640 1 -- 172.21.15.22:0/2655624479 wait complete. 2024-09-21T04:05:17.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:17 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2655624479' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:17.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:17 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2655624479' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:17.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:17 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2655624479' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:17.940 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0' 2024-09-21T04:05:17.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 147.8 --await-for 45.0 2024-09-21T04:05:18.426 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:18 smithi060 ceph-mon[33722]: pgmap v459: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 273 KiB/s wr, 42 op/s 2024-09-21T04:05:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 55.0 s, 745.9 tps, lat 708.988 ms stddev 3589.228 2024-09-21T04:05:18.710 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:18 smithi022 ceph-mon[31015]: pgmap v459: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 273 KiB/s wr, 42 op/s 2024-09-21T04:05:18.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:18 smithi073 ceph-mon[34443]: pgmap v459: 129 pgs: 129 active+clean; 955 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 273 KiB/s wr, 42 op/s 2024-09-21T04:05:19.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.046+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/2817621759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c0094350 msgr2=0x7fd3c0094760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:19.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.046+0000 7fd3ce7f8640 1 --2- 172.21.15.22:0/2817621759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c0094350 0x7fd3c0094760 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc009900 tx=0x7fd3bc02a3f0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.046+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/2817621759 shutdown_connections 2024-09-21T04:05:19.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.046+0000 7fd3ce7f8640 1 --2- 172.21.15.22:0/2817621759 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3c009a5e0 0x7fd3c00a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.047+0000 7fd3ce7f8640 1 --2- 172.21.15.22:0/2817621759 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c0099c90 0x7fd3c009a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.047+0000 7fd3ce7f8640 1 --2- 172.21.15.22:0/2817621759 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c0094350 0x7fd3c0094760 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.047+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/2817621759 >> 172.21.15.22:0/2817621759 conn(0x7fd3c000c0a0 msgr2=0x7fd3c000c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:19.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.048+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/2817621759 shutdown_connections 2024-09-21T04:05:19.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.048+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/2817621759 wait complete. 2024-09-21T04:05:19.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.049+0000 7fd3ce7f8640 1 Processor -- start 2024-09-21T04:05:19.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.049+0000 7fd3ce7f8640 1 -- start start 2024-09-21T04:05:19.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.050+0000 7fd3ce7f8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3c0094350 0x7fd3c012d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.050+0000 7fd3ce7f8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c0099c90 0x7fd3c012dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.051+0000 7fd3ce7f8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c009a5e0 0x7fd3c012e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.051+0000 7fd3c77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c0099c90 0x7fd3c012dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.051+0000 7fd3c77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c0099c90 0x7fd3c012dcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:33688/0 (socket says 172.21.15.22:33688) 2024-09-21T04:05:19.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.051+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3c0094350 0x7fd3c012d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.051+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3c0094350 0x7fd3c012d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42088/0 (socket says 172.21.15.22:42088) 2024-09-21T04:05:19.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.051+0000 7fd3c77fe640 1 -- 172.21.15.22:0/35530416 learned_addr learned my addr 172.21.15.22:0/35530416 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:19.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.051+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c00a4e60 con 0x7fd3c0094350 2024-09-21T04:05:19.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.051+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c00a4ce0 con 0x7fd3c009a5e0 2024-09-21T04:05:19.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.051+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c00a4fe0 con 0x7fd3c0099c90 2024-09-21T04:05:19.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.051+0000 7fd3ccd95640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c009a5e0 0x7fd3c012e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.052+0000 7fd3ccd95640 1 -- 172.21.15.22:0/35530416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c0099c90 msgr2=0x7fd3c012dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:19.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.052+0000 7fd3ccd95640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c0099c90 0x7fd3c012dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.052+0000 7fd3ccd95640 1 -- 172.21.15.22:0/35530416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3c0094350 msgr2=0x7fd3c012d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:19.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.052+0000 7fd3ccd95640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3c0094350 0x7fd3c012d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.052+0000 7fd3ccd95640 1 -- 172.21.15.22:0/35530416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3c0138a00 con 0x7fd3c009a5e0 2024-09-21T04:05:19.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.053+0000 7fd3ccd95640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c009a5e0 0x7fd3c012e1f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8052020 tx=0x7fd3c80755f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:19.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.053+0000 7fd3c57fa640 1 -- 172.21.15.22:0/35530416 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c806a5d0 con 0x7fd3c009a5e0 2024-09-21T04:05:19.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.053+0000 7fd3c57fa640 1 -- 172.21.15.22:0/35530416 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3c8085070 con 0x7fd3c009a5e0 2024-09-21T04:05:19.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.053+0000 7fd3c57fa640 1 -- 172.21.15.22:0/35530416 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c807f7b0 con 0x7fd3c009a5e0 2024-09-21T04:05:19.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.053+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3c012b5c0 con 0x7fd3c009a5e0 2024-09-21T04:05:19.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.054+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3c012b9c0 con 0x7fd3c009a5e0 2024-09-21T04:05:19.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.058+0000 7fd3c57fa640 1 -- 172.21.15.22:0/35530416 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fd3c807f950 con 0x7fd3c009a5e0 2024-09-21T04:05:19.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.060+0000 7fd3d4d6c740 1 Processor -- start 2024-09-21T04:05:19.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.060+0000 7fd3d4d6c740 1 -- start start 2024-09-21T04:05:19.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e1cb840 0x55ed4e5727c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1a2980 0x55ed4e572d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 0x55ed4e573240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3d4d6c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ed4e4e8b90 con 0x55ed4e1a2980 2024-09-21T04:05:19.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3d4d6c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ed4e4d7fc0 con 0x55ed4e1cb840 2024-09-21T04:05:19.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3d4d6c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ed4e4dbdd0 con 0x55ed4e1aab60 2024-09-21T04:05:19.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1a2980 0x55ed4e572d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1a2980 0x55ed4e572d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42104/0 (socket says 172.21.15.22:42104) 2024-09-21T04:05:19.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3c7fff640 1 -- 172.21.15.22:0/4283412690 learned_addr learned my addr 172.21.15.22:0/4283412690 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:19.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/4283412690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e1cb840 0x55ed4e5727c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.061+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/4283412690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 0x55ed4e573240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.062+0000 7fd3c7fff640 1 -- 172.21.15.22:0/4283412690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 msgr2=0x55ed4e573240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:19.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.062+0000 7fd3c7fff640 1 --2- 172.21.15.22:0/4283412690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 0x55ed4e573240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.062+0000 7fd3c7fff640 1 -- 172.21.15.22:0/4283412690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e1cb840 msgr2=0x55ed4e5727c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:19.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.062+0000 7fd3c7fff640 1 --2- 172.21.15.22:0/4283412690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e1cb840 0x55ed4e5727c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.062+0000 7fd3c7fff640 1 -- 172.21.15.22:0/4283412690 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4e45f060 con 0x55ed4e1a2980 2024-09-21T04:05:19.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.062+0000 7fd3c57fa640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd3b80b6750 0x7fd3b80b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.062+0000 7fd3c57fa640 1 -- 172.21.15.22:0/35530416 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fd3c81554a0 con 0x7fd3c009a5e0 2024-09-21T04:05:19.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.063+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd3b80b6750 0x7fd3b80b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.063+0000 7fd3c7fff640 1 --2- 172.21.15.22:0/4283412690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1a2980 0x55ed4e572d00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc000c00 tx=0x7fd3bc004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42682d468149330 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:19.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.064+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd3b80b6750 0x7fd3b80b8c60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0005240 tx=0x7fd3b400a6a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:19.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.064+0000 7fd3b27fc640 1 -- 172.21.15.22:0/4283412690 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc035040 con 0x55ed4e1a2980 2024-09-21T04:05:19.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.064+0000 7fd3b27fc640 1 -- 172.21.15.22:0/4283412690 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3bc0046c0 con 0x55ed4e1a2980 2024-09-21T04:05:19.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.064+0000 7fd3b27fc640 1 -- 172.21.15.22:0/4283412690 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc003830 con 0x55ed4e1a2980 2024-09-21T04:05:19.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.065+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/4283412690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1a2980 msgr2=0x55ed4e572d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:19.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.065+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/4283412690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1a2980 0x55ed4e572d00 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc000c00 tx=0x7fd3bc004380 comp rx=0 tx=0).stop 2024-09-21T04:05:19.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.066+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/4283412690 shutdown_connections 2024-09-21T04:05:19.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.066+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/4283412690 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 0x55ed4e573240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.066+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/4283412690 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1a2980 0x55ed4e572d00 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.066+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/4283412690 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e1cb840 0x55ed4e5727c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.066+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/4283412690 >> 172.21.15.22:0/4283412690 conn(0x55ed4e1bf990 msgr2=0x55ed4e5706b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:19.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.066+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/4283412690 shutdown_connections 2024-09-21T04:05:19.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.066+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/4283412690 wait complete. 2024-09-21T04:05:19.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.067+0000 7fd3d4d6c740 1 -- start start 2024-09-21T04:05:19.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.067+0000 7fd3d4d6c740 1 Processor -- start 2024-09-21T04:05:19.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.067+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1a2980 0x55ed4e57e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.067+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e1aab60 0x55ed4e57e850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1cb840 0x55ed4e58a290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3d4d6c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ed4e3397a0 con 0x55ed4e1cb840 2024-09-21T04:05:19.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3d4d6c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ed4e47d0a0 con 0x55ed4e1aab60 2024-09-21T04:05:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3d4d6c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ed4e580f40 con 0x55ed4e1a2980 2024-09-21T04:05:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3d4d6c740 10 client.0 _ll_register_callbacks cb 0x55ed4e45a3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:05:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3c77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e1aab60 0x55ed4e57e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1a2980 0x55ed4e57e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1a2980 0x55ed4e57e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:33698/0 (socket says 172.21.15.22:33698) 2024-09-21T04:05:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3c7fff640 1 -- 172.21.15.22:0/928801126 learned_addr learned my addr 172.21.15.22:0/928801126 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3c7fff640 1 -- 172.21.15.22:0/928801126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e1aab60 msgr2=0x55ed4e57e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3c7fff640 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e1aab60 0x55ed4e57e850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3c7fff640 1 -- 172.21.15.22:0/928801126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1cb840 msgr2=0x55ed4e58a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3c7fff640 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1cb840 0x55ed4e58a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3c7fff640 1 -- 172.21.15.22:0/928801126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed4e46b880 con 0x55ed4e1a2980 2024-09-21T04:05:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.068+0000 7fd3c7fff640 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1a2980 0x55ed4e57e310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0058c0 tx=0x7fd3bc005230 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9962d083e7463b09 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.069+0000 7fd3a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:05:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.069+0000 7fd3a77fe640 1 -- 172.21.15.22:0/928801126 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3bc035040 con 0x55ed4e1a2980 2024-09-21T04:05:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.069+0000 7fd3a77fe640 1 -- 172.21.15.22:0/928801126 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fd3bc004a70 con 0x55ed4e1a2980 2024-09-21T04:05:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.069+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/928801126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3bc0046c0 con 0x55ed4e1a2980 2024-09-21T04:05:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.069+0000 7fd3a77fe640 1 -- 172.21.15.22:0/928801126 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd3bc004c70 con 0x55ed4e1a2980 2024-09-21T04:05:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.069+0000 7fd3d4d6c740 10 client.25420 fetch_fsmap learned FSMap version 33 2024-09-21T04:05:19.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.069+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/928801126 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ed4e245b90 con 0x55ed4e1a2980 2024-09-21T04:05:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.070+0000 7fd3a77fe640 1 -- 172.21.15.22:0/928801126 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3bc0046c0 con 0x55ed4e1a2980 2024-09-21T04:05:19.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.070+0000 7fd3a77fe640 1 -- 172.21.15.22:0/928801126 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 33) ==== 8402+0+0 (secure 0 0 0) 0x7fd3bc055030 con 0x55ed4e1a2980 2024-09-21T04:05:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.071+0000 7fd3d4d6c740 10 client.25420 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T04:05:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.071+0000 7fd3d4d6c740 10 client.25420 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:05:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.071+0000 7fd3d4d6c740 20 client.25420 populate_metadata read hostname 'smithi022' 2024-09-21T04:05:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.071+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ed4e18a1c0 0x55ed4e590070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.071+0000 7fd3d4d6c740 4 client.25420 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:05:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.071+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/928801126 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed4e4eaae0 con 0x55ed4e18a1c0 2024-09-21T04:05:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.071+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ed4e18a1c0 0x55ed4e590070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.072+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ed4e18a1c0 0x55ed4e590070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b4045b2ec3ee2e6e server_cookie=7eaa7faadc9f329a in_seq=0 out_seq=0 2024-09-21T04:05:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.072+0000 7fd3a77fe640 10 client.25420 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.073+0000 7fd3a77fe640 1 -- 172.21.15.22:0/928801126 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ed4e4eaae0 con 0x55ed4e18a1c0 2024-09-21T04:05:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.073+0000 7fd3a77fe640 10 client.25420 handle_command_reply: tid=0 2024-09-21T04:05:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.073+0000 7fd3d4d6c740 1 client.25420 shutdown 2024-09-21T04:05:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.073+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/928801126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1a2980 msgr2=0x55ed4e57e310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.073+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1a2980 0x55ed4e57e310 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0058c0 tx=0x7fd3bc005230 comp rx=0 tx=0).stop 2024-09-21T04:05:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.074+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/928801126 shutdown_connections 2024-09-21T04:05:19.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.074+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ed4e18a1c0 0x55ed4e590070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.074+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1cb840 0x55ed4e58a290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.074+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e1aab60 0x55ed4e57e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.074+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/928801126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1a2980 0x55ed4e57e310 secure :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0058c0 tx=0x7fd3bc005230 comp rx=0 tx=0).stop 2024-09-21T04:05:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.074+0000 7fd3a77fe640 0 client.25420 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:19.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.074+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/928801126 >> 172.21.15.22:0/928801126 conn(0x55ed4e1bf990 msgr2=0x55ed4e575950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:19.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.074+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/928801126 shutdown_connections 2024-09-21T04:05:19.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.074+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/928801126 wait complete. 2024-09-21T04:05:19.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.074+0000 7fd3d4d6c740 20 client.25420 trim_cache size 0 max 16384 2024-09-21T04:05:19.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.108+0000 7fd3d4d6c740 1 Processor -- start 2024-09-21T04:05:19.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.108+0000 7fd3d4d6c740 1 -- start start 2024-09-21T04:05:19.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 0x55ed4e575fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1cb840 0x55ed4e56ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3d4d6c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c01495b0 con 0x55ed4e1cb840 2024-09-21T04:05:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3d4d6c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c014b270 con 0x55ed4e15f570 2024-09-21T04:05:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3d4d6c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c0149c80 con 0x55ed4e1aab60 2024-09-21T04:05:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 0x55ed4e575fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 0x55ed4e575fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:33702/0 (socket says 172.21.15.22:33702) 2024-09-21T04:05:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3c7fff640 1 -- 172.21.15.22:0/1668814697 learned_addr learned my addr 172.21.15.22:0/1668814697 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3ccd95640 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1cb840 0x55ed4e56ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3ccd95640 1 -- 172.21.15.22:0/1668814697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 msgr2=0x55ed4e575fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3ccd95640 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 0x55ed4e575fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.109+0000 7fd3ccd95640 1 -- 172.21.15.22:0/1668814697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1cb840 msgr2=0x55ed4e56ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.110+0000 7fd3ccd95640 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1cb840 0x55ed4e56ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.110+0000 7fd3ccd95640 1 -- 172.21.15.22:0/1668814697 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4e5799a0 con 0x55ed4e15f570 2024-09-21T04:05:19.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.110+0000 7fd3c7fff640 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 0x55ed4e575fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:05:19.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.110+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1cb840 0x55ed4e56ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:19.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.110+0000 7fd3ccd95640 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5704f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8051230 tx=0x7fd3c81170b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=154c755fc82a6540 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.110+0000 7fd3b1ffb640 1 -- 172.21.15.22:0/1668814697 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c811a980 con 0x55ed4e15f570 2024-09-21T04:05:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.110+0000 7fd3b1ffb640 1 -- 172.21.15.22:0/1668814697 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3c811ad20 con 0x55ed4e15f570 2024-09-21T04:05:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.110+0000 7fd3b1ffb640 1 -- 172.21.15.22:0/1668814697 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3c8116b60 con 0x55ed4e15f570 2024-09-21T04:05:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.112+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/1668814697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 msgr2=0x55ed4e5704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.112+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5704f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8051230 tx=0x7fd3c81170b0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.112+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/1668814697 shutdown_connections 2024-09-21T04:05:19.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.112+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5704f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.112+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1cb840 0x55ed4e56ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.112+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/1668814697 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1aab60 0x55ed4e575fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.112+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/1668814697 >> 172.21.15.22:0/1668814697 conn(0x55ed4e1bf990 msgr2=0x55ed4e5758c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.112+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/1668814697 shutdown_connections 2024-09-21T04:05:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.112+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/1668814697 wait complete. 2024-09-21T04:05:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.113+0000 7fd3d4d6c740 1 -- start start 2024-09-21T04:05:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.113+0000 7fd3d4d6c740 1 Processor -- start 2024-09-21T04:05:19.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.114+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5811b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.114+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1aab60 0x55ed4e5816f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.114+0000 7fd3d4d6c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1cb840 0x55ed4e581c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.115+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5811b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.115+0000 7fd3c7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5811b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:38782/0 (socket says 172.21.15.22:38782) 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.115+0000 7fd3c7fff640 1 -- 172.21.15.22:0/2742035591 learned_addr learned my addr 172.21.15.22:0/2742035591 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.115+0000 7fd3ccd95640 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1cb840 0x55ed4e581c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.115+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c014aae0 con 0x55ed4e1aab60 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.115+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c014a350 con 0x55ed4e15f570 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.115+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fd3c0147590 con 0x55ed4e1cb840 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.116+0000 7fd3d4d6c740 10 client.0 _ll_register_callbacks cb 0x7fd3b400a9f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.116+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1aab60 0x55ed4e5816f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.117+0000 7fd3c77fe640 1 -- 172.21.15.22:0/2742035591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1cb840 msgr2=0x55ed4e581c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.117+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1cb840 0x55ed4e581c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.117+0000 7fd3c77fe640 1 -- 172.21.15.22:0/2742035591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 msgr2=0x55ed4e5811b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:19.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.117+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5811b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.117+0000 7fd3c77fe640 1 -- 172.21.15.22:0/2742035591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed4e60b850 con 0x55ed4e1aab60 2024-09-21T04:05:19.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.117+0000 7fd3c7fff640 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5811b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:05:19.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.118+0000 7fd3c77fe640 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1aab60 0x55ed4e5816f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40058c0 tx=0x7fd3b400a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745b52b65dbb0bda server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:19.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.118+0000 7fd3a77fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:05:19.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.119+0000 7fd3a77fe640 1 -- 172.21.15.22:0/2742035591 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3b401f8d0 con 0x55ed4e1aab60 2024-09-21T04:05:19.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.119+0000 7fd3a77fe640 1 -- 172.21.15.22:0/2742035591 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fd3b401a030 con 0x55ed4e1aab60 2024-09-21T04:05:19.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.120+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd3c811ad20 con 0x55ed4e1aab60 2024-09-21T04:05:19.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.120+0000 7fd3a77fe640 1 -- 172.21.15.22:0/2742035591 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd3b403a050 con 0x55ed4e1aab60 2024-09-21T04:05:19.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.121+0000 7fd3d4d6c740 10 client.15783 fetch_fsmap learned FSMap version 33 2024-09-21T04:05:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.121+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ed4e60ca10 con 0x55ed4e1aab60 2024-09-21T04:05:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.121+0000 7fd3a77fe640 1 -- 172.21.15.22:0/2742035591 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd3b4005020 con 0x55ed4e1aab60 2024-09-21T04:05:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.122+0000 7fd3a77fe640 1 -- 172.21.15.22:0/2742035591 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 33) ==== 8402+0+0 (secure 0 0 0) 0x7fd3b40048a0 con 0x55ed4e1aab60 2024-09-21T04:05:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.122+0000 7fd3d4d6c740 10 client.15783 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T04:05:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.122+0000 7fd3d4d6c740 10 client.15783 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:05:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.122+0000 7fd3d4d6c740 20 client.15783 populate_metadata read hostname 'smithi022' 2024-09-21T04:05:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.122+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ed4e60d240 0x55ed4e60f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:19.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.122+0000 7fd3d4d6c740 4 client.15783 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}] 2024-09-21T04:05:19.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.122+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 147.8, "await_for": 45.0}) -- 0x7fd3c811ad20 con 0x55ed4e60d240 2024-09-21T04:05:19.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.122+0000 7fd3c7fff640 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ed4e60d240 0x55ed4e60f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:19.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.123+0000 7fd3c7fff640 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ed4e60d240 0x55ed4e60f660 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f5c2478577779e server_cookie=210aeea1a5464460 in_seq=0 out_seq=0 2024-09-21T04:05:19.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.123+0000 7fd3a77fe640 10 client.15783 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:19.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3a77fe640 1 -- 172.21.15.22:0/2742035591 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fd3c811ad20 con 0x55ed4e60d240 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3a77fe640 10 client.15783 handle_command_reply: tid=0 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 client.15783 shutdown 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1aab60 msgr2=0x55ed4e5816f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1aab60 0x55ed4e5816f0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40058c0 tx=0x7fd3b400a2d0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 shutdown_connections 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ed4e60d240 0x55ed4e60f660 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ed4e1cb840 0x55ed4e581c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ed4e1aab60 0x55ed4e5816f0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 --2- 172.21.15.22:0/2742035591 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ed4e15f570 0x55ed4e5811b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3a77fe640 0 client.15783 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:19.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 >> 172.21.15.22:0/2742035591 conn(0x55ed4e1bf990 msgr2=0x55ed4e5737f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:19.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 shutdown_connections 2024-09-21T04:05:19.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 1 -- 172.21.15.22:0/2742035591 wait complete. 2024-09-21T04:05:19.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3d4d6c740 20 client.15783 trim_cache size 0 max 16384 2024-09-21T04:05:19.408 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:05:19.408 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 33, 2024-09-21T04:05:19.408 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:05:19.408 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 14, 2024-09-21T04:05:19.408 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:05:19.408 INFO:teuthology.orchestra.run.smithi022.stdout: "77795998": { 2024-09-21T04:05:19.408 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 14, 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 147.8, 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:05:19.409 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:19.410 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:19.410 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:19.410 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:19.410 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:19.410 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd3b80b6750 msgr2=0x7fd3b80b8c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3ce7f8640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd3b80b6750 0x7fd3b80b8c60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fd3c0005240 tx=0x7fd3b400a6a0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c009a5e0 msgr2=0x7fd3c012e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3ce7f8640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c009a5e0 0x7fd3c012e1f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fd3c8052020 tx=0x7fd3c80755f0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 shutdown_connections 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3ce7f8640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fd3b80b6750 0x7fd3b80b8c60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3ce7f8640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fd3c0099c90 0x7fd3c012dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3ce7f8640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fd3c009a5e0 0x7fd3c012e1f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3ce7f8640 1 --2- 172.21.15.22:0/35530416 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd3c0094350 0x7fd3c012d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.404+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 >> 172.21.15.22:0/35530416 conn(0x7fd3c000c0a0 msgr2=0x7fd3c0097d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.405+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 shutdown_connections 2024-09-21T04:05:19.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:19.405+0000 7fd3ce7f8640 1 -- 172.21.15.22:0/35530416 wait complete. 2024-09-21T04:05:20.236 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '77795998', quiesce took 4.8 seconds. Will release after: 23.0 2024-09-21T04:05:20.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:20 smithi022 ceph-mon[31015]: pgmap v460: 129 pgs: 129 active+clean; 956 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 629 KiB/s wr, 88 op/s 2024-09-21T04:05:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:20 smithi060 ceph-mon[33722]: pgmap v460: 129 pgs: 129 active+clean; 956 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 629 KiB/s wr, 88 op/s 2024-09-21T04:05:20.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:20 smithi073 ceph-mon[34443]: pgmap v460: 129 pgs: 129 active+clean; 956 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 629 KiB/s wr, 88 op/s 2024-09-21T04:05:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:22 smithi060 ceph-mon[33722]: pgmap v461: 129 pgs: 129 active+clean; 956 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.4 MiB/s wr, 287 op/s 2024-09-21T04:05:22.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:22 smithi022 ceph-mon[31015]: pgmap v461: 129 pgs: 129 active+clean; 956 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.4 MiB/s wr, 287 op/s 2024-09-21T04:05:22.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:22 smithi073 ceph-mon[34443]: pgmap v461: 129 pgs: 129 active+clean; 956 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 2.4 MiB/s wr, 287 op/s 2024-09-21T04:05:23.707 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 60.0 s, 80.3 tps, lat 109.325 ms stddev 33.282 2024-09-21T04:05:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:24 smithi060 ceph-mon[33722]: pgmap v462: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.9 MiB/s wr, 356 op/s 2024-09-21T04:05:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:24 smithi022 ceph-mon[31015]: pgmap v462: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.9 MiB/s wr, 356 op/s 2024-09-21T04:05:24.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:24 smithi073 ceph-mon[34443]: pgmap v462: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 2.9 MiB/s wr, 356 op/s 2024-09-21T04:05:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:26 smithi060 ceph-mon[33722]: pgmap v463: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.0 MiB/s wr, 361 op/s 2024-09-21T04:05:26.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:26 smithi022 ceph-mon[31015]: pgmap v463: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.0 MiB/s wr, 361 op/s 2024-09-21T04:05:26.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:26 smithi073 ceph-mon[34443]: pgmap v463: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 3.0 MiB/s wr, 361 op/s 2024-09-21T04:05:28.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:28 smithi060 ceph-mon[33722]: pgmap v464: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.9 MiB/s wr, 356 op/s 2024-09-21T04:05:28.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 65.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:05:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:28 smithi022 ceph-mon[31015]: pgmap v464: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.9 MiB/s wr, 356 op/s 2024-09-21T04:05:28.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:28 smithi073 ceph-mon[34443]: pgmap v464: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 2.9 MiB/s wr, 356 op/s 2024-09-21T04:05:30.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:30 smithi022 ceph-mon[31015]: pgmap v465: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.8 MiB/s wr, 344 op/s 2024-09-21T04:05:30.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:30 smithi073 ceph-mon[34443]: pgmap v465: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.8 MiB/s wr, 344 op/s 2024-09-21T04:05:30.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:30 smithi060 ceph-mon[33722]: pgmap v465: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.8 MiB/s wr, 344 op/s 2024-09-21T04:05:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:32 smithi022 ceph-mon[31015]: pgmap v466: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-09-21T04:05:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:32 smithi073 ceph-mon[34443]: pgmap v466: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-09-21T04:05:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:32 smithi060 ceph-mon[33722]: pgmap v466: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 2.4 MiB/s wr, 297 op/s 2024-09-21T04:05:33.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 70.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:05:34.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:34 smithi022 ceph-mon[31015]: pgmap v467: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 727 KiB/s wr, 98 op/s 2024-09-21T04:05:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:34 smithi073 ceph-mon[34443]: pgmap v467: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 727 KiB/s wr, 98 op/s 2024-09-21T04:05:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:34 smithi060 ceph-mon[33722]: pgmap v467: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 727 KiB/s wr, 98 op/s 2024-09-21T04:05:36.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:36 smithi022 ceph-mon[31015]: pgmap v468: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 176 KiB/s wr, 33 op/s 2024-09-21T04:05:36.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:36 smithi073 ceph-mon[34443]: pgmap v468: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 176 KiB/s wr, 33 op/s 2024-09-21T04:05:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:36 smithi060 ceph-mon[33722]: pgmap v468: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 176 KiB/s wr, 33 op/s 2024-09-21T04:05:38.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 75.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:05:38.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:38 smithi022 ceph-mon[31015]: pgmap v469: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 166 KiB/s wr, 30 op/s 2024-09-21T04:05:38.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:38 smithi073 ceph-mon[34443]: pgmap v469: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 166 KiB/s wr, 30 op/s 2024-09-21T04:05:38.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:38 smithi060 ceph-mon[33722]: pgmap v469: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 166 KiB/s wr, 30 op/s 2024-09-21T04:05:40.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:40 smithi022 ceph-mon[31015]: pgmap v470: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 167 KiB/s wr, 30 op/s 2024-09-21T04:05:40.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:40 smithi073 ceph-mon[34443]: pgmap v470: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 167 KiB/s wr, 30 op/s 2024-09-21T04:05:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:40 smithi060 ceph-mon[33722]: pgmap v470: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 167 KiB/s wr, 30 op/s 2024-09-21T04:05:42.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:42 smithi060 ceph-mon[33722]: pgmap v471: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 167 KiB/s wr, 31 op/s 2024-09-21T04:05:42.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:42 smithi022 ceph-mon[31015]: pgmap v471: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 167 KiB/s wr, 31 op/s 2024-09-21T04:05:42.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:42 smithi073 ceph-mon[34443]: pgmap v471: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 167 KiB/s wr, 31 op/s 2024-09-21T04:05:43.238 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:05:43.514 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 80.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:05:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3557433397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b24104860 msgr2=0x7f7b24104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:44.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 --2- 172.21.15.22:0/3557433397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b24104860 0x7f7b24104c70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f7b20009900 tx=0x7f7b2002a410 comp rx=0 tx=0).stop 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3557433397 shutdown_connections 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 --2- 172.21.15.22:0/3557433397 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b24105290 0x7f7b2410d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 --2- 172.21.15.22:0/3557433397 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b2410de10 0x7f7b24110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 --2- 172.21.15.22:0/3557433397 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b24104860 0x7f7b24104c70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3557433397 >> 172.21.15.22:0/3557433397 conn(0x7f7b24079740 msgr2=0x7f7b24079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3557433397 shutdown_connections 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3557433397 wait complete. 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 Processor -- start 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.995+0000 7f7b2b10c640 1 -- start start 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b2b10c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b24104860 0x7f7b2419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b2b10c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b24105290 0x7f7b2419ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:44.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b2b10c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b2410de10 0x7f7b2419fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b2b10c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24113a20 con 0x7f7b2410de10 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b2b10c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7b241138a0 con 0x7f7b24105290 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b2b10c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7b24113ba0 con 0x7f7b24104860 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b296a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b2410de10 0x7f7b2419fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b296a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b2410de10 0x7f7b2419fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50866/0 (socket says 172.21.15.22:50866) 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b296a9640 1 -- 172.21.15.22:0/3326628353 learned_addr learned my addr 172.21.15.22:0/3326628353 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b28ea8640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b24104860 0x7f7b2419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b296a9640 1 -- 172.21.15.22:0/3326628353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b24104860 msgr2=0x7f7b2419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b296a9640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b24104860 0x7f7b2419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b296a9640 1 -- 172.21.15.22:0/3326628353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b24105290 msgr2=0x7f7b2419ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b296a9640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b24105290 0x7f7b2419ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b296a9640 1 -- 172.21.15.22:0/3326628353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b241a0560 con 0x7f7b2410de10 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b28ea8640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b24104860 0x7f7b2419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:44.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b296a9640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b2410de10 0x7f7b2419fe30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00b970 tx=0x7f7b1c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b19ffb640 1 -- 172.21.15.22:0/3326628353 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c019070 con 0x7f7b2410de10 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3326628353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b241a0850 con 0x7f7b2410de10 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b19ffb640 1 -- 172.21.15.22:0/3326628353 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b1c014440 con 0x7f7b2410de10 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.996+0000 7f7b19ffb640 1 -- 172.21.15.22:0/3326628353 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c0075d0 con 0x7f7b2410de10 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.997+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3326628353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b241a6fb0 con 0x7f7b2410de10 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.998+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3326628353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2406c1e0 con 0x7f7b2410de10 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:43.999+0000 7f7b19ffb640 1 -- 172.21.15.22:0/3326628353 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7b1c01c070 con 0x7f7b2410de10 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.000+0000 7f7b19ffb640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7b0c0b6510 0x7f7b0c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.000+0000 7f7b19ffb640 1 -- 172.21.15.22:0/3326628353 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7b1c0e6c20 con 0x7f7b2410de10 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.000+0000 7f7b28ea8640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7b0c0b6510 0x7f7b0c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.000+0000 7f7b28ea8640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7b0c0b6510 0x7f7b0c0b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7b20006010 tx=0x7f7b20000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:44.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.004+0000 7f7b19ffb640 1 -- 172.21.15.22:0/3326628353 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b1c0ad0f0 con 0x7f7b2410de10 2024-09-21T04:05:44.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.239+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3326628353 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7b2402e640 con 0x7f7b2410de10 2024-09-21T04:05:44.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.240+0000 7f7b19ffb640 1 -- 172.21.15.22:0/3326628353 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11973 (secure 0 0 0) 0x7f7b1c0b14d0 con 0x7f7b2410de10 2024-09-21T04:05:44.250 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:05:44.250 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":33,"btime":"2024-09-21T04:04:50:361671+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:04:49.494310+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:05:44.250 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 33 2024-09-21T04:05:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.242+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3326628353 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7b0c0b6510 msgr2=0x7f7b0c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.242+0000 7f7b2b10c640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7b0c0b6510 0x7f7b0c0b8a20 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7b20006010 tx=0x7f7b20000bc0 comp rx=0 tx=0).stop 2024-09-21T04:05:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.242+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3326628353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b2410de10 msgr2=0x7f7b2419fe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.242+0000 7f7b2b10c640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b2410de10 0x7f7b2419fe30 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c00b970 tx=0x7f7b1c00be30 comp rx=0 tx=0).stop 2024-09-21T04:05:44.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.243+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3326628353 shutdown_connections 2024-09-21T04:05:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.243+0000 7f7b2b10c640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7b0c0b6510 0x7f7b0c0b8a20 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.243+0000 7f7b2b10c640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b2410de10 0x7f7b2419fe30 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.243+0000 7f7b2b10c640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7b24105290 0x7f7b2419ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.243+0000 7f7b2b10c640 1 --2- 172.21.15.22:0/3326628353 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7b24104860 0x7f7b2419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.243+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3326628353 >> 172.21.15.22:0/3326628353 conn(0x7f7b24079740 msgr2=0x7f7b24100a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.243+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3326628353 shutdown_connections 2024-09-21T04:05:44.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:44.243+0000 7f7b2b10c640 1 -- 172.21.15.22:0/3326628353 wait complete. 2024-09-21T04:05:44.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:44 smithi022 ceph-mon[31015]: pgmap v472: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 186 KiB/s wr, 31 op/s 2024-09-21T04:05:44.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:44 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3326628353' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:44.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:44 smithi073 ceph-mon[34443]: pgmap v472: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 186 KiB/s wr, 31 op/s 2024-09-21T04:05:44.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:44 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3326628353' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:44 smithi060 ceph-mon[33722]: pgmap v472: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 186 KiB/s wr, 31 op/s 2024-09-21T04:05:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:44 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3326628353' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:05:45.033 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id 77795998 --release --await' 2024-09-21T04:05:45.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id 77795998 --release --await 2024-09-21T04:05:45.298 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:05:45.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.786+0000 7f46a5d7b640 1 -- 172.21.15.22:0/1384504752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01083a0 msgr2=0x7f46a01087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:45.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.786+0000 7f46a5d7b640 1 --2- 172.21.15.22:0/1384504752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01083a0 0x7f46a01087b0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f4688009900 tx=0x7f468802a410 comp rx=0 tx=0).stop 2024-09-21T04:05:45.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.786+0000 7f46a5d7b640 1 -- 172.21.15.22:0/1384504752 shutdown_connections 2024-09-21T04:05:45.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.786+0000 7f46a5d7b640 1 --2- 172.21.15.22:0/1384504752 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a0108cf0 0x7f46a010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.786+0000 7f46a5d7b640 1 --2- 172.21.15.22:0/1384504752 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01083a0 0x7f46a01087b0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.786+0000 7f46a5d7b640 1 --2- 172.21.15.22:0/1384504752 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0102a60 0x7f46a0102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.786+0000 7f46a5d7b640 1 -- 172.21.15.22:0/1384504752 >> 172.21.15.22:0/1384504752 conn(0x7f46a0079730 msgr2=0x7f46a0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:45.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.786+0000 7f46a5d7b640 1 -- 172.21.15.22:0/1384504752 shutdown_connections 2024-09-21T04:05:45.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.787+0000 7f46a5d7b640 1 -- 172.21.15.22:0/1384504752 wait complete. 2024-09-21T04:05:45.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.787+0000 7f46a5d7b640 1 Processor -- start 2024-09-21T04:05:45.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.787+0000 7f46a5d7b640 1 -- start start 2024-09-21T04:05:45.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f46a5d7b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a0102a60 0x7f46a019a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f46a5d7b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01083a0 0x7f46a019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f46a5d7b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0108cf0 0x7f46a019fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f46a5d7b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0112810 con 0x7f46a01083a0 2024-09-21T04:05:45.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f46a5d7b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0112690 con 0x7f46a0102a60 2024-09-21T04:05:45.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f46a5d7b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f46a0112990 con 0x7f46a0108cf0 2024-09-21T04:05:45.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f4696ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01083a0 0x7f46a019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f4696ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01083a0 0x7f46a019aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50892/0 (socket says 172.21.15.22:50892) 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f4696ffd640 1 -- 172.21.15.22:0/4088499701 learned_addr learned my addr 172.21.15.22:0/4088499701 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f469f7fe640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a0102a60 0x7f46a019a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f469ffff640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0108cf0 0x7f46a019fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f4696ffd640 1 -- 172.21.15.22:0/4088499701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0108cf0 msgr2=0x7f46a019fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.788+0000 7f4696ffd640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0108cf0 0x7f46a019fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.789+0000 7f4696ffd640 1 -- 172.21.15.22:0/4088499701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a0102a60 msgr2=0x7f46a019a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.789+0000 7f4696ffd640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a0102a60 0x7f46a019a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.789+0000 7f4696ffd640 1 -- 172.21.15.22:0/4088499701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a01a0420 con 0x7f46a01083a0 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.789+0000 7f469f7fe640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a0102a60 0x7f46a019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.789+0000 7f4696ffd640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01083a0 0x7f46a019aa50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4688005940 tx=0x7f46880042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.789+0000 7f469d7fa640 1 -- 172.21.15.22:0/4088499701 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468803f030 con 0x7f46a01083a0 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.789+0000 7f46a5d7b640 1 -- 172.21.15.22:0/4088499701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a01a06b0 con 0x7f46a01083a0 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.789+0000 7f469d7fa640 1 -- 172.21.15.22:0/4088499701 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4688003c90 con 0x7f46a01083a0 2024-09-21T04:05:45.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.789+0000 7f469d7fa640 1 -- 172.21.15.22:0/4088499701 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4688035070 con 0x7f46a01083a0 2024-09-21T04:05:45.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.789+0000 7f46a5d7b640 1 -- 172.21.15.22:0/4088499701 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a01a6e70 con 0x7f46a01083a0 2024-09-21T04:05:45.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.792+0000 7f469d7fa640 1 -- 172.21.15.22:0/4088499701 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f4688042030 con 0x7f46a01083a0 2024-09-21T04:05:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.792+0000 7f46ac2ef740 1 Processor -- start 2024-09-21T04:05:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.792+0000 7f46ac2ef740 1 -- start start 2024-09-21T04:05:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.792+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d02d520 0x555e6d3d3510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.792+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 0x555e6d3d3a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.792+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 0x555e6d3d3f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.792+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555e6d2bedc0 con 0x555e6d02d520 2024-09-21T04:05:45.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.792+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555e6d34b1f0 con 0x555e6d00c840 2024-09-21T04:05:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.792+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555e6d33a620 con 0x555e6d004660 2024-09-21T04:05:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469d7fa640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f468c0b6510 0x7f468c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d02d520 0x555e6d3d3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d02d520 0x555e6d3d3510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50902/0 (socket says 172.21.15.22:50902) 2024-09-21T04:05:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469ffff640 1 -- 172.21.15.22:0/3751579595 learned_addr learned my addr 172.21.15.22:0/3751579595 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:45.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469f7fe640 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 0x555e6d3d3a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469ffff640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f468c0b6510 0x7f468c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469d7fa640 1 -- 172.21.15.22:0/4088499701 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f4688107ba0 con 0x7f46a01083a0 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f4696ffd640 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 0x555e6d3d3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469f7fe640 1 -- 172.21.15.22:0/3751579595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 msgr2=0x555e6d3d3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469f7fe640 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 0x555e6d3d3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469f7fe640 1 -- 172.21.15.22:0/3751579595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d02d520 msgr2=0x555e6d3d3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469f7fe640 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d02d520 0x555e6d3d3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469f7fe640 1 -- 172.21.15.22:0/3751579595 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e6d302fd0 con 0x555e6d004660 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f4696ffd640 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 0x555e6d3d3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469ffff640 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d02d520 0x555e6d3d3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469f7fe640 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 0x555e6d3d3a50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f46900103d0 tx=0x7f4690010890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b84cf566a7d9062 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.793+0000 7f469ffff640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f468c0b6510 0x7f468c0b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4698009370 tx=0x7f4698004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:45.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.794+0000 7f4695ffb640 1 -- 172.21.15.22:0/3751579595 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690004220 con 0x555e6d004660 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.794+0000 7f4695ffb640 1 -- 172.21.15.22:0/3751579595 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46900043c0 con 0x555e6d004660 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.794+0000 7f4695ffb640 1 -- 172.21.15.22:0/3751579595 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4690011940 con 0x555e6d004660 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.794+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3751579595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 msgr2=0x555e6d3d3a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.794+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 0x555e6d3d3a50 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f46900103d0 tx=0x7f4690010890 comp rx=0 tx=0).stop 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.794+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3751579595 shutdown_connections 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.794+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 0x555e6d3d3a50 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.794+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 0x555e6d3d3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.794+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/3751579595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d02d520 0x555e6d3d3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.795+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3751579595 >> 172.21.15.22:0/3751579595 conn(0x555e6d021910 msgr2=0x555e6d3d1400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.795+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3751579595 shutdown_connections 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.795+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3751579595 wait complete. 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.795+0000 7f46ac2ef740 1 -- start start 2024-09-21T04:05:45.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.795+0000 7f46ac2ef740 1 Processor -- start 2024-09-21T04:05:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d00c840 0x555e6d3df160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d02d520 0x555e6d3eae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555e6d2d5300 con 0x555e6d004660 2024-09-21T04:05:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555e6d33e430 con 0x555e6d02d520 2024-09-21T04:05:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555e6d19bbb0 con 0x555e6d00c840 2024-09-21T04:05:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f46ac2ef740 10 client.0 _ll_register_callbacks cb 0x555e6d2ef120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dec20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50918/0 (socket says 172.21.15.22:50918) 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469f7fe640 1 -- 172.21.15.22:0/2333574558 learned_addr learned my addr 172.21.15.22:0/2333574558 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f4696ffd640 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d00c840 0x555e6d3df160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469ffff640 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d02d520 0x555e6d3eae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469f7fe640 1 -- 172.21.15.22:0/2333574558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d00c840 msgr2=0x555e6d3df160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469f7fe640 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d00c840 0x555e6d3df160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469f7fe640 1 -- 172.21.15.22:0/2333574558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d02d520 msgr2=0x555e6d3eae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469f7fe640 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d02d520 0x555e6d3eae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469f7fe640 1 -- 172.21.15.22:0/2333574558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e6d2c4780 con 0x555e6d004660 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f4696ffd640 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d00c840 0x555e6d3df160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469ffff640 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d02d520 0x555e6d3eae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f469f7fe640 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dec20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4690005890 tx=0x7f46900041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6298947c94dbb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:45.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f467effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f467effd640 1 -- 172.21.15.22:0/2333574558 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f469002a060 con 0x555e6d004660 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f46ac2ef740 1 -- 172.21.15.22:0/2333574558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46900043c0 con 0x555e6d004660 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.796+0000 7f467effd640 1 -- 172.21.15.22:0/2333574558 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f4690005310 con 0x555e6d004660 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f467effd640 1 -- 172.21.15.22:0/2333574558 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4690031050 con 0x555e6d004660 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f46ac2ef740 10 client.15801 fetch_fsmap learned FSMap version 33 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f46ac2ef740 1 -- 172.21.15.22:0/2333574558 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555e6d098b00 con 0x555e6d004660 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f467effd640 1 -- 172.21.15.22:0/2333574558 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46900043c0 con 0x555e6d004660 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f467effd640 1 -- 172.21.15.22:0/2333574558 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 33) ==== 8402+0+0 (secure 0 0 0) 0x7f4690011750 con 0x555e6d004660 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f46ac2ef740 10 client.15801 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f46ac2ef740 10 client.15801 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f46ac2ef740 20 client.15801 populate_metadata read hostname 'smithi022' 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555e6cfebea0 0x555e6d3f0da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f46ac2ef740 4 client.15801 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:05:45.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.797+0000 7f46ac2ef740 1 -- 172.21.15.22:0/2333574558 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555e6d34d140 con 0x555e6cfebea0 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.798+0000 7f4696ffd640 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555e6cfebea0 0x555e6d3f0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.798+0000 7f467effd640 10 client.15801 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.798+0000 7f4696ffd640 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555e6cfebea0 0x555e6d3f0da0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d11744f0d904a7a1 server_cookie=d87c59863600e4 in_seq=0 out_seq=0 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f467effd640 1 -- 172.21.15.22:0/2333574558 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555e6d34d140 con 0x555e6cfebea0 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f467effd640 10 client.15801 handle_command_reply: tid=0 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 client.15801 shutdown 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 -- 172.21.15.22:0/2333574558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 msgr2=0x555e6d3dec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dec20 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f4690005890 tx=0x7f46900041d0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 -- 172.21.15.22:0/2333574558 shutdown_connections 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555e6cfebea0 0x555e6d3f0da0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d00c840 0x555e6d3df160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d02d520 0x555e6d3eae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f467effd640 0 client.15801 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:45.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/2333574558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dec20 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 -- 172.21.15.22:0/2333574558 >> 172.21.15.22:0/2333574558 conn(0x555e6d021910 msgr2=0x555e6d3d66f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:45.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 -- 172.21.15.22:0/2333574558 shutdown_connections 2024-09-21T04:05:45.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 1 -- 172.21.15.22:0/2333574558 wait complete. 2024-09-21T04:05:45.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.799+0000 7f46ac2ef740 20 client.15801 trim_cache size 0 max 16384 2024-09-21T04:05:45.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.816+0000 7f46ac2ef740 1 Processor -- start 2024-09-21T04:05:45.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.816+0000 7f46ac2ef740 1 -- start start 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6cfebea0 0x555e6d3de9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 0x555e6d3dc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01b0ad0 con 0x555e6d004660 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01b2790 con 0x555e6d00c840 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01b11a0 con 0x555e6cfebea0 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f4696ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f4696ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dbe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50926/0 (socket says 172.21.15.22:50926) 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f4696ffd640 1 -- 172.21.15.22:0/542264560 learned_addr learned my addr 172.21.15.22:0/542264560 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f469ffff640 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 0x555e6d3dc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f4696ffd640 1 -- 172.21.15.22:0/542264560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6cfebea0 msgr2=0x555e6d3de9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f469f7fe640 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6cfebea0 0x555e6d3de9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f4696ffd640 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6cfebea0 0x555e6d3de9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f4696ffd640 1 -- 172.21.15.22:0/542264560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 msgr2=0x555e6d3dc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:45.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f4696ffd640 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 0x555e6d3dc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f4696ffd640 1 -- 172.21.15.22:0/542264560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e6d10f960 con 0x555e6d004660 2024-09-21T04:05:45.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f469ffff640 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 0x555e6d3dc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:45.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f469f7fe640 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6cfebea0 0x555e6d3de9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:05:45.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.817+0000 7f4696ffd640 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dbe10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4688000c00 tx=0x7f46880f1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1b24ee63c113b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:45.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.818+0000 7f46957fa640 1 -- 172.21.15.22:0/542264560 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4688049040 con 0x555e6d004660 2024-09-21T04:05:45.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.818+0000 7f46957fa640 1 -- 172.21.15.22:0/542264560 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4688003e40 con 0x555e6d004660 2024-09-21T04:05:45.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.818+0000 7f46957fa640 1 -- 172.21.15.22:0/542264560 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46880d7390 con 0x555e6d004660 2024-09-21T04:05:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.818+0000 7f46ac2ef740 1 -- 172.21.15.22:0/542264560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 msgr2=0x555e6d3dbe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.818+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dbe10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f4688000c00 tx=0x7f46880f1040 comp rx=0 tx=0).stop 2024-09-21T04:05:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.818+0000 7f46ac2ef740 1 -- 172.21.15.22:0/542264560 shutdown_connections 2024-09-21T04:05:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.818+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6d00c840 0x555e6d3dc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.818+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d004660 0x555e6d3dbe10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.818+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/542264560 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6cfebea0 0x555e6d3de9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.818+0000 7f46ac2ef740 1 -- 172.21.15.22:0/542264560 >> 172.21.15.22:0/542264560 conn(0x555e6d021910 msgr2=0x555e6d3dd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.819+0000 7f46ac2ef740 1 -- 172.21.15.22:0/542264560 shutdown_connections 2024-09-21T04:05:45.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.819+0000 7f46ac2ef740 1 -- 172.21.15.22:0/542264560 wait complete. 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.819+0000 7f46ac2ef740 1 -- start start 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.819+0000 7f46ac2ef740 1 Processor -- start 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.819+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6cfebea0 0x555e6d3e38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.819+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 0x555e6d3e3e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.819+0000 7f46ac2ef740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d00c840 0x555e6d4546c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01b2000 con 0x555e6d00c840 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01b1870 con 0x555e6cfebea0 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f46ac2ef740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f46a01aeab0 con 0x555e6d004660 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f469ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d00c840 0x555e6d4546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f469ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d00c840 0x555e6d4546c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50930/0 (socket says 172.21.15.22:50930) 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f469ffff640 1 -- 172.21.15.22:0/3924758039 learned_addr learned my addr 172.21.15.22:0/3924758039 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f46ac2ef740 10 client.0 _ll_register_callbacks cb 0x7f46980097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:05:45.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f4696ffd640 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 0x555e6d3e3e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f469f7fe640 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6cfebea0 0x555e6d3e38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f469ffff640 1 -- 172.21.15.22:0/3924758039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 msgr2=0x555e6d3e3e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f469ffff640 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 0x555e6d3e3e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f469ffff640 1 -- 172.21.15.22:0/3924758039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6cfebea0 msgr2=0x555e6d3e38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f469ffff640 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6cfebea0 0x555e6d3e38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f469ffff640 1 -- 172.21.15.22:0/3924758039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e6d454d30 con 0x555e6d00c840 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f469ffff640 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d00c840 0x555e6d4546c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4698013c30 tx=0x7f4698004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa5c179c7eb7bbae server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.820+0000 7f467effd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f467effd640 1 -- 172.21.15.22:0/3924758039 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4698004510 con 0x555e6d00c840 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f467effd640 1 -- 172.21.15.22:0/3924758039 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f46980046b0 con 0x555e6d00c840 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3924758039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555e6d348bf0 con 0x555e6d00c840 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f467effd640 1 -- 172.21.15.22:0/3924758039 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4698033050 con 0x555e6d00c840 2024-09-21T04:05:45.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f46ac2ef740 10 client.15807 fetch_fsmap learned FSMap version 33 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3924758039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555e6d45c0d0 con 0x555e6d00c840 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f467effd640 1 -- 172.21.15.22:0/3924758039 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555e6d348bf0 con 0x555e6d00c840 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f467effd640 1 -- 172.21.15.22:0/3924758039 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 33) ==== 8402+0+0 (secure 0 0 0) 0x7f469801f040 con 0x555e6d00c840 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f46ac2ef740 10 client.15807 fetch_fsmap finished waiting for FSMap version 33 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f46ac2ef740 10 client.15807 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f46ac2ef740 20 client.15807 populate_metadata read hostname 'smithi022' 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555e6d02d520 0x555e6d45e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f46ac2ef740 4 client.15807 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "77795998", "release": true, "await": true}] 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.821+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3924758039 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "77795998", "release": true, "await": true}) -- 0x555e6d346020 con 0x555e6d02d520 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.822+0000 7f469f7fe640 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555e6d02d520 0x555e6d45e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.822+0000 7f469f7fe640 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555e6d02d520 0x555e6d45e9b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d2ae7fbd31d20c3a server_cookie=d007742cf29e01e2 in_seq=0 out_seq=0 2024-09-21T04:05:45.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.822+0000 7f467effd640 10 client.15807 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:45.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.862+0000 7f467effd640 1 -- 172.21.15.22:0/3924758039 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555e6d346020 con 0x555e6d02d520 2024-09-21T04:05:45.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.862+0000 7f467effd640 10 client.15807 handle_command_reply: tid=0 2024-09-21T04:05:45.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.862+0000 7f46ac2ef740 1 client.15807 shutdown 2024-09-21T04:05:45.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.863+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3924758039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d00c840 msgr2=0x555e6d4546c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:45.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.863+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d00c840 0x555e6d4546c0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f4698013c30 tx=0x7f4698004a40 comp rx=0 tx=0).stop 2024-09-21T04:05:45.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.863+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3924758039 shutdown_connections 2024-09-21T04:05:45.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.863+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555e6d02d520 0x555e6d45e9b0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.864+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555e6d004660 0x555e6d3e3e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.864+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555e6d00c840 0x555e6d4546c0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.864+0000 7f46ac2ef740 1 --2- 172.21.15.22:0/3924758039 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555e6cfebea0 0x555e6d3e38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.864+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3924758039 >> 172.21.15.22:0/3924758039 conn(0x555e6d021910 msgr2=0x555e6d3dd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:45.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.864+0000 7f467effd640 0 client.15807 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:05:45.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.864+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3924758039 shutdown_connections 2024-09-21T04:05:45.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.864+0000 7f46ac2ef740 1 -- 172.21.15.22:0/3924758039 wait complete. 2024-09-21T04:05:45.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.865+0000 7f46ac2ef740 20 client.15807 trim_cache size 0 max 16384 2024-09-21T04:05:45.868 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:05:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 33, 2024-09-21T04:05:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:05:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 16, 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "77795998": { 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 16, 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 147.8, 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:05:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:05:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:05:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:05:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:05:45.870 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 -- 172.21.15.22:0/4088499701 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f468c0b6510 msgr2=0x7f468c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f468c0b6510 0x7f468c0b8a20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4698009370 tx=0x7f4698004ab0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 -- 172.21.15.22:0/4088499701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01083a0 msgr2=0x7f46a019aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01083a0 0x7f46a019aa50 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f4688005940 tx=0x7f46880042f0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 -- 172.21.15.22:0/4088499701 shutdown_connections 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f468c0b6510 0x7f468c0b8a20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46a0108cf0 0x7f46a019fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46a01083a0 0x7f46a019aa50 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 --2- 172.21.15.22:0/4088499701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46a0102a60 0x7f46a019a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 -- 172.21.15.22:0/4088499701 >> 172.21.15.22:0/4088499701 conn(0x7f46a0079730 msgr2=0x7f46a0101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:05:45.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.866+0000 7f46a5d7b640 1 -- 172.21.15.22:0/4088499701 shutdown_connections 2024-09-21T04:05:45.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:05:45.867+0000 7f46a5d7b640 1 -- 172.21.15.22:0/4088499701 wait complete. 2024-09-21T04:05:46.725 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:46 smithi022 ceph-mon[31015]: pgmap v473: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 198 KiB/s wr, 34 op/s 2024-09-21T04:05:46.726 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '77795998', total seconds elapsed: 31.3 2024-09-21T04:05:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:46 smithi073 ceph-mon[34443]: pgmap v473: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 198 KiB/s wr, 34 op/s 2024-09-21T04:05:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:46 smithi060 ceph-mon[33722]: pgmap v473: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 198 KiB/s wr, 34 op/s 2024-09-21T04:05:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 85.0 s, 597.8 tps, lat 989.841 ms stddev 4799.289 2024-09-21T04:05:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:48 smithi022 ceph-mon[31015]: pgmap v474: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 191 KiB/s wr, 33 op/s 2024-09-21T04:05:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:48 smithi073 ceph-mon[34443]: pgmap v474: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 191 KiB/s wr, 33 op/s 2024-09-21T04:05:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:48 smithi060 ceph-mon[33722]: pgmap v474: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 191 KiB/s wr, 33 op/s 2024-09-21T04:05:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:50 smithi022 ceph-mon[31015]: pgmap v475: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 450 KiB/s wr, 64 op/s 2024-09-21T04:05:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:50 smithi073 ceph-mon[34443]: pgmap v475: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 450 KiB/s wr, 64 op/s 2024-09-21T04:05:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:50 smithi060 ceph-mon[33722]: pgmap v475: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 450 KiB/s wr, 64 op/s 2024-09-21T04:05:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:52 smithi022 ceph-mon[31015]: pgmap v476: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 2.5 MiB/s wr, 297 op/s 2024-09-21T04:05:52.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:52 smithi073 ceph-mon[34443]: pgmap v476: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 2.5 MiB/s wr, 297 op/s 2024-09-21T04:05:52.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:52 smithi060 ceph-mon[33722]: pgmap v476: 129 pgs: 129 active+clean; 956 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 2.5 MiB/s wr, 297 op/s 2024-09-21T04:05:53.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 90.0 s, 1181.8 tps, lat 84.630 ms stddev 22.281 2024-09-21T04:05:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:54 smithi022 ceph-mon[31015]: pgmap v477: 129 pgs: 129 active+clean; 956 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.2 MiB/s wr, 501 op/s 2024-09-21T04:05:54.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:54 smithi073 ceph-mon[34443]: pgmap v477: 129 pgs: 129 active+clean; 956 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.2 MiB/s wr, 501 op/s 2024-09-21T04:05:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:54 smithi060 ceph-mon[33722]: pgmap v477: 129 pgs: 129 active+clean; 956 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.2 MiB/s wr, 501 op/s 2024-09-21T04:05:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:56 smithi022 ceph-mon[31015]: pgmap v478: 129 pgs: 129 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.5 MiB/s wr, 764 op/s 2024-09-21T04:05:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:56 smithi073 ceph-mon[34443]: pgmap v478: 129 pgs: 129 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.5 MiB/s wr, 764 op/s 2024-09-21T04:05:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:56 smithi060 ceph-mon[33722]: pgmap v478: 129 pgs: 129 active+clean; 956 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 6.5 MiB/s wr, 764 op/s 2024-09-21T04:05:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 95.0 s, 1066.0 tps, lat 66.594 ms stddev 22.560 2024-09-21T04:05:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:58 smithi022 ceph-mon[31015]: pgmap v479: 129 pgs: 129 active+clean; 956 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 MiB/s wr, 920 op/s 2024-09-21T04:05:58.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:58 smithi073 ceph-mon[34443]: pgmap v479: 129 pgs: 129 active+clean; 956 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 MiB/s wr, 920 op/s 2024-09-21T04:05:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:58 smithi060 ceph-mon[33722]: pgmap v479: 129 pgs: 129 active+clean; 956 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.8 MiB/s wr, 920 op/s 2024-09-21T04:05:59.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:05:59 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:05:59.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:05:59 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:05:59.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:05:59 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:00 smithi022 ceph-mon[31015]: pgmap v480: 129 pgs: 129 active+clean; 956 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.0 MiB/s wr, 1.07k op/s 2024-09-21T04:06:00.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:00 smithi073 ceph-mon[34443]: pgmap v480: 129 pgs: 129 active+clean; 956 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.0 MiB/s wr, 1.07k op/s 2024-09-21T04:06:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:00 smithi060 ceph-mon[33722]: pgmap v480: 129 pgs: 129 active+clean; 956 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 9.0 MiB/s wr, 1.07k op/s 2024-09-21T04:06:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:02 smithi022 ceph-mon[31015]: pgmap v481: 129 pgs: 129 active+clean; 957 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 1.34k op/s 2024-09-21T04:06:02.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:02 smithi073 ceph-mon[34443]: pgmap v481: 129 pgs: 129 active+clean; 957 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 1.34k op/s 2024-09-21T04:06:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:02 smithi060 ceph-mon[33722]: pgmap v481: 129 pgs: 129 active+clean; 957 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 11 MiB/s wr, 1.34k op/s 2024-09-21T04:06:03.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 100.0 s, 1020.2 tps, lat 126.481 ms stddev 478.709 2024-09-21T04:06:04.838 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:04 smithi022 ceph-mon[31015]: pgmap v482: 129 pgs: 129 active+clean; 957 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-21T04:06:04.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:04 smithi073 ceph-mon[34443]: pgmap v482: 129 pgs: 129 active+clean; 957 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-21T04:06:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:04 smithi060 ceph-mon[33722]: pgmap v482: 129 pgs: 129 active+clean; 957 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-21T04:06:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:06 smithi022 ceph-mon[31015]: pgmap v483: 129 pgs: 129 active+clean; 957 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-21T04:06:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:06 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:06:06.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:06 smithi073 ceph-mon[34443]: pgmap v483: 129 pgs: 129 active+clean; 957 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-21T04:06:06.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:06 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:06:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:06 smithi060 ceph-mon[33722]: pgmap v483: 129 pgs: 129 active+clean; 957 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 11 MiB/s wr, 1.30k op/s 2024-09-21T04:06:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:06 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:06:07.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:07 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:06:07.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:07 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:06:07.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:07 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:06:07.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:07 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:06:07.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:07 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:06:07.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:07 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:06:07.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:07 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:06:07.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:07 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:06:07.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:07 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:06:08.705 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 105.0 s, 1120.4 tps, lat 89.187 ms stddev 23.842 2024-09-21T04:06:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:08 smithi022 ceph-mon[31015]: pgmap v484: 129 pgs: 129 active+clean; 957 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 1.18k op/s 2024-09-21T04:06:08.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:08 smithi073 ceph-mon[34443]: pgmap v484: 129 pgs: 129 active+clean; 957 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 1.18k op/s 2024-09-21T04:06:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:08 smithi060 ceph-mon[33722]: pgmap v484: 129 pgs: 129 active+clean; 957 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 10 MiB/s wr, 1.18k op/s 2024-09-21T04:06:10.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:09 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:10.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:09 smithi022 ceph-mon[31015]: pgmap v485: 129 pgs: 129 active+clean; 957 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.8 MiB/s wr, 1.15k op/s 2024-09-21T04:06:10.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:09 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:10.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:09 smithi073 ceph-mon[34443]: pgmap v485: 129 pgs: 129 active+clean; 957 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.8 MiB/s wr, 1.15k op/s 2024-09-21T04:06:10.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:09 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:10.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:09 smithi060 ceph-mon[33722]: pgmap v485: 129 pgs: 129 active+clean; 957 MiB data, 2.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 9.8 MiB/s wr, 1.15k op/s 2024-09-21T04:06:12.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:12 smithi022 ceph-mon[31015]: pgmap v486: 129 pgs: 129 active+clean; 957 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 1.32k op/s 2024-09-21T04:06:12.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:12 smithi073 ceph-mon[34443]: pgmap v486: 129 pgs: 129 active+clean; 957 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 1.32k op/s 2024-09-21T04:06:12.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:12 smithi060 ceph-mon[33722]: pgmap v486: 129 pgs: 129 active+clean; 957 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 11 MiB/s wr, 1.32k op/s 2024-09-21T04:06:13.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 110.0 s, 1012.2 tps, lat 99.086 ms stddev 109.916 2024-09-21T04:06:14.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:14 smithi022 ceph-mon[31015]: pgmap v487: 129 pgs: 129 active+clean; 958 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 10 MiB/s wr, 1.22k op/s 2024-09-21T04:06:14.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:14 smithi073 ceph-mon[34443]: pgmap v487: 129 pgs: 129 active+clean; 958 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 10 MiB/s wr, 1.22k op/s 2024-09-21T04:06:14.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:14 smithi060 ceph-mon[33722]: pgmap v487: 129 pgs: 129 active+clean; 958 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 10 MiB/s wr, 1.22k op/s 2024-09-21T04:06:16.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:16 smithi022 ceph-mon[31015]: pgmap v488: 129 pgs: 129 active+clean; 966 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 1.24k op/s 2024-09-21T04:06:16.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:16 smithi073 ceph-mon[34443]: pgmap v488: 129 pgs: 129 active+clean; 966 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 1.24k op/s 2024-09-21T04:06:16.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:16 smithi060 ceph-mon[33722]: pgmap v488: 129 pgs: 129 active+clean; 966 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 1.24k op/s 2024-09-21T04:06:18.354 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:18 smithi073 ceph-mon[34443]: pgmap v489: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-21T04:06:18.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:18 smithi060 ceph-mon[33722]: pgmap v489: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-21T04:06:18.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:18 smithi022 ceph-mon[31015]: pgmap v489: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-21T04:06:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 115.0 s, 1099.8 tps, lat 90.299 ms stddev 24.580 2024-09-21T04:06:20.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:20 smithi060 ceph-mon[33722]: pgmap v490: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-09-21T04:06:20.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:20 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:20.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:20 smithi022 ceph-mon[31015]: pgmap v490: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-09-21T04:06:20.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:20 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:20.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:20 smithi073 ceph-mon[34443]: pgmap v490: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-09-21T04:06:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:20 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:22.401 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:22 smithi022 ceph-mon[31015]: pgmap v491: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 1.35k op/s 2024-09-21T04:06:22.454 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:22 smithi060 ceph-mon[33722]: pgmap v491: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 1.35k op/s 2024-09-21T04:06:22.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:22 smithi073 ceph-mon[34443]: pgmap v491: 129 pgs: 129 active+clean; 974 MiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 13 MiB/s wr, 1.35k op/s 2024-09-21T04:06:23.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 120.0 s, 978.2 tps, lat 102.636 ms stddev 35.226 2024-09-21T04:06:24.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:24 smithi060 ceph-mon[33722]: pgmap v492: 129 pgs: 129 active+clean; 974 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-21T04:06:24.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:24 smithi022 ceph-mon[31015]: pgmap v492: 129 pgs: 129 active+clean; 974 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-21T04:06:24.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:24 smithi073 ceph-mon[34443]: pgmap v492: 129 pgs: 129 active+clean; 974 MiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-21T04:06:26.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:26 smithi060 ceph-mon[33722]: pgmap v493: 129 pgs: 129 active+clean; 974 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 12 MiB/s wr, 1.20k op/s 2024-09-21T04:06:26.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:26 smithi022 ceph-mon[31015]: pgmap v493: 129 pgs: 129 active+clean; 974 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 12 MiB/s wr, 1.20k op/s 2024-09-21T04:06:26.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:26 smithi073 ceph-mon[34443]: pgmap v493: 129 pgs: 129 active+clean; 974 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 12 MiB/s wr, 1.20k op/s 2024-09-21T04:06:28.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:28 smithi060 ceph-mon[33722]: pgmap v494: 129 pgs: 129 active+clean; 974 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 1.15k op/s 2024-09-21T04:06:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:28 smithi022 ceph-mon[31015]: pgmap v494: 129 pgs: 129 active+clean; 974 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 1.15k op/s 2024-09-21T04:06:28.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:28 smithi073 ceph-mon[34443]: pgmap v494: 129 pgs: 129 active+clean; 974 MiB data, 2.8 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 10 MiB/s wr, 1.15k op/s 2024-09-21T04:06:28.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 125.0 s, 1008.6 tps, lat 98.733 ms stddev 27.338 2024-09-21T04:06:30.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:30 smithi060 ceph-mon[33722]: pgmap v495: 129 pgs: 129 active+clean; 974 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.2 MiB/s wr, 1.10k op/s 2024-09-21T04:06:30.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:30 smithi022 ceph-mon[31015]: pgmap v495: 129 pgs: 129 active+clean; 974 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.2 MiB/s wr, 1.10k op/s 2024-09-21T04:06:30.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:30 smithi073 ceph-mon[34443]: pgmap v495: 129 pgs: 129 active+clean; 974 MiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.2 MiB/s wr, 1.10k op/s 2024-09-21T04:06:32.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:32 smithi060 ceph-mon[33722]: pgmap v496: 129 pgs: 129 active+clean; 974 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-21T04:06:32.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:32 smithi022 ceph-mon[31015]: pgmap v496: 129 pgs: 129 active+clean; 974 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-21T04:06:32.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:32 smithi073 ceph-mon[34443]: pgmap v496: 129 pgs: 129 active+clean; 974 MiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 1.23k op/s 2024-09-21T04:06:33.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:33 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:33.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:33 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:33.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:33 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 130.0 s, 1006.6 tps, lat 99.795 ms stddev 68.862 2024-09-21T04:06:34.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:34 smithi060 ceph-mon[33722]: pgmap v497: 129 pgs: 129 active+clean; 974 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 1.15k op/s 2024-09-21T04:06:34.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:34 smithi022 ceph-mon[31015]: pgmap v497: 129 pgs: 129 active+clean; 974 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 1.15k op/s 2024-09-21T04:06:34.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:34 smithi073 ceph-mon[34443]: pgmap v497: 129 pgs: 129 active+clean; 974 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.7 MiB/s wr, 1.15k op/s 2024-09-21T04:06:36.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:36 smithi060 ceph-mon[33722]: pgmap v498: 129 pgs: 129 active+clean; 974 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.6 MiB/s wr, 1.14k op/s 2024-09-21T04:06:36.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:36 smithi022 ceph-mon[31015]: pgmap v498: 129 pgs: 129 active+clean; 974 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.6 MiB/s wr, 1.14k op/s 2024-09-21T04:06:36.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:36 smithi073 ceph-mon[34443]: pgmap v498: 129 pgs: 129 active+clean; 974 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 9.6 MiB/s wr, 1.14k op/s 2024-09-21T04:06:38.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:38 smithi060 ceph-mon[33722]: pgmap v499: 129 pgs: 129 active+clean; 974 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.6 MiB/s wr, 1.15k op/s 2024-09-21T04:06:38.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:38 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:38.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:38 smithi022 ceph-mon[31015]: pgmap v499: 129 pgs: 129 active+clean; 974 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.6 MiB/s wr, 1.15k op/s 2024-09-21T04:06:38.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:38 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:38.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:38 smithi073 ceph-mon[34443]: pgmap v499: 129 pgs: 129 active+clean; 974 MiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.6 MiB/s wr, 1.15k op/s 2024-09-21T04:06:38.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:38 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:38.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 135.0 s, 1081.0 tps, lat 75.638 ms stddev 27.083 2024-09-21T04:06:40.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:40 smithi060 ceph-mon[33722]: pgmap v500: 129 pgs: 129 active+clean; 978 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.9 MiB/s wr, 1.14k op/s 2024-09-21T04:06:40.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:40 smithi022 ceph-mon[31015]: pgmap v500: 129 pgs: 129 active+clean; 978 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.9 MiB/s wr, 1.14k op/s 2024-09-21T04:06:40.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:40 smithi073 ceph-mon[34443]: pgmap v500: 129 pgs: 129 active+clean; 978 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 9.9 MiB/s wr, 1.14k op/s 2024-09-21T04:06:41.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:41 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:41.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:41 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:41.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:41 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:06:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:42 smithi022 ceph-mon[31015]: pgmap v501: 129 pgs: 129 active+clean; 979 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-21T04:06:42.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:42 smithi073 ceph-mon[34443]: pgmap v501: 129 pgs: 129 active+clean; 979 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-21T04:06:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:42 smithi060 ceph-mon[33722]: pgmap v501: 129 pgs: 129 active+clean; 979 MiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-21T04:06:43.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 140.0 s, 1201.1 tps, lat 98.242 ms stddev 402.688 2024-09-21T04:06:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:44 smithi022 ceph-mon[31015]: pgmap v502: 129 pgs: 129 active+clean; 980 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.22k op/s 2024-09-21T04:06:44.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:44 smithi073 ceph-mon[34443]: pgmap v502: 129 pgs: 129 active+clean; 980 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.22k op/s 2024-09-21T04:06:44.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:44 smithi060 ceph-mon[33722]: pgmap v502: 129 pgs: 129 active+clean; 980 MiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.22k op/s 2024-09-21T04:06:46.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:46 smithi022 ceph-mon[31015]: pgmap v503: 129 pgs: 129 active+clean; 980 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 1.27k op/s 2024-09-21T04:06:46.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:46 smithi073 ceph-mon[34443]: pgmap v503: 129 pgs: 129 active+clean; 980 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 1.27k op/s 2024-09-21T04:06:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:46 smithi060 ceph-mon[33722]: pgmap v503: 129 pgs: 129 active+clean; 980 MiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 1.27k op/s 2024-09-21T04:06:48.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:48 smithi022 ceph-mon[31015]: pgmap v504: 129 pgs: 129 active+clean; 980 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-21T04:06:48.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:48 smithi073 ceph-mon[34443]: pgmap v504: 129 pgs: 129 active+clean; 980 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-21T04:06:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:48 smithi060 ceph-mon[33722]: pgmap v504: 129 pgs: 129 active+clean; 980 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 1.26k op/s 2024-09-21T04:06:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 145.0 s, 1106.3 tps, lat 90.507 ms stddev 104.463 2024-09-21T04:06:50.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:50 smithi022 ceph-mon[31015]: pgmap v505: 129 pgs: 129 active+clean; 984 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-21T04:06:50.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:50 smithi073 ceph-mon[34443]: pgmap v505: 129 pgs: 129 active+clean; 984 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-21T04:06:50.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:50 smithi060 ceph-mon[33722]: pgmap v505: 129 pgs: 129 active+clean; 984 MiB data, 3.5 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 11 MiB/s wr, 1.21k op/s 2024-09-21T04:06:52.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:52 smithi022 ceph-mon[31015]: pgmap v506: 129 pgs: 129 active+clean; 996 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 1.29k op/s 2024-09-21T04:06:52.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:52 smithi073 ceph-mon[34443]: pgmap v506: 129 pgs: 129 active+clean; 996 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 1.29k op/s 2024-09-21T04:06:52.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:52 smithi060 ceph-mon[33722]: pgmap v506: 129 pgs: 129 active+clean; 996 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 MiB/s wr, 1.29k op/s 2024-09-21T04:06:53.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 150.0 s, 1101.2 tps, lat 90.748 ms stddev 24.518 2024-09-21T04:06:54.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:54 smithi022 ceph-mon[31015]: pgmap v507: 129 pgs: 129 active+clean; 997 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 1.28k op/s 2024-09-21T04:06:54.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:54 smithi073 ceph-mon[34443]: pgmap v507: 129 pgs: 129 active+clean; 997 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 1.28k op/s 2024-09-21T04:06:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:54 smithi060 ceph-mon[33722]: pgmap v507: 129 pgs: 129 active+clean; 997 MiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 1.28k op/s 2024-09-21T04:06:56.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:56 smithi022 ceph-mon[31015]: pgmap v508: 129 pgs: 129 active+clean; 997 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 1.23k op/s 2024-09-21T04:06:56.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:56 smithi073 ceph-mon[34443]: pgmap v508: 129 pgs: 129 active+clean; 997 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 1.23k op/s 2024-09-21T04:06:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:56 smithi060 ceph-mon[33722]: pgmap v508: 129 pgs: 129 active+clean; 997 MiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 12 MiB/s wr, 1.23k op/s 2024-09-21T04:06:58.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:06:58 smithi022 ceph-mon[31015]: pgmap v509: 129 pgs: 129 active+clean; 997 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 1.23k op/s 2024-09-21T04:06:58.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:06:58 smithi073 ceph-mon[34443]: pgmap v509: 129 pgs: 129 active+clean; 997 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 1.23k op/s 2024-09-21T04:06:58.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:06:58 smithi060 ceph-mon[33722]: pgmap v509: 129 pgs: 129 active+clean; 997 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 12 MiB/s wr, 1.23k op/s 2024-09-21T04:06:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 155.0 s, 955.4 tps, lat 104.463 ms stddev 31.947 2024-09-21T04:07:00.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:00 smithi022 ceph-mon[31015]: pgmap v510: 129 pgs: 129 active+clean; 997 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.12k op/s 2024-09-21T04:07:00.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:00 smithi073 ceph-mon[34443]: pgmap v510: 129 pgs: 129 active+clean; 997 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.12k op/s 2024-09-21T04:07:00.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:00 smithi060 ceph-mon[33722]: pgmap v510: 129 pgs: 129 active+clean; 997 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 11 MiB/s wr, 1.12k op/s 2024-09-21T04:07:02.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:02 smithi022 ceph-mon[31015]: pgmap v511: 129 pgs: 129 active+clean; 997 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-09-21T04:07:02.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:02 smithi073 ceph-mon[34443]: pgmap v511: 129 pgs: 129 active+clean; 997 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-09-21T04:07:02.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:02 smithi060 ceph-mon[33722]: pgmap v511: 129 pgs: 129 active+clean; 997 MiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 1.20k op/s 2024-09-21T04:07:03.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 160.0 s, 921.0 tps, lat 108.507 ms stddev 31.774 2024-09-21T04:07:04.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:04 smithi022 ceph-mon[31015]: pgmap v512: 129 pgs: 129 active+clean; 997 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 1.13k op/s 2024-09-21T04:07:04.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:04 smithi073 ceph-mon[34443]: pgmap v512: 129 pgs: 129 active+clean; 997 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 1.13k op/s 2024-09-21T04:07:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:04 smithi060 ceph-mon[33722]: pgmap v512: 129 pgs: 129 active+clean; 997 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.5 MiB/s wr, 1.13k op/s 2024-09-21T04:07:06.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:06 smithi022 ceph-mon[31015]: pgmap v513: 129 pgs: 129 active+clean; 997 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.4 MiB/s wr, 1.02k op/s 2024-09-21T04:07:06.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:06 smithi073 ceph-mon[34443]: pgmap v513: 129 pgs: 129 active+clean; 997 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.4 MiB/s wr, 1.02k op/s 2024-09-21T04:07:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:06 smithi060 ceph-mon[33722]: pgmap v513: 129 pgs: 129 active+clean; 997 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.4 MiB/s wr, 1.02k op/s 2024-09-21T04:07:07.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:07 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:07:07.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:07 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:07:07.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:07 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:07:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:08 smithi060 ceph-mon[33722]: pgmap v514: 129 pgs: 129 active+clean; 997 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-09-21T04:07:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:08 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:07:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:08 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:07:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:08 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:07:08.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 165.0 s, 992.8 tps, lat 101.464 ms stddev 31.788 2024-09-21T04:07:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:08 smithi022 ceph-mon[31015]: pgmap v514: 129 pgs: 129 active+clean; 997 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-09-21T04:07:08.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:08 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:07:08.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:08 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:07:08.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:08 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:07:08.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:08 smithi073 ceph-mon[34443]: pgmap v514: 129 pgs: 129 active+clean; 997 MiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-09-21T04:07:08.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:08 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:07:08.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:08 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:07:08.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:08 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:07:10.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:10 smithi060 ceph-mon[33722]: pgmap v515: 129 pgs: 129 active+clean; 997 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.2 MiB/s wr, 866 op/s 2024-09-21T04:07:10.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:10 smithi022 ceph-mon[31015]: pgmap v515: 129 pgs: 129 active+clean; 997 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.2 MiB/s wr, 866 op/s 2024-09-21T04:07:10.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:10 smithi073 ceph-mon[34443]: pgmap v515: 129 pgs: 129 active+clean; 997 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 7.2 MiB/s wr, 866 op/s 2024-09-21T04:07:11.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:11 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:07:11.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:11 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:07:11.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:11 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:07:12.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:12 smithi060 ceph-mon[33722]: pgmap v516: 129 pgs: 129 active+clean; 997 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-09-21T04:07:12.755 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:12 smithi073 ceph-mon[34443]: pgmap v516: 129 pgs: 129 active+clean; 997 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-09-21T04:07:12.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:12 smithi022 ceph-mon[31015]: pgmap v516: 129 pgs: 129 active+clean; 997 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 9.2 MiB/s wr, 1.09k op/s 2024-09-21T04:07:13.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 170.0 s, 1023.4 tps, lat 97.338 ms stddev 28.875 2024-09-21T04:07:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:14 smithi060 ceph-mon[33722]: pgmap v517: 129 pgs: 129 active+clean; 997 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.6 MiB/s wr, 1.03k op/s 2024-09-21T04:07:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:14 smithi022 ceph-mon[31015]: pgmap v517: 129 pgs: 129 active+clean; 997 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.6 MiB/s wr, 1.03k op/s 2024-09-21T04:07:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:14 smithi073 ceph-mon[34443]: pgmap v517: 129 pgs: 129 active+clean; 997 MiB data, 4.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 8.6 MiB/s wr, 1.03k op/s 2024-09-21T04:07:16.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:16 smithi060 ceph-mon[33722]: pgmap v518: 129 pgs: 129 active+clean; 997 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.6 MiB/s wr, 1.03k op/s 2024-09-21T04:07:16.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:16 smithi022 ceph-mon[31015]: pgmap v518: 129 pgs: 129 active+clean; 997 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.6 MiB/s wr, 1.03k op/s 2024-09-21T04:07:16.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:16 smithi073 ceph-mon[34443]: pgmap v518: 129 pgs: 129 active+clean; 997 MiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.6 MiB/s wr, 1.03k op/s 2024-09-21T04:07:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:18 smithi060 ceph-mon[33722]: pgmap v519: 129 pgs: 129 active+clean; 997 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.8 MiB/s wr, 1.16k op/s 2024-09-21T04:07:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 175.0 s, 1022.0 tps, lat 97.727 ms stddev 34.167 2024-09-21T04:07:18.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:18 smithi022 ceph-mon[31015]: pgmap v519: 129 pgs: 129 active+clean; 997 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.8 MiB/s wr, 1.16k op/s 2024-09-21T04:07:18.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:18 smithi073 ceph-mon[34443]: pgmap v519: 129 pgs: 129 active+clean; 997 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.8 MiB/s wr, 1.16k op/s 2024-09-21T04:07:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:20 smithi060 ceph-mon[33722]: pgmap v520: 129 pgs: 129 active+clean; 997 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 973 op/s 2024-09-21T04:07:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:20 smithi022 ceph-mon[31015]: pgmap v520: 129 pgs: 129 active+clean; 997 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 973 op/s 2024-09-21T04:07:20.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:20 smithi073 ceph-mon[34443]: pgmap v520: 129 pgs: 129 active+clean; 997 MiB data, 4.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 973 op/s 2024-09-21T04:07:22.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:22 smithi022 ceph-mon[31015]: pgmap v521: 129 pgs: 129 active+clean; 997 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 1.22k op/s 2024-09-21T04:07:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:22 smithi060 ceph-mon[33722]: pgmap v521: 129 pgs: 129 active+clean; 997 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 1.22k op/s 2024-09-21T04:07:22.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:22 smithi073 ceph-mon[34443]: pgmap v521: 129 pgs: 129 active+clean; 997 MiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 1.22k op/s 2024-09-21T04:07:23.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 180.0 s, 966.4 tps, lat 103.849 ms stddev 115.420 2024-09-21T04:07:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:24 smithi060 ceph-mon[33722]: pgmap v522: 129 pgs: 129 active+clean; 997 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.5 MiB/s wr, 1.13k op/s 2024-09-21T04:07:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:24 smithi022 ceph-mon[31015]: pgmap v522: 129 pgs: 129 active+clean; 997 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.5 MiB/s wr, 1.13k op/s 2024-09-21T04:07:24.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:24 smithi073 ceph-mon[34443]: pgmap v522: 129 pgs: 129 active+clean; 997 MiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.5 MiB/s wr, 1.13k op/s 2024-09-21T04:07:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:26 smithi060 ceph-mon[33722]: pgmap v523: 129 pgs: 129 active+clean; 1001 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-21T04:07:26.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:26 smithi022 ceph-mon[31015]: pgmap v523: 129 pgs: 129 active+clean; 1001 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-21T04:07:26.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:26 smithi073 ceph-mon[34443]: pgmap v523: 129 pgs: 129 active+clean; 1001 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 10 MiB/s wr, 1.14k op/s 2024-09-21T04:07:28.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:28 smithi060 ceph-mon[33722]: pgmap v524: 129 pgs: 129 active+clean; 1009 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-21T04:07:28.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 185.0 s, 1052.2 tps, lat 94.704 ms stddev 35.562 2024-09-21T04:07:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:28 smithi022 ceph-mon[31015]: pgmap v524: 129 pgs: 129 active+clean; 1009 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-21T04:07:28.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:28 smithi073 ceph-mon[34443]: pgmap v524: 129 pgs: 129 active+clean; 1009 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 11 MiB/s wr, 1.17k op/s 2024-09-21T04:07:29.984 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-09-21T04:07:29.984 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:07:30.449 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:07:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:30 smithi060 ceph-mon[33722]: pgmap v525: 129 pgs: 129 active+clean; 1013 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-09-21T04:07:30.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:30 smithi022 ceph-mon[31015]: pgmap v525: 129 pgs: 129 active+clean; 1013 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-09-21T04:07:30.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:30 smithi073 ceph-mon[34443]: pgmap v525: 129 pgs: 129 active+clean; 1013 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 10 MiB/s wr, 1.02k op/s 2024-09-21T04:07:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:32 smithi060 ceph-mon[33722]: pgmap v526: 129 pgs: 129 active+clean; 1013 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-09-21T04:07:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:32 smithi022 ceph-mon[31015]: pgmap v526: 129 pgs: 129 active+clean; 1013 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-09-21T04:07:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:32 smithi073 ceph-mon[34443]: pgmap v526: 129 pgs: 129 active+clean; 1013 MiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 11 MiB/s wr, 1.16k op/s 2024-09-21T04:07:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 190.0 s, 848.4 tps, lat 114.606 ms stddev 57.124 2024-09-21T04:07:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:34 smithi060 ceph-mon[33722]: pgmap v527: 129 pgs: 129 active+clean; 1013 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 1.08k op/s 2024-09-21T04:07:34.768 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:34 smithi022 ceph-mon[31015]: pgmap v527: 129 pgs: 129 active+clean; 1013 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 1.08k op/s 2024-09-21T04:07:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:34 smithi073 ceph-mon[34443]: pgmap v527: 129 pgs: 129 active+clean; 1013 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 10 MiB/s wr, 1.08k op/s 2024-09-21T04:07:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:36 smithi060 ceph-mon[33722]: pgmap v528: 129 pgs: 129 active+clean; 1013 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.9 MiB/s wr, 1.02k op/s 2024-09-21T04:07:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:36 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3446568924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:07:36.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:36 smithi022 ceph-mon[31015]: pgmap v528: 129 pgs: 129 active+clean; 1013 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.9 MiB/s wr, 1.02k op/s 2024-09-21T04:07:36.739 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:36 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3446568924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:07:36.770 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:07:36.771 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":40,"btime":"2024-09-21T04:07:10:355928+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:07:09.496163+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:07:36.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.287+0000 7fc03144c640 1 -- 172.21.15.22:0/2978168893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02c102270 msgr2=0x7fc02c102680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:36.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.287+0000 7fc03144c640 1 --2- 172.21.15.22:0/2978168893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02c102270 0x7fc02c102680 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fc01400aa10 tx=0x7fc01402b720 comp rx=0 tx=0).stop 2024-09-21T04:07:36.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.287+0000 7fc03144c640 1 -- 172.21.15.22:0/2978168893 shutdown_connections 2024-09-21T04:07:36.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.287+0000 7fc03144c640 1 --2- 172.21.15.22:0/2978168893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c1084b0 0x7fc02c10ece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:36.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.287+0000 7fc03144c640 1 --2- 172.21.15.22:0/2978168893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c107b60 0x7fc02c107f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:36.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.287+0000 7fc03144c640 1 --2- 172.21.15.22:0/2978168893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02c102270 0x7fc02c102680 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:36.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.287+0000 7fc03144c640 1 -- 172.21.15.22:0/2978168893 >> 172.21.15.22:0/2978168893 conn(0x7fc02c077cc0 msgr2=0x7fc02c078100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:36.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.287+0000 7fc03144c640 1 -- 172.21.15.22:0/2978168893 shutdown_connections 2024-09-21T04:07:36.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.287+0000 7fc03144c640 1 -- 172.21.15.22:0/2978168893 wait complete. 2024-09-21T04:07:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.288+0000 7fc03144c640 1 Processor -- start 2024-09-21T04:07:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.288+0000 7fc03144c640 1 -- start start 2024-09-21T04:07:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.288+0000 7fc03144c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c102270 0x7fc02c198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.288+0000 7fc03144c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02c107b60 0x7fc02c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.288+0000 7fc03144c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c1084b0 0x7fc02c19da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.288+0000 7fc03144c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1117a0 con 0x7fc02c107b60 2024-09-21T04:07:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.288+0000 7fc03144c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c111620 con 0x7fc02c1084b0 2024-09-21T04:07:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.288+0000 7fc03144c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c111920 con 0x7fc02c102270 2024-09-21T04:07:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02c107b60 0x7fc02c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:36.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02c107b60 0x7fc02c1987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37954/0 (socket says 172.21.15.22:37954) 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02a7fc640 1 -- 172.21.15.22:0/3446568924 learned_addr learned my addr 172.21.15.22:0/3446568924 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02affd640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c102270 0x7fc02c198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02b7fe640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c1084b0 0x7fc02c19da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02a7fc640 1 -- 172.21.15.22:0/3446568924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c102270 msgr2=0x7fc02c198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02a7fc640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c102270 0x7fc02c198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02a7fc640 1 -- 172.21.15.22:0/3446568924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c1084b0 msgr2=0x7fc02c19da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02a7fc640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c1084b0 0x7fc02c19da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02a7fc640 1 -- 172.21.15.22:0/3446568924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c19e1c0 con 0x7fc02c107b60 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02b7fe640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c1084b0 0x7fc02c19da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc02a7fc640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02c107b60 0x7fc02c1987f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d740 tx=0x7fc01c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc023fff640 1 -- 172.21.15.22:0/3446568924 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c017070 con 0x7fc02c107b60 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc023fff640 1 -- 172.21.15.22:0/3446568924 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc01c00de50 con 0x7fc02c107b60 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc03144c640 1 -- 172.21.15.22:0/3446568924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c19e4b0 con 0x7fc02c107b60 2024-09-21T04:07:36.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.289+0000 7fc023fff640 1 -- 172.21.15.22:0/3446568924 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c00f620 con 0x7fc02c107b60 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.290+0000 7fc03144c640 1 -- 172.21.15.22:0/3446568924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c1a4c10 con 0x7fc02c107b60 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.290+0000 7fc03144c640 1 -- 172.21.15.22:0/3446568924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc02c102680 con 0x7fc02c107b60 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.292+0000 7fc023fff640 1 -- 172.21.15.22:0/3446568924 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc01c01a070 con 0x7fc02c107b60 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.293+0000 7fc023fff640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc0180b6510 0x7fc0180b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.293+0000 7fc02affd640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc0180b6510 0x7fc0180b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.293+0000 7fc023fff640 1 -- 172.21.15.22:0/3446568924 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fc01c0e7060 con 0x7fc02c107b60 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.293+0000 7fc02affd640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc0180b6510 0x7fc0180b8a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc0140057c0 tx=0x7fc0140058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.296+0000 7fc023fff640 1 -- 172.21.15.22:0/3446568924 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc01c0ad530 con 0x7fc02c107b60 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.635+0000 7fc03144c640 1 -- 172.21.15.22:0/3446568924 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc02c10a280 con 0x7fc02c107b60 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.636+0000 7fc023fff640 1 -- 172.21.15.22:0/3446568924 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11966 (secure 0 0 0) 0x7fc01c0b1910 con 0x7fc02c107b60 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 40 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 -- 172.21.15.22:0/3446568924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc0180b6510 msgr2=0x7fc0180b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:36.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc0180b6510 0x7fc0180b8a20 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fc0140057c0 tx=0x7fc0140058d0 comp rx=0 tx=0).stop 2024-09-21T04:07:36.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 -- 172.21.15.22:0/3446568924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02c107b60 msgr2=0x7fc02c1987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:36.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02c107b60 0x7fc02c1987f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fc01c00d740 tx=0x7fc01c00dc00 comp rx=0 tx=0).stop 2024-09-21T04:07:36.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 -- 172.21.15.22:0/3446568924 shutdown_connections 2024-09-21T04:07:36.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc0180b6510 0x7fc0180b8a20 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:36.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc02c1084b0 0x7fc02c19da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:36.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc02c107b60 0x7fc02c1987f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:36.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 --2- 172.21.15.22:0/3446568924 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc02c102270 0x7fc02c198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:36.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 -- 172.21.15.22:0/3446568924 >> 172.21.15.22:0/3446568924 conn(0x7fc02c077cc0 msgr2=0x7fc02c105ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:36.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 -- 172.21.15.22:0/3446568924 shutdown_connections 2024-09-21T04:07:36.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:35.638+0000 7fc03144c640 1 -- 172.21.15.22:0/3446568924 wait complete. 2024-09-21T04:07:36.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:36 smithi073 ceph-mon[34443]: pgmap v528: 129 pgs: 129 active+clean; 1013 MiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 9.9 MiB/s wr, 1.02k op/s 2024-09-21T04:07:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:36 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3446568924' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:07:38.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:38 smithi060 ceph-mon[33722]: pgmap v529: 129 pgs: 129 active+clean; 1013 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.6 MiB/s wr, 1.02k op/s 2024-09-21T04:07:38.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 195.0 s, 837.8 tps, lat 122.476 ms stddev 70.608 2024-09-21T04:07:38.798 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:38 smithi022 ceph-mon[31015]: pgmap v529: 129 pgs: 129 active+clean; 1013 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.6 MiB/s wr, 1.02k op/s 2024-09-21T04:07:38.851 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-09-21T04:07:38.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-09-21T04:07:38.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:38 smithi073 ceph-mon[34443]: pgmap v529: 129 pgs: 129 active+clean; 1013 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 9.6 MiB/s wr, 1.02k op/s 2024-09-21T04:07:39.327 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:07:39.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.940+0000 7f8797034640 1 -- 172.21.15.22:0/3011579944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8790108d10 msgr2=0x7f879010f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:39.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.940+0000 7f8797034640 1 --2- 172.21.15.22:0/3011579944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8790108d10 0x7f879010f540 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f878400b9f0 tx=0x7f878402c0a0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.940+0000 7f8797034640 1 -- 172.21.15.22:0/3011579944 shutdown_connections 2024-09-21T04:07:39.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.940+0000 7f8797034640 1 --2- 172.21.15.22:0/3011579944 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8790108d10 0x7f879010f540 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.940+0000 7f8797034640 1 --2- 172.21.15.22:0/3011579944 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87901083c0 0x7f87901087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.940+0000 7f8797034640 1 --2- 172.21.15.22:0/3011579944 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8790102a80 0x7f8790102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.940+0000 7f8797034640 1 -- 172.21.15.22:0/3011579944 >> 172.21.15.22:0/3011579944 conn(0x7f8790079760 msgr2=0x7f8790079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:39.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.940+0000 7f8797034640 1 -- 172.21.15.22:0/3011579944 shutdown_connections 2024-09-21T04:07:39.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.941+0000 7f8797034640 1 -- 172.21.15.22:0/3011579944 wait complete. 2024-09-21T04:07:39.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.942+0000 7f8797034640 1 Processor -- start 2024-09-21T04:07:39.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.942+0000 7f8797034640 1 -- start start 2024-09-21T04:07:39.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.942+0000 7f8797034640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8790102a80 0x7f879010e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.942+0000 7f8797034640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87901083c0 0x7f879010e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.942+0000 7f8797034640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8790108d10 0x7f87901a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.942+0000 7f8797034640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8790111190 con 0x7f8790102a80 2024-09-21T04:07:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.942+0000 7f8797034640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8790111010 con 0x7f8790108d10 2024-09-21T04:07:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.942+0000 7f8797034640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8790111310 con 0x7f87901083c0 2024-09-21T04:07:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f878ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87901083c0 0x7f879010e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f878ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87901083c0 0x7f879010e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:45062/0 (socket says 172.21.15.22:45062) 2024-09-21T04:07:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f878ffff640 1 -- 172.21.15.22:0/2842722070 learned_addr learned my addr 172.21.15.22:0/2842722070 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:39.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f87955d1640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8790108d10 0x7f87901a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f878ffff640 1 -- 172.21.15.22:0/2842722070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8790108d10 msgr2=0x7f87901a50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f878ffff640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8790108d10 0x7f87901a50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f8794dd0640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8790102a80 0x7f879010e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f878ffff640 1 -- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8790102a80 msgr2=0x7f879010e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f878ffff640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8790102a80 0x7f879010e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f878ffff640 1 -- 172.21.15.22:0/2842722070 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87901a57e0 con 0x7f87901083c0 2024-09-21T04:07:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.943+0000 7f8794dd0640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8790102a80 0x7f879010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:07:39.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.944+0000 7f878ffff640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87901083c0 0x7f879010e9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f878000e9f0 tx=0x7f878000eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:39.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.944+0000 7f878dffb640 1 -- 172.21.15.22:0/2842722070 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878000ccc0 con 0x7f87901083c0 2024-09-21T04:07:39.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.944+0000 7f8797034640 1 -- 172.21.15.22:0/2842722070 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87901a5ad0 con 0x7f87901083c0 2024-09-21T04:07:39.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.944+0000 7f878dffb640 1 -- 172.21.15.22:0/2842722070 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87800108c0 con 0x7f87901083c0 2024-09-21T04:07:39.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.944+0000 7f8797034640 1 -- 172.21.15.22:0/2842722070 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87901ad340 con 0x7f87901083c0 2024-09-21T04:07:39.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.945+0000 7f878dffb640 1 -- 172.21.15.22:0/2842722070 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878000ccc0 con 0x7f87901083c0 2024-09-21T04:07:39.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.950+0000 7f878dffb640 1 -- 172.21.15.22:0/2842722070 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8780010430 con 0x7f87901083c0 2024-09-21T04:07:39.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.950+0000 7f879d5a8740 1 Processor -- start 2024-09-21T04:07:39.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.950+0000 7f879d5a8740 1 -- start start 2024-09-21T04:07:39.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 0x55ca4738d600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca4738db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fc5b60 0x55ca4738e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f879d5a8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ca47303b90 con 0x55ca46fbd980 2024-09-21T04:07:39.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f879d5a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ca472f2fc0 con 0x55ca46fc5b60 2024-09-21T04:07:39.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f879d5a8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ca472f6dd0 con 0x55ca46fe6840 2024-09-21T04:07:39.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f87955d1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 0x55ca4738d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:39.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f8794dd0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca4738db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:39.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f87955d1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 0x55ca4738d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:45068/0 (socket says 172.21.15.22:45068) 2024-09-21T04:07:39.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f87955d1640 1 -- 172.21.15.22:0/2192178910 learned_addr learned my addr 172.21.15.22:0/2192178910 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:39.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.951+0000 7f878dffb640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87780b6790 0x7f87780b8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.952+0000 7f878dffb640 1 -- 172.21.15.22:0/2842722070 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f87800e75a0 con 0x7f87901083c0 2024-09-21T04:07:39.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.952+0000 7f87955d1640 1 -- 172.21.15.22:0/2192178910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fc5b60 msgr2=0x55ca4738e080 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T04:07:39.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.952+0000 7f87955d1640 1 --2- 172.21.15.22:0/2192178910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fc5b60 0x55ca4738e080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.952+0000 7f87955d1640 1 -- 172.21.15.22:0/2192178910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 msgr2=0x55ca4738db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:39.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.952+0000 7f87955d1640 1 --2- 172.21.15.22:0/2192178910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca4738db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.952+0000 7f87955d1640 1 -- 172.21.15.22:0/2192178910 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca4727a060 con 0x55ca46fe6840 2024-09-21T04:07:39.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.952+0000 7f87955d1640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87780b6790 0x7f87780b8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:39.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.952+0000 7f87955d1640 1 --2- 172.21.15.22:0/2192178910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 0x55ca4738d600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f878402c5c0 tx=0x7f878400b7c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d53d83461e0c301 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:39.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.953+0000 7f8776ffd640 1 -- 172.21.15.22:0/2192178910 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784004240 con 0x55ca46fe6840 2024-09-21T04:07:39.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.953+0000 7f8776ffd640 1 -- 172.21.15.22:0/2192178910 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87840043e0 con 0x55ca46fe6840 2024-09-21T04:07:39.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.953+0000 7f8776ffd640 1 -- 172.21.15.22:0/2192178910 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784009780 con 0x55ca46fe6840 2024-09-21T04:07:39.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.954+0000 7f879d5a8740 1 -- 172.21.15.22:0/2192178910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 msgr2=0x55ca4738d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:39.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.954+0000 7f87955d1640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87780b6790 0x7f87780b8ca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8784005cd0 tx=0x7f878404b000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:39.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.954+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2192178910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 0x55ca4738d600 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f878402c5c0 tx=0x7f878400b7c0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.954+0000 7f879d5a8740 1 -- 172.21.15.22:0/2192178910 shutdown_connections 2024-09-21T04:07:39.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.954+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2192178910 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fc5b60 0x55ca4738e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.954+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2192178910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca4738db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.954+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2192178910 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 0x55ca4738d600 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.954+0000 7f879d5a8740 1 -- 172.21.15.22:0/2192178910 >> 172.21.15.22:0/2192178910 conn(0x55ca46fda990 msgr2=0x55ca4738b4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:39.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.954+0000 7f879d5a8740 1 -- 172.21.15.22:0/2192178910 shutdown_connections 2024-09-21T04:07:39.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.954+0000 7f879d5a8740 1 -- 172.21.15.22:0/2192178910 wait complete. 2024-09-21T04:07:39.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.955+0000 7f879d5a8740 1 -- start start 2024-09-21T04:07:39.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.955+0000 7f879d5a8740 1 Processor -- start 2024-09-21T04:07:39.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.956+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca47399130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.956+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 0x55ca47399670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.956+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 0x55ca473a5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.956+0000 7f879d5a8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ca471547a0 con 0x55ca46fbd980 2024-09-21T04:07:39.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.956+0000 7f879d5a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55ca472980a0 con 0x55ca46fe6840 2024-09-21T04:07:39.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.956+0000 7f879d5a8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55ca4739be80 con 0x55ca46fc5b60 2024-09-21T04:07:39.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.957+0000 7f87955d1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 0x55ca473a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:39.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.957+0000 7f87955d1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 0x55ca473a5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:36972/0 (socket says 172.21.15.22:36972) 2024-09-21T04:07:39.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.957+0000 7f87955d1640 1 -- 172.21.15.22:0/2567571468 learned_addr learned my addr 172.21.15.22:0/2567571468 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:39.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.957+0000 7f879d5a8740 10 client.0 _ll_register_callbacks cb 0x55ca472753c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:07:39.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.957+0000 7f8794dd0640 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca47399130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:39.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.957+0000 7f87955d1640 1 -- 172.21.15.22:0/2567571468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 msgr2=0x55ca47399670 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T04:07:39.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.957+0000 7f87955d1640 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 0x55ca47399670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.957+0000 7f87955d1640 1 -- 172.21.15.22:0/2567571468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 msgr2=0x55ca47399130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:39.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.957+0000 7f87955d1640 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca47399130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.957+0000 7f87955d1640 1 -- 172.21.15.22:0/2567571468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca47286880 con 0x55ca46fe6840 2024-09-21T04:07:39.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.958+0000 7f87955d1640 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 0x55ca473a5170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8784037040 tx=0x7f8784009460 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab55aa4d5ceb9fd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:39.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.958+0000 7f876ffff640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:07:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.958+0000 7f876ffff640 1 -- 172.21.15.22:0/2567571468 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8784039070 con 0x55ca46fe6840 2024-09-21T04:07:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.958+0000 7f876ffff640 1 -- 172.21.15.22:0/2567571468 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f87840037f0 con 0x55ca46fe6840 2024-09-21T04:07:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.959+0000 7f879d5a8740 1 -- 172.21.15.22:0/2567571468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87840043e0 con 0x55ca46fe6840 2024-09-21T04:07:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.959+0000 7f876ffff640 1 -- 172.21.15.22:0/2567571468 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f87840039f0 con 0x55ca46fe6840 2024-09-21T04:07:39.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.959+0000 7f879d5a8740 10 client.25442 fetch_fsmap learned FSMap version 40 2024-09-21T04:07:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.959+0000 7f879d5a8740 1 -- 172.21.15.22:0/2567571468 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55ca47060b90 con 0x55ca46fe6840 2024-09-21T04:07:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.960+0000 7f876ffff640 1 -- 172.21.15.22:0/2567571468 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87840043e0 con 0x55ca46fe6840 2024-09-21T04:07:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.960+0000 7f876ffff640 1 -- 172.21.15.22:0/2567571468 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f8784053070 con 0x55ca46fe6840 2024-09-21T04:07:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.960+0000 7f879d5a8740 10 client.25442 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:07:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.960+0000 7f879d5a8740 10 client.25442 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:07:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.960+0000 7f879d5a8740 20 client.25442 populate_metadata read hostname 'smithi022' 2024-09-21T04:07:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.960+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ca46fa51c0 0x55ca473aafa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:39.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.960+0000 7f879d5a8740 4 client.25442 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:07:39.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.960+0000 7f879d5a8740 1 -- 172.21.15.22:0/2567571468 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca47305ae0 con 0x55ca46fa51c0 2024-09-21T04:07:39.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.961+0000 7f8794dd0640 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ca46fa51c0 0x55ca473aafa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:39.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.962+0000 7f8794dd0640 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ca46fa51c0 0x55ca473aafa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0a47124f5720a33 server_cookie=85513117159949f1 in_seq=0 out_seq=0 2024-09-21T04:07:39.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.962+0000 7f876ffff640 10 client.25442 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:07:39.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.963+0000 7f876ffff640 1 -- 172.21.15.22:0/2567571468 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55ca47305ae0 con 0x55ca46fa51c0 2024-09-21T04:07:39.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.963+0000 7f876ffff640 10 client.25442 handle_command_reply: tid=0 2024-09-21T04:07:39.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.963+0000 7f879d5a8740 1 client.25442 shutdown 2024-09-21T04:07:39.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.963+0000 7f879d5a8740 1 -- 172.21.15.22:0/2567571468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 msgr2=0x55ca473a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:39.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.963+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 0x55ca473a5170 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8784037040 tx=0x7f8784009460 comp rx=0 tx=0).stop 2024-09-21T04:07:39.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.963+0000 7f879d5a8740 1 -- 172.21.15.22:0/2567571468 shutdown_connections 2024-09-21T04:07:39.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.963+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ca46fa51c0 0x55ca473aafa0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.964+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 0x55ca47399670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.964+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 0x55ca473a5170 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.964+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2567571468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca47399130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:39.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.964+0000 7f879d5a8740 1 -- 172.21.15.22:0/2567571468 >> 172.21.15.22:0/2567571468 conn(0x55ca46fda990 msgr2=0x55ca4738e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:39.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.964+0000 7f876ffff640 0 client.25442 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:07:39.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.964+0000 7f879d5a8740 1 -- 172.21.15.22:0/2567571468 shutdown_connections 2024-09-21T04:07:39.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.965+0000 7f879d5a8740 1 -- 172.21.15.22:0/2567571468 wait complete. 2024-09-21T04:07:39.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.965+0000 7f879d5a8740 20 client.25442 trim_cache size 0 max 16384 2024-09-21T04:07:40.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.998+0000 7f879d5a8740 1 Processor -- start 2024-09-21T04:07:40.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.999+0000 7f879d5a8740 1 -- start start 2024-09-21T04:07:40.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.999+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca4739ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:40.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.999+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 0x55ca473a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:40.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.999+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 0x55ca473a5620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:40.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.999+0000 7f879d5a8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87901b7200 con 0x55ca46fbd980 2024-09-21T04:07:40.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.999+0000 7f879d5a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f87901b8e00 con 0x55ca46fe6840 2024-09-21T04:07:40.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.999+0000 7f879d5a8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f87901b78d0 con 0x55ca46fc5b60 2024-09-21T04:07:40.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.999+0000 7f878ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 0x55ca473a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.999+0000 7f878ffff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 0x55ca473a50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:45078/0 (socket says 172.21.15.22:45078) 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:39.999+0000 7f878ffff640 1 -- 172.21.15.22:0/2201720285 learned_addr learned my addr 172.21.15.22:0/2201720285 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.000+0000 7f878ffff640 1 -- 172.21.15.22:0/2201720285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 msgr2=0x55ca473a5620 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.000+0000 7f878ffff640 1 --2- 172.21.15.22:0/2201720285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 0x55ca473a5620 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.000+0000 7f878ffff640 1 -- 172.21.15.22:0/2201720285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 msgr2=0x55ca4739ae10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.000+0000 7f878ffff640 1 --2- 172.21.15.22:0/2201720285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca4739ae10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.000+0000 7f878ffff640 1 -- 172.21.15.22:0/2201720285 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca4738abe0 con 0x55ca46fc5b60 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.000+0000 7f878ffff640 1 --2- 172.21.15.22:0/2201720285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 0x55ca473a50e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8780009230 tx=0x7f87800aca80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11e96e22a0d5d17f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.000+0000 7f87767fc640 1 -- 172.21.15.22:0/2201720285 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87800ace20 con 0x55ca46fc5b60 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.000+0000 7f87767fc640 1 -- 172.21.15.22:0/2201720285 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87800b6050 con 0x55ca46fc5b60 2024-09-21T04:07:40.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.001+0000 7f87767fc640 1 -- 172.21.15.22:0/2201720285 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87800e7280 con 0x55ca46fc5b60 2024-09-21T04:07:40.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.002+0000 7f879d5a8740 1 -- 172.21.15.22:0/2201720285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 msgr2=0x55ca473a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:40.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.002+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2201720285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 0x55ca473a50e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f8780009230 tx=0x7f87800aca80 comp rx=0 tx=0).stop 2024-09-21T04:07:40.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.002+0000 7f879d5a8740 1 -- 172.21.15.22:0/2201720285 shutdown_connections 2024-09-21T04:07:40.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.002+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2201720285 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fc5b60 0x55ca473a50e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.002+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2201720285 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fe6840 0x55ca473a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.002+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2201720285 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fbd980 0x55ca4739ae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.002+0000 7f879d5a8740 1 -- 172.21.15.22:0/2201720285 >> 172.21.15.22:0/2201720285 conn(0x55ca46fda990 msgr2=0x55ca4738b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:40.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.002+0000 7f879d5a8740 1 -- 172.21.15.22:0/2201720285 shutdown_connections 2024-09-21T04:07:40.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.002+0000 7f879d5a8740 1 -- 172.21.15.22:0/2201720285 wait complete. 2024-09-21T04:07:40.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.003+0000 7f879d5a8740 1 -- start start 2024-09-21T04:07:40.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.003+0000 7f879d5a8740 1 Processor -- start 2024-09-21T04:07:40.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.004+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fbd980 0x55ca473ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:40.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.004+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fc5b60 0x55ca473acda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:40.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.004+0000 7f879d5a8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 0x55ca473ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:40.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.004+0000 7f879d5a8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87901b8730 con 0x55ca46fc5b60 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.004+0000 7f879d5a8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f87901b8060 con 0x55ca46fbd980 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.004+0000 7f879d5a8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f87901b51e0 con 0x55ca46fe6840 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.004+0000 7f879d5a8740 10 client.0 _ll_register_callbacks cb 0x7f8788009940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.004+0000 7f878ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fc5b60 0x55ca473acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.004+0000 7f878ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fc5b60 0x55ca473acda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37998/0 (socket says 172.21.15.22:37998) 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.005+0000 7f878ffff640 1 -- 172.21.15.22:0/2284813974 learned_addr learned my addr 172.21.15.22:0/2284813974 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.005+0000 7f8794dd0640 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fbd980 0x55ca473ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.006+0000 7f878ffff640 1 -- 172.21.15.22:0/2284813974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 msgr2=0x55ca473ad3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.006+0000 7f87955d1640 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 0x55ca473ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.006+0000 7f878ffff640 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 0x55ca473ad3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.006+0000 7f878ffff640 1 -- 172.21.15.22:0/2284813974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fbd980 msgr2=0x55ca473ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.006+0000 7f878ffff640 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fbd980 0x55ca473ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.006+0000 7f878ffff640 1 -- 172.21.15.22:0/2284813974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca473adb80 con 0x55ca46fc5b60 2024-09-21T04:07:40.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.006+0000 7f878ffff640 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fc5b60 0x55ca473acda0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f87800a9ad0 tx=0x7f8780010f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e5def8d78ea3ac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:40.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.007+0000 7f876ffff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:07:40.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.007+0000 7f876ffff640 1 -- 172.21.15.22:0/2284813974 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8780098070 con 0x55ca46fc5b60 2024-09-21T04:07:40.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.008+0000 7f876ffff640 1 -- 172.21.15.22:0/2284813974 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f87800a8c60 con 0x55ca46fc5b60 2024-09-21T04:07:40.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.008+0000 7f879d5a8740 1 -- 172.21.15.22:0/2284813974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87800b6050 con 0x55ca46fc5b60 2024-09-21T04:07:40.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.009+0000 7f876ffff640 1 -- 172.21.15.22:0/2284813974 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f87800a8ee0 con 0x55ca46fc5b60 2024-09-21T04:07:40.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.010+0000 7f879d5a8740 10 client.15825 fetch_fsmap learned FSMap version 40 2024-09-21T04:07:40.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.010+0000 7f879d5a8740 1 -- 172.21.15.22:0/2284813974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55ca47416760 con 0x55ca46fc5b60 2024-09-21T04:07:40.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.011+0000 7f876ffff640 1 -- 172.21.15.22:0/2284813974 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87800b6050 con 0x55ca46fc5b60 2024-09-21T04:07:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.011+0000 7f876ffff640 1 -- 172.21.15.22:0/2284813974 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f87800b2f80 con 0x55ca46fc5b60 2024-09-21T04:07:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.011+0000 7f879d5a8740 10 client.15825 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:07:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.011+0000 7f879d5a8740 10 client.15825 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:07:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.011+0000 7f879d5a8740 20 client.15825 populate_metadata read hostname 'smithi022' 2024-09-21T04:07:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.011+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ca46f7a570 0x55ca47418f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.012+0000 7f879d5a8740 4 client.15825 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-09-21T04:07:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.012+0000 7f879d5a8740 1 -- 172.21.15.22:0/2284813974 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x55ca47301590 con 0x55ca46f7a570 2024-09-21T04:07:40.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.012+0000 7f8794dd0640 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ca46f7a570 0x55ca47418f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:40.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.013+0000 7f8794dd0640 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ca46f7a570 0x55ca47418f20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=358151e3a449d071 server_cookie=fd7e205ed109ce9e in_seq=0 out_seq=0 2024-09-21T04:07:40.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.013+0000 7f876ffff640 10 client.15825 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:07:40.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f876ffff640 1 -- 172.21.15.22:0/2284813974 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55ca47301590 con 0x55ca46f7a570 2024-09-21T04:07:40.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f876ffff640 10 client.15825 handle_command_reply: tid=0 2024-09-21T04:07:40.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 client.15825 shutdown 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 -- 172.21.15.22:0/2284813974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fc5b60 msgr2=0x55ca473acda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fc5b60 0x55ca473acda0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f87800a9ad0 tx=0x7f8780010f60 comp rx=0 tx=0).stop 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 -- 172.21.15.22:0/2284813974 shutdown_connections 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55ca46f7a570 0x55ca47418f20 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55ca46fe6840 0x55ca473ad3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ca46fc5b60 0x55ca473acda0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 --2- 172.21.15.22:0/2284813974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55ca46fbd980 0x55ca473ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 -- 172.21.15.22:0/2284813974 >> 172.21.15.22:0/2284813974 conn(0x55ca46fda990 msgr2=0x55ca4738b460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f876ffff640 0 client.15825 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 -- 172.21.15.22:0/2284813974 shutdown_connections 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 1 -- 172.21.15.22:0/2284813974 wait complete. 2024-09-21T04:07:40.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.282+0000 7f879d5a8740 20 client.15825 trim_cache size 0 max 16384 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 40, 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 18, 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "82ef325a": { 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 18, 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:07:40.287 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 130.0, 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:07:40.288 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:07:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 -- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87780b6790 msgr2=0x7f87780b8ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87780b6790 0x7f87780b8ca0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8784005cd0 tx=0x7f878404b000 comp rx=0 tx=0).stop 2024-09-21T04:07:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 -- 172.21.15.22:0/2842722070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87901083c0 msgr2=0x7f879010e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87901083c0 0x7f879010e9e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f878000e9f0 tx=0x7f878000eeb0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 -- 172.21.15.22:0/2842722070 shutdown_connections 2024-09-21T04:07:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87780b6790 0x7f87780b8ca0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87901083c0 0x7f879010e9e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8790108d10 0x7f87901a50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 --2- 172.21.15.22:0/2842722070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8790102a80 0x7f879010e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:40.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 -- 172.21.15.22:0/2842722070 >> 172.21.15.22:0/2842722070 conn(0x7f8790079760 msgr2=0x7f8790105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:40.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 -- 172.21.15.22:0/2842722070 shutdown_connections 2024-09-21T04:07:40.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:40.283+0000 7f8797034640 1 -- 172.21.15.22:0/2842722070 wait complete. 2024-09-21T04:07:40.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:40 smithi022 ceph-mon[31015]: pgmap v530: 129 pgs: 129 active+clean; 1013 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 859 op/s 2024-09-21T04:07:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:40 smithi060 ceph-mon[33722]: pgmap v530: 129 pgs: 129 active+clean; 1013 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 859 op/s 2024-09-21T04:07:40.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:40 smithi073 ceph-mon[34443]: pgmap v530: 129 pgs: 129 active+clean; 1013 MiB data, 4.8 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.7 MiB/s wr, 859 op/s 2024-09-21T04:07:41.124 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '82ef325a', quiesce took 11.1 seconds. Will release after: -1.0999999999999996 2024-09-21T04:07:41.124 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:07:41.390 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:07:42.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.899+0000 7f01cf04e640 1 -- 172.21.15.22:0/4181250509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01c8109df0 msgr2=0x7f01c8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.899+0000 7f01cf04e640 1 --2- 172.21.15.22:0/4181250509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01c8109df0 0x7f01c8110620 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f01c0009ca0 tx=0x7f01c002a8e0 comp rx=0 tx=0).stop 2024-09-21T04:07:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.899+0000 7f01cf04e640 1 -- 172.21.15.22:0/4181250509 shutdown_connections 2024-09-21T04:07:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.899+0000 7f01cf04e640 1 --2- 172.21.15.22:0/4181250509 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c81094a0 0x7f01c81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.899+0000 7f01cf04e640 1 --2- 172.21.15.22:0/4181250509 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01c8109df0 0x7f01c8110620 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.899+0000 7f01cf04e640 1 --2- 172.21.15.22:0/4181250509 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c8103b60 0x7f01c8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.899+0000 7f01cf04e640 1 -- 172.21.15.22:0/4181250509 >> 172.21.15.22:0/4181250509 conn(0x7f01c807b850 msgr2=0x7f01c807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.899+0000 7f01cf04e640 1 -- 172.21.15.22:0/4181250509 shutdown_connections 2024-09-21T04:07:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.899+0000 7f01cf04e640 1 -- 172.21.15.22:0/4181250509 wait complete. 2024-09-21T04:07:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01cf04e640 1 Processor -- start 2024-09-21T04:07:42.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01cf04e640 1 -- start start 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01cf04e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01c8103b60 0x7f01c819a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01cf04e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c81094a0 0x7f01c819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01cf04e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c8109df0 0x7f01c819fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01cf04e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f01c81139f0 con 0x7f01c8103b60 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01cf04e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8113870 con 0x7f01c8109df0 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01cf04e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f01c8113b70 con 0x7f01c81094a0 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01ccdea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01c8103b60 0x7f01c819a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01ccdea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01c8103b60 0x7f01c819a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48706/0 (socket says 172.21.15.22:48706) 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01ccdea640 1 -- 172.21.15.22:0/4169138769 learned_addr learned my addr 172.21.15.22:0/4169138769 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01cd5eb640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c8109df0 0x7f01c819fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.900+0000 7f01c7fff640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c81094a0 0x7f01c819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01ccdea640 1 -- 172.21.15.22:0/4169138769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c81094a0 msgr2=0x7f01c819aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:42.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01ccdea640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c81094a0 0x7f01c819aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01ccdea640 1 -- 172.21.15.22:0/4169138769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c8109df0 msgr2=0x7f01c819fd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01ccdea640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c8109df0 0x7f01c819fd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01ccdea640 1 -- 172.21.15.22:0/4169138769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c81a0470 con 0x7f01c8103b60 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01ccdea640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01c8103b60 0x7f01c819a500 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00d950 tx=0x7f01bc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01c5ffb640 1 -- 172.21.15.22:0/4169138769 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc017070 con 0x7f01c8103b60 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01c5ffb640 1 -- 172.21.15.22:0/4169138769 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01bc009c30 con 0x7f01c8103b60 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01cf04e640 1 -- 172.21.15.22:0/4169138769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01c81a0760 con 0x7f01c8103b60 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01c5ffb640 1 -- 172.21.15.22:0/4169138769 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01bc00f620 con 0x7f01c8103b60 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.901+0000 7f01cf04e640 1 -- 172.21.15.22:0/4169138769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01c81a6ec0 con 0x7f01c8103b60 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.902+0000 7f01cf04e640 1 -- 172.21.15.22:0/4169138769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01c8103f70 con 0x7f01c8103b60 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.904+0000 7f01c5ffb640 1 -- 172.21.15.22:0/4169138769 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f01bc005030 con 0x7f01c8103b60 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.905+0000 7f01c5ffb640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01b80b6510 0x7f01b80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:42.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.905+0000 7f01c7fff640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01b80b6510 0x7f01b80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.905+0000 7f01c5ffb640 1 -- 172.21.15.22:0/4169138769 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f01bc0e7300 con 0x7f01c8103b60 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.905+0000 7f01c7fff640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01b80b6510 0x7f01b80b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f01c8109220 tx=0x7f01b4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:41.908+0000 7f01c5ffb640 1 -- 172.21.15.22:0/4169138769 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f01bc0ad770 con 0x7f01c8103b60 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.135+0000 7f01cf04e640 1 -- 172.21.15.22:0/4169138769 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01c802e640 con 0x7f01c8103b60 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.136+0000 7f01c5ffb640 1 -- 172.21.15.22:0/4169138769 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11966 (secure 0 0 0) 0x7f01bc009de0 con 0x7f01c8103b60 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 40 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 -- 172.21.15.22:0/4169138769 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01b80b6510 msgr2=0x7f01b80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01b80b6510 0x7f01b80b8a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f01c8109220 tx=0x7f01b4008040 comp rx=0 tx=0).stop 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 -- 172.21.15.22:0/4169138769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01c8103b60 msgr2=0x7f01c819a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01c8103b60 0x7f01c819a500 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f01bc00d950 tx=0x7f01bc00de10 comp rx=0 tx=0).stop 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 -- 172.21.15.22:0/4169138769 shutdown_connections 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01b80b6510 0x7f01b80b8a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:42.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f01c81094a0 0x7f01c819aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:42.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f01c8109df0 0x7f01c819fd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:42.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 --2- 172.21.15.22:0/4169138769 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f01c8103b60 0x7f01c819a500 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:42.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 -- 172.21.15.22:0/4169138769 >> 172.21.15.22:0/4169138769 conn(0x7f01c807b850 msgr2=0x7f01c8107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:42.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 -- 172.21.15.22:0/4169138769 shutdown_connections 2024-09-21T04:07:42.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:42.138+0000 7f01cf04e640 1 -- 172.21.15.22:0/4169138769 wait complete. 2024-09-21T04:07:42.324 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:07:42.324 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":40,"btime":"2024-09-21T04:07:10:355928+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:07:09.496163+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:07:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:42 smithi060 ceph-mon[33722]: pgmap v531: 129 pgs: 129 active+clean; 1013 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 904 op/s 2024-09-21T04:07:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:42 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/4169138769' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:07:42.732 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:42 smithi022 ceph-mon[31015]: pgmap v531: 129 pgs: 129 active+clean; 1013 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 904 op/s 2024-09-21T04:07:42.733 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:42 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/4169138769' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:07:42.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:42 smithi073 ceph-mon[34443]: pgmap v531: 129 pgs: 129 active+clean; 1013 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 904 op/s 2024-09-21T04:07:42.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:42 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/4169138769' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:07:43.375 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id 82ef325a --release --await' 2024-09-21T04:07:43.375 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id 82ef325a --release --await 2024-09-21T04:07:43.639 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:07:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 200.0 s, 248.4 tps, lat 106.580 ms stddev 38.071 2024-09-21T04:07:44.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.146+0000 7faaf80e3640 1 -- 172.21.15.22:0/2050396532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaf0104860 msgr2=0x7faaf0104c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:44.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.146+0000 7faaf80e3640 1 --2- 172.21.15.22:0/2050396532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaf0104860 0x7faaf0104c70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7faaec009900 tx=0x7faaec02a3f0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.146+0000 7faaf80e3640 1 -- 172.21.15.22:0/2050396532 shutdown_connections 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.146+0000 7faaf80e3640 1 --2- 172.21.15.22:0/2050396532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf010de10 0x7faaf01102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.146+0000 7faaf80e3640 1 --2- 172.21.15.22:0/2050396532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf0105290 0x7faaf010d8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.146+0000 7faaf80e3640 1 --2- 172.21.15.22:0/2050396532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaf0104860 0x7faaf0104c70 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.146+0000 7faaf80e3640 1 -- 172.21.15.22:0/2050396532 >> 172.21.15.22:0/2050396532 conn(0x7faaf0079730 msgr2=0x7faaf0079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.146+0000 7faaf80e3640 1 -- 172.21.15.22:0/2050396532 shutdown_connections 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.146+0000 7faaf80e3640 1 -- 172.21.15.22:0/2050396532 wait complete. 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf80e3640 1 Processor -- start 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf80e3640 1 -- start start 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf80e3640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf0104860 0x7faaf019c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf80e3640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf0105290 0x7faaf019cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf80e3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaf010de10 0x7faaf01a1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf80e3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faaf0113910 con 0x7faaf010de10 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf80e3640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faaf0113790 con 0x7faaf0105290 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf80e3640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faaf0113a90 con 0x7faaf0104860 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf6680640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaf010de10 0x7faaf01a1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf6680640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaf010de10 0x7faaf01a1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48716/0 (socket says 172.21.15.22:48716) 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf6680640 1 -- 172.21.15.22:0/3555818088 learned_addr learned my addr 172.21.15.22:0/3555818088 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf0104860 0x7faaf019c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.147+0000 7faaf567e640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf0105290 0x7faaf019cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faaf6680640 1 -- 172.21.15.22:0/3555818088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf0104860 msgr2=0x7faaf019c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faaf6680640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf0104860 0x7faaf019c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faaf6680640 1 -- 172.21.15.22:0/3555818088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf0105290 msgr2=0x7faaf019cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faaf6680640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf0105290 0x7faaf019cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faaf6680640 1 -- 172.21.15.22:0/3555818088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf01a23f0 con 0x7faaf010de10 2024-09-21T04:07:44.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faaf6680640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaf010de10 0x7faaf01a1d80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faae800cce0 tx=0x7faae800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:44.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faae6ffd640 1 -- 172.21.15.22:0/3555818088 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae800f450 con 0x7faaf010de10 2024-09-21T04:07:44.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faae6ffd640 1 -- 172.21.15.22:0/3555818088 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faae800fa80 con 0x7faaf010de10 2024-09-21T04:07:44.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faaf80e3640 1 -- 172.21.15.22:0/3555818088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf01a26e0 con 0x7faaf010de10 2024-09-21T04:07:44.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faae6ffd640 1 -- 172.21.15.22:0/3555818088 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8018ad0 con 0x7faaf010de10 2024-09-21T04:07:44.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.148+0000 7faaf80e3640 1 -- 172.21.15.22:0/3555818088 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf01a2bd0 con 0x7faaf010de10 2024-09-21T04:07:44.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.151+0000 7faafe657740 1 Processor -- start 2024-09-21T04:07:44.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.151+0000 7faae6ffd640 1 -- 172.21.15.22:0/3555818088 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7faae800f5f0 con 0x7faaf010de10 2024-09-21T04:07:44.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.151+0000 7faafe657740 1 -- start start 2024-09-21T04:07:44.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faafe657740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 0x5596454bb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faafe657740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454bba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faafe657740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450f4840 0x5596454bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faafe657740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5596453a6dc0 con 0x5596450ec660 2024-09-21T04:07:44.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faafe657740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5596454331f0 con 0x559645115520 2024-09-21T04:07:44.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faafe657740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559645422620 con 0x5596450f4840 2024-09-21T04:07:44.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faaf567e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 0x5596454bb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faaf567e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 0x5596454bb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:37860/0 (socket says 172.21.15.22:37860) 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faaf567e640 1 -- 172.21.15.22:0/3882811611 learned_addr learned my addr 172.21.15.22:0/3882811611 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/3882811611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454bba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faaf567e640 1 --2- 172.21.15.22:0/3882811611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450f4840 0x5596454bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faaf567e640 1 -- 172.21.15.22:0/3882811611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450f4840 msgr2=0x5596454bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.152+0000 7faaf567e640 1 --2- 172.21.15.22:0/3882811611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450f4840 0x5596454bbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faaf567e640 1 -- 172.21.15.22:0/3882811611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 msgr2=0x5596454bba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faaf567e640 1 --2- 172.21.15.22:0/3882811611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454bba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faaf567e640 1 -- 172.21.15.22:0/3882811611 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596453eafd0 con 0x559645115520 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/3882811611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454bba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faaf567e640 1 --2- 172.21.15.22:0/3882811611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 0x5596454bb510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faae0005fd0 tx=0x7faae000b440 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fe42ec89be66d4d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faae6ffd640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faadc0b6540 0x7faadc0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faadbfff640 1 -- 172.21.15.22:0/3882811611 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae000e920 con 0x559645115520 2024-09-21T04:07:44.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faadc0b6540 0x7faadc0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faadbfff640 1 -- 172.21.15.22:0/3882811611 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faae0010430 con 0x559645115520 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faadbfff640 1 -- 172.21.15.22:0/3882811611 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae000f620 con 0x559645115520 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.153+0000 7faae6ffd640 1 -- 172.21.15.22:0/3555818088 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7faae80e7e40 con 0x7faaf010de10 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.154+0000 7faafe657740 1 -- 172.21.15.22:0/3882811611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 msgr2=0x5596454bb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.154+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faadc0b6540 0x7faadc0b8a50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faaec0057c0 tx=0x7faaec0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.154+0000 7faafe657740 1 --2- 172.21.15.22:0/3882811611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 0x5596454bb510 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7faae0005fd0 tx=0x7faae000b440 comp rx=0 tx=0).stop 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.154+0000 7faafe657740 1 -- 172.21.15.22:0/3882811611 shutdown_connections 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.154+0000 7faafe657740 1 --2- 172.21.15.22:0/3882811611 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450f4840 0x5596454bbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.154+0000 7faafe657740 1 --2- 172.21.15.22:0/3882811611 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454bba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.154+0000 7faafe657740 1 --2- 172.21.15.22:0/3882811611 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 0x5596454bb510 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.154+0000 7faafe657740 1 -- 172.21.15.22:0/3882811611 >> 172.21.15.22:0/3882811611 conn(0x559645109910 msgr2=0x5596454b9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.154+0000 7faafe657740 1 -- 172.21.15.22:0/3882811611 shutdown_connections 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.154+0000 7faafe657740 1 -- 172.21.15.22:0/3882811611 wait complete. 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.155+0000 7faafe657740 1 -- start start 2024-09-21T04:07:44.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.155+0000 7faafe657740 1 Processor -- start 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.155+0000 7faafe657740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450ec660 0x5596454c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.155+0000 7faafe657740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c71d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.155+0000 7faafe657740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 0x5596454db6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.155+0000 7faafe657740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5596453bd300 con 0x5596450f4840 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.155+0000 7faafe657740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x559645426430 con 0x559645115520 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.155+0000 7faafe657740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x559645283bb0 con 0x5596450ec660 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.155+0000 7faafe657740 10 client.0 _ll_register_callbacks cb 0x5596453d7120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf567e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c71d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf567e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c71d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48736/0 (socket says 172.21.15.22:48736) 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf567e640 1 -- 172.21.15.22:0/39065280 learned_addr learned my addr 172.21.15.22:0/39065280 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450ec660 0x5596454c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf6680640 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 0x5596454db6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf567e640 1 -- 172.21.15.22:0/39065280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450ec660 msgr2=0x5596454c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf567e640 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450ec660 0x5596454c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf567e640 1 -- 172.21.15.22:0/39065280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 msgr2=0x5596454db6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf567e640 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 0x5596454db6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf567e640 1 -- 172.21.15.22:0/39065280 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596453ac780 con 0x5596450f4840 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faaf567e640 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c71d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faae0010d50 tx=0x7faae0005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c4449183d4acc0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faad97fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faad97fa640 1 -- 172.21.15.22:0/39065280 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae000e720 con 0x5596450f4840 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faafe657740 1 -- 172.21.15.22:0/39065280 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faae0010430 con 0x5596450f4840 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.156+0000 7faad97fa640 1 -- 172.21.15.22:0/39065280 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7faae000e8c0 con 0x5596450f4840 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faad97fa640 1 -- 172.21.15.22:0/39065280 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7faae000eac0 con 0x5596450f4840 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faafe657740 10 client.15843 fetch_fsmap learned FSMap version 40 2024-09-21T04:07:44.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faafe657740 1 -- 172.21.15.22:0/39065280 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x559645180b00 con 0x5596450f4840 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faad97fa640 1 -- 172.21.15.22:0/39065280 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faae0010430 con 0x5596450f4840 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faad97fa640 1 -- 172.21.15.22:0/39065280 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7faae00118d0 con 0x5596450f4840 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faafe657740 10 client.15843 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faafe657740 10 client.15843 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faafe657740 20 client.15843 populate_metadata read hostname 'smithi022' 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faafe657740 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5596450d3ea0 0x5596454e1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faafe657740 4 client.15843 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faafe657740 1 -- 172.21.15.22:0/39065280 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559645435140 con 0x5596450d3ea0 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.157+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5596450d3ea0 0x5596454e1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.158+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5596450d3ea0 0x5596454e1680 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7523789f033ad0 server_cookie=8f7e416f15fd15d1 in_seq=0 out_seq=0 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.158+0000 7faad97fa640 10 client.15843 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faad97fa640 1 -- 172.21.15.22:0/39065280 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x559645435140 con 0x5596450d3ea0 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faad97fa640 10 client.15843 handle_command_reply: tid=0 2024-09-21T04:07:44.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 client.15843 shutdown 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 -- 172.21.15.22:0/39065280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 msgr2=0x5596454c71d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c71d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7faae0010d50 tx=0x7faae0005f30 comp rx=0 tx=0).stop 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 -- 172.21.15.22:0/39065280 shutdown_connections 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5596450d3ea0 0x5596454e1680 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x559645115520 0x5596454db6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c71d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 --2- 172.21.15.22:0/39065280 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450ec660 0x5596454c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faad97fa640 0 client.15843 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 -- 172.21.15.22:0/39065280 >> 172.21.15.22:0/39065280 conn(0x559645109910 msgr2=0x5596454be6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 -- 172.21.15.22:0/39065280 shutdown_connections 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 1 -- 172.21.15.22:0/39065280 wait complete. 2024-09-21T04:07:44.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.159+0000 7faafe657740 20 client.15843 trim_cache size 0 max 16384 2024-09-21T04:07:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faafe657740 1 Processor -- start 2024-09-21T04:07:44.180 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faafe657740 1 -- start start 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faafe657740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450d3ea0 0x5596454c23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faafe657740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450ec660 0x5596454bed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faafe657740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faafe657740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faaf01ae6f0 con 0x5596450f4840 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faafe657740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faaf01b02f0 con 0x5596450d3ea0 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faafe657740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faaf01aedc0 con 0x5596450ec660 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faaf6680640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faaf6680640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48750/0 (socket says 172.21.15.22:48750) 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faaf6680640 1 -- 172.21.15.22:0/1557857370 learned_addr learned my addr 172.21.15.22:0/1557857370 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/1557857370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450d3ea0 0x5596454c23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faaf567e640 1 --2- 172.21.15.22:0/1557857370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450ec660 0x5596454bed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faaf6680640 1 -- 172.21.15.22:0/1557857370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450ec660 msgr2=0x5596454bed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:44.181 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faaf6680640 1 --2- 172.21.15.22:0/1557857370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450ec660 0x5596454bed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faaf6680640 1 -- 172.21.15.22:0/1557857370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450d3ea0 msgr2=0x5596454c23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faaf6680640 1 --2- 172.21.15.22:0/1557857370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450d3ea0 0x5596454c23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.177+0000 7faaf6680640 1 -- 172.21.15.22:0/1557857370 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596451f7960 con 0x5596450f4840 2024-09-21T04:07:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.178+0000 7faaf6680640 1 --2- 172.21.15.22:0/1557857370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c0770 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faae80e58f0 tx=0x7faae80077a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5261bbbad3525028 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.178+0000 7faadb7fe640 1 -- 172.21.15.22:0/1557857370 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80ad720 con 0x5596450f4840 2024-09-21T04:07:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.178+0000 7faadb7fe640 1 -- 172.21.15.22:0/1557857370 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faae80ae310 con 0x5596450f4840 2024-09-21T04:07:44.182 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.178+0000 7faadb7fe640 1 -- 172.21.15.22:0/1557857370 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae80d10b0 con 0x5596450f4840 2024-09-21T04:07:44.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 -- 172.21.15.22:0/1557857370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 msgr2=0x5596454c0770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:44.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 --2- 172.21.15.22:0/1557857370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c0770 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7faae80e58f0 tx=0x7faae80077a0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 -- 172.21.15.22:0/1557857370 shutdown_connections 2024-09-21T04:07:44.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 --2- 172.21.15.22:0/1557857370 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450ec660 0x5596454bed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 --2- 172.21.15.22:0/1557857370 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450f4840 0x5596454c0770 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 --2- 172.21.15.22:0/1557857370 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450d3ea0 0x5596454c23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 -- 172.21.15.22:0/1557857370 >> 172.21.15.22:0/1557857370 conn(0x559645109910 msgr2=0x5596454be610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:44.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 -- 172.21.15.22:0/1557857370 shutdown_connections 2024-09-21T04:07:44.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 -- 172.21.15.22:0/1557857370 wait complete. 2024-09-21T04:07:44.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 -- start start 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.179+0000 7faafe657740 1 Processor -- start 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faafe657740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450d3ea0 0x5596454e4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faafe657740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454e1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faafe657740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450f4840 0x5596454e1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faafe657740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faaf01afc20 con 0x5596450ec660 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faafe657740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7faaf01af550 con 0x5596450f4840 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faafe657740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7faaf01ac730 con 0x5596450d3ea0 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faafe657740 10 client.0 _ll_register_callbacks cb 0x7faaec005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf567e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454e1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf567e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454e1110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48760/0 (socket says 172.21.15.22:48760) 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf567e640 1 -- 172.21.15.22:0/1510797352 learned_addr learned my addr 172.21.15.22:0/1510797352 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450d3ea0 0x5596454e4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf6680640 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450f4840 0x5596454e1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf567e640 1 -- 172.21.15.22:0/1510797352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450d3ea0 msgr2=0x5596454e4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf567e640 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450d3ea0 0x5596454e4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf567e640 1 -- 172.21.15.22:0/1510797352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450f4840 msgr2=0x5596454e1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf567e640 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450f4840 0x5596454e1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf567e640 1 -- 172.21.15.22:0/1510797352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596454e1b90 con 0x5596450ec660 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf6680640 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450f4840 0x5596454e1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faaf567e640 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454e1110 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faae0010d50 tx=0x7faae0005d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b43d78488e54a487 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.180+0000 7faad97fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faad97fa640 1 -- 172.21.15.22:0/1510797352 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae0010430 con 0x5596450ec660 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faad97fa640 1 -- 172.21.15.22:0/1510797352 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7faae00107f0 con 0x5596450ec660 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faafe657740 1 -- 172.21.15.22:0/1510797352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faae80ae310 con 0x5596450ec660 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faad97fa640 1 -- 172.21.15.22:0/1510797352 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7faae0005740 con 0x5596450ec660 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faafe657740 10 client.15849 fetch_fsmap learned FSMap version 40 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faafe657740 1 -- 172.21.15.22:0/1510797352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55964554cb30 con 0x5596450ec660 2024-09-21T04:07:44.187 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faad97fa640 1 -- 172.21.15.22:0/1510797352 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faae80ae310 con 0x5596450ec660 2024-09-21T04:07:44.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faad97fa640 1 -- 172.21.15.22:0/1510797352 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7faae0011440 con 0x5596450ec660 2024-09-21T04:07:44.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faafe657740 10 client.15849 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:07:44.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faafe657740 10 client.15849 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:07:44.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faafe657740 20 client.15849 populate_metadata read hostname 'smithi022' 2024-09-21T04:07:44.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faafe657740 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x559645115520 0x55964554f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:07:44.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faafe657740 4 client.15849 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "82ef325a", "release": true, "await": true}] 2024-09-21T04:07:44.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.181+0000 7faafe657740 1 -- 172.21.15.22:0/1510797352 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "82ef325a", "release": true, "await": true}) -- 0x559645430bf0 con 0x559645115520 2024-09-21T04:07:44.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.182+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x559645115520 0x55964554f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:07:44.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.182+0000 7faad97fa640 10 client.15849 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:07:44.188 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.182+0000 7faaf5e7f640 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x559645115520 0x55964554f280 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a5d8ab33503f4d0c server_cookie=9b448166f0078795 in_seq=0 out_seq=0 2024-09-21T04:07:44.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.238+0000 7faad97fa640 1 -- 172.21.15.22:0/1510797352 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x559645430bf0 con 0x559645115520 2024-09-21T04:07:44.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.238+0000 7faad97fa640 10 client.15849 handle_command_reply: tid=0 2024-09-21T04:07:44.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.238+0000 7faafe657740 1 client.15849 shutdown 2024-09-21T04:07:44.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faafe657740 1 -- 172.21.15.22:0/1510797352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 msgr2=0x5596454e1110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faafe657740 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454e1110 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7faae0010d50 tx=0x7faae0005d60 comp rx=0 tx=0).stop 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faafe657740 1 -- 172.21.15.22:0/1510797352 shutdown_connections 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faafe657740 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x559645115520 0x55964554f280 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faafe657740 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5596450f4840 0x5596454e1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faafe657740 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5596450ec660 0x5596454e1110 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faafe657740 1 --2- 172.21.15.22:0/1510797352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5596450d3ea0 0x5596454e4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faad97fa640 0 client.15849 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faafe657740 1 -- 172.21.15.22:0/1510797352 >> 172.21.15.22:0/1510797352 conn(0x559645109910 msgr2=0x5596454b82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faafe657740 1 -- 172.21.15.22:0/1510797352 shutdown_connections 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.239+0000 7faafe657740 1 -- 172.21.15.22:0/1510797352 wait complete. 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.240+0000 7faafe657740 20 client.15849 trim_cache size 0 max 16384 2024-09-21T04:07:44.243 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 40, 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 20, 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "82ef325a": { 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 20, 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 130.0, 2024-09-21T04:07:44.244 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:07:44.245 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:07:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 -- 172.21.15.22:0/3555818088 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faadc0b6540 msgr2=0x7faadc0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faadc0b6540 0x7faadc0b8a50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faaec0057c0 tx=0x7faaec0058d0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 -- 172.21.15.22:0/3555818088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaf010de10 msgr2=0x7faaf01a1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:07:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaf010de10 0x7faaf01a1d80 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7faae800cce0 tx=0x7faae800a620 comp rx=0 tx=0).stop 2024-09-21T04:07:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 -- 172.21.15.22:0/3555818088 shutdown_connections 2024-09-21T04:07:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7faadc0b6540 0x7faadc0b8a50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faaf010de10 0x7faaf01a1d80 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7faaf0105290 0x7faaf019cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 --2- 172.21.15.22:0/3555818088 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7faaf0104860 0x7faaf019c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:07:44.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 -- 172.21.15.22:0/3555818088 >> 172.21.15.22:0/3555818088 conn(0x7faaf0079730 msgr2=0x7faaf01005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:07:44.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 -- 172.21.15.22:0/3555818088 shutdown_connections 2024-09-21T04:07:44.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:07:44.241+0000 7faaf80e3640 1 -- 172.21.15.22:0/3555818088 wait complete. 2024-09-21T04:07:44.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:44 smithi060 ceph-mon[33722]: pgmap v532: 129 pgs: 129 active+clean; 1013 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 840 op/s 2024-09-21T04:07:44.788 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:44 smithi022 ceph-mon[31015]: pgmap v532: 129 pgs: 129 active+clean; 1013 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 840 op/s 2024-09-21T04:07:44.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:44 smithi073 ceph-mon[34443]: pgmap v532: 129 pgs: 129 active+clean; 1013 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 MiB/s wr, 840 op/s 2024-09-21T04:07:45.125 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '82ef325a', total seconds elapsed: 15.1 2024-09-21T04:07:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:46 smithi060 ceph-mon[33722]: pgmap v533: 129 pgs: 129 active+clean; 1013 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 662 op/s 2024-09-21T04:07:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:46 smithi022 ceph-mon[31015]: pgmap v533: 129 pgs: 129 active+clean; 1013 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 662 op/s 2024-09-21T04:07:46.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:46 smithi073 ceph-mon[34443]: pgmap v533: 129 pgs: 129 active+clean; 1013 MiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 5.5 MiB/s wr, 662 op/s 2024-09-21T04:07:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 205.0 s, 918.8 tps, lat 189.175 ms stddev 608.289 2024-09-21T04:07:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:48 smithi022 ceph-mon[31015]: pgmap v534: 129 pgs: 129 active+clean; 1013 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 658 op/s 2024-09-21T04:07:48.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:48 smithi073 ceph-mon[34443]: pgmap v534: 129 pgs: 129 active+clean; 1013 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 658 op/s 2024-09-21T04:07:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:48 smithi060 ceph-mon[33722]: pgmap v534: 129 pgs: 129 active+clean; 1013 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.6 MiB/s wr, 658 op/s 2024-09-21T04:07:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:50 smithi022 ceph-mon[31015]: pgmap v535: 129 pgs: 129 active+clean; 1013 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 MiB/s wr, 506 op/s 2024-09-21T04:07:50.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:50 smithi073 ceph-mon[34443]: pgmap v535: 129 pgs: 129 active+clean; 1013 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 MiB/s wr, 506 op/s 2024-09-21T04:07:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:50 smithi060 ceph-mon[33722]: pgmap v535: 129 pgs: 129 active+clean; 1013 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 4.2 MiB/s wr, 506 op/s 2024-09-21T04:07:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:52 smithi022 ceph-mon[31015]: pgmap v536: 129 pgs: 129 active+clean; 1013 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 680 op/s 2024-09-21T04:07:52.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:52 smithi073 ceph-mon[34443]: pgmap v536: 129 pgs: 129 active+clean; 1013 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 680 op/s 2024-09-21T04:07:52.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:52 smithi060 ceph-mon[33722]: pgmap v536: 129 pgs: 129 active+clean; 1013 MiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 5.7 MiB/s wr, 680 op/s 2024-09-21T04:07:53.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 210.0 s, 969.0 tps, lat 102.864 ms stddev 31.522 2024-09-21T04:07:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:54 smithi022 ceph-mon[31015]: pgmap v537: 129 pgs: 129 active+clean; 1014 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.8 MiB/s wr, 691 op/s 2024-09-21T04:07:54.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:54 smithi073 ceph-mon[34443]: pgmap v537: 129 pgs: 129 active+clean; 1014 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.8 MiB/s wr, 691 op/s 2024-09-21T04:07:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:54 smithi060 ceph-mon[33722]: pgmap v537: 129 pgs: 129 active+clean; 1014 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 5.8 MiB/s wr, 691 op/s 2024-09-21T04:07:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:56 smithi022 ceph-mon[31015]: pgmap v538: 129 pgs: 129 active+clean; 1014 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.3 MiB/s wr, 744 op/s 2024-09-21T04:07:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:56 smithi073 ceph-mon[34443]: pgmap v538: 129 pgs: 129 active+clean; 1014 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.3 MiB/s wr, 744 op/s 2024-09-21T04:07:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:56 smithi060 ceph-mon[33722]: pgmap v538: 129 pgs: 129 active+clean; 1014 MiB data, 5.1 GiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 6.3 MiB/s wr, 744 op/s 2024-09-21T04:07:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 215.0 s, 891.2 tps, lat 112.080 ms stddev 96.378 2024-09-21T04:07:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:07:58 smithi022 ceph-mon[31015]: pgmap v539: 129 pgs: 129 active+clean; 1014 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.6 MiB/s wr, 907 op/s 2024-09-21T04:07:58.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:07:58 smithi073 ceph-mon[34443]: pgmap v539: 129 pgs: 129 active+clean; 1014 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.6 MiB/s wr, 907 op/s 2024-09-21T04:07:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:07:58 smithi060 ceph-mon[33722]: pgmap v539: 129 pgs: 129 active+clean; 1014 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 7.6 MiB/s wr, 907 op/s 2024-09-21T04:08:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:00 smithi022 ceph-mon[31015]: pgmap v540: 129 pgs: 129 active+clean; 1014 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.9 MiB/s wr, 831 op/s 2024-09-21T04:08:00.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:00 smithi073 ceph-mon[34443]: pgmap v540: 129 pgs: 129 active+clean; 1014 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.9 MiB/s wr, 831 op/s 2024-09-21T04:08:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:00 smithi060 ceph-mon[33722]: pgmap v540: 129 pgs: 129 active+clean; 1014 MiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 6.9 MiB/s wr, 831 op/s 2024-09-21T04:08:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:02 smithi022 ceph-mon[31015]: pgmap v541: 129 pgs: 129 active+clean; 1017 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 MiB/s wr, 1.00k op/s 2024-09-21T04:08:02.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:02 smithi073 ceph-mon[34443]: pgmap v541: 129 pgs: 129 active+clean; 1017 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 MiB/s wr, 1.00k op/s 2024-09-21T04:08:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:02 smithi060 ceph-mon[33722]: pgmap v541: 129 pgs: 129 active+clean; 1017 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 8.7 MiB/s wr, 1.00k op/s 2024-09-21T04:08:03.697 INFO:tasks.quiescer.fs.[cephfs]:Total duration (38.5) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T04:08:03.698 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T04:08:03.698 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:08:03.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 220.0 s, 975.6 tps, lat 92.019 ms stddev 31.176 2024-09-21T04:08:04.078 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:08:04.746 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:04 smithi022 ceph-mon[31015]: pgmap v542: 129 pgs: 129 active+clean; 1017 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.9 MiB/s wr, 1.02k op/s 2024-09-21T04:08:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:04 smithi073 ceph-mon[34443]: pgmap v542: 129 pgs: 129 active+clean; 1017 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.9 MiB/s wr, 1.02k op/s 2024-09-21T04:08:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:04 smithi060 ceph-mon[33722]: pgmap v542: 129 pgs: 129 active+clean; 1017 MiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 8.9 MiB/s wr, 1.02k op/s 2024-09-21T04:08:05.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.214+0000 7f1875304640 1 -- 172.21.15.22:0/1015841728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1870077330 msgr2=0x7f18700757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:05.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.214+0000 7f1875304640 1 --2- 172.21.15.22:0/1015841728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1870077330 0x7f18700757b0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1858009900 tx=0x7f185802a3f0 comp rx=0 tx=0).stop 2024-09-21T04:08:05.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.214+0000 7f1875304640 1 -- 172.21.15.22:0/1015841728 shutdown_connections 2024-09-21T04:08:05.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.214+0000 7f1875304640 1 --2- 172.21.15.22:0/1015841728 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1870075cf0 0x7f1870076100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:05.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.214+0000 7f1875304640 1 --2- 172.21.15.22:0/1015841728 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1870114430 0x7f1870116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:05.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.214+0000 7f1875304640 1 --2- 172.21.15.22:0/1015841728 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1870077330 0x7f18700757b0 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f1858009900 tx=0x7f185802a3f0 comp rx=0 tx=0).stop 2024-09-21T04:08:05.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.214+0000 7f1875304640 1 -- 172.21.15.22:0/1015841728 >> 172.21.15.22:0/1015841728 conn(0x7f187007b910 msgr2=0x7f187007bd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:05.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.214+0000 7f1875304640 1 -- 172.21.15.22:0/1015841728 shutdown_connections 2024-09-21T04:08:05.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.215+0000 7f1875304640 1 -- 172.21.15.22:0/1015841728 wait complete. 2024-09-21T04:08:05.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.216+0000 7f1875304640 1 Processor -- start 2024-09-21T04:08:05.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.217+0000 7f1875304640 1 -- start start 2024-09-21T04:08:05.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.217+0000 7f1875304640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1870075cf0 0x7f18701a0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:05.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.217+0000 7f1875304640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1870114430 0x7f18701a1140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:05.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.217+0000 7f1875304640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18701a6320 0x7f18701a6730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:05.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.217+0000 7f1875304640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1870119f50 con 0x7f1870075cf0 2024-09-21T04:08:05.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.217+0000 7f1875304640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1870119dd0 con 0x7f18701a6320 2024-09-21T04:08:05.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.217+0000 7f1875304640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f187011a0d0 con 0x7f1870114430 2024-09-21T04:08:05.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.218+0000 7f186e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1870114430 0x7f18701a1140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.218+0000 7f186e7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1870114430 0x7f18701a1140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:59930/0 (socket says 172.21.15.22:59930) 2024-09-21T04:08:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.218+0000 7f186f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18701a6320 0x7f18701a6730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.218+0000 7f186e7fc640 1 -- 172.21.15.22:0/3497276096 learned_addr learned my addr 172.21.15.22:0/3497276096 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.218+0000 7f186effd640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1870075cf0 0x7f18701a0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.218+0000 7f186f7fe640 1 -- 172.21.15.22:0/3497276096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1870114430 msgr2=0x7f18701a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.218+0000 7f186f7fe640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1870114430 0x7f18701a1140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.218+0000 7f186f7fe640 1 -- 172.21.15.22:0/3497276096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1870075cf0 msgr2=0x7f18701a0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.218+0000 7f186f7fe640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1870075cf0 0x7f18701a0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:05.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.218+0000 7f186f7fe640 1 -- 172.21.15.22:0/3497276096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18701a6f00 con 0x7f18701a6320 2024-09-21T04:08:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.219+0000 7f186f7fe640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18701a6320 0x7f18701a6730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1868009fd0 tx=0x7f186800ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.219+0000 7f1867fff640 1 -- 172.21.15.22:0/3497276096 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f186800ce20 con 0x7f18701a6320 2024-09-21T04:08:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.220+0000 7f1867fff640 1 -- 172.21.15.22:0/3497276096 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1868005020 con 0x7f18701a6320 2024-09-21T04:08:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.220+0000 7f1875304640 1 -- 172.21.15.22:0/3497276096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18701ad4a0 con 0x7f18701a6320 2024-09-21T04:08:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.220+0000 7f1867fff640 1 -- 172.21.15.22:0/3497276096 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1868010690 con 0x7f18701a6320 2024-09-21T04:08:05.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.220+0000 7f1875304640 1 -- 172.21.15.22:0/3497276096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18701ad840 con 0x7f18701a6320 2024-09-21T04:08:05.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.223+0000 7f1875304640 1 -- 172.21.15.22:0/3497276096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18700757b0 con 0x7f18701a6320 2024-09-21T04:08:05.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.223+0000 7f1867fff640 1 -- 172.21.15.22:0/3497276096 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1868010830 con 0x7f18701a6320 2024-09-21T04:08:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.225+0000 7f1867fff640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f185c0b6610 0x7f185c0b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.225+0000 7f1867fff640 1 -- 172.21.15.22:0/3497276096 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f18680e7df0 con 0x7f18701a6320 2024-09-21T04:08:05.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.225+0000 7f186effd640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f185c0b6610 0x7f185c0b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:05.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.227+0000 7f186effd640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f185c0b6610 0x7f185c0b8b20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1858000c00 tx=0x7f1858004040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:05.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.229+0000 7f1867fff640 1 -- 172.21.15.22:0/3497276096 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f18680af100 con 0x7f18701a6320 2024-09-21T04:08:05.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.683+0000 7f1875304640 1 -- 172.21.15.22:0/3497276096 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f18701adb60 con 0x7f18701a6320 2024-09-21T04:08:05.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.684+0000 7f1867fff640 1 -- 172.21.15.22:0/3497276096 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11966 (secure 0 0 0) 0x7f18680b7580 con 0x7f18701a6320 2024-09-21T04:08:05.688 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:08:05.688 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":40,"btime":"2024-09-21T04:07:10:355928+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:07:09.496163+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:08:05.688 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 40 2024-09-21T04:08:05.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.690+0000 7f1875304640 1 -- 172.21.15.22:0/3497276096 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f185c0b6610 msgr2=0x7f185c0b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:05.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.690+0000 7f1875304640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f185c0b6610 0x7f185c0b8b20 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f1858000c00 tx=0x7f1858004040 comp rx=0 tx=0).stop 2024-09-21T04:08:05.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.690+0000 7f1875304640 1 -- 172.21.15.22:0/3497276096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18701a6320 msgr2=0x7f18701a6730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:05.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.690+0000 7f1875304640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18701a6320 0x7f18701a6730 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1868009fd0 tx=0x7f186800ef10 comp rx=0 tx=0).stop 2024-09-21T04:08:05.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.690+0000 7f1875304640 1 -- 172.21.15.22:0/3497276096 shutdown_connections 2024-09-21T04:08:05.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.690+0000 7f1875304640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f185c0b6610 0x7f185c0b8b20 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:05.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.690+0000 7f1875304640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1870114430 0x7f18701a1140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:05.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.690+0000 7f1875304640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f18701a6320 0x7f18701a6730 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:05.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.690+0000 7f1875304640 1 --2- 172.21.15.22:0/3497276096 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1870075cf0 0x7f18701a0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:05.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.690+0000 7f1875304640 1 -- 172.21.15.22:0/3497276096 >> 172.21.15.22:0/3497276096 conn(0x7f187007b910 msgr2=0x7f18701132f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.692+0000 7f1875304640 1 -- 172.21.15.22:0/3497276096 shutdown_connections 2024-09-21T04:08:05.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:05.692+0000 7f1875304640 1 -- 172.21.15.22:0/3497276096 wait complete. 2024-09-21T04:08:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:06 smithi022 ceph-mon[31015]: pgmap v543: 129 pgs: 129 active+clean; 1021 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.3 MiB/s wr, 1.01k op/s 2024-09-21T04:08:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:06 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3497276096' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:06 smithi073 ceph-mon[34443]: pgmap v543: 129 pgs: 129 active+clean; 1021 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.3 MiB/s wr, 1.01k op/s 2024-09-21T04:08:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3497276096' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:06 smithi060 ceph-mon[33722]: pgmap v543: 129 pgs: 129 active+clean; 1021 MiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 9.3 MiB/s wr, 1.01k op/s 2024-09-21T04:08:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:06 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3497276096' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:08.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 225.0 s, 765.5 tps, lat 130.211 ms stddev 223.900 2024-09-21T04:08:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:08 smithi022 ceph-mon[31015]: pgmap v544: 129 pgs: 129 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2024-09-21T04:08:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:08 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:08:08.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:08 smithi073 ceph-mon[34443]: pgmap v544: 129 pgs: 129 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2024-09-21T04:08:08.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:08 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:08:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:08 smithi060 ceph-mon[33722]: pgmap v544: 129 pgs: 129 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 11 MiB/s wr, 1.04k op/s 2024-09-21T04:08:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:08 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:08:09.807 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T04:08:09.808 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T04:08:10.301 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:08:10.772 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:10 smithi022 ceph-mon[31015]: pgmap v545: 129 pgs: 129 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 912 op/s 2024-09-21T04:08:10.772 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:08:10.772 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:08:10.772 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:08:10.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:10 smithi073 ceph-mon[34443]: pgmap v545: 129 pgs: 129 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 912 op/s 2024-09-21T04:08:10.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:08:10.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:08:10.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:08:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:10 smithi060 ceph-mon[33722]: pgmap v545: 129 pgs: 129 active+clean; 1.0 GiB data, 5.4 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 912 op/s 2024-09-21T04:08:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:08:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:08:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:08:10.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.964+0000 7f07c1b84640 1 -- 172.21.15.22:0/3980927938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07bc075dd0 msgr2=0x7f07bc0761e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:10.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.964+0000 7f07c1b84640 1 --2- 172.21.15.22:0/3980927938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07bc075dd0 0x7f07bc0761e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07ac009860 tx=0x7f07ac02a340 comp rx=0 tx=0).stop 2024-09-21T04:08:10.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.967+0000 7f07c1b84640 1 -- 172.21.15.22:0/3980927938 shutdown_connections 2024-09-21T04:08:10.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.967+0000 7f07c1b84640 1 --2- 172.21.15.22:0/3980927938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07bc114450 0x7f07bc116920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:10.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.967+0000 7f07c1b84640 1 --2- 172.21.15.22:0/3980927938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07bc075dd0 0x7f07bc0761e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:10.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.967+0000 7f07c1b84640 1 --2- 172.21.15.22:0/3980927938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc077380 0x7f07bc0757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:10.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.967+0000 7f07c1b84640 1 -- 172.21.15.22:0/3980927938 >> 172.21.15.22:0/3980927938 conn(0x7f07bc0ff5f0 msgr2=0x7f07bc101a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:10.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.968+0000 7f07c1b84640 1 -- 172.21.15.22:0/3980927938 shutdown_connections 2024-09-21T04:08:10.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.969+0000 7f07c1b84640 1 -- 172.21.15.22:0/3980927938 wait complete. 2024-09-21T04:08:10.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.970+0000 7f07c1b84640 1 Processor -- start 2024-09-21T04:08:10.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.972+0000 7f07c1b84640 1 -- start start 2024-09-21T04:08:10.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.972+0000 7f07c1b84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07bc075dd0 0x7f07bc075040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:10.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.972+0000 7f07c1b84640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc077380 0x7f07bc0755c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:10.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.972+0000 7f07c1b84640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07bc114450 0x7f07bc06f340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:10.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.972+0000 7f07c1b84640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc06d170 con 0x7f07bc075dd0 2024-09-21T04:08:10.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.972+0000 7f07c1b84640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc06cff0 con 0x7f07bc114450 2024-09-21T04:08:10.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.972+0000 7f07c1b84640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07bc06d2f0 con 0x7f07bc077380 2024-09-21T04:08:10.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.974+0000 7f07baffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc077380 0x7f07bc0755c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:10.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.974+0000 7f07baffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc077380 0x7f07bc0755c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:41318/0 (socket says 172.21.15.22:41318) 2024-09-21T04:08:10.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.974+0000 7f07baffd640 1 -- 172.21.15.22:0/4210964815 learned_addr learned my addr 172.21.15.22:0/4210964815 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:10.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.974+0000 7f07bbfff640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07bc114450 0x7f07bc06f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:10.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.974+0000 7f07bb7fe640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07bc075dd0 0x7f07bc075040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:10.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.974+0000 7f07baffd640 1 -- 172.21.15.22:0/4210964815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07bc114450 msgr2=0x7f07bc06f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:10.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.974+0000 7f07baffd640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07bc114450 0x7f07bc06f340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:10.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.974+0000 7f07baffd640 1 -- 172.21.15.22:0/4210964815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07bc075dd0 msgr2=0x7f07bc075040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:10.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.974+0000 7f07baffd640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07bc075dd0 0x7f07bc075040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:10.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.974+0000 7f07baffd640 1 -- 172.21.15.22:0/4210964815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07bc06fb60 con 0x7f07bc077380 2024-09-21T04:08:10.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.975+0000 7f07baffd640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc077380 0x7f07bc0755c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07ac035040 tx=0x7f07ac030ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:10.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.979+0000 7f07b8ff9640 1 -- 172.21.15.22:0/4210964815 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac037040 con 0x7f07bc077380 2024-09-21T04:08:10.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.979+0000 7f07b8ff9640 1 -- 172.21.15.22:0/4210964815 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07ac041070 con 0x7f07bc077380 2024-09-21T04:08:10.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.979+0000 7f07b8ff9640 1 -- 172.21.15.22:0/4210964815 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac003ce0 con 0x7f07bc077380 2024-09-21T04:08:10.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.979+0000 7f07c1b84640 1 -- 172.21.15.22:0/4210964815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07bc06fdf0 con 0x7f07bc077380 2024-09-21T04:08:10.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.980+0000 7f07c1b84640 1 -- 172.21.15.22:0/4210964815 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07bc107b40 con 0x7f07bc077380 2024-09-21T04:08:10.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.988+0000 7f07c80f8740 1 Processor -- start 2024-09-21T04:08:10.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.991+0000 7f07c80f8740 1 -- start start 2024-09-21T04:08:10.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.991+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7672850 0x55c2c7a18e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:10.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.991+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7649990 0x55c2c7a193b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:10.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.991+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 0x55c2c7a198f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:10.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.991+0000 7f07c80f8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c2c798fbb0 con 0x55c2c7649990 2024-09-21T04:08:10.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.991+0000 7f07c80f8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c2c797efe0 con 0x55c2c7651b70 2024-09-21T04:08:10.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.991+0000 7f07c80f8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c2c7982df0 con 0x55c2c7672850 2024-09-21T04:08:10.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.992+0000 7f07b8ff9640 1 -- 172.21.15.22:0/4210964815 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f07ac0035f0 con 0x7f07bc077380 2024-09-21T04:08:10.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.992+0000 7f07bb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7649990 0x55c2c7a193b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:10.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.992+0000 7f07bb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7649990 0x55c2c7a193b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59124/0 (socket says 172.21.15.22:59124) 2024-09-21T04:08:10.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.992+0000 7f07bb7fe640 1 -- 172.21.15.22:0/4138767530 learned_addr learned my addr 172.21.15.22:0/4138767530 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:10.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.992+0000 7f07bbfff640 1 --2- 172.21.15.22:0/4138767530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7672850 0x55c2c7a18e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:10.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.993+0000 7f07b8ff9640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07a40b6710 0x7f07a40b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.993+0000 7f07baffd640 1 --2- 172.21.15.22:0/4138767530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 0x55c2c7a198f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.993+0000 7f07b8ff9640 1 -- 172.21.15.22:0/4210964815 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f07ac1073e0 con 0x7f07bc077380 2024-09-21T04:08:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.994+0000 7f07bb7fe640 1 -- 172.21.15.22:0/4138767530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7672850 msgr2=0x55c2c7a18e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.994+0000 7f07bb7fe640 1 --2- 172.21.15.22:0/4138767530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7672850 0x55c2c7a18e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.994+0000 7f07bb7fe640 1 -- 172.21.15.22:0/4138767530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 msgr2=0x55c2c7a198f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.994+0000 7f07bb7fe640 1 --2- 172.21.15.22:0/4138767530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 0x55c2c7a198f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:10.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.994+0000 7f07bb7fe640 1 -- 172.21.15.22:0/4138767530 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c76ecba0 con 0x55c2c7649990 2024-09-21T04:08:10.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.994+0000 7f07baffd640 1 --2- 172.21.15.22:0/4138767530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 0x55c2c7a198f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:08:10.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.994+0000 7f07bb7fe640 1 --2- 172.21.15.22:0/4138767530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7649990 0x55c2c7a193b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f07b000bcf0 tx=0x7f07b000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361e357b1a1a215d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:11.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.995+0000 7f07a1ffb640 1 -- 172.21.15.22:0/4138767530 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0015070 con 0x55c2c7649990 2024-09-21T04:08:11.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.996+0000 7f07a1ffb640 1 -- 172.21.15.22:0/4138767530 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07b00054b0 con 0x55c2c7649990 2024-09-21T04:08:11.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.996+0000 7f07a1ffb640 1 -- 172.21.15.22:0/4138767530 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0011460 con 0x55c2c7649990 2024-09-21T04:08:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.997+0000 7f07c80f8740 1 -- 172.21.15.22:0/4138767530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7649990 msgr2=0x55c2c7a193b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.997+0000 7f07c80f8740 1 --2- 172.21.15.22:0/4138767530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7649990 0x55c2c7a193b0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f07b000bcf0 tx=0x7f07b000f730 comp rx=0 tx=0).stop 2024-09-21T04:08:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.997+0000 7f07bbfff640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07a40b6710 0x7f07a40b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:11.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.997+0000 7f07bbfff640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07a40b6710 0x7f07a40b8c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f07b4007da0 tx=0x7f07b4004b50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.998+0000 7f07c80f8740 1 -- 172.21.15.22:0/4138767530 shutdown_connections 2024-09-21T04:08:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.998+0000 7f07c80f8740 1 --2- 172.21.15.22:0/4138767530 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 0x55c2c7a198f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.998+0000 7f07c80f8740 1 --2- 172.21.15.22:0/4138767530 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7649990 0x55c2c7a193b0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.998+0000 7f07c80f8740 1 --2- 172.21.15.22:0/4138767530 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7672850 0x55c2c7a18e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.998+0000 7f07c80f8740 1 -- 172.21.15.22:0/4138767530 >> 172.21.15.22:0/4138767530 conn(0x55c2c7666c40 msgr2=0x55c2c7a16d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:11.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.998+0000 7f07c80f8740 1 -- 172.21.15.22:0/4138767530 shutdown_connections 2024-09-21T04:08:11.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.998+0000 7f07c80f8740 1 -- 172.21.15.22:0/4138767530 wait complete. 2024-09-21T04:08:11.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.999+0000 7f07c80f8740 1 -- start start 2024-09-21T04:08:11.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:10.999+0000 7f07c80f8740 1 Processor -- start 2024-09-21T04:08:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.000+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7649990 0x55c2c7a24aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.000+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7651b70 0x55c2c7a25020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.000+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7672850 0x55c2c7a309d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.000+0000 7f07c80f8740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c2c77e07b0 con 0x55c2c7651b70 2024-09-21T04:08:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.000+0000 7f07c80f8740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c2c7919e90 con 0x55c2c7649990 2024-09-21T04:08:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.000+0000 7f07c80f8740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c2c7a27650 con 0x55c2c7672850 2024-09-21T04:08:11.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.000+0000 7f07c80f8740 10 client.0 _ll_register_callbacks cb 0x55c2c797c710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:08:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.000+0000 7f07baffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7651b70 0x55c2c7a25020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.000+0000 7f07baffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7651b70 0x55c2c7a25020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59126/0 (socket says 172.21.15.22:59126) 2024-09-21T04:08:11.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.000+0000 7f07baffd640 1 -- 172.21.15.22:0/1946278813 learned_addr learned my addr 172.21.15.22:0/1946278813 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:11.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.002+0000 7f07baffd640 1 -- 172.21.15.22:0/1946278813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7672850 msgr2=0x55c2c7a309d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T04:08:11.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.002+0000 7f07baffd640 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7672850 0x55c2c7a309d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.002+0000 7f07baffd640 1 -- 172.21.15.22:0/1946278813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7649990 msgr2=0x55c2c7a24aa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T04:08:11.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.002+0000 7f07baffd640 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7649990 0x55c2c7a24aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.003+0000 7f07baffd640 1 -- 172.21.15.22:0/1946278813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c7a30fe0 con 0x55c2c7651b70 2024-09-21T04:08:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.008+0000 7f07baffd640 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7651b70 0x55c2c7a25020 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0cce50 tx=0x7f07ac0c97a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80cf8bf570cafd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:11.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.008+0000 7f079affd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:08:11.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.009+0000 7f079affd640 1 -- 172.21.15.22:0/1946278813 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac0ccaa0 con 0x55c2c7651b70 2024-09-21T04:08:11.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.010+0000 7f07c80f8740 1 -- 172.21.15.22:0/1946278813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07b00054b0 con 0x55c2c7651b70 2024-09-21T04:08:11.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.010+0000 7f079affd640 1 -- 172.21.15.22:0/1946278813 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f07ac0304c0 con 0x55c2c7651b70 2024-09-21T04:08:11.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.010+0000 7f079affd640 1 -- 172.21.15.22:0/1946278813 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f07ac0038e0 con 0x55c2c7651b70 2024-09-21T04:08:11.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.010+0000 7f07c80f8740 10 client.15864 fetch_fsmap learned FSMap version 40 2024-09-21T04:08:11.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.010+0000 7f07c80f8740 1 -- 172.21.15.22:0/1946278813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c2c7a33910 con 0x55c2c7651b70 2024-09-21T04:08:11.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.011+0000 7f079affd640 1 -- 172.21.15.22:0/1946278813 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07b00054b0 con 0x55c2c7651b70 2024-09-21T04:08:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.011+0000 7f079affd640 1 -- 172.21.15.22:0/1946278813 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f07ac0c8aa0 con 0x55c2c7651b70 2024-09-21T04:08:11.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.012+0000 7f07c80f8740 10 client.15864 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:08:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.012+0000 7f07c80f8740 10 client.15864 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:08:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.012+0000 7f07c80f8740 20 client.15864 populate_metadata read hostname 'smithi022' 2024-09-21T04:08:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.012+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c2c76311d0 0x55c2c7a370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.012+0000 7f07c80f8740 4 client.15864 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:08:11.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.012+0000 7f07c80f8740 1 -- 172.21.15.22:0/1946278813 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2c7991b00 con 0x55c2c76311d0 2024-09-21T04:08:11.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.013+0000 7f07bb7fe640 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c2c76311d0 0x55c2c7a370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:11.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.015+0000 7f07bb7fe640 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c2c76311d0 0x55c2c7a370e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1012f67d599dcaeb server_cookie=8c78efeefdbf03b8 in_seq=0 out_seq=0 2024-09-21T04:08:11.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.015+0000 7f079affd640 10 client.15864 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:11.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.026+0000 7f079affd640 1 -- 172.21.15.22:0/1946278813 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55c2c7991b00 con 0x55c2c76311d0 2024-09-21T04:08:11.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.026+0000 7f079affd640 10 client.15864 handle_command_reply: tid=0 2024-09-21T04:08:11.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.026+0000 7f07c80f8740 1 client.15864 shutdown 2024-09-21T04:08:11.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.027+0000 7f07c80f8740 1 -- 172.21.15.22:0/1946278813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7651b70 msgr2=0x55c2c7a25020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:11.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.027+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7651b70 0x55c2c7a25020 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0cce50 tx=0x7f07ac0c97a0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.030+0000 7f07c80f8740 1 -- 172.21.15.22:0/1946278813 shutdown_connections 2024-09-21T04:08:11.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.030+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c2c76311d0 0x55c2c7a370e0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.030+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7672850 0x55c2c7a309d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.030+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7651b70 0x55c2c7a25020 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.030+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1946278813 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7649990 0x55c2c7a24aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.030+0000 7f07c80f8740 1 -- 172.21.15.22:0/1946278813 >> 172.21.15.22:0/1946278813 conn(0x55c2c7666c40 msgr2=0x55c2c7a1c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:11.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.030+0000 7f079affd640 0 client.15864 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:11.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.031+0000 7f07c80f8740 1 -- 172.21.15.22:0/1946278813 shutdown_connections 2024-09-21T04:08:11.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.033+0000 7f07c80f8740 1 -- 172.21.15.22:0/1946278813 wait complete. 2024-09-21T04:08:11.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.036+0000 7f07c80f8740 20 client.15864 trim_cache size 0 max 16384 2024-09-21T04:08:11.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.073+0000 7f07c80f8740 1 Processor -- start 2024-09-21T04:08:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.074+0000 7f07c80f8740 1 -- start start 2024-09-21T04:08:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.074+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7649990 0x55c2c7a1df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.074+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7651b70 0x55c2c7a1e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.075+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7672850 0x55c2c7a21a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.075+0000 7f07baffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7651b70 0x55c2c7a1e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.075+0000 7f07baffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7651b70 0x55c2c7a1e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:41324/0 (socket says 172.21.15.22:41324) 2024-09-21T04:08:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.075+0000 7f07baffd640 1 -- 172.21.15.22:0/2719945413 learned_addr learned my addr 172.21.15.22:0/2719945413 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.075+0000 7f07c80f8740 1 -- 172.21.15.22:0/2719945413 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07a800fcc0 con 0x55c2c7672850 2024-09-21T04:08:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.075+0000 7f07c80f8740 1 -- 172.21.15.22:0/2719945413 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07a80118c0 con 0x55c2c7649990 2024-09-21T04:08:11.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.075+0000 7f07c80f8740 1 -- 172.21.15.22:0/2719945413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8010390 con 0x55c2c7651b70 2024-09-21T04:08:11.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.076+0000 7f07bbfff640 1 --2- 172.21.15.22:0/2719945413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7672850 0x55c2c7a21a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:11.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.076+0000 7f07baffd640 1 -- 172.21.15.22:0/2719945413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7649990 msgr2=0x55c2c7a1df80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T04:08:11.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.076+0000 7f07baffd640 1 --2- 172.21.15.22:0/2719945413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7649990 0x55c2c7a1df80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.076+0000 7f07baffd640 1 -- 172.21.15.22:0/2719945413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7672850 msgr2=0x55c2c7a21a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:11.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.076+0000 7f07baffd640 1 --2- 172.21.15.22:0/2719945413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7672850 0x55c2c7a21a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.076+0000 7f07baffd640 1 -- 172.21.15.22:0/2719945413 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2c7a1b190 con 0x55c2c7651b70 2024-09-21T04:08:11.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.078+0000 7f07baffd640 1 --2- 172.21.15.22:0/2719945413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7651b70 0x55c2c7a1e4c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0cd0e0 tx=0x7f07ac0c98d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=798fc6deb6555e66 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:11.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.080+0000 7f07a17fa640 1 -- 172.21.15.22:0/2719945413 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07ac0cc8c0 con 0x55c2c7651b70 2024-09-21T04:08:11.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.081+0000 7f07a17fa640 1 -- 172.21.15.22:0/2719945413 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07ac0ccc60 con 0x55c2c7651b70 2024-09-21T04:08:11.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.082+0000 7f07c80f8740 1 -- 172.21.15.22:0/2719945413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7651b70 msgr2=0x55c2c7a1e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:11.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.082+0000 7f07c80f8740 1 --2- 172.21.15.22:0/2719945413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7651b70 0x55c2c7a1e4c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f07ac0cd0e0 tx=0x7f07ac0c98d0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.083+0000 7f07c80f8740 1 -- 172.21.15.22:0/2719945413 shutdown_connections 2024-09-21T04:08:11.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.083+0000 7f07c80f8740 1 --2- 172.21.15.22:0/2719945413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7651b70 0x55c2c7a1e4c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.083+0000 7f07c80f8740 1 --2- 172.21.15.22:0/2719945413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7672850 0x55c2c7a21a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.083+0000 7f07c80f8740 1 --2- 172.21.15.22:0/2719945413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7649990 0x55c2c7a1df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.083+0000 7f07c80f8740 1 -- 172.21.15.22:0/2719945413 >> 172.21.15.22:0/2719945413 conn(0x55c2c7666c40 msgr2=0x55c2c7a23120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:11.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.084+0000 7f07c80f8740 1 -- 172.21.15.22:0/2719945413 shutdown_connections 2024-09-21T04:08:11.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.084+0000 7f07c80f8740 1 -- 172.21.15.22:0/2719945413 wait complete. 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.085+0000 7f07c80f8740 1 -- start start 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.085+0000 7f07c80f8740 1 Processor -- start 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.086+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7649990 0x55c2c7a28b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.086+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 0x55c2c7a29060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.086+0000 7f07c80f8740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7672850 0x55c2c7a295c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.086+0000 7f07bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7649990 0x55c2c7a28b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.086+0000 7f07bb7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7649990 0x55c2c7a28b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:41330/0 (socket says 172.21.15.22:41330) 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.086+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f07a80111f0 con 0x55c2c7672850 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.086+0000 7f07bb7fe640 1 -- 172.21.15.22:0/1860882634 learned_addr learned my addr 172.21.15.22:0/1860882634 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.086+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f07a8010b20 con 0x55c2c7651b70 2024-09-21T04:08:11.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.086+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f07a800dca0 con 0x55c2c7649990 2024-09-21T04:08:11.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.086+0000 7f07c80f8740 10 client.0 _ll_register_callbacks cb 0x7f07ac005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:08:11.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.087+0000 7f07baffd640 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 0x55c2c7a29060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:11.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.087+0000 7f07bb7fe640 1 -- 172.21.15.22:0/1860882634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 msgr2=0x55c2c7a29060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:11.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.087+0000 7f07bb7fe640 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 0x55c2c7a29060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.087+0000 7f07bb7fe640 1 -- 172.21.15.22:0/1860882634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7672850 msgr2=0x55c2c7a295c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:11.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.087+0000 7f07bb7fe640 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7672850 0x55c2c7a295c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.087+0000 7f07bb7fe640 1 -- 172.21.15.22:0/1860882634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2c7aa0d10 con 0x55c2c7649990 2024-09-21T04:08:11.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.087+0000 7f07bb7fe640 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7649990 0x55c2c7a28b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07b0000c00 tx=0x7f07b000bde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c730e0b2171f6643 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:11.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.088+0000 7f079affd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:08:11.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.088+0000 7f079affd640 1 -- 172.21.15.22:0/1860882634 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07b0030060 con 0x55c2c7649990 2024-09-21T04:08:11.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.088+0000 7f079affd640 1 -- 172.21.15.22:0/1860882634 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f07b0004d80 con 0x55c2c7649990 2024-09-21T04:08:11.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.088+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f07ac0ccc60 con 0x55c2c7649990 2024-09-21T04:08:11.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.092+0000 7f079affd640 1 -- 172.21.15.22:0/1860882634 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f07b0037050 con 0x55c2c7649990 2024-09-21T04:08:11.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.093+0000 7f07c80f8740 10 client.25498 fetch_fsmap learned FSMap version 40 2024-09-21T04:08:11.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.093+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55c2c7aa1fd0 con 0x55c2c7649990 2024-09-21T04:08:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.094+0000 7f079affd640 1 -- 172.21.15.22:0/1860882634 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f07b0005000 con 0x55c2c7649990 2024-09-21T04:08:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.094+0000 7f079affd640 1 -- 172.21.15.22:0/1860882634 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f07b002b5e0 con 0x55c2c7649990 2024-09-21T04:08:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.094+0000 7f07c80f8740 10 client.25498 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:08:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.094+0000 7f07c80f8740 10 client.25498 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:08:11.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.094+0000 7f07c80f8740 20 client.25498 populate_metadata read hostname 'smithi022' 2024-09-21T04:08:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.094+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c2c7606580 0x55c2c7aa4790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.094+0000 7f07c80f8740 4 client.25498 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T04:08:11.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.094+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x7f07ac0ccc60 con 0x55c2c7606580 2024-09-21T04:08:11.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.099+0000 7f07baffd640 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c2c7606580 0x55c2c7aa4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:11.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.101+0000 7f079affd640 10 client.25498 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:11.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.101+0000 7f07baffd640 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c2c7606580 0x55c2c7aa4790 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb8bdbfd480423f0 server_cookie=6b3181cad1bbda3b in_seq=0 out_seq=0 2024-09-21T04:08:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.371+0000 7f079affd640 1 -- 172.21.15.22:0/1860882634 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f07ac0ccc60 con 0x55c2c7606580 2024-09-21T04:08:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.371+0000 7f079affd640 10 client.25498 handle_command_reply: tid=0 2024-09-21T04:08:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.371+0000 7f07c80f8740 1 client.25498 shutdown 2024-09-21T04:08:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7649990 msgr2=0x55c2c7a28b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7649990 0x55c2c7a28b20 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f07b0000c00 tx=0x7f07b000bde0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 shutdown_connections 2024-09-21T04:08:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c2c7606580 0x55c2c7aa4790 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c2c7672850 0x55c2c7a295c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c2c7651b70 0x55c2c7a29060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f079affd640 0 client.25498 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:11.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 1 --2- 172.21.15.22:0/1860882634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c2c7649990 0x55c2c7a28b20 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 >> 172.21.15.22:0/1860882634 conn(0x55c2c7666c40 msgr2=0x55c2c7a1df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:11.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 shutdown_connections 2024-09-21T04:08:11.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 1 -- 172.21.15.22:0/1860882634 wait complete. 2024-09-21T04:08:11.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.372+0000 7f07c80f8740 20 client.25498 trim_cache size 0 max 16384 2024-09-21T04:08:11.376 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:08:11.376 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 40, 2024-09-21T04:08:11.376 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:08:11.376 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 22, 2024-09-21T04:08:11.376 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "1092dee5": { 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 22, 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 139.2, 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:08:11.377 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:08:11.378 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:11.378 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:11.378 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:11.378 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:11.378 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:11.378 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:08:11.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 -- 172.21.15.22:0/4210964815 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07a40b6710 msgr2=0x7f07a40b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07a40b6710 0x7f07a40b8c20 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f07b4007da0 tx=0x7f07b4004b50 comp rx=0 tx=0).stop 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 -- 172.21.15.22:0/4210964815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc077380 msgr2=0x7f07bc0755c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc077380 0x7f07bc0755c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f07ac035040 tx=0x7f07ac030ce0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 -- 172.21.15.22:0/4210964815 shutdown_connections 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f07a40b6710 0x7f07a40b8c20 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f07bc077380 0x7f07bc0755c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f07bc114450 0x7f07bc06f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 --2- 172.21.15.22:0/4210964815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f07bc075dd0 0x7f07bc075040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 -- 172.21.15.22:0/4210964815 >> 172.21.15.22:0/4210964815 conn(0x7f07bc0ff5f0 msgr2=0x7f07bc101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 -- 172.21.15.22:0/4210964815 shutdown_connections 2024-09-21T04:08:11.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:11.373+0000 7f07c1b84640 1 -- 172.21.15.22:0/4210964815 wait complete. 2024-09-21T04:08:12.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:12 smithi060 ceph-mon[33722]: pgmap v546: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 1.05k op/s 2024-09-21T04:08:12.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:12 smithi022 ceph-mon[31015]: pgmap v546: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 1.05k op/s 2024-09-21T04:08:12.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:12 smithi073 ceph-mon[34443]: pgmap v546: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 15 MiB/s wr, 1.05k op/s 2024-09-21T04:08:12.898 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1092dee5', quiesce took 9.2 seconds. Will release after: 10.05 2024-09-21T04:08:13.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 230.0 s, 422.4 tps, lat 122.879 ms stddev 222.595 2024-09-21T04:08:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:14 smithi022 ceph-mon[31015]: pgmap v547: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 16 MiB/s wr, 981 op/s 2024-09-21T04:08:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:14 smithi073 ceph-mon[34443]: pgmap v547: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 16 MiB/s wr, 981 op/s 2024-09-21T04:08:14.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:14 smithi060 ceph-mon[33722]: pgmap v547: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 16 MiB/s wr, 981 op/s 2024-09-21T04:08:16.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:16 smithi022 ceph-mon[31015]: pgmap v548: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 793 op/s 2024-09-21T04:08:16.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:16 smithi073 ceph-mon[34443]: pgmap v548: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 793 op/s 2024-09-21T04:08:16.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:16 smithi060 ceph-mon[33722]: pgmap v548: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 793 op/s 2024-09-21T04:08:18.707 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 235.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:08:18.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:18 smithi022 ceph-mon[31015]: pgmap v549: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 664 op/s 2024-09-21T04:08:18.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:18 smithi073 ceph-mon[34443]: pgmap v549: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 664 op/s 2024-09-21T04:08:18.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:18 smithi060 ceph-mon[33722]: pgmap v549: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 13 MiB/s wr, 664 op/s 2024-09-21T04:08:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:20 smithi022 ceph-mon[31015]: pgmap v550: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.6 MiB/s wr, 451 op/s 2024-09-21T04:08:20.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:20 smithi073 ceph-mon[34443]: pgmap v550: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.6 MiB/s wr, 451 op/s 2024-09-21T04:08:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:20 smithi060 ceph-mon[33722]: pgmap v550: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.6 MiB/s wr, 451 op/s 2024-09-21T04:08:22.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:22 smithi022 ceph-mon[31015]: pgmap v551: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.2 MiB/s wr, 396 op/s 2024-09-21T04:08:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:22 smithi073 ceph-mon[34443]: pgmap v551: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.2 MiB/s wr, 396 op/s 2024-09-21T04:08:22.949 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:08:22.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:22 smithi060 ceph-mon[33722]: pgmap v551: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.2 MiB/s wr, 396 op/s 2024-09-21T04:08:23.222 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:08:23.707 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 240.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:08:23.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.722+0000 7f6554d34640 1 -- 172.21.15.22:0/2493531678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65501083b0 msgr2=0x7f65501087c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:23.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.722+0000 7f6554d34640 1 --2- 172.21.15.22:0/2493531678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65501083b0 0x7f65501087c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6544009900 tx=0x7f654402a410 comp rx=0 tx=0).stop 2024-09-21T04:08:23.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.722+0000 7f6554d34640 1 -- 172.21.15.22:0/2493531678 shutdown_connections 2024-09-21T04:08:23.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.722+0000 7f6554d34640 1 --2- 172.21.15.22:0/2493531678 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6550108d00 0x7f655010f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:23.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.722+0000 7f6554d34640 1 --2- 172.21.15.22:0/2493531678 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65501083b0 0x7f65501087c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:23.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.722+0000 7f6554d34640 1 --2- 172.21.15.22:0/2493531678 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6550102a70 0x7f6550102e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:23.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.722+0000 7f6554d34640 1 -- 172.21.15.22:0/2493531678 >> 172.21.15.22:0/2493531678 conn(0x7f6550079730 msgr2=0x7f6550079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:23.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.722+0000 7f6554d34640 1 -- 172.21.15.22:0/2493531678 shutdown_connections 2024-09-21T04:08:23.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.722+0000 7f6554d34640 1 -- 172.21.15.22:0/2493531678 wait complete. 2024-09-21T04:08:23.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.723+0000 7f6554d34640 1 Processor -- start 2024-09-21T04:08:23.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.723+0000 7f6554d34640 1 -- start start 2024-09-21T04:08:23.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.723+0000 7f6554d34640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6550102a70 0x7f655019a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.723+0000 7f6554d34640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65501083b0 0x7f655019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.723+0000 7f6554d34640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6550108d00 0x7f655019fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.723+0000 7f6554d34640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6550112820 con 0x7f6550102a70 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.723+0000 7f6554d34640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f65501126a0 con 0x7f65501083b0 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.723+0000 7f6554d34640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f65501129a0 con 0x7f6550108d00 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.723+0000 7f654e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6550102a70 0x7f655019a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f654e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6550102a70 0x7f655019a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39114/0 (socket says 172.21.15.22:39114) 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f654e59c640 1 -- 172.21.15.22:0/3108485163 learned_addr learned my addr 172.21.15.22:0/3108485163 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f654ed9d640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6550108d00 0x7f655019fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f654dd9b640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65501083b0 0x7f655019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f654e59c640 1 -- 172.21.15.22:0/3108485163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6550108d00 msgr2=0x7f655019fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f654e59c640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6550108d00 0x7f655019fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f654e59c640 1 -- 172.21.15.22:0/3108485163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65501083b0 msgr2=0x7f655019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:23.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f654e59c640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65501083b0 0x7f655019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f654e59c640 1 -- 172.21.15.22:0/3108485163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65501a0350 con 0x7f6550102a70 2024-09-21T04:08:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f654e59c640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6550102a70 0x7f655019a3e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f654000d770 tx=0x7f654000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f653f7fe640 1 -- 172.21.15.22:0/3108485163 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540017070 con 0x7f6550102a70 2024-09-21T04:08:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.724+0000 7f6554d34640 1 -- 172.21.15.22:0/3108485163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65501a0640 con 0x7f6550102a70 2024-09-21T04:08:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.725+0000 7f6554d34640 1 -- 172.21.15.22:0/3108485163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65501a6da0 con 0x7f6550102a70 2024-09-21T04:08:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.725+0000 7f653f7fe640 1 -- 172.21.15.22:0/3108485163 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65400054b0 con 0x7f6550102a70 2024-09-21T04:08:23.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.725+0000 7f653f7fe640 1 -- 172.21.15.22:0/3108485163 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6540004c60 con 0x7f6550102a70 2024-09-21T04:08:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.726+0000 7f6554d34640 1 -- 172.21.15.22:0/3108485163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6530005290 con 0x7f6550102a70 2024-09-21T04:08:23.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.727+0000 7f653f7fe640 1 -- 172.21.15.22:0/3108485163 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6540009c30 con 0x7f6550102a70 2024-09-21T04:08:23.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.728+0000 7f653f7fe640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f65380b6590 0x7f65380b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:23.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.728+0000 7f654dd9b640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f65380b6590 0x7f65380b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:23.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.728+0000 7f653f7fe640 1 -- 172.21.15.22:0/3108485163 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f65400e72c0 con 0x7f6550102a70 2024-09-21T04:08:23.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.729+0000 7f654dd9b640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f65380b6590 0x7f65380b8aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6544004770 tx=0x7f65440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:23.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.731+0000 7f653f7fe640 1 -- 172.21.15.22:0/3108485163 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f65400b1b90 con 0x7f6550102a70 2024-09-21T04:08:23.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.961+0000 7f6554d34640 1 -- 172.21.15.22:0/3108485163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6530005580 con 0x7f6550102a70 2024-09-21T04:08:23.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.962+0000 7f653f7fe640 1 -- 172.21.15.22:0/3108485163 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11966 (secure 0 0 0) 0x7f65400b6ad0 con 0x7f6550102a70 2024-09-21T04:08:23.965 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:08:23.965 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":40,"btime":"2024-09-21T04:07:10:355928+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:07:09.496163+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:08:23.965 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 40 2024-09-21T04:08:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 -- 172.21.15.22:0/3108485163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f65380b6590 msgr2=0x7f65380b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f65380b6590 0x7f65380b8aa0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6544004770 tx=0x7f65440058d0 comp rx=0 tx=0).stop 2024-09-21T04:08:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 -- 172.21.15.22:0/3108485163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6550102a70 msgr2=0x7f655019a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6550102a70 0x7f655019a3e0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f654000d770 tx=0x7f654000dc30 comp rx=0 tx=0).stop 2024-09-21T04:08:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 -- 172.21.15.22:0/3108485163 shutdown_connections 2024-09-21T04:08:23.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f65380b6590 0x7f65380b8aa0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:23.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6550108d00 0x7f655019fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:23.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f65501083b0 0x7f655019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:23.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 --2- 172.21.15.22:0/3108485163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6550102a70 0x7f655019a3e0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:23.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 -- 172.21.15.22:0/3108485163 >> 172.21.15.22:0/3108485163 conn(0x7f6550079730 msgr2=0x7f6550101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:23.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 -- 172.21.15.22:0/3108485163 shutdown_connections 2024-09-21T04:08:23.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:23.965+0000 7f6554d34640 1 -- 172.21.15.22:0/3108485163 wait complete. 2024-09-21T04:08:24.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:24 smithi022 ceph-mon[31015]: pgmap v552: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.7 MiB/s wr, 219 op/s 2024-09-21T04:08:24.756 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:24 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3108485163' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:24.783 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id 1092dee5 --release --await' 2024-09-21T04:08:24.784 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id 1092dee5 --release --await 2024-09-21T04:08:24.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:24 smithi073 ceph-mon[34443]: pgmap v552: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.7 MiB/s wr, 219 op/s 2024-09-21T04:08:24.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:24 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3108485163' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:24.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:24 smithi060 ceph-mon[33722]: pgmap v552: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 3.7 MiB/s wr, 219 op/s 2024-09-21T04:08:24.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:24 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3108485163' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:25.044 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:08:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.736+0000 7f6a50433640 1 -- 172.21.15.22:0/1946857553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a48103b80 msgr2=0x7f6a48103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.736+0000 7f6a50433640 1 --2- 172.21.15.22:0/1946857553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a48103b80 0x7f6a48103f90 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f6a44009860 tx=0x7f6a4402a340 comp rx=0 tx=0).stop 2024-09-21T04:08:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.736+0000 7f6a50433640 1 -- 172.21.15.22:0/1946857553 shutdown_connections 2024-09-21T04:08:25.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.736+0000 7f6a50433640 1 --2- 172.21.15.22:0/1946857553 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a481094c0 0x7f6a481098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.736+0000 7f6a50433640 1 --2- 172.21.15.22:0/1946857553 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a48109e10 0x7f6a48110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.736+0000 7f6a50433640 1 --2- 172.21.15.22:0/1946857553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a48103b80 0x7f6a48103f90 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.736+0000 7f6a50433640 1 -- 172.21.15.22:0/1946857553 >> 172.21.15.22:0/1946857553 conn(0x7f6a480ff610 msgr2=0x7f6a48101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:25.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.736+0000 7f6a50433640 1 -- 172.21.15.22:0/1946857553 shutdown_connections 2024-09-21T04:08:25.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.736+0000 7f6a50433640 1 -- 172.21.15.22:0/1946857553 wait complete. 2024-09-21T04:08:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.737+0000 7f6a50433640 1 Processor -- start 2024-09-21T04:08:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.737+0000 7f6a50433640 1 -- start start 2024-09-21T04:08:25.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a50433640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a48103b80 0x7f6a4819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a50433640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a481094c0 0x7f6a4819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a50433640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a48109e10 0x7f6a4819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a50433640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6a48113980 con 0x7f6a481094c0 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a50433640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a48113800 con 0x7f6a48103b80 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a50433640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a48113b00 con 0x7f6a48109e10 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4d9ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a481094c0 0x7f6a4819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4d9ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a481094c0 0x7f6a4819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39138/0 (socket says 172.21.15.22:39138) 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4d9ce640 1 -- 172.21.15.22:0/99526758 learned_addr learned my addr 172.21.15.22:0/99526758 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a48109e10 0x7f6a4819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a48103b80 0x7f6a4819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4d9ce640 1 -- 172.21.15.22:0/99526758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a48109e10 msgr2=0x7f6a4819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:25.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a48109e10 0x7f6a4819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4d9ce640 1 -- 172.21.15.22:0/99526758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a48103b80 msgr2=0x7f6a4819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a48103b80 0x7f6a4819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4d9ce640 1 -- 172.21.15.22:0/99526758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a481a0340 con 0x7f6a481094c0 2024-09-21T04:08:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a481094c0 0x7f6a4819a970 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800d750 tx=0x7f6a3800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.738+0000 7f6a3f7fe640 1 -- 172.21.15.22:0/99526758 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38017070 con 0x7f6a481094c0 2024-09-21T04:08:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.739+0000 7f6a3f7fe640 1 -- 172.21.15.22:0/99526758 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a380054b0 con 0x7f6a481094c0 2024-09-21T04:08:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.739+0000 7f6a50433640 1 -- 172.21.15.22:0/99526758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a481a0630 con 0x7f6a481094c0 2024-09-21T04:08:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.739+0000 7f6a3f7fe640 1 -- 172.21.15.22:0/99526758 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a38004bc0 con 0x7f6a481094c0 2024-09-21T04:08:25.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.739+0000 7f6a50433640 1 -- 172.21.15.22:0/99526758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a481a6d90 con 0x7f6a481094c0 2024-09-21T04:08:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.741+0000 7f6a569a7740 1 Processor -- start 2024-09-21T04:08:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.741+0000 7f6a3f7fe640 1 -- 172.21.15.22:0/99526758 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6a38010460 con 0x7f6a481094c0 2024-09-21T04:08:25.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.741+0000 7f6a569a7740 1 -- start start 2024-09-21T04:08:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd07510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 0x5589ccd07a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc940840 0x5589ccd07f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a569a7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5589ccbf2dc0 con 0x5589cc961520 2024-09-21T04:08:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a569a7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5589ccc7f1f0 con 0x5589cc938660 2024-09-21T04:08:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a569a7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5589ccc6e620 con 0x5589cc940840 2024-09-21T04:08:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4e9d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd07510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4e9d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd07510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39146/0 (socket says 172.21.15.22:39146) 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4e9d0640 1 -- 172.21.15.22:0/3442645702 learned_addr learned my addr 172.21.15.22:0/3442645702 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/3442645702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 0x5589ccd07a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/3442645702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc940840 0x5589ccd07f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a3f7fe640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6a340b6510 0x7f6a340b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4e9d0640 1 -- 172.21.15.22:0/3442645702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc940840 msgr2=0x5589ccd07f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/3442645702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc940840 0x5589ccd07f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4e9d0640 1 -- 172.21.15.22:0/3442645702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 msgr2=0x5589ccd07a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/3442645702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 0x5589ccd07a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4e9d0640 1 -- 172.21.15.22:0/3442645702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589ccc36fd0 con 0x5589cc961520 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.742+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/3442645702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 0x5589ccd07a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.743+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6a340b6510 0x7f6a340b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.743+0000 7f6a3f7fe640 1 -- 172.21.15.22:0/99526758 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6a380e71a0 con 0x7f6a481094c0 2024-09-21T04:08:25.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.743+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/3442645702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd07510 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000f5e0 tx=0x7f6a4000faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbd6c9fe759a32f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.743+0000 7f6a3cd9a640 1 -- 172.21.15.22:0/3442645702 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4001bae0 con 0x5589cc961520 2024-09-21T04:08:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.743+0000 7f6a3cd9a640 1 -- 172.21.15.22:0/3442645702 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a4000ce80 con 0x5589cc961520 2024-09-21T04:08:25.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.743+0000 7f6a3cd9a640 1 -- 172.21.15.22:0/3442645702 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a40026c30 con 0x5589cc961520 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.744+0000 7f6a569a7740 1 -- 172.21.15.22:0/3442645702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 msgr2=0x5589ccd07510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.744+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6a340b6510 0x7f6a340b8a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6a40023000 tx=0x7f6a40020000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.744+0000 7f6a569a7740 1 --2- 172.21.15.22:0/3442645702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd07510 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000f5e0 tx=0x7f6a4000faa0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.744+0000 7f6a569a7740 1 -- 172.21.15.22:0/3442645702 shutdown_connections 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.744+0000 7f6a569a7740 1 --2- 172.21.15.22:0/3442645702 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc940840 0x5589ccd07f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.744+0000 7f6a569a7740 1 --2- 172.21.15.22:0/3442645702 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 0x5589ccd07a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.744+0000 7f6a569a7740 1 --2- 172.21.15.22:0/3442645702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd07510 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.744+0000 7f6a569a7740 1 -- 172.21.15.22:0/3442645702 >> 172.21.15.22:0/3442645702 conn(0x5589cc955910 msgr2=0x5589ccd05400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.744+0000 7f6a569a7740 1 -- 172.21.15.22:0/3442645702 shutdown_connections 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.744+0000 7f6a569a7740 1 -- 172.21.15.22:0/3442645702 wait complete. 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a569a7740 1 -- start start 2024-09-21T04:08:25.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a569a7740 1 Processor -- start 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd12bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc940840 0x5589ccd130f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 0x5589ccd1ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a569a7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5589ccc09300 con 0x5589cc938660 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a569a7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5589ccc72430 con 0x5589cc940840 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a569a7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5589ccacfbb0 con 0x5589cc961520 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a4e1cf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd12bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a4e1cf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd12bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39154/0 (socket says 172.21.15.22:39154) 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a569a7740 10 client.0 _ll_register_callbacks cb 0x5589ccc23120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a4e1cf640 1 -- 172.21.15.22:0/707433540 learned_addr learned my addr 172.21.15.22:0/707433540 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc940840 0x5589ccd130f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.745+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 0x5589ccd1ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a4e1cf640 1 -- 172.21.15.22:0/707433540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 msgr2=0x5589ccd1ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 0x5589ccd1ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a4e1cf640 1 -- 172.21.15.22:0/707433540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc940840 msgr2=0x5589ccd130f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc940840 0x5589ccd130f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a4e1cf640 1 -- 172.21.15.22:0/707433540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ccbf8780 con 0x5589cc938660 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 0x5589ccd1ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd12bb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6a44005cd0 tx=0x7f6a44030d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e778ce6d3a913213 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a31ffb640 1 -- 172.21.15.22:0/707433540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44037040 con 0x5589cc938660 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a31ffb640 1 -- 172.21.15.22:0/707433540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6a44004450 con 0x5589cc938660 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a569a7740 1 -- 172.21.15.22:0/707433540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5589ccc81140 con 0x5589cc938660 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a31ffb640 1 -- 172.21.15.22:0/707433540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6a4404c050 con 0x5589cc938660 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a569a7740 10 client.15885 fetch_fsmap learned FSMap version 40 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.746+0000 7f6a569a7740 1 -- 172.21.15.22:0/707433540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5589cc9ccb00 con 0x5589cc938660 2024-09-21T04:08:25.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.747+0000 7f6a31ffb640 1 -- 172.21.15.22:0/707433540 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5589ccc81140 con 0x5589cc938660 2024-09-21T04:08:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.747+0000 7f6a31ffb640 1 -- 172.21.15.22:0/707433540 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f6a440046c0 con 0x5589cc938660 2024-09-21T04:08:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.747+0000 7f6a569a7740 10 client.15885 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:08:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.747+0000 7f6a569a7740 10 client.15885 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:08:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.747+0000 7f6a569a7740 20 client.15885 populate_metadata read hostname 'smithi022' 2024-09-21T04:08:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.747+0000 7f6a569a7740 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5589cc91fea0 0x5589ccd24f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.747+0000 7f6a569a7740 4 client.15885 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:08:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.747+0000 7f6a569a7740 1 -- 172.21.15.22:0/707433540 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589ccc7cbf0 con 0x5589cc91fea0 2024-09-21T04:08:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.747+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5589cc91fea0 0x5589ccd24f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.748+0000 7f6a31ffb640 10 client.15885 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:25.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.748+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5589cc91fea0 0x5589ccd24f40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=69a178ada96f5f3f server_cookie=1ab6b5a637c512af in_seq=0 out_seq=0 2024-09-21T04:08:25.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.748+0000 7f6a31ffb640 1 -- 172.21.15.22:0/707433540 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5589ccc7cbf0 con 0x5589cc91fea0 2024-09-21T04:08:25.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.748+0000 7f6a31ffb640 10 client.15885 handle_command_reply: tid=0 2024-09-21T04:08:25.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 client.15885 shutdown 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 -- 172.21.15.22:0/707433540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 msgr2=0x5589ccd12bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd12bb0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f6a44005cd0 tx=0x7f6a44030d10 comp rx=0 tx=0).stop 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 -- 172.21.15.22:0/707433540 shutdown_connections 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5589cc91fea0 0x5589ccd24f40 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 0x5589ccd1ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc940840 0x5589ccd130f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 --2- 172.21.15.22:0/707433540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd12bb0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 -- 172.21.15.22:0/707433540 >> 172.21.15.22:0/707433540 conn(0x5589cc955910 msgr2=0x5589ccd0a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a31ffb640 0 client.15885 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 -- 172.21.15.22:0/707433540 shutdown_connections 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 1 -- 172.21.15.22:0/707433540 wait complete. 2024-09-21T04:08:25.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.749+0000 7f6a569a7740 20 client.15885 trim_cache size 0 max 16384 2024-09-21T04:08:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.766+0000 7f6a569a7740 1 Processor -- start 2024-09-21T04:08:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.766+0000 7f6a569a7740 1 -- start start 2024-09-21T04:08:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 0x5589ccd1ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc940840 0x5589ccd0ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd0fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a569a7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481b0a00 con 0x5589cc961520 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a569a7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481b2600 con 0x5589cc938660 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a569a7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481b10d0 con 0x5589cc940840 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e9d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd0fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e9d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd0fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39170/0 (socket says 172.21.15.22:39170) 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e9d0640 1 -- 172.21.15.22:0/884897026 learned_addr learned my addr 172.21.15.22:0/884897026 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/884897026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc940840 0x5589ccd0ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/884897026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 0x5589ccd1ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e9d0640 1 -- 172.21.15.22:0/884897026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc940840 msgr2=0x5589ccd0ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/884897026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc940840 0x5589ccd0ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e9d0640 1 -- 172.21.15.22:0/884897026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 msgr2=0x5589ccd1ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/884897026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 0x5589ccd1ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e9d0640 1 -- 172.21.15.22:0/884897026 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589cca43960 con 0x5589cc961520 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/884897026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 0x5589ccd1ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:08:25.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.767+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/884897026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd0fda0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000f580 tx=0x7f6a40009c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3565f5a39c2c65d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:25.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.768+0000 7f6a33fff640 1 -- 172.21.15.22:0/884897026 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a4002b030 con 0x5589cc961520 2024-09-21T04:08:25.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.768+0000 7f6a33fff640 1 -- 172.21.15.22:0/884897026 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a4002c040 con 0x5589cc961520 2024-09-21T04:08:25.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.768+0000 7f6a33fff640 1 -- 172.21.15.22:0/884897026 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a400266a0 con 0x5589cc961520 2024-09-21T04:08:25.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.768+0000 7f6a569a7740 1 -- 172.21.15.22:0/884897026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 msgr2=0x5589ccd0fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:25.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.768+0000 7f6a569a7740 1 --2- 172.21.15.22:0/884897026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd0fda0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f6a4000f580 tx=0x7f6a40009c60 comp rx=0 tx=0).stop 2024-09-21T04:08:25.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 -- 172.21.15.22:0/884897026 shutdown_connections 2024-09-21T04:08:25.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 --2- 172.21.15.22:0/884897026 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc940840 0x5589ccd0ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 --2- 172.21.15.22:0/884897026 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc961520 0x5589ccd0fda0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 --2- 172.21.15.22:0/884897026 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc938660 0x5589ccd1ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 -- 172.21.15.22:0/884897026 >> 172.21.15.22:0/884897026 conn(0x5589cc955910 msgr2=0x5589ccd0a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 -- 172.21.15.22:0/884897026 shutdown_connections 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 -- 172.21.15.22:0/884897026 wait complete. 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 -- start start 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 Processor -- start 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd175c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc940840 0x5589ccd17b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 0x5589ccd8e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481b1f30 con 0x5589cc938660 2024-09-21T04:08:25.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481b1860 con 0x5589cc940840 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6a481ae9e0 con 0x5589cc961520 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a569a7740 10 client.0 _ll_register_callbacks cb 0x7f6a44035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a4e1cf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd175c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a4e1cf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd175c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39184/0 (socket says 172.21.15.22:39184) 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.769+0000 7f6a4e1cf640 1 -- 172.21.15.22:0/684801458 learned_addr learned my addr 172.21.15.22:0/684801458 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a4e9d0640 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 0x5589ccd8e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc940840 0x5589ccd17b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a4e1cf640 1 -- 172.21.15.22:0/684801458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 msgr2=0x5589ccd8e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 0x5589ccd8e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a4e1cf640 1 -- 172.21.15.22:0/684801458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc940840 msgr2=0x5589ccd17b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc940840 0x5589ccd17b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a4e1cf640 1 -- 172.21.15.22:0/684801458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589ccd8ef80 con 0x5589cc938660 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a4e1cf640 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd175c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6a44000c00 tx=0x7f6a44009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458c9ce80ef16100 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a31ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a31ffb640 1 -- 172.21.15.22:0/684801458 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a44037030 con 0x5589cc938660 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a31ffb640 1 -- 172.21.15.22:0/684801458 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6a44004450 con 0x5589cc938660 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.770+0000 7f6a569a7740 1 -- 172.21.15.22:0/684801458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a4002c040 con 0x5589cc938660 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a31ffb640 1 -- 172.21.15.22:0/684801458 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f6a44005d00 con 0x5589cc938660 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a569a7740 10 client.15891 fetch_fsmap learned FSMap version 40 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a569a7740 1 -- 172.21.15.22:0/684801458 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x5589ccd901b0 con 0x5589cc938660 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a31ffb640 1 -- 172.21.15.22:0/684801458 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a4002c040 con 0x5589cc938660 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a31ffb640 1 -- 172.21.15.22:0/684801458 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f6a44005000 con 0x5589cc938660 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a569a7740 10 client.15891 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a569a7740 10 client.15891 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a569a7740 20 client.15891 populate_metadata read hostname 'smithi022' 2024-09-21T04:08:25.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a569a7740 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5589cc8f5250 0x5589ccd92950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a569a7740 4 client.15891 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1092dee5", "release": true, "await": true}] 2024-09-21T04:08:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a569a7740 1 -- 172.21.15.22:0/684801458 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1092dee5", "release": true, "await": true}) -- 0x5589ccc7a020 con 0x5589cc8f5250 2024-09-21T04:08:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.771+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5589cc8f5250 0x5589ccd92950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.772+0000 7f6a4d9ce640 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5589cc8f5250 0x5589ccd92950 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f2a9e5f315dbc43 server_cookie=757c8c1331b038e5 in_seq=0 out_seq=0 2024-09-21T04:08:25.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.772+0000 7f6a31ffb640 10 client.15891 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:25.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.816+0000 7f6a31ffb640 1 -- 172.21.15.22:0/684801458 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5589ccc7a020 con 0x5589cc8f5250 2024-09-21T04:08:25.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.816+0000 7f6a31ffb640 10 client.15891 handle_command_reply: tid=0 2024-09-21T04:08:25.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.816+0000 7f6a569a7740 1 client.15891 shutdown 2024-09-21T04:08:25.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 1 -- 172.21.15.22:0/684801458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 msgr2=0x5589ccd175c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:25.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd175c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f6a44000c00 tx=0x7f6a44009720 comp rx=0 tx=0).stop 2024-09-21T04:08:25.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 1 -- 172.21.15.22:0/684801458 shutdown_connections 2024-09-21T04:08:25.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5589cc8f5250 0x5589ccd92950 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a31ffb640 0 client.15891 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:25.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5589cc961520 0x5589ccd8e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5589cc940840 0x5589ccd17b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 1 --2- 172.21.15.22:0/684801458 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5589cc938660 0x5589ccd175c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 1 -- 172.21.15.22:0/684801458 >> 172.21.15.22:0/684801458 conn(0x5589cc955910 msgr2=0x5589ccd0a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:25.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 1 -- 172.21.15.22:0/684801458 shutdown_connections 2024-09-21T04:08:25.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 1 -- 172.21.15.22:0/684801458 wait complete. 2024-09-21T04:08:25.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.817+0000 7f6a569a7740 20 client.15891 trim_cache size 0 max 16384 2024-09-21T04:08:25.821 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:08:25.821 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 40, 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 24, 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "1092dee5": { 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 24, 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:08:25.822 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 139.2, 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:25.823 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:08:25.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 -- 172.21.15.22:0/99526758 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6a340b6510 msgr2=0x7f6a340b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:25.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6a340b6510 0x7f6a340b8a20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f6a40023000 tx=0x7f6a40020000 comp rx=0 tx=0).stop 2024-09-21T04:08:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 -- 172.21.15.22:0/99526758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a481094c0 msgr2=0x7f6a4819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a481094c0 0x7f6a4819a970 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f6a3800d750 tx=0x7f6a3800dc10 comp rx=0 tx=0).stop 2024-09-21T04:08:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 -- 172.21.15.22:0/99526758 shutdown_connections 2024-09-21T04:08:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6a340b6510 0x7f6a340b8a20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6a48109e10 0x7f6a4819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6a481094c0 0x7f6a4819a970 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 --2- 172.21.15.22:0/99526758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6a48103b80 0x7f6a4819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 -- 172.21.15.22:0/99526758 >> 172.21.15.22:0/99526758 conn(0x7f6a480ff610 msgr2=0x7f6a48101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 -- 172.21.15.22:0/99526758 shutdown_connections 2024-09-21T04:08:25.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:25.818+0000 7f6a50433640 1 -- 172.21.15.22:0/99526758 wait complete. 2024-09-21T04:08:26.568 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:26 smithi022 ceph-mon[31015]: pgmap v553: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 599 KiB/s wr, 85 op/s 2024-09-21T04:08:26.618 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1092dee5', total seconds elapsed: 22.9 2024-09-21T04:08:26.618 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 19.25 2024-09-21T04:08:26.618 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:08:26.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:26 smithi073 ceph-mon[34443]: pgmap v553: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 599 KiB/s wr, 85 op/s 2024-09-21T04:08:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:26 smithi060 ceph-mon[33722]: pgmap v553: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 599 KiB/s wr, 85 op/s 2024-09-21T04:08:27.024 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:08:27.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.609+0000 7f61adbc5640 1 -- 172.21.15.22:0/2843860103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61a00a2080 msgr2=0x7f61a00a2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:27.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.609+0000 7f61adbc5640 1 --2- 172.21.15.22:0/2843860103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61a00a2080 0x7f61a00a2490 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6194009900 tx=0x7f619402a400 comp rx=0 tx=0).stop 2024-09-21T04:08:27.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.609+0000 7f61adbc5640 1 -- 172.21.15.22:0/2843860103 shutdown_connections 2024-09-21T04:08:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.609+0000 7f61adbc5640 1 --2- 172.21.15.22:0/2843860103 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61a00a2080 0x7f61a00a2490 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.609+0000 7f61adbc5640 1 --2- 172.21.15.22:0/2843860103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a00a29d0 0x7f61a00a9200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.609+0000 7f61adbc5640 1 --2- 172.21.15.22:0/2843860103 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61a009c740 0x7f61a009cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.609+0000 7f61adbc5640 1 -- 172.21.15.22:0/2843860103 >> 172.21.15.22:0/2843860103 conn(0x7f61a0008c70 msgr2=0x7f61a0009080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.609+0000 7f61adbc5640 1 -- 172.21.15.22:0/2843860103 shutdown_connections 2024-09-21T04:08:27.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.609+0000 7f61adbc5640 1 -- 172.21.15.22:0/2843860103 wait complete. 2024-09-21T04:08:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.611+0000 7f61adbc5640 1 Processor -- start 2024-09-21T04:08:27.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.611+0000 7f61adbc5640 1 -- start start 2024-09-21T04:08:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.611+0000 7f61adbc5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a009c740 0x7f61a0132d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.612+0000 7f61adbc5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61a00a2080 0x7f61a0133330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.612+0000 7f61adbc5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61a00a29d0 0x7f61a01385d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.612+0000 7f61a7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61a00a2080 0x7f61a0133330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.612+0000 7f61a7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61a00a2080 0x7f61a0133330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:34038/0 (socket says 172.21.15.22:34038) 2024-09-21T04:08:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.612+0000 7f61a7fff640 1 -- 172.21.15.22:0/2816306463 learned_addr learned my addr 172.21.15.22:0/2816306463 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.612+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00ac500 con 0x7f61a009c740 2024-09-21T04:08:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.612+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00ac380 con 0x7f61a00a29d0 2024-09-21T04:08:27.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.612+0000 7f61ad3c4640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61a00a29d0 0x7f61a01385d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:27.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.612+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f61a00ac680 con 0x7f61a00a2080 2024-09-21T04:08:27.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.612+0000 7f61acbc3640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a009c740 0x7f61a0132d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:27.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.613+0000 7f61a7fff640 1 -- 172.21.15.22:0/2816306463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61a00a29d0 msgr2=0x7f61a01385d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:27.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.613+0000 7f61a7fff640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61a00a29d0 0x7f61a01385d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:27.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.613+0000 7f61a7fff640 1 -- 172.21.15.22:0/2816306463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a009c740 msgr2=0x7f61a0132d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:27.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.613+0000 7f61a7fff640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a009c740 0x7f61a0132d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:27.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.613+0000 7f61a7fff640 1 -- 172.21.15.22:0/2816306463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a0138d00 con 0x7f61a00a2080 2024-09-21T04:08:27.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.613+0000 7f61a7fff640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61a00a2080 0x7f61a0133330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f619402a920 tx=0x7f6194030650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:27.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.614+0000 7f61a5ffb640 1 -- 172.21.15.22:0/2816306463 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619403f070 con 0x7f61a00a2080 2024-09-21T04:08:27.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.614+0000 7f61a5ffb640 1 -- 172.21.15.22:0/2816306463 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6194004460 con 0x7f61a00a2080 2024-09-21T04:08:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.614+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a0138f90 con 0x7f61a00a2080 2024-09-21T04:08:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.614+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a01393b0 con 0x7f61a00a2080 2024-09-21T04:08:27.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.614+0000 7f61a5ffb640 1 -- 172.21.15.22:0/2816306463 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194035030 con 0x7f61a00a2080 2024-09-21T04:08:27.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.616+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f618c0052c0 con 0x7f61a00a2080 2024-09-21T04:08:27.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.617+0000 7f61a5ffb640 1 -- 172.21.15.22:0/2816306463 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6194042070 con 0x7f61a00a2080 2024-09-21T04:08:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.619+0000 7f61a5ffb640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61980b66e0 0x7f61980b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.619+0000 7f61a5ffb640 1 -- 172.21.15.22:0/2816306463 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6194107fe0 con 0x7f61a00a2080 2024-09-21T04:08:27.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.619+0000 7f61acbc3640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61980b66e0 0x7f61980b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:27.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.620+0000 7f61acbc3640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61980b66e0 0x7f61980b8bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f61a8051230 tx=0x7f61a8069570 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:27.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:27.624+0000 7f61a5ffb640 1 -- 172.21.15.22:0/2816306463 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f61940ce450 con 0x7f61a00a2080 2024-09-21T04:08:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.062+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f618c0055b0 con 0x7f61a00a2080 2024-09-21T04:08:28.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.063+0000 7f61a5ffb640 1 -- 172.21.15.22:0/2816306463 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11966 (secure 0 0 0) 0x7f61940d2830 con 0x7f61a00a2080 2024-09-21T04:08:28.067 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:08:28.068 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":40,"btime":"2024-09-21T04:07:10:355928+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:07:09.496163+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:08:28.068 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 40 2024-09-21T04:08:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.067+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61980b66e0 msgr2=0x7f61980b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.067+0000 7f61adbc5640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61980b66e0 0x7f61980b8bf0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f61a8051230 tx=0x7f61a8069570 comp rx=0 tx=0).stop 2024-09-21T04:08:28.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.067+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61a00a2080 msgr2=0x7f61a0133330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.067+0000 7f61adbc5640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61a00a2080 0x7f61a0133330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f619402a920 tx=0x7f6194030650 comp rx=0 tx=0).stop 2024-09-21T04:08:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.067+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 shutdown_connections 2024-09-21T04:08:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.067+0000 7f61adbc5640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61980b66e0 0x7f61980b8bf0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.067+0000 7f61adbc5640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f61a00a2080 0x7f61a0133330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.067+0000 7f61adbc5640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f61a00a29d0 0x7f61a01385d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.067+0000 7f61adbc5640 1 --2- 172.21.15.22:0/2816306463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f61a009c740 0x7f61a0132d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:28.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.067+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 >> 172.21.15.22:0/2816306463 conn(0x7f61a0008c70 msgr2=0x7f61a0005180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:28.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.068+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 shutdown_connections 2024-09-21T04:08:28.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:28.068+0000 7f61adbc5640 1 -- 172.21.15.22:0/2816306463 wait complete. 2024-09-21T04:08:28.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 245.0 s, 433.9 tps, lat 809.552 ms stddev 3272.412 2024-09-21T04:08:28.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:28 smithi022 ceph-mon[31015]: pgmap v554: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.7 MiB/s wr, 69 op/s 2024-09-21T04:08:28.754 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:28 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2816306463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:28.806 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0' 2024-09-21T04:08:28.806 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 139.25 --await-for 45.0 2024-09-21T04:08:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:28 smithi073 ceph-mon[34443]: pgmap v554: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.7 MiB/s wr, 69 op/s 2024-09-21T04:08:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:28 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2816306463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:28 smithi060 ceph-mon[33722]: pgmap v554: 129 pgs: 129 active+clean; 1.0 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.7 MiB/s wr, 69 op/s 2024-09-21T04:08:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:28 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2816306463' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:29.206 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:08:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.791+0000 7f84a0ced640 1 -- 172.21.15.22:0/2606463250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c103110 msgr2=0x7f849c107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.791+0000 7f84a0ced640 1 --2- 172.21.15.22:0/2606463250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c103110 0x7f849c107640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f848c009900 tx=0x7f848c02a410 comp rx=0 tx=0).stop 2024-09-21T04:08:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.791+0000 7f84a0ced640 1 -- 172.21.15.22:0/2606463250 shutdown_connections 2024-09-21T04:08:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.791+0000 7f84a0ced640 1 --2- 172.21.15.22:0/2606463250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c103110 0x7f849c107640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.791+0000 7f84a0ced640 1 --2- 172.21.15.22:0/2606463250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849c107c00 0x7f849c1080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.791+0000 7f84a0ced640 1 --2- 172.21.15.22:0/2606463250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f849c1027c0 0x7f849c102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.791+0000 7f84a0ced640 1 -- 172.21.15.22:0/2606463250 >> 172.21.15.22:0/2606463250 conn(0x7f849c079760 msgr2=0x7f849c079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.791+0000 7f84a0ced640 1 -- 172.21.15.22:0/2606463250 shutdown_connections 2024-09-21T04:08:29.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.791+0000 7f84a0ced640 1 -- 172.21.15.22:0/2606463250 wait complete. 2024-09-21T04:08:29.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f84a0ced640 1 Processor -- start 2024-09-21T04:08:29.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f84a0ced640 1 -- start start 2024-09-21T04:08:29.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f84a0ced640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c1027c0 0x7f849c1a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f84a0ced640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849c103110 0x7f849c1a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f84a0ced640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f849c107c00 0x7f849c1a6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f84a0ced640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f849c119f10 con 0x7f849c103110 2024-09-21T04:08:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f84a0ced640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f849c119d90 con 0x7f849c107c00 2024-09-21T04:08:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f84a0ced640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f849c11a090 con 0x7f849c1027c0 2024-09-21T04:08:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f849a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c1027c0 0x7f849c1a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f849a59c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c1027c0 0x7f849c1a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:34056/0 (socket says 172.21.15.22:34056) 2024-09-21T04:08:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.793+0000 7f849a59c640 1 -- 172.21.15.22:0/3781548766 learned_addr learned my addr 172.21.15.22:0/3781548766 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:29.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.794+0000 7f849ad9d640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f849c107c00 0x7f849c1a6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.794+0000 7f8499d9b640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849c103110 0x7f849c1a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.794+0000 7f849a59c640 1 -- 172.21.15.22:0/3781548766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f849c107c00 msgr2=0x7f849c1a6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.794+0000 7f849a59c640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f849c107c00 0x7f849c1a6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.794+0000 7f849a59c640 1 -- 172.21.15.22:0/3781548766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849c103110 msgr2=0x7f849c1a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.794+0000 7f849a59c640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849c103110 0x7f849c1a0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.794+0000 7f849a59c640 1 -- 172.21.15.22:0/3781548766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c1a6900 con 0x7f849c1027c0 2024-09-21T04:08:29.798 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.795+0000 7f849a59c640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c1027c0 0x7f849c1a09c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f849000e9c0 tx=0x7f849000edc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.795+0000 7f848b7fe640 1 -- 172.21.15.22:0/3781548766 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849000ccc0 con 0x7f849c1027c0 2024-09-21T04:08:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.795+0000 7f848b7fe640 1 -- 172.21.15.22:0/3781548766 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84900044b0 con 0x7f849c1027c0 2024-09-21T04:08:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.795+0000 7f84a0ced640 1 -- 172.21.15.22:0/3781548766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849c1a6bf0 con 0x7f849c1027c0 2024-09-21T04:08:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.795+0000 7f84a0ced640 1 -- 172.21.15.22:0/3781548766 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849c108c10 con 0x7f849c1027c0 2024-09-21T04:08:29.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.795+0000 7f848b7fe640 1 -- 172.21.15.22:0/3781548766 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849000ccc0 con 0x7f849c1027c0 2024-09-21T04:08:29.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.799+0000 7f84a7261740 1 Processor -- start 2024-09-21T04:08:29.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.799+0000 7f84a7261740 1 -- start start 2024-09-21T04:08:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.799+0000 7f84a7261740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838784e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.800+0000 7f84a7261740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383b5990 0x5628387853b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.800+0000 7f84a7261740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 0x5628387858f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.800+0000 7f84a7261740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5628386fbbb0 con 0x5628383de850 2024-09-21T04:08:29.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.800+0000 7f84a7261740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5628386eafe0 con 0x5628383bdb70 2024-09-21T04:08:29.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.800+0000 7f84a7261740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5628386eedf0 con 0x5628383b5990 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.800+0000 7f8499d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 0x5628387858f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.800+0000 7f849ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838784e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.800+0000 7f8499d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 0x5628387858f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:57102/0 (socket says 172.21.15.22:57102) 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.800+0000 7f8499d9b640 1 -- 172.21.15.22:0/578570993 learned_addr learned my addr 172.21.15.22:0/578570993 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.801+0000 7f8499d9b640 1 -- 172.21.15.22:0/578570993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383b5990 msgr2=0x5628387853b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.801+0000 7f8499d9b640 1 --2- 172.21.15.22:0/578570993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383b5990 0x5628387853b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.801+0000 7f8499d9b640 1 -- 172.21.15.22:0/578570993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 msgr2=0x562838784e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.801+0000 7f8499d9b640 1 --2- 172.21.15.22:0/578570993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838784e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.801+0000 7f8499d9b640 1 -- 172.21.15.22:0/578570993 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562838458ba0 con 0x5628383bdb70 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.801+0000 7f8499d9b640 1 --2- 172.21.15.22:0/578570993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 0x5628387858f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f848c000c00 tx=0x7f848c031490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1f90a136227a7e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.801+0000 7f848b7fe640 1 -- 172.21.15.22:0/3781548766 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8490003be0 con 0x7f849c1027c0 2024-09-21T04:08:29.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.802+0000 7f8488ff9640 1 -- 172.21.15.22:0/578570993 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c035030 con 0x5628383bdb70 2024-09-21T04:08:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.802+0000 7f8488ff9640 1 -- 172.21.15.22:0/578570993 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f848c004030 con 0x5628383bdb70 2024-09-21T04:08:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.802+0000 7f8488ff9640 1 -- 172.21.15.22:0/578570993 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c0053c0 con 0x5628383bdb70 2024-09-21T04:08:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.803+0000 7f84a7261740 1 -- 172.21.15.22:0/578570993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 msgr2=0x5628387858f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:29.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.803+0000 7f84a7261740 1 --2- 172.21.15.22:0/578570993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 0x5628387858f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f848c000c00 tx=0x7f848c031490 comp rx=0 tx=0).stop 2024-09-21T04:08:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.804+0000 7f848b7fe640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f84840b6740 0x7f84840b8c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.804+0000 7f848b7fe640 1 -- 172.21.15.22:0/3781548766 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f84900e7580 con 0x7f849c1027c0 2024-09-21T04:08:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.804+0000 7f849ad9d640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f84840b6740 0x7f84840b8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.804+0000 7f84a7261740 1 -- 172.21.15.22:0/578570993 shutdown_connections 2024-09-21T04:08:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.804+0000 7f84a7261740 1 --2- 172.21.15.22:0/578570993 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383b5990 0x5628387853b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.804+0000 7f84a7261740 1 --2- 172.21.15.22:0/578570993 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 0x5628387858f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.804+0000 7f84a7261740 1 --2- 172.21.15.22:0/578570993 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838784e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.804+0000 7f84a7261740 1 -- 172.21.15.22:0/578570993 >> 172.21.15.22:0/578570993 conn(0x5628383d2c40 msgr2=0x562838782d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.805+0000 7f84a7261740 1 -- 172.21.15.22:0/578570993 shutdown_connections 2024-09-21T04:08:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.805+0000 7f84a7261740 1 -- 172.21.15.22:0/578570993 wait complete. 2024-09-21T04:08:29.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.805+0000 7f84a7261740 1 -- start start 2024-09-21T04:08:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.806+0000 7f84a7261740 1 Processor -- start 2024-09-21T04:08:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.806+0000 7f849ad9d640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f84840b6740 0x7f84840b8c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8494005fd0 tx=0x7f8494009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.806+0000 7f84a7261740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383b5990 0x562838790a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.806+0000 7f84a7261740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 0x562838790f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.806+0000 7f84a7261740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x56283879c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.806+0000 7f84a7261740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56283854c7b0 con 0x5628383de850 2024-09-21T04:08:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.806+0000 7f84a7261740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562838685e90 con 0x5628383bdb70 2024-09-21T04:08:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.806+0000 7f84a7261740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x562838793640 con 0x5628383b5990 2024-09-21T04:08:29.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.806+0000 7f84a7261740 10 client.0 _ll_register_callbacks cb 0x5628386e8710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.807+0000 7f849ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x56283879c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.807+0000 7f8499d9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 0x562838790f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.807+0000 7f849ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x56283879c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39238/0 (socket says 172.21.15.22:39238) 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.807+0000 7f849ad9d640 1 -- 172.21.15.22:0/2243762610 learned_addr learned my addr 172.21.15.22:0/2243762610 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.807+0000 7f849a59c640 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383b5990 0x562838790a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.808+0000 7f849ad9d640 1 -- 172.21.15.22:0/2243762610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383b5990 msgr2=0x562838790a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.808+0000 7f849ad9d640 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383b5990 0x562838790a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.808+0000 7f849ad9d640 1 -- 172.21.15.22:0/2243762610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 msgr2=0x562838790f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.808+0000 7f849ad9d640 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 0x562838790f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.808+0000 7f849ad9d640 1 -- 172.21.15.22:0/2243762610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56283879cf00 con 0x5628383de850 2024-09-21T04:08:29.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.808+0000 7f849a59c640 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383b5990 0x562838790a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:08:29.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.808+0000 7f849ad9d640 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x56283879c9c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f849401e9f0 tx=0x7f8494004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e752aeac2d6106b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:29.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.808+0000 7f8481ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:08:29.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.809+0000 7f8481ffb640 1 -- 172.21.15.22:0/2243762610 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849402e060 con 0x5628383de850 2024-09-21T04:08:29.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.809+0000 7f84a7261740 1 -- 172.21.15.22:0/2243762610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f848c004030 con 0x5628383de850 2024-09-21T04:08:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.809+0000 7f8481ffb640 1 -- 172.21.15.22:0/2243762610 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f8494018030 con 0x5628383de850 2024-09-21T04:08:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.809+0000 7f8481ffb640 1 -- 172.21.15.22:0/2243762610 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f8494035050 con 0x5628383de850 2024-09-21T04:08:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.809+0000 7f84a7261740 10 client.15909 fetch_fsmap learned FSMap version 40 2024-09-21T04:08:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.809+0000 7f84a7261740 1 -- 172.21.15.22:0/2243762610 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x56283879f910 con 0x5628383de850 2024-09-21T04:08:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.810+0000 7f8481ffb640 1 -- 172.21.15.22:0/2243762610 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f848c004030 con 0x5628383de850 2024-09-21T04:08:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.810+0000 7f8481ffb640 1 -- 172.21.15.22:0/2243762610 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f84940295d0 con 0x5628383de850 2024-09-21T04:08:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.810+0000 7f84a7261740 10 client.15909 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:08:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.810+0000 7f84a7261740 10 client.15909 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:08:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.810+0000 7f84a7261740 20 client.15909 populate_metadata read hostname 'smithi022' 2024-09-21T04:08:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.810+0000 7f84a7261740 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56283839d1d0 0x5628387a2e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.810+0000 7f84a7261740 4 client.15909 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:08:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.810+0000 7f84a7261740 1 -- 172.21.15.22:0/2243762610 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628386fdb00 con 0x56283839d1d0 2024-09-21T04:08:29.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.811+0000 7f849a59c640 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56283839d1d0 0x5628387a2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.812+0000 7f849a59c640 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56283839d1d0 0x5628387a2e10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8227c4ff79500168 server_cookie=81318669b01b270f in_seq=0 out_seq=0 2024-09-21T04:08:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.812+0000 7f8481ffb640 10 client.15909 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.812+0000 7f8481ffb640 1 -- 172.21.15.22:0/2243762610 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5628386fdb00 con 0x56283839d1d0 2024-09-21T04:08:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.812+0000 7f8481ffb640 10 client.15909 handle_command_reply: tid=0 2024-09-21T04:08:29.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.812+0000 7f84a7261740 1 client.15909 shutdown 2024-09-21T04:08:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f84a7261740 1 -- 172.21.15.22:0/2243762610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 msgr2=0x56283879c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f84a7261740 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x56283879c9c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f849401e9f0 tx=0x7f8494004ab0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f84a7261740 1 -- 172.21.15.22:0/2243762610 shutdown_connections 2024-09-21T04:08:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f84a7261740 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56283839d1d0 0x5628387a2e10 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f84a7261740 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x56283879c9c0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f84a7261740 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383bdb70 0x562838790f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f84a7261740 1 --2- 172.21.15.22:0/2243762610 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383b5990 0x562838790a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f84a7261740 1 -- 172.21.15.22:0/2243762610 >> 172.21.15.22:0/2243762610 conn(0x5628383d2c40 msgr2=0x562838788000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f8481ffb640 0 client.15909 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f84a7261740 1 -- 172.21.15.22:0/2243762610 shutdown_connections 2024-09-21T04:08:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.813+0000 7f84a7261740 1 -- 172.21.15.22:0/2243762610 wait complete. 2024-09-21T04:08:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.814+0000 7f84a7261740 20 client.15909 trim_cache size 0 max 16384 2024-09-21T04:08:29.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.846+0000 7f84a7261740 1 Processor -- start 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.846+0000 7f84a7261740 1 -- start start 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.846+0000 7f84a7261740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 0x56283879c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.846+0000 7f84a7261740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 0x56283878f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.846+0000 7f84a7261740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838789f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.846+0000 7f84a7261740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f847c00fc40 con 0x5628383de850 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.846+0000 7f84a7261740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f847c011840 con 0x5628383b5990 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.846+0000 7f84a7261740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f847c010310 con 0x5628383bdb70 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.846+0000 7f849a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 0x56283879c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.846+0000 7f849a59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 0x56283879c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:57122/0 (socket says 172.21.15.22:57122) 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.847+0000 7f849a59c640 1 -- 172.21.15.22:0/3321212615 learned_addr learned my addr 172.21.15.22:0/3321212615 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.847+0000 7f8499d9b640 1 --2- 172.21.15.22:0/3321212615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 0x56283878f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.847+0000 7f849ad9d640 1 --2- 172.21.15.22:0/3321212615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838789f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.847+0000 7f849a59c640 1 -- 172.21.15.22:0/3321212615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 msgr2=0x56283878f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.847+0000 7f849a59c640 1 --2- 172.21.15.22:0/3321212615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 0x56283878f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.847+0000 7f849a59c640 1 -- 172.21.15.22:0/3321212615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 msgr2=0x562838789f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.847+0000 7f849a59c640 1 --2- 172.21.15.22:0/3321212615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838789f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.847+0000 7f849a59c640 1 -- 172.21.15.22:0/3321212615 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56283878c0e0 con 0x5628383b5990 2024-09-21T04:08:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.847+0000 7f849a59c640 1 --2- 172.21.15.22:0/3321212615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 0x56283879c8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f849000c6a0 tx=0x7f84900a9ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f6d31a575f972d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.848+0000 7f8483fff640 1 -- 172.21.15.22:0/3321212615 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8490094040 con 0x5628383b5990 2024-09-21T04:08:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.848+0000 7f8483fff640 1 -- 172.21.15.22:0/3321212615 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f84900e6040 con 0x5628383b5990 2024-09-21T04:08:29.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.848+0000 7f8483fff640 1 -- 172.21.15.22:0/3321212615 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84900a95c0 con 0x5628383b5990 2024-09-21T04:08:29.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.849+0000 7f84a7261740 1 -- 172.21.15.22:0/3321212615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 msgr2=0x56283879c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:29.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.849+0000 7f84a7261740 1 --2- 172.21.15.22:0/3321212615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 0x56283879c8c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f849000c6a0 tx=0x7f84900a9ab0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.849+0000 7f84a7261740 1 -- 172.21.15.22:0/3321212615 shutdown_connections 2024-09-21T04:08:29.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.849+0000 7f84a7261740 1 --2- 172.21.15.22:0/3321212615 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 0x56283878f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.849+0000 7f84a7261740 1 --2- 172.21.15.22:0/3321212615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838789f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.849+0000 7f84a7261740 1 --2- 172.21.15.22:0/3321212615 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 0x56283879c8c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.849+0000 7f84a7261740 1 -- 172.21.15.22:0/3321212615 >> 172.21.15.22:0/3321212615 conn(0x5628383d2c40 msgr2=0x562838790a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:29.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.849+0000 7f84a7261740 1 -- 172.21.15.22:0/3321212615 shutdown_connections 2024-09-21T04:08:29.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.849+0000 7f84a7261740 1 -- 172.21.15.22:0/3321212615 wait complete. 2024-09-21T04:08:29.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.850+0000 7f84a7261740 1 -- start start 2024-09-21T04:08:29.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.850+0000 7f84a7261740 1 Processor -- start 2024-09-21T04:08:29.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.850+0000 7f84a7261740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 0x562838798bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f84a7261740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 0x5628387991a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f84a7261740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838793900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f84a7261740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f847c011170 con 0x5628383de850 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f84a7261740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f847c010aa0 con 0x5628383b5990 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f84a7261740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f847c00dc20 con 0x5628383bdb70 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f8499d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 0x5628387991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f8499d9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 0x5628387991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:34092/0 (socket says 172.21.15.22:34092) 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f8499d9b640 1 -- 172.21.15.22:0/1051963070 learned_addr learned my addr 172.21.15.22:0/1051963070 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f849a59c640 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 0x562838798bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f8499d9b640 1 -- 172.21.15.22:0/1051963070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 msgr2=0x562838798bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f8499d9b640 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 0x562838798bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f8499d9b640 1 -- 172.21.15.22:0/1051963070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 msgr2=0x562838793900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f8499d9b640 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838793900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f8499d9b640 1 -- 172.21.15.22:0/1051963070 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562838794090 con 0x5628383bdb70 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.851+0000 7f84a7261740 10 client.0 _ll_register_callbacks cb 0x7f8494009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:08:29.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.852+0000 7f84a7261740 1 -- 172.21.15.22:0/1051963070 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f84900e6040 con 0x5628383bdb70 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.852+0000 7f8499d9b640 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 0x5628387991a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f848c000c00 tx=0x7f848c031de0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bd9a5fcdcda8eb39 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.852+0000 7f8481ffb640 10 client.25540 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.852+0000 7f8481ffb640 1 -- 172.21.15.22:0/1051963070 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f848c035040 con 0x5628383bdb70 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.852+0000 7f8481ffb640 1 -- 172.21.15.22:0/1051963070 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f848c004450 con 0x5628383bdb70 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.852+0000 7f8481ffb640 1 -- 172.21.15.22:0/1051963070 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f848c005040 con 0x5628383bdb70 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.852+0000 7f84a7261740 10 client.25540 fetch_fsmap learned FSMap version 40 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.853+0000 7f84a7261740 1 -- 172.21.15.22:0/1051963070 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({fsmap=40}) -- 0x56283880e0c0 con 0x5628383bdb70 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.853+0000 7f8481ffb640 1 -- 172.21.15.22:0/1051963070 <== mon.1 v2:172.21.15.73:3300/0 4 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7f848c0051e0 con 0x5628383bdb70 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.853+0000 7f84a7261740 10 client.25540 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.853+0000 7f84a7261740 10 client.25540 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.853+0000 7f84a7261740 20 client.25540 populate_metadata read hostname 'smithi022' 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.853+0000 7f84a7261740 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562838372580 0x562838810300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.853+0000 7f84a7261740 4 client.25540 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}] 2024-09-21T04:08:29.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.853+0000 7f84a7261740 1 -- 172.21.15.22:0/1051963070 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 139.25, "await_for": 45.0}) -- 0x5628386f95b0 con 0x562838372580 2024-09-21T04:08:29.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.854+0000 7f849a59c640 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562838372580 0x562838810300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:29.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.854+0000 7f849a59c640 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562838372580 0x562838810300 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97c2f52e21d41228 server_cookie=62d5b6786e27d44f in_seq=0 out_seq=0 2024-09-21T04:08:29.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:29.854+0000 7f8481ffb640 10 client.25540 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f8481ffb640 1 -- 172.21.15.22:0/1051963070 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5628386f95b0 con 0x562838372580 2024-09-21T04:08:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f8481ffb640 10 client.25540 handle_command_reply: tid=0 2024-09-21T04:08:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 client.25540 shutdown 2024-09-21T04:08:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 -- 172.21.15.22:0/1051963070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 msgr2=0x5628387991a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 0x5628387991a0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f848c000c00 tx=0x7f848c031de0 comp rx=0 tx=0).stop 2024-09-21T04:08:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 -- 172.21.15.22:0/1051963070 shutdown_connections 2024-09-21T04:08:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562838372580 0x562838810300 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5628383bdb70 0x5628387991a0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5628383de850 0x562838793900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:30.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f8481ffb640 0 client.25540 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:30.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 --2- 172.21.15.22:0/1051963070 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5628383b5990 0x562838798bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:30.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 -- 172.21.15.22:0/1051963070 >> 172.21.15.22:0/1051963070 conn(0x5628383d2c40 msgr2=0x562838787f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:30.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 -- 172.21.15.22:0/1051963070 shutdown_connections 2024-09-21T04:08:30.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 1 -- 172.21.15.22:0/1051963070 wait complete. 2024-09-21T04:08:30.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a7261740 20 client.25540 trim_cache size 0 max 16384 2024-09-21T04:08:30.163 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:08:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 40, 2024-09-21T04:08:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:08:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 26, 2024-09-21T04:08:30.163 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "d077d2cc": { 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 26, 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 139.2, 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:08:30.164 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:08:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:08:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:08:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:30.165 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:30.165 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:08:30.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a0ced640 1 -- 172.21.15.22:0/3781548766 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f84840b6740 msgr2=0x7f84840b8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:30.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a0ced640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f84840b6740 0x7f84840b8c50 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8494005fd0 tx=0x7f8494009500 comp rx=0 tx=0).stop 2024-09-21T04:08:30.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a0ced640 1 -- 172.21.15.22:0/3781548766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c1027c0 msgr2=0x7f849c1a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:30.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a0ced640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c1027c0 0x7f849c1a09c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f849000e9c0 tx=0x7f849000edc0 comp rx=0 tx=0).stop 2024-09-21T04:08:30.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a0ced640 1 -- 172.21.15.22:0/3781548766 shutdown_connections 2024-09-21T04:08:30.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a0ced640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f84840b6740 0x7f84840b8c50 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:30.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a0ced640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f849c107c00 0x7f849c1a6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:30.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a0ced640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f849c103110 0x7f849c1a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:30.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a0ced640 1 --2- 172.21.15.22:0/3781548766 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f849c1027c0 0x7f849c1a09c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:30.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.159+0000 7f84a0ced640 1 -- 172.21.15.22:0/3781548766 >> 172.21.15.22:0/3781548766 conn(0x7f849c079760 msgr2=0x7f849c105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:30.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.160+0000 7f84a0ced640 1 -- 172.21.15.22:0/3781548766 shutdown_connections 2024-09-21T04:08:30.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:30.160+0000 7f84a0ced640 1 -- 172.21.15.22:0/3781548766 wait complete. 2024-09-21T04:08:30.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:30 smithi022 ceph-mon[31015]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.0 MiB/s wr, 68 op/s 2024-09-21T04:08:30.853 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd077d2cc', quiesce took 4.2 seconds. Will release after: 15.05 2024-09-21T04:08:30.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:30 smithi073 ceph-mon[34443]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.0 MiB/s wr, 68 op/s 2024-09-21T04:08:30.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:30 smithi060 ceph-mon[33722]: pgmap v555: 129 pgs: 129 active+clean; 1.1 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 2.0 MiB/s wr, 68 op/s 2024-09-21T04:08:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:32 smithi022 ceph-mon[31015]: pgmap v556: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.9 MiB/s wr, 180 op/s 2024-09-21T04:08:32.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:32 smithi073 ceph-mon[34443]: pgmap v556: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.9 MiB/s wr, 180 op/s 2024-09-21T04:08:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:32 smithi060 ceph-mon[33722]: pgmap v556: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.9 MiB/s wr, 180 op/s 2024-09-21T04:08:33.707 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 250.0 s, 236.5 tps, lat 132.790 ms stddev 255.156 2024-09-21T04:08:34.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:34 smithi022 ceph-mon[31015]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.9 MiB/s wr, 265 op/s 2024-09-21T04:08:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:34 smithi073 ceph-mon[34443]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.9 MiB/s wr, 265 op/s 2024-09-21T04:08:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:34 smithi060 ceph-mon[33722]: pgmap v557: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 6.9 MiB/s wr, 265 op/s 2024-09-21T04:08:36.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:36 smithi022 ceph-mon[31015]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.8 MiB/s wr, 264 op/s 2024-09-21T04:08:36.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:36 smithi073 ceph-mon[34443]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.8 MiB/s wr, 264 op/s 2024-09-21T04:08:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:36 smithi060 ceph-mon[33722]: pgmap v558: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.8 MiB/s wr, 264 op/s 2024-09-21T04:08:38.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 255.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:08:38.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:38 smithi022 ceph-mon[31015]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.8 MiB/s wr, 263 op/s 2024-09-21T04:08:38.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:38 smithi073 ceph-mon[34443]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.8 MiB/s wr, 263 op/s 2024-09-21T04:08:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:38 smithi060 ceph-mon[33722]: pgmap v559: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.8 MiB/s wr, 263 op/s 2024-09-21T04:08:40.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:40 smithi022 ceph-mon[31015]: pgmap v560: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.4 MiB/s wr, 234 op/s 2024-09-21T04:08:40.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:40 smithi073 ceph-mon[34443]: pgmap v560: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.4 MiB/s wr, 234 op/s 2024-09-21T04:08:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:40 smithi060 ceph-mon[33722]: pgmap v560: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.4 MiB/s wr, 234 op/s 2024-09-21T04:08:42.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:42 smithi022 ceph-mon[31015]: pgmap v561: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.0 MiB/s wr, 226 op/s 2024-09-21T04:08:42.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:42 smithi073 ceph-mon[34443]: pgmap v561: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.0 MiB/s wr, 226 op/s 2024-09-21T04:08:42.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:42 smithi060 ceph-mon[33722]: pgmap v561: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 5.0 MiB/s wr, 226 op/s 2024-09-21T04:08:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 260.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:08:44.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:44 smithi022 ceph-mon[31015]: pgmap v562: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.1 MiB/s wr, 119 op/s 2024-09-21T04:08:44.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:44 smithi073 ceph-mon[34443]: pgmap v562: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.1 MiB/s wr, 119 op/s 2024-09-21T04:08:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:44 smithi060 ceph-mon[33722]: pgmap v562: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 3.1 MiB/s wr, 119 op/s 2024-09-21T04:08:45.903 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:08:46.180 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:08:46.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.650+0000 7f9f81b75640 1 -- 172.21.15.22:0/1391006648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c109e20 msgr2=0x7f9f7c110650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:46.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.650+0000 7f9f81b75640 1 --2- 172.21.15.22:0/1391006648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c109e20 0x7f9f7c110650 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f9f74009900 tx=0x7f9f7402a410 comp rx=0 tx=0).stop 2024-09-21T04:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.650+0000 7f9f81b75640 1 -- 172.21.15.22:0/1391006648 shutdown_connections 2024-09-21T04:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.650+0000 7f9f81b75640 1 --2- 172.21.15.22:0/1391006648 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c1094d0 0x7f9f7c1098e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.650+0000 7f9f81b75640 1 --2- 172.21.15.22:0/1391006648 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c109e20 0x7f9f7c110650 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.650+0000 7f9f81b75640 1 --2- 172.21.15.22:0/1391006648 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c103b90 0x7f9f7c103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.650+0000 7f9f81b75640 1 -- 172.21.15.22:0/1391006648 >> 172.21.15.22:0/1391006648 conn(0x7f9f7c0ff600 msgr2=0x7f9f7c101a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.650+0000 7f9f81b75640 1 -- 172.21.15.22:0/1391006648 shutdown_connections 2024-09-21T04:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.650+0000 7f9f81b75640 1 -- 172.21.15.22:0/1391006648 wait complete. 2024-09-21T04:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.651+0000 7f9f81b75640 1 Processor -- start 2024-09-21T04:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.651+0000 7f9f81b75640 1 -- start start 2024-09-21T04:08:46.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f81b75640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c103b90 0x7f9f7c19a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f81b75640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c1094d0 0x7f9f7c19a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f81b75640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c109e20 0x7f9f7c19fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f81b75640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c113990 con 0x7f9f7c1094d0 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f81b75640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c113810 con 0x7f9f7c103b90 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f81b75640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c113b10 con 0x7f9f7c109e20 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c1094d0 0x7f9f7c19a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c1094d0 0x7f9f7c19a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42162/0 (socket says 172.21.15.22:42162) 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7affd640 1 -- 172.21.15.22:0/24453894 learned_addr learned my addr 172.21.15.22:0/24453894 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7b7fe640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c103b90 0x7f9f7c19a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7bfff640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c109e20 0x7f9f7c19fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7affd640 1 -- 172.21.15.22:0/24453894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c109e20 msgr2=0x7f9f7c19fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7affd640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c109e20 0x7f9f7c19fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7affd640 1 -- 172.21.15.22:0/24453894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c103b90 msgr2=0x7f9f7c19a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:46.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7affd640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c103b90 0x7f9f7c19a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:46.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7affd640 1 -- 172.21.15.22:0/24453894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c1a02f0 con 0x7f9f7c1094d0 2024-09-21T04:08:46.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.652+0000 7f9f7affd640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c1094d0 0x7f9f7c19a920 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800eb90 tx=0x7f9f6800c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:46.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.653+0000 7f9f78ff9640 1 -- 172.21.15.22:0/24453894 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68004d20 con 0x7f9f7c1094d0 2024-09-21T04:08:46.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.653+0000 7f9f78ff9640 1 -- 172.21.15.22:0/24453894 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f6800ee90 con 0x7f9f7c1094d0 2024-09-21T04:08:46.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.653+0000 7f9f81b75640 1 -- 172.21.15.22:0/24453894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f7c1a05e0 con 0x7f9f7c1094d0 2024-09-21T04:08:46.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.653+0000 7f9f78ff9640 1 -- 172.21.15.22:0/24453894 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68010670 con 0x7f9f7c1094d0 2024-09-21T04:08:46.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.653+0000 7f9f81b75640 1 -- 172.21.15.22:0/24453894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f7c1a6d40 con 0x7f9f7c1094d0 2024-09-21T04:08:46.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.654+0000 7f9f81b75640 1 -- 172.21.15.22:0/24453894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f7c103fa0 con 0x7f9f7c1094d0 2024-09-21T04:08:46.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.656+0000 7f9f78ff9640 1 -- 172.21.15.22:0/24453894 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9f68005020 con 0x7f9f7c1094d0 2024-09-21T04:08:46.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.658+0000 7f9f78ff9640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f600b6590 0x7f9f600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:46.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.658+0000 7f9f7b7fe640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f600b6590 0x7f9f600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:46.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.658+0000 7f9f78ff9640 1 -- 172.21.15.22:0/24453894 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f9f680e7e60 con 0x7f9f7c1094d0 2024-09-21T04:08:46.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.658+0000 7f9f7b7fe640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f600b6590 0x7f9f600b8aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c005d00 tx=0x7f9f6c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:46.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.662+0000 7f9f78ff9640 1 -- 172.21.15.22:0/24453894 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f680ae2d0 con 0x7f9f7c1094d0 2024-09-21T04:08:46.832 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:46 smithi022 ceph-mon[31015]: pgmap v563: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-09-21T04:08:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:46 smithi073 ceph-mon[34443]: pgmap v563: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-09-21T04:08:46.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.888+0000 7f9f81b75640 1 -- 172.21.15.22:0/24453894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f7c19b4b0 con 0x7f9f7c1094d0 2024-09-21T04:08:46.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.889+0000 7f9f78ff9640 1 -- 172.21.15.22:0/24453894 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+11966 (secure 0 0 0) 0x7f9f680b26b0 con 0x7f9f7c1094d0 2024-09-21T04:08:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:08:46.893 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":40,"btime":"2024-09-21T04:07:10:355928+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":40,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:07:09.496163+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[0,1,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:08:46.893 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 40 2024-09-21T04:08:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.891+0000 7f9f81b75640 1 -- 172.21.15.22:0/24453894 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f600b6590 msgr2=0x7f9f600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.891+0000 7f9f81b75640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f600b6590 0x7f9f600b8aa0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c005d00 tx=0x7f9f6c00b410 comp rx=0 tx=0).stop 2024-09-21T04:08:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.891+0000 7f9f81b75640 1 -- 172.21.15.22:0/24453894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c1094d0 msgr2=0x7f9f7c19a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.891+0000 7f9f81b75640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c1094d0 0x7f9f7c19a920 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800eb90 tx=0x7f9f6800c6a0 comp rx=0 tx=0).stop 2024-09-21T04:08:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.892+0000 7f9f81b75640 1 -- 172.21.15.22:0/24453894 shutdown_connections 2024-09-21T04:08:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.892+0000 7f9f81b75640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f600b6590 0x7f9f600b8aa0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.892+0000 7f9f81b75640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f7c109e20 0x7f9f7c19fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.892+0000 7f9f81b75640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c1094d0 0x7f9f7c19a920 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:46.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.892+0000 7f9f81b75640 1 --2- 172.21.15.22:0/24453894 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f7c103b90 0x7f9f7c19a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.892+0000 7f9f81b75640 1 -- 172.21.15.22:0/24453894 >> 172.21.15.22:0/24453894 conn(0x7f9f7c0ff600 msgr2=0x7f9f7c101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.892+0000 7f9f81b75640 1 -- 172.21.15.22:0/24453894 shutdown_connections 2024-09-21T04:08:46.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:46.892+0000 7f9f81b75640 1 -- 172.21.15.22:0/24453894 wait complete. 2024-09-21T04:08:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:46 smithi060 ceph-mon[33722]: pgmap v563: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 131 KiB/s wr, 30 op/s 2024-09-21T04:08:47.554 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id d077d2cc --release --await' 2024-09-21T04:08:47.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id d077d2cc --release --await 2024-09-21T04:08:47.819 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:08:47.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:47 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/24453894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:47.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:47 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/24453894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:47.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:47 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/24453894' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:08:48.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.342+0000 7fc6da396640 1 -- 172.21.15.22:0/1874503819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d4108d00 msgr2=0x7fc6d410f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:48.353 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.342+0000 7fc6da396640 1 --2- 172.21.15.22:0/1874503819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d4108d00 0x7fc6d410f530 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009ca0 tx=0x7fc6cc02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.342+0000 7fc6da396640 1 -- 172.21.15.22:0/1874503819 shutdown_connections 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.342+0000 7fc6da396640 1 --2- 172.21.15.22:0/1874503819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6d41083b0 0x7fc6d41087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.342+0000 7fc6da396640 1 --2- 172.21.15.22:0/1874503819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d4108d00 0x7fc6d410f530 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.342+0000 7fc6da396640 1 --2- 172.21.15.22:0/1874503819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6d4102ac0 0x7fc6d4102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.342+0000 7fc6da396640 1 -- 172.21.15.22:0/1874503819 >> 172.21.15.22:0/1874503819 conn(0x7fc6d4079790 msgr2=0x7fc6d4079ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.343+0000 7fc6da396640 1 -- 172.21.15.22:0/1874503819 shutdown_connections 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.343+0000 7fc6da396640 1 -- 172.21.15.22:0/1874503819 wait complete. 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.343+0000 7fc6da396640 1 Processor -- start 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.343+0000 7fc6da396640 1 -- start start 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6da396640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6d4102ac0 0x7fc6d419a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6da396640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6d41083b0 0x7fc6d419a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6da396640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d4108d00 0x7fc6d419fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.354 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6da396640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41139c0 con 0x7fc6d4108d00 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6da396640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d4113840 con 0x7fc6d4102ac0 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6da396640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d4113b40 con 0x7fc6d41083b0 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6d8933640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d4108d00 0x7fc6d419fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6d8933640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d4108d00 0x7fc6d419fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42188/0 (socket says 172.21.15.22:42188) 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6d8933640 1 -- 172.21.15.22:0/1192416125 learned_addr learned my addr 172.21.15.22:0/1192416125 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6d4102ac0 0x7fc6d419a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6cbfff640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6d41083b0 0x7fc6d419a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6d8933640 1 -- 172.21.15.22:0/1192416125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6d41083b0 msgr2=0x7fc6d419a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6d8933640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6d41083b0 0x7fc6d419a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6d8933640 1 -- 172.21.15.22:0/1192416125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6d4102ac0 msgr2=0x7fc6d419a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6d8933640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6d4102ac0 0x7fc6d419a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6d8933640 1 -- 172.21.15.22:0/1192416125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d41a02c0 con 0x7fc6d4108d00 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.344+0000 7fc6d8933640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d4108d00 0x7fc6d419fb90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc005cc0 tx=0x7fc6cc032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:48.355 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.345+0000 7fc6d1ffb640 1 -- 172.21.15.22:0/1192416125 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc032e00 con 0x7fc6d4108d00 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.345+0000 7fc6d1ffb640 1 -- 172.21.15.22:0/1192416125 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6cc0044d0 con 0x7fc6d4108d00 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.345+0000 7fc6da396640 1 -- 172.21.15.22:0/1192416125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d41a0550 con 0x7fc6d4108d00 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.345+0000 7fc6d1ffb640 1 -- 172.21.15.22:0/1192416125 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc030b70 con 0x7fc6d4108d00 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.345+0000 7fc6da396640 1 -- 172.21.15.22:0/1192416125 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d41a6d10 con 0x7fc6d4108d00 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.347+0000 7fc6e090a740 1 Processor -- start 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6d1ffb640 1 -- 172.21.15.22:0/1192416125 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc6cc004040 con 0x7fc6d4108d00 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6e090a740 1 -- start start 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c303e520 0x55d9c33e4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33e4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c301d840 0x55d9c33e4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6e090a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d9c32cfdc0 con 0x55d9c3015660 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6e090a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d9c335c1f0 con 0x55d9c303e520 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6e090a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d9c334b620 con 0x55d9c301d840 2024-09-21T04:08:48.356 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33e4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33e4a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42200/0 (socket says 172.21.15.22:42200) 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6d3fff640 1 -- 172.21.15.22:0/1072136424 learned_addr learned my addr 172.21.15.22:0/1072136424 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6cbfff640 1 --2- 172.21.15.22:0/1072136424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c303e520 0x55d9c33e4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6cbfff640 1 --2- 172.21.15.22:0/1072136424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c301d840 0x55d9c33e4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6d3fff640 1 -- 172.21.15.22:0/1072136424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c301d840 msgr2=0x55d9c33e4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/1072136424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c301d840 0x55d9c33e4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6d3fff640 1 -- 172.21.15.22:0/1072136424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c303e520 msgr2=0x55d9c33e4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.348+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/1072136424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c303e520 0x55d9c33e4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.349+0000 7fc6d3fff640 1 -- 172.21.15.22:0/1072136424 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c3313fd0 con 0x55d9c3015660 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.349+0000 7fc6cbfff640 1 --2- 172.21.15.22:0/1072136424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c303e520 0x55d9c33e4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.349+0000 7fc6d1ffb640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc6c00b6590 0x7fc6c00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.349+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/1072136424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33e4a50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400bd10 tx=0x7fc6c400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29349b5354b10c8e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.349+0000 7fc6cbfff640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc6c00b6590 0x7fc6c00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.357 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.349+0000 7fc6ca7fc640 1 -- 172.21.15.22:0/1072136424 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4015070 con 0x55d9c3015660 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.349+0000 7fc6d1ffb640 1 -- 172.21.15.22:0/1192416125 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fc6cc108970 con 0x7fc6d4108d00 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.349+0000 7fc6ca7fc640 1 -- 172.21.15.22:0/1072136424 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c401a8f0 con 0x55d9c3015660 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.349+0000 7fc6ca7fc640 1 -- 172.21.15.22:0/1072136424 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4011900 con 0x55d9c3015660 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6e090a740 1 -- 172.21.15.22:0/1072136424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 msgr2=0x55d9c33e4a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6e090a740 1 --2- 172.21.15.22:0/1072136424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33e4a50 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400bd10 tx=0x7fc6c400f730 comp rx=0 tx=0).stop 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6cbfff640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc6c00b6590 0x7fc6c00b8aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4107fd0 tx=0x7fc6bc004730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6e090a740 1 -- 172.21.15.22:0/1072136424 shutdown_connections 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6e090a740 1 --2- 172.21.15.22:0/1072136424 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c301d840 0x55d9c33e4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6e090a740 1 --2- 172.21.15.22:0/1072136424 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33e4a50 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6e090a740 1 --2- 172.21.15.22:0/1072136424 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c303e520 0x55d9c33e4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6e090a740 1 -- 172.21.15.22:0/1072136424 >> 172.21.15.22:0/1072136424 conn(0x55d9c3032910 msgr2=0x55d9c33e2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6e090a740 1 -- 172.21.15.22:0/1072136424 shutdown_connections 2024-09-21T04:08:48.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6e090a740 1 -- 172.21.15.22:0/1072136424 wait complete. 2024-09-21T04:08:48.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.350+0000 7fc6e090a740 1 -- start start 2024-09-21T04:08:48.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6e090a740 1 Processor -- start 2024-09-21T04:08:48.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c3015660 0x55d9c33efb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33f0080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c33f05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6e090a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55d9c32e6300 con 0x55d9c303e520 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6e090a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55d9c334f430 con 0x55d9c301d840 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6e090a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55d9c31acbb0 con 0x55d9c3015660 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6e090a740 10 client.0 _ll_register_callbacks cb 0x55d9c3300120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6d8933640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c33f05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6d8933640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c33f05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42208/0 (socket says 172.21.15.22:42208) 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6d8933640 1 -- 172.21.15.22:0/3349900163 learned_addr learned my addr 172.21.15.22:0/3349900163 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6cbfff640 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33f0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.351+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c3015660 0x55d9c33efb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6d8933640 1 -- 172.21.15.22:0/3349900163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c3015660 msgr2=0x55d9c33efb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6d8933640 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c3015660 0x55d9c33efb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6d8933640 1 -- 172.21.15.22:0/3349900163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 msgr2=0x55d9c33f0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6d8933640 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33f0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6d8933640 1 -- 172.21.15.22:0/3349900163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9c32d5780 con 0x55d9c303e520 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6d8933640 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c33f05c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0cad10 tx=0x7fc6cc0ce150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7db2496e9153624 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6b37fe640 1 -- 172.21.15.22:0/3349900163 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc0ce250 con 0x55d9c303e520 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6b37fe640 1 -- 172.21.15.22:0/3349900163 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fc6cc0d7cd0 con 0x55d9c303e520 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6e090a740 1 -- 172.21.15.22:0/3349900163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c401a8f0 con 0x55d9c303e520 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6b37fe640 1 -- 172.21.15.22:0/3349900163 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc6cc0cee40 con 0x55d9c303e520 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6e090a740 10 client.15930 fetch_fsmap learned FSMap version 40 2024-09-21T04:08:48.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6e090a740 1 -- 172.21.15.22:0/3349900163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55d9c30a9b00 con 0x55d9c303e520 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6b37fe640 1 -- 172.21.15.22:0/3349900163 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c401a8f0 con 0x55d9c303e520 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.352+0000 7fc6b37fe640 1 -- 172.21.15.22:0/3349900163 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fc6cc0cdac0 con 0x55d9c303e520 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.353+0000 7fc6e090a740 10 client.15930 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.353+0000 7fc6e090a740 10 client.15930 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.353+0000 7fc6e090a740 20 client.15930 populate_metadata read hostname 'smithi022' 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.353+0000 7fc6e090a740 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d9c2ffcea0 0x55d9c3406340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.353+0000 7fc6e090a740 4 client.15930 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.353+0000 7fc6e090a740 1 -- 172.21.15.22:0/3349900163 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d9c335e140 con 0x55d9c2ffcea0 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.353+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d9c2ffcea0 0x55d9c3406340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.353+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d9c2ffcea0 0x55d9c3406340 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da5c987900cd6e73 server_cookie=e212a82165713691 in_seq=0 out_seq=0 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.353+0000 7fc6b37fe640 10 client.15930 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:48.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6b37fe640 1 -- 172.21.15.22:0/3349900163 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55d9c335e140 con 0x55d9c2ffcea0 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6b37fe640 10 client.15930 handle_command_reply: tid=0 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6e090a740 1 client.15930 shutdown 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6e090a740 1 -- 172.21.15.22:0/3349900163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 msgr2=0x55d9c33f05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6e090a740 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c33f05c0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc0cad10 tx=0x7fc6cc0ce150 comp rx=0 tx=0).stop 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6e090a740 1 -- 172.21.15.22:0/3349900163 shutdown_connections 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6e090a740 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d9c2ffcea0 0x55d9c3406340 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6e090a740 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c33f05c0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6e090a740 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33f0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6e090a740 1 --2- 172.21.15.22:0/3349900163 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c3015660 0x55d9c33efb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6e090a740 1 -- 172.21.15.22:0/3349900163 >> 172.21.15.22:0/3349900163 conn(0x55d9c3032910 msgr2=0x55d9c33e76a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6b37fe640 0 client.15930 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.354+0000 7fc6e090a740 1 -- 172.21.15.22:0/3349900163 shutdown_connections 2024-09-21T04:08:48.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.355+0000 7fc6e090a740 1 -- 172.21.15.22:0/3349900163 wait complete. 2024-09-21T04:08:48.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.355+0000 7fc6e090a740 20 client.15930 trim_cache size 0 max 16384 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6e090a740 1 Processor -- start 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6e090a740 1 -- start start 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33f1a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33ecd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c303e520 0x55d9c33ed270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6e090a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41ae890 con 0x55d9c3015660 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6e090a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41b0490 con 0x55d9c301d840 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6e090a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41aef60 con 0x55d9c303e520 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33f1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6d3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33f1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42220/0 (socket says 172.21.15.22:42220) 2024-09-21T04:08:48.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6d3fff640 1 -- 172.21.15.22:0/1541879000 learned_addr learned my addr 172.21.15.22:0/1541879000 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6d8933640 1 --2- 172.21.15.22:0/1541879000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c303e520 0x55d9c33ed270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6cbfff640 1 --2- 172.21.15.22:0/1541879000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33ecd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6d3fff640 1 -- 172.21.15.22:0/1541879000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c303e520 msgr2=0x55d9c33ed270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/1541879000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c303e520 0x55d9c33ed270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6d3fff640 1 -- 172.21.15.22:0/1541879000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 msgr2=0x55d9c33ecd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/1541879000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33ecd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6d3fff640 1 -- 172.21.15.22:0/1541879000 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d9c3120960 con 0x55d9c3015660 2024-09-21T04:08:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.372+0000 7fc6cbfff640 1 --2- 172.21.15.22:0/1541879000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:08:48.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.373+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/1541879000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33f1a20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400bce0 tx=0x7fc6c400bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf66156330b3c1e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.373+0000 7fc6c9ffb640 1 -- 172.21.15.22:0/1541879000 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4030070 con 0x55d9c3015660 2024-09-21T04:08:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.373+0000 7fc6c9ffb640 1 -- 172.21.15.22:0/1541879000 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c40054d0 con 0x55d9c3015660 2024-09-21T04:08:48.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.373+0000 7fc6c9ffb640 1 -- 172.21.15.22:0/1541879000 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6c4015040 con 0x55d9c3015660 2024-09-21T04:08:48.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 -- 172.21.15.22:0/1541879000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 msgr2=0x55d9c33f1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:48.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 --2- 172.21.15.22:0/1541879000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33f1a20 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc6c400bce0 tx=0x7fc6c400bf20 comp rx=0 tx=0).stop 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 -- 172.21.15.22:0/1541879000 shutdown_connections 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 --2- 172.21.15.22:0/1541879000 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c303e520 0x55d9c33ed270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 --2- 172.21.15.22:0/1541879000 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33ecd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 --2- 172.21.15.22:0/1541879000 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c3015660 0x55d9c33f1a20 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 -- 172.21.15.22:0/1541879000 >> 172.21.15.22:0/1541879000 conn(0x55d9c3032910 msgr2=0x55d9c33efab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 -- 172.21.15.22:0/1541879000 shutdown_connections 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 -- 172.21.15.22:0/1541879000 wait complete. 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 -- start start 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.374+0000 7fc6e090a740 1 Processor -- start 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c3015660 0x55d9c33f6470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33f69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6e090a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c346fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6e090a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41afdc0 con 0x55d9c303e520 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6e090a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41af6f0 con 0x55d9c301d840 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6e090a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d41ac870 con 0x55d9c3015660 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6e090a740 10 client.0 _ll_register_callbacks cb 0x7fc6cc009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6d8933640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c346fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6d3fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c3015660 0x55d9c33f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6d8933640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c346fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42224/0 (socket says 172.21.15.22:42224) 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6d8933640 1 -- 172.21.15.22:0/2821663958 learned_addr learned my addr 172.21.15.22:0/2821663958 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6cbfff640 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33f69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6d8933640 1 -- 172.21.15.22:0/2821663958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c3015660 msgr2=0x55d9c33f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6d8933640 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c3015660 0x55d9c33f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6d8933640 1 -- 172.21.15.22:0/2821663958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 msgr2=0x55d9c33f69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:08:48.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6d8933640 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33f69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.375+0000 7fc6d8933640 1 -- 172.21.15.22:0/2821663958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9c3470200 con 0x55d9c303e520 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6d8933640 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c346fcc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc030fd0 tx=0x7fc6cc0048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17cc15c0d02066da server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6b37fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6b37fe640 1 -- 172.21.15.22:0/2821663958 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6cc0ce510 con 0x55d9c303e520 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6b37fe640 1 -- 172.21.15.22:0/2821663958 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fc6cc0cd9a0 con 0x55d9c303e520 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6e090a740 1 -- 172.21.15.22:0/2821663958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6c40054d0 con 0x55d9c303e520 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6b37fe640 1 -- 172.21.15.22:0/2821663958 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc6cc0ca5e0 con 0x55d9c303e520 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6e090a740 10 client.15936 fetch_fsmap learned FSMap version 40 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6e090a740 1 -- 172.21.15.22:0/2821663958 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=4+}) -- 0x55d9c3471370 con 0x55d9c303e520 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6b37fe640 1 -- 172.21.15.22:0/2821663958 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6c40054d0 con 0x55d9c303e520 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6b37fe640 1 -- 172.21.15.22:0/2821663958 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 40) ==== 8386+0+0 (secure 0 0 0) 0x7fc6cc0cd410 con 0x55d9c303e520 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6e090a740 10 client.15936 fetch_fsmap finished waiting for FSMap version 40 2024-09-21T04:08:48.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6e090a740 10 client.15936 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:08:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6e090a740 20 client.15936 populate_metadata read hostname 'smithi022' 2024-09-21T04:08:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6e090a740 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d9c2fd2250 0x55d9c34737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:08:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6e090a740 4 client.15936 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d077d2cc", "release": true, "await": true}] 2024-09-21T04:08:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.376+0000 7fc6e090a740 1 -- 172.21.15.22:0/2821663958 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d077d2cc", "release": true, "await": true}) -- 0x55d9c3359bf0 con 0x55d9c2fd2250 2024-09-21T04:08:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.377+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d9c2fd2250 0x55d9c34737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:08:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.377+0000 7fc6d3fff640 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d9c2fd2250 0x55d9c34737f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff01eb5631ff2237 server_cookie=b9224cb0112b05f7 in_seq=0 out_seq=0 2024-09-21T04:08:48.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.377+0000 7fc6b37fe640 10 client.15936 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:48.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.433+0000 7fc6b37fe640 1 -- 172.21.15.22:0/2821663958 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55d9c3359bf0 con 0x55d9c2fd2250 2024-09-21T04:08:48.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6b37fe640 10 client.15936 handle_command_reply: tid=0 2024-09-21T04:08:48.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 client.15936 shutdown 2024-09-21T04:08:48.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 -- 172.21.15.22:0/2821663958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 msgr2=0x55d9c346fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:48.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c346fcc0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc030fd0 tx=0x7fc6cc0048b0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 -- 172.21.15.22:0/2821663958 shutdown_connections 2024-09-21T04:08:48.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55d9c2fd2250 0x55d9c34737f0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55d9c303e520 0x55d9c346fcc0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55d9c301d840 0x55d9c33f69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 --2- 172.21.15.22:0/2821663958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55d9c3015660 0x55d9c33f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6b37fe640 0 client.15936 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:08:48.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 -- 172.21.15.22:0/2821663958 >> 172.21.15.22:0/2821663958 conn(0x55d9c3032910 msgr2=0x55d9c33efab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:48.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 -- 172.21.15.22:0/2821663958 shutdown_connections 2024-09-21T04:08:48.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 1 -- 172.21.15.22:0/2821663958 wait complete. 2024-09-21T04:08:48.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.434+0000 7fc6e090a740 20 client.15936 trim_cache size 0 max 16384 2024-09-21T04:08:48.439 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:08:48.439 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 40, 2024-09-21T04:08:48.439 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:08:48.439 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 28, 2024-09-21T04:08:48.439 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:08:48.439 INFO:teuthology.orchestra.run.smithi022.stdout: "d077d2cc": { 2024-09-21T04:08:48.439 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 28, 2024-09-21T04:08:48.439 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 139.2, 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:48.440 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:48.441 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:48.441 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:48.441 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:08:48.441 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:08:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.435+0000 7fc6da396640 1 -- 172.21.15.22:0/1192416125 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc6c00b6590 msgr2=0x7fc6c00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.435+0000 7fc6da396640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc6c00b6590 0x7fc6c00b8aa0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fc6d4107fd0 tx=0x7fc6bc004730 comp rx=0 tx=0).stop 2024-09-21T04:08:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.435+0000 7fc6da396640 1 -- 172.21.15.22:0/1192416125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d4108d00 msgr2=0x7fc6d419fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:08:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.435+0000 7fc6da396640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d4108d00 0x7fc6d419fb90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc005cc0 tx=0x7fc6cc032a10 comp rx=0 tx=0).stop 2024-09-21T04:08:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.435+0000 7fc6da396640 1 -- 172.21.15.22:0/1192416125 shutdown_connections 2024-09-21T04:08:48.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.435+0000 7fc6da396640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc6c00b6590 0x7fc6c00b8aa0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.435+0000 7fc6da396640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc6d41083b0 0x7fc6d419a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.435+0000 7fc6da396640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc6d4108d00 0x7fc6d419fb90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.435+0000 7fc6da396640 1 --2- 172.21.15.22:0/1192416125 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc6d4102ac0 0x7fc6d419a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:08:48.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.435+0000 7fc6da396640 1 -- 172.21.15.22:0/1192416125 >> 172.21.15.22:0/1192416125 conn(0x7fc6d4079790 msgr2=0x7fc6d4106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:08:48.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.436+0000 7fc6da396640 1 -- 172.21.15.22:0/1192416125 shutdown_connections 2024-09-21T04:08:48.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:08:48.436+0000 7fc6da396640 1 -- 172.21.15.22:0/1192416125 wait complete. 2024-09-21T04:08:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 265.0 s, 94.5 tps, lat 3991.855 ms stddev 7568.865 2024-09-21T04:08:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:48 smithi022 ceph-mon[31015]: pgmap v564: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 163 KiB/s wr, 32 op/s 2024-09-21T04:08:48.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:48 smithi073 ceph-mon[34443]: pgmap v564: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 163 KiB/s wr, 32 op/s 2024-09-21T04:08:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:48 smithi060 ceph-mon[33722]: pgmap v564: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 163 KiB/s wr, 32 op/s 2024-09-21T04:08:49.467 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd077d2cc', total seconds elapsed: 22.8 2024-09-21T04:08:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:50 smithi022 ceph-mon[31015]: pgmap v565: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 160 KiB/s wr, 30 op/s 2024-09-21T04:08:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:50 smithi073 ceph-mon[34443]: pgmap v565: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 160 KiB/s wr, 30 op/s 2024-09-21T04:08:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:50 smithi060 ceph-mon[33722]: pgmap v565: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 160 KiB/s wr, 30 op/s 2024-09-21T04:08:52.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:52 smithi022 ceph-mon[31015]: pgmap v566: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 102 op/s 2024-09-21T04:08:52.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:52 smithi073 ceph-mon[34443]: pgmap v566: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 102 op/s 2024-09-21T04:08:52.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:52 smithi060 ceph-mon[33722]: pgmap v566: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 1.9 MiB/s wr, 102 op/s 2024-09-21T04:08:53.705 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 270.0 s, 950.5 tps, lat 104.498 ms stddev 171.011 2024-09-21T04:08:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:54 smithi022 ceph-mon[31015]: pgmap v567: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.6 MiB/s wr, 226 op/s 2024-09-21T04:08:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:54 smithi073 ceph-mon[34443]: pgmap v567: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.6 MiB/s wr, 226 op/s 2024-09-21T04:08:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:54 smithi060 ceph-mon[33722]: pgmap v567: 129 pgs: 129 active+clean; 1.1 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 4.6 MiB/s wr, 226 op/s 2024-09-21T04:08:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:56 smithi022 ceph-mon[31015]: pgmap v568: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.3 MiB/s wr, 355 op/s 2024-09-21T04:08:56.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:56 smithi073 ceph-mon[34443]: pgmap v568: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.3 MiB/s wr, 355 op/s 2024-09-21T04:08:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:56 smithi060 ceph-mon[33722]: pgmap v568: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.3 MiB/s wr, 355 op/s 2024-09-21T04:08:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 275.0 s, 911.7 tps, lat 109.936 ms stddev 181.189 2024-09-21T04:08:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:08:58 smithi022 ceph-mon[31015]: pgmap v569: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 546 op/s 2024-09-21T04:08:58.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:08:58 smithi073 ceph-mon[34443]: pgmap v569: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 546 op/s 2024-09-21T04:08:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:08:58 smithi060 ceph-mon[33722]: pgmap v569: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 546 op/s 2024-09-21T04:09:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:00 smithi022 ceph-mon[31015]: pgmap v570: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-09-21T04:09:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:00 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:00.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:00 smithi073 ceph-mon[34443]: pgmap v570: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-09-21T04:09:00.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:00 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:00 smithi060 ceph-mon[33722]: pgmap v570: 129 pgs: 129 active+clean; 1.1 GiB data, 5.7 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-09-21T04:09:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:00 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:02.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:02 smithi022 ceph-mon[31015]: pgmap v571: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 17 MiB/s wr, 797 op/s 2024-09-21T04:09:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:02 smithi073 ceph-mon[34443]: pgmap v571: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 17 MiB/s wr, 797 op/s 2024-09-21T04:09:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:02 smithi060 ceph-mon[33722]: pgmap v571: 129 pgs: 129 active+clean; 1.1 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 17 MiB/s wr, 797 op/s 2024-09-21T04:09:03.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 280.0 s, 866.2 tps, lat 115.839 ms stddev 179.508 2024-09-21T04:09:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:04 smithi060 ceph-mon[33722]: pgmap v572: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 18 MiB/s wr, 888 op/s 2024-09-21T04:09:05.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:04 smithi022 ceph-mon[31015]: pgmap v572: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 18 MiB/s wr, 888 op/s 2024-09-21T04:09:05.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:04 smithi073 ceph-mon[34443]: pgmap v572: 129 pgs: 129 active+clean; 1.1 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 18 MiB/s wr, 888 op/s 2024-09-21T04:09:05.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:05 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:06.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:05 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:06.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:05 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:06 smithi060 ceph-mon[33722]: pgmap v573: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 19 MiB/s wr, 903 op/s 2024-09-21T04:09:07.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:06 smithi022 ceph-mon[31015]: pgmap v573: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 19 MiB/s wr, 903 op/s 2024-09-21T04:09:07.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:06 smithi073 ceph-mon[34443]: pgmap v573: 129 pgs: 129 active+clean; 1.2 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 19 MiB/s wr, 903 op/s 2024-09-21T04:09:08.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 285.0 s, 1016.8 tps, lat 97.705 ms stddev 125.283 2024-09-21T04:09:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:08 smithi060 ceph-mon[33722]: pgmap v574: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 21 MiB/s wr, 981 op/s 2024-09-21T04:09:09.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:08 smithi022 ceph-mon[31015]: pgmap v574: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 21 MiB/s wr, 981 op/s 2024-09-21T04:09:09.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:08 smithi073 ceph-mon[34443]: pgmap v574: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 21 MiB/s wr, 981 op/s 2024-09-21T04:09:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:10 smithi060 ceph-mon[33722]: pgmap v575: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 18 MiB/s wr, 846 op/s 2024-09-21T04:09:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:09:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:10.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:10.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:10.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:10.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:10.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:10.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:10 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:10 smithi022 ceph-mon[31015]: pgmap v575: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 18 MiB/s wr, 846 op/s 2024-09-21T04:09:11.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:09:11.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.102 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:10 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:10 smithi073 ceph-mon[34443]: pgmap v575: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 18 MiB/s wr, 846 op/s 2024-09-21T04:09:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:09:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:10 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-21T04:09:11.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T04:09:11.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-21T04:09:11.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: Unable to set osd_memory_target on smithi060 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T04:09:11.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:11.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:09:11.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:09:11.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:09:12.006 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-21T04:09:12.006 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T04:09:12.006 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-21T04:09:12.006 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: Unable to set osd_memory_target on smithi060 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T04:09:12.006 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:12.006 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:12.006 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:12.006 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:12.006 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:09:12.006 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:09:12.007 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:09:12.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-21T04:09:12.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T04:09:12.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-21T04:09:12.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: Unable to set osd_memory_target on smithi060 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T04:09:12.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:12.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:12.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:12.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T04:09:12.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:09:12.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:09:12.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:09:12.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:12 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-21T04:09:12.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:12 smithi060 ceph-mon[33722]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T04:09:12.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:12 smithi060 ceph-mon[33722]: pgmap v576: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 20 MiB/s wr, 999 op/s 2024-09-21T04:09:13.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:12 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-21T04:09:13.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:12 smithi022 ceph-mon[31015]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T04:09:13.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:12 smithi022 ceph-mon[31015]: pgmap v576: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 20 MiB/s wr, 999 op/s 2024-09-21T04:09:13.104 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:12 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-21T04:09:13.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:12 smithi073 ceph-mon[34443]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T04:09:13.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:12 smithi073 ceph-mon[34443]: pgmap v576: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 20 MiB/s wr, 999 op/s 2024-09-21T04:09:13.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 290.0 s, 842.0 tps, lat 119.272 ms stddev 192.650 2024-09-21T04:09:14.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:13 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:14.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:13 smithi022 ceph-mon[31015]: pgmap v577: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 17 MiB/s wr, 955 op/s 2024-09-21T04:09:14.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:13 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:14.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:13 smithi073 ceph-mon[34443]: pgmap v577: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 17 MiB/s wr, 955 op/s 2024-09-21T04:09:14.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:13 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:14.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:13 smithi060 ceph-mon[33722]: pgmap v577: 129 pgs: 129 active+clean; 1.2 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 17 MiB/s wr, 955 op/s 2024-09-21T04:09:16.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:16 smithi060 ceph-mon[33722]: pgmap v578: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 17 MiB/s wr, 937 op/s 2024-09-21T04:09:16.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:16 smithi022 ceph-mon[31015]: pgmap v578: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 17 MiB/s wr, 937 op/s 2024-09-21T04:09:16.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:16 smithi073 ceph-mon[34443]: pgmap v578: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 17 MiB/s wr, 937 op/s 2024-09-21T04:09:18.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:18 smithi060 ceph-mon[33722]: pgmap v579: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-21T04:09:18.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:18 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:18.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:18 smithi022 ceph-mon[31015]: pgmap v579: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-21T04:09:18.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:18 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:18.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:18 smithi073 ceph-mon[34443]: pgmap v579: 129 pgs: 129 active+clean; 1.2 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-21T04:09:18.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:18 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 295.0 s, 997.6 tps, lat 99.708 ms stddev 124.857 2024-09-21T04:09:20.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:20 smithi060 ceph-mon[33722]: pgmap v580: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 16 MiB/s wr, 864 op/s 2024-09-21T04:09:20.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:20 smithi022 ceph-mon[31015]: pgmap v580: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 16 MiB/s wr, 864 op/s 2024-09-21T04:09:20.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:20 smithi073 ceph-mon[34443]: pgmap v580: 129 pgs: 129 active+clean; 1.2 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 81 KiB/s rd, 16 MiB/s wr, 864 op/s 2024-09-21T04:09:22.452 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:22 smithi060 ceph-mon[33722]: pgmap v581: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-21T04:09:22.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:22 smithi022 ceph-mon[31015]: pgmap v581: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-21T04:09:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:22 smithi073 ceph-mon[34443]: pgmap v581: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-21T04:09:23.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:23 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:23.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:23 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:23.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:23 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:23.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 300.0 s, 931.8 tps, lat 107.312 ms stddev 123.603 2024-09-21T04:09:24.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:24 smithi022 ceph-mon[31015]: pgmap v582: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 16 MiB/s wr, 967 op/s 2024-09-21T04:09:24.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:24 smithi073 ceph-mon[34443]: pgmap v582: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 16 MiB/s wr, 967 op/s 2024-09-21T04:09:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:24 smithi060 ceph-mon[33722]: pgmap v582: 129 pgs: 129 active+clean; 1.2 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 16 MiB/s wr, 967 op/s 2024-09-21T04:09:26.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:26 smithi022 ceph-mon[31015]: pgmap v583: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 16 MiB/s wr, 950 op/s 2024-09-21T04:09:26.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:26 smithi073 ceph-mon[34443]: pgmap v583: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 16 MiB/s wr, 950 op/s 2024-09-21T04:09:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:26 smithi060 ceph-mon[33722]: pgmap v583: 129 pgs: 129 active+clean; 1.2 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 16 MiB/s wr, 950 op/s 2024-09-21T04:09:28.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:28 smithi022 ceph-mon[31015]: pgmap v584: 129 pgs: 129 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-21T04:09:28.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:28 smithi073 ceph-mon[34443]: pgmap v584: 129 pgs: 129 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-21T04:09:28.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:28 smithi060 ceph-mon[33722]: pgmap v584: 129 pgs: 129 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 17 MiB/s wr, 1.01k op/s 2024-09-21T04:09:28.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 305.0 s, 928.6 tps, lat 107.844 ms stddev 134.725 2024-09-21T04:09:30.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:30 smithi022 ceph-mon[31015]: pgmap v585: 129 pgs: 129 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 15 MiB/s wr, 841 op/s 2024-09-21T04:09:30.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:30 smithi073 ceph-mon[34443]: pgmap v585: 129 pgs: 129 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 15 MiB/s wr, 841 op/s 2024-09-21T04:09:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:30 smithi060 ceph-mon[33722]: pgmap v585: 129 pgs: 129 active+clean; 1.3 GiB data, 6.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 15 MiB/s wr, 841 op/s 2024-09-21T04:09:32.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:32 smithi022 ceph-mon[31015]: pgmap v586: 129 pgs: 129 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 15 MiB/s wr, 965 op/s 2024-09-21T04:09:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:32 smithi073 ceph-mon[34443]: pgmap v586: 129 pgs: 129 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 15 MiB/s wr, 965 op/s 2024-09-21T04:09:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:32 smithi060 ceph-mon[33722]: pgmap v586: 129 pgs: 129 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 15 MiB/s wr, 965 op/s 2024-09-21T04:09:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 310.0 s, 954.0 tps, lat 104.956 ms stddev 131.487 2024-09-21T04:09:34.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:34 smithi022 ceph-mon[31015]: pgmap v587: 129 pgs: 129 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 15 MiB/s wr, 951 op/s 2024-09-21T04:09:34.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:34 smithi073 ceph-mon[34443]: pgmap v587: 129 pgs: 129 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 15 MiB/s wr, 951 op/s 2024-09-21T04:09:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:34 smithi060 ceph-mon[33722]: pgmap v587: 129 pgs: 129 active+clean; 1.3 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 15 MiB/s wr, 951 op/s 2024-09-21T04:09:36.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:36 smithi022 ceph-mon[31015]: pgmap v588: 129 pgs: 129 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 947 op/s 2024-09-21T04:09:36.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:36 smithi073 ceph-mon[34443]: pgmap v588: 129 pgs: 129 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 947 op/s 2024-09-21T04:09:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:36 smithi060 ceph-mon[33722]: pgmap v588: 129 pgs: 129 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 15 MiB/s wr, 947 op/s 2024-09-21T04:09:38.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:38 smithi022 ceph-mon[31015]: pgmap v589: 129 pgs: 129 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 15 MiB/s wr, 943 op/s 2024-09-21T04:09:38.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:38 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:38.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:38 smithi073 ceph-mon[34443]: pgmap v589: 129 pgs: 129 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 15 MiB/s wr, 943 op/s 2024-09-21T04:09:38.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:38 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:38.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:38 smithi060 ceph-mon[33722]: pgmap v589: 129 pgs: 129 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 15 MiB/s wr, 943 op/s 2024-09-21T04:09:38.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:38 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:09:38.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 315.0 s, 932.8 tps, lat 107.397 ms stddev 129.198 2024-09-21T04:09:40.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:40 smithi022 ceph-mon[31015]: pgmap v590: 129 pgs: 129 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 849 op/s 2024-09-21T04:09:40.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:40 smithi073 ceph-mon[34443]: pgmap v590: 129 pgs: 129 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 849 op/s 2024-09-21T04:09:40.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:40 smithi060 ceph-mon[33722]: pgmap v590: 129 pgs: 129 active+clean; 1.3 GiB data, 6.6 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 12 MiB/s wr, 849 op/s 2024-09-21T04:09:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:42 smithi022 ceph-mon[31015]: pgmap v591: 129 pgs: 129 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 14 MiB/s wr, 999 op/s 2024-09-21T04:09:42.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:42 smithi073 ceph-mon[34443]: pgmap v591: 129 pgs: 129 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 14 MiB/s wr, 999 op/s 2024-09-21T04:09:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:42 smithi060 ceph-mon[33722]: pgmap v591: 129 pgs: 129 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 14 MiB/s wr, 999 op/s 2024-09-21T04:09:43.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 320.0 s, 963.4 tps, lat 103.466 ms stddev 141.501 2024-09-21T04:09:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:44 smithi022 ceph-mon[31015]: pgmap v592: 129 pgs: 129 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-09-21T04:09:44.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:44 smithi073 ceph-mon[34443]: pgmap v592: 129 pgs: 129 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-09-21T04:09:44.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:44 smithi060 ceph-mon[33722]: pgmap v592: 129 pgs: 129 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-09-21T04:09:46.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:46 smithi022 ceph-mon[31015]: pgmap v593: 129 pgs: 129 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 MiB/s wr, 942 op/s 2024-09-21T04:09:46.604 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:46 smithi073 ceph-mon[34443]: pgmap v593: 129 pgs: 129 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 MiB/s wr, 942 op/s 2024-09-21T04:09:46.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:46 smithi060 ceph-mon[33722]: pgmap v593: 129 pgs: 129 active+clean; 1.3 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 MiB/s wr, 942 op/s 2024-09-21T04:09:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:48 smithi073 ceph-mon[34443]: pgmap v594: 129 pgs: 129 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 913 op/s 2024-09-21T04:09:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:48 smithi060 ceph-mon[33722]: pgmap v594: 129 pgs: 129 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 913 op/s 2024-09-21T04:09:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 325.0 s, 920.8 tps, lat 108.776 ms stddev 149.127 2024-09-21T04:09:48.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:48 smithi022 ceph-mon[31015]: pgmap v594: 129 pgs: 129 active+clean; 1.3 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 913 op/s 2024-09-21T04:09:50.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:50 smithi060 ceph-mon[33722]: pgmap v595: 129 pgs: 129 active+clean; 1.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 890 op/s 2024-09-21T04:09:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:50 smithi022 ceph-mon[31015]: pgmap v595: 129 pgs: 129 active+clean; 1.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 890 op/s 2024-09-21T04:09:50.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:50 smithi073 ceph-mon[34443]: pgmap v595: 129 pgs: 129 active+clean; 1.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 12 MiB/s wr, 890 op/s 2024-09-21T04:09:52.651 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:52 smithi022 ceph-mon[31015]: pgmap v596: 129 pgs: 129 active+clean; 1.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 MiB/s wr, 989 op/s 2024-09-21T04:09:52.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:52 smithi060 ceph-mon[33722]: pgmap v596: 129 pgs: 129 active+clean; 1.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 MiB/s wr, 989 op/s 2024-09-21T04:09:52.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:52 smithi073 ceph-mon[34443]: pgmap v596: 129 pgs: 129 active+clean; 1.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 14 MiB/s wr, 989 op/s 2024-09-21T04:09:53.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 330.0 s, 943.1 tps, lat 106.205 ms stddev 54.608 2024-09-21T04:09:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:54 smithi060 ceph-mon[33722]: pgmap v597: 129 pgs: 129 active+clean; 1.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 14 MiB/s wr, 989 op/s 2024-09-21T04:09:54.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:54 smithi022 ceph-mon[31015]: pgmap v597: 129 pgs: 129 active+clean; 1.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 14 MiB/s wr, 989 op/s 2024-09-21T04:09:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:54 smithi073 ceph-mon[34443]: pgmap v597: 129 pgs: 129 active+clean; 1.3 GiB data, 6.9 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 14 MiB/s wr, 989 op/s 2024-09-21T04:09:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:56 smithi060 ceph-mon[33722]: pgmap v598: 129 pgs: 129 active+clean; 1.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 934 op/s 2024-09-21T04:09:56.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:56 smithi022 ceph-mon[31015]: pgmap v598: 129 pgs: 129 active+clean; 1.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 934 op/s 2024-09-21T04:09:56.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:56 smithi073 ceph-mon[34443]: pgmap v598: 129 pgs: 129 active+clean; 1.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 934 op/s 2024-09-21T04:09:58.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:09:58 smithi060 ceph-mon[33722]: pgmap v599: 129 pgs: 129 active+clean; 1.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 936 op/s 2024-09-21T04:09:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 335.0 s, 980.8 tps, lat 101.384 ms stddev 50.490 2024-09-21T04:09:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:09:58 smithi022 ceph-mon[31015]: pgmap v599: 129 pgs: 129 active+clean; 1.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 936 op/s 2024-09-21T04:09:58.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:09:58 smithi073 ceph-mon[34443]: pgmap v599: 129 pgs: 129 active+clean; 1.3 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 11 MiB/s wr, 936 op/s 2024-09-21T04:10:00.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:00 smithi060 ceph-mon[33722]: pgmap v600: 129 pgs: 129 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 11 MiB/s wr, 938 op/s 2024-09-21T04:10:00.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:00 smithi060 ceph-mon[33722]: overall HEALTH_OK 2024-09-21T04:10:00.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:00 smithi022 ceph-mon[31015]: pgmap v600: 129 pgs: 129 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 11 MiB/s wr, 938 op/s 2024-09-21T04:10:00.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:00 smithi022 ceph-mon[31015]: overall HEALTH_OK 2024-09-21T04:10:00.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:00 smithi073 ceph-mon[34443]: pgmap v600: 129 pgs: 129 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 105 KiB/s rd, 11 MiB/s wr, 938 op/s 2024-09-21T04:10:00.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:00 smithi073 ceph-mon[34443]: overall HEALTH_OK 2024-09-21T04:10:00.968 INFO:tasks.quiescer.fs.[cephfs]:Total duration (42.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T04:10:00.968 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T04:10:00.968 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:10:01.443 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:10:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.207+0000 7f7bbd63d640 1 -- 172.21.15.22:0/3491216456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bb81094d0 msgr2=0x7f7bb81098e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.207+0000 7f7bbd63d640 1 --2- 172.21.15.22:0/3491216456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bb81094d0 0x7f7bb81098e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ba8009900 tx=0x7f7ba802a410 comp rx=0 tx=0).stop 2024-09-21T04:10:02.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.207+0000 7f7bbd63d640 1 -- 172.21.15.22:0/3491216456 shutdown_connections 2024-09-21T04:10:02.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.207+0000 7f7bbd63d640 1 --2- 172.21.15.22:0/3491216456 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bb81094d0 0x7f7bb81098e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:02.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.207+0000 7f7bbd63d640 1 --2- 172.21.15.22:0/3491216456 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bb8109e20 0x7f7bb8110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:02.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.207+0000 7f7bbd63d640 1 --2- 172.21.15.22:0/3491216456 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb8103b90 0x7f7bb8103fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:02.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.207+0000 7f7bbd63d640 1 -- 172.21.15.22:0/3491216456 >> 172.21.15.22:0/3491216456 conn(0x7f7bb80ff5e0 msgr2=0x7f7bb8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:02.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.208+0000 7f7bbd63d640 1 -- 172.21.15.22:0/3491216456 shutdown_connections 2024-09-21T04:10:02.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.208+0000 7f7bbd63d640 1 -- 172.21.15.22:0/3491216456 wait complete. 2024-09-21T04:10:02.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.209+0000 7f7bbd63d640 1 Processor -- start 2024-09-21T04:10:02.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.209+0000 7f7bbd63d640 1 -- start start 2024-09-21T04:10:02.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.210+0000 7f7bbd63d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bb8103b90 0x7f7bb8197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:02.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.210+0000 7f7bbd63d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb81094d0 0x7f7bb8198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:02.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.210+0000 7f7bbd63d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bb8109e20 0x7f7bb819d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:02.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.210+0000 7f7bbd63d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb81117a0 con 0x7f7bb8109e20 2024-09-21T04:10:02.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.210+0000 7f7bbd63d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb8111620 con 0x7f7bb81094d0 2024-09-21T04:10:02.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.210+0000 7f7bbd63d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7bb8111920 con 0x7f7bb8103b90 2024-09-21T04:10:02.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.210+0000 7f7bb6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bb8103b90 0x7f7bb8197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:02.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.210+0000 7f7bb6ffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bb8103b90 0x7f7bb8197fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:43746/0 (socket says 172.21.15.22:43746) 2024-09-21T04:10:02.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.210+0000 7f7bb6ffd640 1 -- 172.21.15.22:0/2173860580 learned_addr learned my addr 172.21.15.22:0/2173860580 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:02.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.210+0000 7f7bb67fc640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb81094d0 0x7f7bb8198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:02.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.211+0000 7f7bb77fe640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bb8109e20 0x7f7bb819d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:02.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.211+0000 7f7bb67fc640 1 -- 172.21.15.22:0/2173860580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bb8103b90 msgr2=0x7f7bb8197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:02.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.211+0000 7f7bb67fc640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bb8103b90 0x7f7bb8197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:02.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.211+0000 7f7bb67fc640 1 -- 172.21.15.22:0/2173860580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bb8109e20 msgr2=0x7f7bb819d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.211+0000 7f7bb67fc640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bb8109e20 0x7f7bb819d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.211+0000 7f7bb67fc640 1 -- 172.21.15.22:0/2173860580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bb819df50 con 0x7f7bb81094d0 2024-09-21T04:10:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.211+0000 7f7bb67fc640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb81094d0 0x7f7bb8198580 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ba802a930 tx=0x7f7ba8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.212+0000 7f7b9ffff640 1 -- 172.21.15.22:0/2173860580 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8040030 con 0x7f7bb81094d0 2024-09-21T04:10:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.212+0000 7f7b9ffff640 1 -- 172.21.15.22:0/2173860580 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ba8032bd0 con 0x7f7bb81094d0 2024-09-21T04:10:02.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.212+0000 7f7b9ffff640 1 -- 172.21.15.22:0/2173860580 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ba8035020 con 0x7f7bb81094d0 2024-09-21T04:10:02.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.214+0000 7f7bbd63d640 1 -- 172.21.15.22:0/2173860580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bb819e1e0 con 0x7f7bb81094d0 2024-09-21T04:10:02.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.214+0000 7f7bbd63d640 1 -- 172.21.15.22:0/2173860580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bb819e580 con 0x7f7bb81094d0 2024-09-21T04:10:02.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.215+0000 7f7bbd63d640 1 -- 172.21.15.22:0/2173860580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bb8199110 con 0x7f7bb81094d0 2024-09-21T04:10:02.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.218+0000 7f7b9ffff640 1 -- 172.21.15.22:0/2173860580 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7ba8043030 con 0x7f7bb81094d0 2024-09-21T04:10:02.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.219+0000 7f7b9ffff640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7ba00ba9a0 0x7f7ba00bceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:02.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.219+0000 7f7bb6ffd640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7ba00ba9a0 0x7f7ba00bceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:02.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.219+0000 7f7b9ffff640 1 -- 172.21.15.22:0/2173860580 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7ba8107da0 con 0x7f7bb81094d0 2024-09-21T04:10:02.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.220+0000 7f7bb6ffd640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7ba00ba9a0 0x7f7ba00bceb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7bac005fd0 tx=0x7f7bac00b480 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:02.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.224+0000 7f7b9ffff640 1 -- 172.21.15.22:0/2173860580 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ba804a070 con 0x7f7bb81094d0 2024-09-21T04:10:02.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:02 smithi022 ceph-mon[31015]: pgmap v601: 129 pgs: 129 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 997 op/s 2024-09-21T04:10:02.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.658+0000 7f7bbd63d640 1 -- 172.21.15.22:0/2173860580 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7bb802e7f0 con 0x7f7bb81094d0 2024-09-21T04:10:02.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.658+0000 7f7b9ffff640 1 -- 172.21.15.22:0/2173860580 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11966 (secure 0 0 0) 0x7f7ba80ce210 con 0x7f7bb81094d0 2024-09-21T04:10:02.662 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:10:02.662 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":46,"btime":"2024-09-21T04:09:37:240006+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:09:36.909677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:10:02.663 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 46 2024-09-21T04:10:02.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.663+0000 7f7bbd63d640 1 -- 172.21.15.22:0/2173860580 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7ba00ba9a0 msgr2=0x7f7ba00bceb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:02.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.663+0000 7f7bbd63d640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7ba00ba9a0 0x7f7ba00bceb0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7bac005fd0 tx=0x7f7bac00b480 comp rx=0 tx=0).stop 2024-09-21T04:10:02.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.663+0000 7f7bbd63d640 1 -- 172.21.15.22:0/2173860580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb81094d0 msgr2=0x7f7bb8198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:02.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.663+0000 7f7bbd63d640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb81094d0 0x7f7bb8198580 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f7ba802a930 tx=0x7f7ba8004730 comp rx=0 tx=0).stop 2024-09-21T04:10:02.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.664+0000 7f7bbd63d640 1 -- 172.21.15.22:0/2173860580 shutdown_connections 2024-09-21T04:10:02.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.664+0000 7f7bbd63d640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7ba00ba9a0 0x7f7ba00bceb0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:02.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.664+0000 7f7bbd63d640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7bb8109e20 0x7f7bb819d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:02.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.664+0000 7f7bbd63d640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7bb81094d0 0x7f7bb8198580 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:02.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.664+0000 7f7bbd63d640 1 --2- 172.21.15.22:0/2173860580 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7bb8103b90 0x7f7bb8197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:02.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.664+0000 7f7bbd63d640 1 -- 172.21.15.22:0/2173860580 >> 172.21.15.22:0/2173860580 conn(0x7f7bb80ff5e0 msgr2=0x7f7bb81069f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:02.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.665+0000 7f7bbd63d640 1 -- 172.21.15.22:0/2173860580 shutdown_connections 2024-09-21T04:10:02.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:02.665+0000 7f7bbd63d640 1 -- 172.21.15.22:0/2173860580 wait complete. 2024-09-21T04:10:02.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:02 smithi060 ceph-mon[33722]: pgmap v601: 129 pgs: 129 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 997 op/s 2024-09-21T04:10:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:02 smithi073 ceph-mon[34443]: pgmap v601: 129 pgs: 129 active+clean; 1.3 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 997 op/s 2024-09-21T04:10:03.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:03 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2173860580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:03.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 340.0 s, 941.8 tps, lat 106.214 ms stddev 47.249 2024-09-21T04:10:03.822 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:03 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2173860580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:03.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:03 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2173860580' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:03.878 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T04:10:03.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T04:10:04.367 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:10:04.665 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:04 smithi022 ceph-mon[31015]: pgmap v602: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 11 MiB/s wr, 990 op/s 2024-09-21T04:10:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:04 smithi060 ceph-mon[33722]: pgmap v602: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 11 MiB/s wr, 990 op/s 2024-09-21T04:10:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:04 smithi073 ceph-mon[34443]: pgmap v602: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 11 MiB/s wr, 990 op/s 2024-09-21T04:10:04.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.981+0000 7f9aac8e8640 1 -- 172.21.15.22:0/2600962016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9aa81083c0 msgr2=0x7f9aa81087d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:04.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.981+0000 7f9aac8e8640 1 --2- 172.21.15.22:0/2600962016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9aa81083c0 0x7f9aa81087d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f9a94009860 tx=0x7f9a9402a340 comp rx=0 tx=0).stop 2024-09-21T04:10:04.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.982+0000 7f9aac8e8640 1 -- 172.21.15.22:0/2600962016 shutdown_connections 2024-09-21T04:10:04.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.982+0000 7f9aac8e8640 1 --2- 172.21.15.22:0/2600962016 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa8108d10 0x7f9aa810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:04.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.982+0000 7f9aac8e8640 1 --2- 172.21.15.22:0/2600962016 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9aa81083c0 0x7f9aa81087d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:04.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.982+0000 7f9aac8e8640 1 --2- 172.21.15.22:0/2600962016 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa8102a80 0x7f9aa8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:04.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.982+0000 7f9aac8e8640 1 -- 172.21.15.22:0/2600962016 >> 172.21.15.22:0/2600962016 conn(0x7f9aa8079760 msgr2=0x7f9aa8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:04.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.983+0000 7f9aac8e8640 1 -- 172.21.15.22:0/2600962016 shutdown_connections 2024-09-21T04:10:04.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.983+0000 7f9aac8e8640 1 -- 172.21.15.22:0/2600962016 wait complete. 2024-09-21T04:10:04.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.986+0000 7f9aac8e8640 1 Processor -- start 2024-09-21T04:10:04.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.986+0000 7f9aac8e8640 1 -- start start 2024-09-21T04:10:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.987+0000 7f9aac8e8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa8102a80 0x7f9aa8198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.987+0000 7f9aac8e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa81083c0 0x7f9aa8198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.987+0000 7f9aac8e8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9aa8108d10 0x7f9aa819daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.987+0000 7f9aac8e8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa8111770 con 0x7f9aa81083c0 2024-09-21T04:10:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.988+0000 7f9aac8e8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa81115f0 con 0x7f9aa8108d10 2024-09-21T04:10:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.988+0000 7f9aa6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9aa8108d10 0x7f9aa819daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.988+0000 7f9aa6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9aa8108d10 0x7f9aa819daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:34988/0 (socket says 172.21.15.22:34988) 2024-09-21T04:10:04.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.988+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/1300328244 learned_addr learned my addr 172.21.15.22:0/1300328244 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:04.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.988+0000 7f9aac8e8640 1 -- 172.21.15.22:0/1300328244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa81118f0 con 0x7f9aa8102a80 2024-09-21T04:10:04.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.988+0000 7f9aa659c640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa8102a80 0x7f9aa8198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:04.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.988+0000 7f9aa5d9b640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa81083c0 0x7f9aa8198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:04.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.989+0000 7f9aa659c640 1 -- 172.21.15.22:0/1300328244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9aa8108d10 msgr2=0x7f9aa819daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:04.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.989+0000 7f9aa659c640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9aa8108d10 0x7f9aa819daa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:04.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.989+0000 7f9aa659c640 1 -- 172.21.15.22:0/1300328244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa81083c0 msgr2=0x7f9aa8198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:04.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.989+0000 7f9aa659c640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa81083c0 0x7f9aa8198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:04.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.989+0000 7f9aa659c640 1 -- 172.21.15.22:0/1300328244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9aa819e1d0 con 0x7f9aa8102a80 2024-09-21T04:10:04.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.990+0000 7f9aa659c640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa8102a80 0x7f9aa8198260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009820 tx=0x7f9a98009ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:04.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.990+0000 7f9a9f7fe640 1 -- 172.21.15.22:0/1300328244 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9801c070 con 0x7f9aa8102a80 2024-09-21T04:10:04.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.990+0000 7f9a9f7fe640 1 -- 172.21.15.22:0/1300328244 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9a98007e40 con 0x7f9aa8102a80 2024-09-21T04:10:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.990+0000 7f9a9f7fe640 1 -- 172.21.15.22:0/1300328244 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800cc30 con 0x7f9aa8102a80 2024-09-21T04:10:04.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.991+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9aa8108d10 0x7f9aa819daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:10:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.991+0000 7f9aac8e8640 1 -- 172.21.15.22:0/1300328244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9aa819e4c0 con 0x7f9aa8102a80 2024-09-21T04:10:04.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.992+0000 7f9aac8e8640 1 -- 172.21.15.22:0/1300328244 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9aa819e8c0 con 0x7f9aa8102a80 2024-09-21T04:10:04.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.997+0000 7f9a9f7fe640 1 -- 172.21.15.22:0/1300328244 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9a9800c330 con 0x7f9aa8102a80 2024-09-21T04:10:05.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.997+0000 7f9ab2e5c740 1 Processor -- start 2024-09-21T04:10:05.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.998+0000 7f9ab2e5c740 1 -- start start 2024-09-21T04:10:05.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.998+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d7b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d7bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d7c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9ab2e5c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556ec9ce9bb0 con 0x556ec99abb70 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9ab2e5c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556ec9cd8fe0 con 0x556ec99cc850 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9ab2e5c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556ec9cdcdf0 con 0x556ec99a3990 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d7b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d7b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:34994/0 (socket says 172.21.15.22:34994) 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/1935084408 learned_addr learned my addr 172.21.15.22:0/1935084408 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa5d9b640 1 --2- 172.21.15.22:0/1935084408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d7c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/1935084408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 msgr2=0x556ec9d7bbc0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/1935084408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d7bbc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/1935084408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 msgr2=0x556ec9d7c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/1935084408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d7c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/1935084408 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec9a46ba0 con 0x556ec99cc850 2024-09-21T04:10:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/1935084408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d7b680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009fb0 tx=0x7f9aa000f7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e78a3ffe2cb9390f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:04.999+0000 7f9aa5d9b640 1 --2- 172.21.15.22:0/1935084408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d7c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:10:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.000+0000 7f9a9cff9640 1 -- 172.21.15.22:0/1935084408 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0011700 con 0x556ec99cc850 2024-09-21T04:10:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.000+0000 7f9a9cff9640 1 -- 172.21.15.22:0/1935084408 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aa0011d30 con 0x556ec99cc850 2024-09-21T04:10:05.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.000+0000 7f9a9cff9640 1 -- 172.21.15.22:0/1935084408 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0010cd0 con 0x556ec99cc850 2024-09-21T04:10:05.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.001+0000 7f9a9f7fe640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a8c0b6650 0x7f9a8c0b8b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.001+0000 7f9a9f7fe640 1 -- 172.21.15.22:0/1300328244 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f9a980e6a50 con 0x7f9aa8102a80 2024-09-21T04:10:05.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.001+0000 7f9aa659c640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a8c0b6650 0x7f9a8c0b8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.002+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/1935084408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 msgr2=0x556ec9d7b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:05.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.002+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/1935084408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d7b680 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0009fb0 tx=0x7f9aa000f7f0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.003+0000 7f9aa659c640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a8c0b6650 0x7f9a8c0b8b60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a98005fd0 tx=0x7f9a9800f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:05.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.003+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/1935084408 shutdown_connections 2024-09-21T04:10:05.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.003+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/1935084408 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d7bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.003+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/1935084408 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d7c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.003+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/1935084408 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d7b680 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.003+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/1935084408 >> 172.21.15.22:0/1935084408 conn(0x556ec99c0c40 msgr2=0x556ec9d79570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:05.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.004+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/1935084408 shutdown_connections 2024-09-21T04:10:05.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.004+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/1935084408 wait complete. 2024-09-21T04:10:05.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.005+0000 7f9ab2e5c740 1 -- start start 2024-09-21T04:10:05.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.005+0000 7f9ab2e5c740 1 Processor -- start 2024-09-21T04:10:05.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.006+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d872c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.006+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d87880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.006+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d93180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.006+0000 7f9ab2e5c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556ec9b3a7b0 con 0x556ec99abb70 2024-09-21T04:10:05.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.006+0000 7f9ab2e5c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x556ec9c73e90 con 0x556ec99cc850 2024-09-21T04:10:05.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.006+0000 7f9ab2e5c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556ec9d89e60 con 0x556ec99a3990 2024-09-21T04:10:05.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.006+0000 7f9ab2e5c740 10 client.0 _ll_register_callbacks cb 0x556ec9cd6710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:10:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.007+0000 7f9aa6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d93180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.007+0000 7f9aa6d9d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d93180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:35010/0 (socket says 172.21.15.22:35010) 2024-09-21T04:10:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.007+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/150784467 learned_addr learned my addr 172.21.15.22:0/150784467 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.007+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d872c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.007+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/150784467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 msgr2=0x556ec9d872c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.007+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d872c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.007+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/150784467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 msgr2=0x556ec9d87880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.007+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d87880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.007+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/150784467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec9d937f0 con 0x556ec99cc850 2024-09-21T04:10:05.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.008+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d93180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0012fe0 tx=0x7f9aa00108d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=734ca1f60b09719f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:05.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.008+0000 7f9a89ffb640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:10:05.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.008+0000 7f9a89ffb640 1 -- 172.21.15.22:0/150784467 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0010c80 con 0x556ec99cc850 2024-09-21T04:10:05.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.008+0000 7f9a89ffb640 1 -- 172.21.15.22:0/150784467 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f9aa0004a40 con 0x556ec99cc850 2024-09-21T04:10:05.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.008+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/150784467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aa0011d30 con 0x556ec99cc850 2024-09-21T04:10:05.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.008+0000 7f9a89ffb640 1 -- 172.21.15.22:0/150784467 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f9aa0003970 con 0x556ec99cc850 2024-09-21T04:10:05.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.008+0000 7f9ab2e5c740 10 client.25562 fetch_fsmap learned FSMap version 46 2024-09-21T04:10:05.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.008+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/150784467 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x556ec9d96070 con 0x556ec99cc850 2024-09-21T04:10:05.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.009+0000 7f9a89ffb640 1 -- 172.21.15.22:0/150784467 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aa0011d30 con 0x556ec99cc850 2024-09-21T04:10:05.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.009+0000 7f9a89ffb640 1 -- 172.21.15.22:0/150784467 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 46) ==== 8386+0+0 (secure 0 0 0) 0x7f9aa0027780 con 0x556ec99cc850 2024-09-21T04:10:05.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.009+0000 7f9ab2e5c740 10 client.25562 fetch_fsmap finished waiting for FSMap version 46 2024-09-21T04:10:05.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.009+0000 7f9ab2e5c740 10 client.25562 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:10:05.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.009+0000 7f9ab2e5c740 20 client.25562 populate_metadata read hostname 'smithi022' 2024-09-21T04:10:05.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.009+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556ec998b1d0 0x556ec9d994e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.009+0000 7f9ab2e5c740 4 client.25562 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:10:05.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.009+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/150784467 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ec9cebb00 con 0x556ec998b1d0 2024-09-21T04:10:05.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.010+0000 7f9aa5d9b640 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556ec998b1d0 0x556ec9d994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.011+0000 7f9a89ffb640 10 client.25562 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:05.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.011+0000 7f9aa5d9b640 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556ec998b1d0 0x556ec9d994e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94c587d8959f723a server_cookie=1a2b5724be1f7c31 in_seq=0 out_seq=0 2024-09-21T04:10:05.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.011+0000 7f9a89ffb640 1 -- 172.21.15.22:0/150784467 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x556ec9cebb00 con 0x556ec998b1d0 2024-09-21T04:10:05.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9a89ffb640 10 client.25562 handle_command_reply: tid=0 2024-09-21T04:10:05.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 client.25562 shutdown 2024-09-21T04:10:05.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/150784467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 msgr2=0x556ec9d93180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:05.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d93180 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0012fe0 tx=0x7f9aa00108d0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/150784467 shutdown_connections 2024-09-21T04:10:05.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556ec998b1d0 0x556ec9d994e0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d93180 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d87880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/150784467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d872c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/150784467 >> 172.21.15.22:0/150784467 conn(0x556ec99c0c40 msgr2=0x556ec9d7e810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:05.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9a89ffb640 0 client.25562 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:05.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/150784467 shutdown_connections 2024-09-21T04:10:05.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/150784467 wait complete. 2024-09-21T04:10:05.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.012+0000 7f9ab2e5c740 20 client.25562 trim_cache size 0 max 16384 2024-09-21T04:10:05.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.047+0000 7f9ab2e5c740 1 Processor -- start 2024-09-21T04:10:05.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.048+0000 7f9ab2e5c740 1 -- start start 2024-09-21T04:10:05.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.048+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99a3990 0x556ec9d814f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.048+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99abb70 0x556ec9d93080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.048+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99cc850 0x556ec9d86950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.051 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.048+0000 7f9ab2e5c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa81aeaa0 con 0x556ec99a3990 2024-09-21T04:10:05.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.048+0000 7f9ab2e5c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa81b06a0 con 0x556ec99abb70 2024-09-21T04:10:05.052 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.048+0000 7f9ab2e5c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa81af170 con 0x556ec99cc850 2024-09-21T04:10:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.048+0000 7f9aa6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99a3990 0x556ec9d814f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.049+0000 7f9aa6d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99a3990 0x556ec9d814f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53246/0 (socket says 172.21.15.22:53246) 2024-09-21T04:10:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.049+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/2177411057 learned_addr learned my addr 172.21.15.22:0/2177411057 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.049+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/2177411057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99cc850 0x556ec9d86950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.049+0000 7f9aa5d9b640 1 --2- 172.21.15.22:0/2177411057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99abb70 0x556ec9d93080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.049+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/2177411057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99cc850 msgr2=0x556ec9d86950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.049+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/2177411057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99cc850 0x556ec9d86950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.049+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/2177411057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99abb70 msgr2=0x556ec9d93080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.049+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/2177411057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99abb70 0x556ec9d93080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.053 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.049+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/2177411057 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ec9d794a0 con 0x556ec99a3990 2024-09-21T04:10:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.050+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/2177411057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99a3990 0x556ec9d814f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0005d70 tx=0x7f9aa000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ff0e6a8a1af31d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.051+0000 7f9a8bfff640 1 -- 172.21.15.22:0/2177411057 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa00105e0 con 0x556ec99a3990 2024-09-21T04:10:05.054 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.051+0000 7f9a8bfff640 1 -- 172.21.15.22:0/2177411057 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9aa000fcf0 con 0x556ec99a3990 2024-09-21T04:10:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.051+0000 7f9a8bfff640 1 -- 172.21.15.22:0/2177411057 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa0011500 con 0x556ec99a3990 2024-09-21T04:10:05.055 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.052+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/2177411057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99a3990 msgr2=0x556ec9d814f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.052+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/2177411057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99a3990 0x556ec9d814f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f9aa0005d70 tx=0x7f9aa000f7f0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.052+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/2177411057 shutdown_connections 2024-09-21T04:10:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.052+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/2177411057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99cc850 0x556ec9d86950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.053+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/2177411057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99abb70 0x556ec9d93080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.053+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/2177411057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99a3990 0x556ec9d814f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.056 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.053+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/2177411057 >> 172.21.15.22:0/2177411057 conn(0x556ec99c0c40 msgr2=0x556ec9d82270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.053+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/2177411057 shutdown_connections 2024-09-21T04:10:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.053+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/2177411057 wait complete. 2024-09-21T04:10:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.054+0000 7f9ab2e5c740 1 -- start start 2024-09-21T04:10:05.057 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.054+0000 7f9ab2e5c740 1 Processor -- start 2024-09-21T04:10:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.055+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d8aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.055+0000 7f9ab2e5c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d8b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.055+0000 7f9aa6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d8aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.055+0000 7f9aa6d9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d8aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:43808/0 (socket says 172.21.15.22:43808) 2024-09-21T04:10:05.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/3906768110 learned_addr learned my addr 172.21.15.22:0/3906768110 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d8ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa81affd0 con 0x556ec99abb70 2024-09-21T04:10:05.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa81af840 con 0x556ec99cc850 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9aa81aca80 con 0x556ec99a3990 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d8ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/3906768110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 msgr2=0x556ec9d8ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d8ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/3906768110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 msgr2=0x556ec9d8b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9ab2e5c740 10 client.0 _ll_register_callbacks cb 0x7f9aa0015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.056+0000 7f9aa5d9b640 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d8b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.057+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d8b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.057+0000 7f9aa6d9d640 1 -- 172.21.15.22:0/3906768110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ec9e02d40 con 0x556ec99a3990 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.057+0000 7f9aa5d9b640 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d8b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:10:05.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.057+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9aa000fcf0 con 0x556ec99a3990 2024-09-21T04:10:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.057+0000 7f9aa6d9d640 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d8aff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000a010 tx=0x7f9aa0009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75948ca600eb5ad6 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.057+0000 7f9a89ffb640 10 client.25582 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:10:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.058+0000 7f9a89ffb640 1 -- 172.21.15.22:0/3906768110 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9aa003e040 con 0x556ec99a3990 2024-09-21T04:10:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.058+0000 7f9a89ffb640 1 -- 172.21.15.22:0/3906768110 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f9aa0011500 con 0x556ec99a3990 2024-09-21T04:10:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.058+0000 7f9a89ffb640 1 -- 172.21.15.22:0/3906768110 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f9aa0011740 con 0x556ec99a3990 2024-09-21T04:10:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.058+0000 7f9ab2e5c740 10 client.25582 fetch_fsmap learned FSMap version 46 2024-09-21T04:10:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.058+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({fsmap=46}) -- 0x556ec9e03df0 con 0x556ec99a3990 2024-09-21T04:10:05.063 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.059+0000 7f9a89ffb640 1 -- 172.21.15.22:0/3906768110 <== mon.1 v2:172.21.15.73:3300/0 4 ==== fsmap(e 46) ==== 8386+0+0 (secure 0 0 0) 0x7f9aa00118e0 con 0x556ec99a3990 2024-09-21T04:10:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.060+0000 7f9ab2e5c740 10 client.25582 fetch_fsmap finished waiting for FSMap version 46 2024-09-21T04:10:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.060+0000 7f9ab2e5c740 10 client.25582 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:10:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.060+0000 7f9ab2e5c740 20 client.25582 populate_metadata read hostname 'smithi022' 2024-09-21T04:10:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.060+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556ec9960580 0x556ec9e06410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.060+0000 7f9ab2e5c740 4 client.25582 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T04:10:05.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.060+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x556ec9ce75b0 con 0x556ec9960580 2024-09-21T04:10:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.061+0000 7f9aa5d9b640 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556ec9960580 0x556ec9e06410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.063+0000 7f9aa5d9b640 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556ec9960580 0x556ec9e06410 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e28e748be2d4cd59 server_cookie=fcde9f6b83f1ed17 in_seq=0 out_seq=0 2024-09-21T04:10:05.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.063+0000 7f9a89ffb640 10 client.25582 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9a89ffb640 1 -- 172.21.15.22:0/3906768110 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x556ec9ce75b0 con 0x556ec9960580 2024-09-21T04:10:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9a89ffb640 10 client.25582 handle_command_reply: tid=0 2024-09-21T04:10:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9ab2e5c740 1 client.25582 shutdown 2024-09-21T04:10:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 msgr2=0x556ec9d8aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d8aff0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9aa000a010 tx=0x7f9aa0009f60 comp rx=0 tx=0).stop 2024-09-21T04:10:05.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 shutdown_connections 2024-09-21T04:10:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556ec9960580 0x556ec9e06410 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556ec99cc850 0x556ec9d8ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556ec99abb70 0x556ec9d8b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9a89ffb640 0 client.25582 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.359+0000 7f9ab2e5c740 1 --2- 172.21.15.22:0/3906768110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556ec99a3990 0x556ec9d8aff0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.360+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 >> 172.21.15.22:0/3906768110 conn(0x556ec99c0c40 msgr2=0x556ec9d82270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:05.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.360+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 shutdown_connections 2024-09-21T04:10:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.360+0000 7f9ab2e5c740 1 -- 172.21.15.22:0/3906768110 wait complete. 2024-09-21T04:10:05.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.360+0000 7f9ab2e5c740 20 client.25582 trim_cache size 0 max 16384 2024-09-21T04:10:05.366 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:10:05.366 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 46, 2024-09-21T04:10:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:10:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 30, 2024-09-21T04:10:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:10:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "c2d6d638": { 2024-09-21T04:10:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 30, 2024-09-21T04:10:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:10:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:10:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:10:05.367 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 141.1, 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:05.368 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:10:05.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.360+0000 7f9aac8e8640 1 -- 172.21.15.22:0/1300328244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a8c0b6650 msgr2=0x7f9a8c0b8b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:05.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.360+0000 7f9aac8e8640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a8c0b6650 0x7f9a8c0b8b60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9a98005fd0 tx=0x7f9a9800f040 comp rx=0 tx=0).stop 2024-09-21T04:10:05.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.360+0000 7f9aac8e8640 1 -- 172.21.15.22:0/1300328244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa8102a80 msgr2=0x7f9aa8198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:05.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.360+0000 7f9aac8e8640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa8102a80 0x7f9aa8198260 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9a98009820 tx=0x7f9a98009ce0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.361+0000 7f9aac8e8640 1 -- 172.21.15.22:0/1300328244 shutdown_connections 2024-09-21T04:10:05.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.361+0000 7f9aac8e8640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9a8c0b6650 0x7f9a8c0b8b60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.361+0000 7f9aac8e8640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9aa8108d10 0x7f9aa819daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.361+0000 7f9aac8e8640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9aa81083c0 0x7f9aa8198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.361+0000 7f9aac8e8640 1 --2- 172.21.15.22:0/1300328244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9aa8102a80 0x7f9aa8198260 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:05.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.361+0000 7f9aac8e8640 1 -- 172.21.15.22:0/1300328244 >> 172.21.15.22:0/1300328244 conn(0x7f9aa8079760 msgr2=0x7f9aa8104590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:05.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.361+0000 7f9aac8e8640 1 -- 172.21.15.22:0/1300328244 shutdown_connections 2024-09-21T04:10:05.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:05.361+0000 7f9aac8e8640 1 -- 172.21.15.22:0/1300328244 wait complete. 2024-09-21T04:10:06.093 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c2d6d638', quiesce took 5.1 seconds. Will release after: 15.950000000000001 2024-09-21T04:10:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:06 smithi060 ceph-mon[33722]: pgmap v603: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 9.2 MiB/s wr, 905 op/s 2024-09-21T04:10:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:06 smithi022 ceph-mon[31015]: pgmap v603: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 9.2 MiB/s wr, 905 op/s 2024-09-21T04:10:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:06 smithi073 ceph-mon[34443]: pgmap v603: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 9.2 MiB/s wr, 905 op/s 2024-09-21T04:10:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:08 smithi060 ceph-mon[33722]: pgmap v604: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.2 MiB/s wr, 861 op/s 2024-09-21T04:10:08.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 345.0 s, 188.9 tps, lat 145.181 ms stddev 42.808 2024-09-21T04:10:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:08 smithi022 ceph-mon[31015]: pgmap v604: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.2 MiB/s wr, 861 op/s 2024-09-21T04:10:08.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:08 smithi073 ceph-mon[34443]: pgmap v604: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 9.2 MiB/s wr, 861 op/s 2024-09-21T04:10:10.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:10 smithi060 ceph-mon[33722]: pgmap v605: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.2 MiB/s wr, 792 op/s 2024-09-21T04:10:10.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:10 smithi022 ceph-mon[31015]: pgmap v605: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.2 MiB/s wr, 792 op/s 2024-09-21T04:10:10.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:10 smithi073 ceph-mon[34443]: pgmap v605: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.2 MiB/s wr, 792 op/s 2024-09-21T04:10:11.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:10:11.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:10:11.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:10:11.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:10:11.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:10:11.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:10:11.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:10:11.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:10:11.857 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:10:11.858 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:10:11.858 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:10:11.858 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:10:12.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:12 smithi060 ceph-mon[33722]: pgmap v606: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-09-21T04:10:12.756 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:12 smithi073 ceph-mon[34443]: pgmap v606: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-09-21T04:10:12.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:12 smithi022 ceph-mon[31015]: pgmap v606: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.7 MiB/s wr, 676 op/s 2024-09-21T04:10:13.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 350.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:10:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:14 smithi060 ceph-mon[33722]: pgmap v607: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.3 MiB/s wr, 497 op/s 2024-09-21T04:10:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:14 smithi022 ceph-mon[31015]: pgmap v607: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.3 MiB/s wr, 497 op/s 2024-09-21T04:10:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:14 smithi073 ceph-mon[34443]: pgmap v607: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 5.3 MiB/s wr, 497 op/s 2024-09-21T04:10:16.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:16 smithi060 ceph-mon[33722]: pgmap v608: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.8 MiB/s wr, 297 op/s 2024-09-21T04:10:16.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:16 smithi022 ceph-mon[31015]: pgmap v608: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.8 MiB/s wr, 297 op/s 2024-09-21T04:10:16.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:16 smithi073 ceph-mon[34443]: pgmap v608: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 2.8 MiB/s wr, 297 op/s 2024-09-21T04:10:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:18 smithi060 ceph-mon[33722]: pgmap v609: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 184 op/s 2024-09-21T04:10:18.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 355.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:10:18.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:18 smithi022 ceph-mon[31015]: pgmap v609: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 184 op/s 2024-09-21T04:10:18.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:18 smithi073 ceph-mon[34443]: pgmap v609: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 184 op/s 2024-09-21T04:10:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:20 smithi060 ceph-mon[33722]: pgmap v610: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 868 KiB/s wr, 90 op/s 2024-09-21T04:10:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:20 smithi022 ceph-mon[31015]: pgmap v610: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 868 KiB/s wr, 90 op/s 2024-09-21T04:10:20.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:20 smithi073 ceph-mon[34443]: pgmap v610: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 868 KiB/s wr, 90 op/s 2024-09-21T04:10:22.043 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:10:22.320 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:10:22.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:22 smithi022 ceph-mon[31015]: pgmap v611: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 220 KiB/s wr, 39 op/s 2024-09-21T04:10:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:22 smithi060 ceph-mon[33722]: pgmap v611: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 220 KiB/s wr, 39 op/s 2024-09-21T04:10:22.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.828+0000 7f59dbdb7640 1 -- 172.21.15.22:0/3729833943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59d4102a60 msgr2=0x7f59d4102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:22.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.828+0000 7f59dbdb7640 1 --2- 172.21.15.22:0/3729833943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59d4102a60 0x7f59d4102e70 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f59c8009900 tx=0x7f59c802a410 comp rx=0 tx=0).stop 2024-09-21T04:10:22.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.828+0000 7f59dbdb7640 1 -- 172.21.15.22:0/3729833943 shutdown_connections 2024-09-21T04:10:22.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.828+0000 7f59dbdb7640 1 --2- 172.21.15.22:0/3729833943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d4108cf0 0x7f59d410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:22.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.828+0000 7f59dbdb7640 1 --2- 172.21.15.22:0/3729833943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d41083a0 0x7f59d41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:22.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.828+0000 7f59dbdb7640 1 --2- 172.21.15.22:0/3729833943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59d4102a60 0x7f59d4102e70 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:22.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.828+0000 7f59dbdb7640 1 -- 172.21.15.22:0/3729833943 >> 172.21.15.22:0/3729833943 conn(0x7f59d4079730 msgr2=0x7f59d4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:22.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.828+0000 7f59dbdb7640 1 -- 172.21.15.22:0/3729833943 shutdown_connections 2024-09-21T04:10:22.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.828+0000 7f59dbdb7640 1 -- 172.21.15.22:0/3729833943 wait complete. 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59dbdb7640 1 Processor -- start 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59dbdb7640 1 -- start start 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59dbdb7640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d4102a60 0x7f59d4104250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59dbdb7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59d41083a0 0x7f59d4104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59dbdb7640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d4108cf0 0x7f59d4104cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59dbdb7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f59d4112810 con 0x7f59d41083a0 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59dbdb7640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f59d4112690 con 0x7f59d4108cf0 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59dbdb7640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f59d4112990 con 0x7f59d4102a60 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59d9352640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59d41083a0 0x7f59d4104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59d9352640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59d41083a0 0x7f59d4104790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52244/0 (socket says 172.21.15.22:52244) 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59d9352640 1 -- 172.21.15.22:0/1981757296 learned_addr learned my addr 172.21.15.22:0/1981757296 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:22.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59da354640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d4108cf0 0x7f59d4104cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.829+0000 7f59d9b53640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d4102a60 0x7f59d4104250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59d9352640 1 -- 172.21.15.22:0/1981757296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d4102a60 msgr2=0x7f59d4104250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59d9352640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d4102a60 0x7f59d4104250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59d9352640 1 -- 172.21.15.22:0/1981757296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d4108cf0 msgr2=0x7f59d4104cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59d9352640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d4108cf0 0x7f59d4104cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59d9352640 1 -- 172.21.15.22:0/1981757296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59d41a8610 con 0x7f59d41083a0 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59d9352640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59d41083a0 0x7f59d4104790 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f59d000d770 tx=0x7f59d000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59c6ffd640 1 -- 172.21.15.22:0/1981757296 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0017070 con 0x7f59d41083a0 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59dbdb7640 1 -- 172.21.15.22:0/1981757296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59d41a8900 con 0x7f59d41083a0 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59c6ffd640 1 -- 172.21.15.22:0/1981757296 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f59d0009c30 con 0x7f59d41083a0 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59c6ffd640 1 -- 172.21.15.22:0/1981757296 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d000f620 con 0x7f59d41083a0 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.830+0000 7f59dbdb7640 1 -- 172.21.15.22:0/1981757296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59d41a8e40 con 0x7f59d41083a0 2024-09-21T04:10:22.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.831+0000 7f59dbdb7640 1 -- 172.21.15.22:0/1981757296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d4102e70 con 0x7f59d41083a0 2024-09-21T04:10:22.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.833+0000 7f59c6ffd640 1 -- 172.21.15.22:0/1981757296 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f59d001a070 con 0x7f59d41083a0 2024-09-21T04:10:22.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.833+0000 7f59c6ffd640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59c00b6510 0x7f59c00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:22.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.834+0000 7f59d9b53640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59c00b6510 0x7f59c00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:22.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.834+0000 7f59c6ffd640 1 -- 172.21.15.22:0/1981757296 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f59d00e7110 con 0x7f59d41083a0 2024-09-21T04:10:22.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.834+0000 7f59d9b53640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59c00b6510 0x7f59c00b8a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f59d4105ca0 tx=0x7f59c80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:22.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:22.840+0000 7f59c6ffd640 1 -- 172.21.15.22:0/1981757296 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f59d0009de0 con 0x7f59d41083a0 2024-09-21T04:10:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:22 smithi073 ceph-mon[34443]: pgmap v611: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 220 KiB/s wr, 39 op/s 2024-09-21T04:10:23.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.068+0000 7f59dbdb7640 1 -- 172.21.15.22:0/1981757296 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59d41a91a0 con 0x7f59d41083a0 2024-09-21T04:10:23.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.069+0000 7f59c6ffd640 1 -- 172.21.15.22:0/1981757296 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11966 (secure 0 0 0) 0x7f59d00b19c0 con 0x7f59d41083a0 2024-09-21T04:10:23.072 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:10:23.073 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":46,"btime":"2024-09-21T04:09:37:240006+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:09:36.909677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:10:23.073 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 46 2024-09-21T04:10:23.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 -- 172.21.15.22:0/1981757296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59c00b6510 msgr2=0x7f59c00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:23.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59c00b6510 0x7f59c00b8a20 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f59d4105ca0 tx=0x7f59c80058d0 comp rx=0 tx=0).stop 2024-09-21T04:10:23.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 -- 172.21.15.22:0/1981757296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59d41083a0 msgr2=0x7f59d4104790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:23.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59d41083a0 0x7f59d4104790 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f59d000d770 tx=0x7f59d000dc30 comp rx=0 tx=0).stop 2024-09-21T04:10:23.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 -- 172.21.15.22:0/1981757296 shutdown_connections 2024-09-21T04:10:23.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f59c00b6510 0x7f59c00b8a20 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:23.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f59d4108cf0 0x7f59d4104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:23.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59d41083a0 0x7f59d4104790 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:23.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 --2- 172.21.15.22:0/1981757296 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f59d4102a60 0x7f59d4104250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:23.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 -- 172.21.15.22:0/1981757296 >> 172.21.15.22:0/1981757296 conn(0x7f59d4079730 msgr2=0x7f59d4101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:23.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 -- 172.21.15.22:0/1981757296 shutdown_connections 2024-09-21T04:10:23.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:23.071+0000 7f59dbdb7640 1 -- 172.21.15.22:0/1981757296 wait complete. 2024-09-21T04:10:23.661 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:23 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1981757296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:23.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:23 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1981757296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:23.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 360.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:10:23.858 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:23 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1981757296' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:24.094 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id c2d6d638 --release --await' 2024-09-21T04:10:24.094 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id c2d6d638 --release --await 2024-09-21T04:10:24.366 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:10:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:24 smithi060 ceph-mon[33722]: pgmap v612: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 178 KiB/s wr, 31 op/s 2024-09-21T04:10:24.762 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:24 smithi022 ceph-mon[31015]: pgmap v612: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 178 KiB/s wr, 31 op/s 2024-09-21T04:10:24.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:24 smithi073 ceph-mon[34443]: pgmap v612: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 178 KiB/s wr, 31 op/s 2024-09-21T04:10:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.861+0000 7f33f0cf6640 1 -- 172.21.15.22:0/2693368831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33ec1094a0 msgr2=0x7f33ec1098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.861+0000 7f33f0cf6640 1 --2- 172.21.15.22:0/2693368831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33ec1094a0 0x7f33ec1098b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009900 tx=0x7f33e002a410 comp rx=0 tx=0).stop 2024-09-21T04:10:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.861+0000 7f33f0cf6640 1 -- 172.21.15.22:0/2693368831 shutdown_connections 2024-09-21T04:10:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.861+0000 7f33f0cf6640 1 --2- 172.21.15.22:0/2693368831 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ec109df0 0x7f33ec110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.861+0000 7f33f0cf6640 1 --2- 172.21.15.22:0/2693368831 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33ec1094a0 0x7f33ec1098b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.861+0000 7f33f0cf6640 1 --2- 172.21.15.22:0/2693368831 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec103b60 0x7f33ec103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.861+0000 7f33f0cf6640 1 -- 172.21.15.22:0/2693368831 >> 172.21.15.22:0/2693368831 conn(0x7f33ec07b850 msgr2=0x7f33ec07bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.861+0000 7f33f0cf6640 1 -- 172.21.15.22:0/2693368831 shutdown_connections 2024-09-21T04:10:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.861+0000 7f33f0cf6640 1 -- 172.21.15.22:0/2693368831 wait complete. 2024-09-21T04:10:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33f0cf6640 1 Processor -- start 2024-09-21T04:10:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33f0cf6640 1 -- start start 2024-09-21T04:10:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33f0cf6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33ec103b60 0x7f33ec19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33f0cf6640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec1094a0 0x7f33ec19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33f0cf6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ec109df0 0x7f33ec19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33f0cf6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec113960 con 0x7f33ec103b60 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33f0cf6640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec1137e0 con 0x7f33ec1094a0 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33f0cf6640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec113ae0 con 0x7f33ec109df0 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33ea59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33ec103b60 0x7f33ec19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33ea59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33ec103b60 0x7f33ec19a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52262/0 (socket says 172.21.15.22:52262) 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33ea59c640 1 -- 172.21.15.22:0/1491519776 learned_addr learned my addr 172.21.15.22:0/1491519776 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec1094a0 0x7f33ec19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.862+0000 7f33ead9d640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ec109df0 0x7f33ec19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33ea59c640 1 -- 172.21.15.22:0/1491519776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ec109df0 msgr2=0x7f33ec19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33ea59c640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ec109df0 0x7f33ec19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33ea59c640 1 -- 172.21.15.22:0/1491519776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec1094a0 msgr2=0x7f33ec19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:24.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33ea59c640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec1094a0 0x7f33ec19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33ea59c640 1 -- 172.21.15.22:0/1491519776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ec1a0340 con 0x7f33ec103b60 2024-09-21T04:10:24.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33ea59c640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33ec103b60 0x7f33ec19a3d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00e9f0 tx=0x7f33dc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:24.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33db7fe640 1 -- 172.21.15.22:0/1491519776 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00cd80 con 0x7f33ec103b60 2024-09-21T04:10:24.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33db7fe640 1 -- 172.21.15.22:0/1491519776 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33dc0108c0 con 0x7f33ec103b60 2024-09-21T04:10:24.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33f0cf6640 1 -- 172.21.15.22:0/1491519776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33ec1a0630 con 0x7f33ec103b60 2024-09-21T04:10:24.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33db7fe640 1 -- 172.21.15.22:0/1491519776 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33dc0187c0 con 0x7f33ec103b60 2024-09-21T04:10:24.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.863+0000 7f33f0cf6640 1 -- 172.21.15.22:0/1491519776 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33ec1a6d90 con 0x7f33ec103b60 2024-09-21T04:10:24.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.866+0000 7f33db7fe640 1 -- 172.21.15.22:0/1491519776 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f33dc010430 con 0x7f33ec103b60 2024-09-21T04:10:24.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.866+0000 7f33f726a740 1 Processor -- start 2024-09-21T04:10:24.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.866+0000 7f33f726a740 1 -- start start 2024-09-21T04:10:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33f726a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b479520 0x55b08b81f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33f726a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b450660 0x55b08b81fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33f726a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b81ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33f726a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b08b70adc0 con 0x55b08b458840 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33f726a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b08b7971f0 con 0x55b08b450660 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33f726a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b08b786620 con 0x55b08b479520 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33e9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b81ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33e9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b81ff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52266/0 (socket says 172.21.15.22:52266) 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33e9d9b640 1 -- 172.21.15.22:0/1168900132 learned_addr learned my addr 172.21.15.22:0/1168900132 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33ead9d640 1 --2- 172.21.15.22:0/1168900132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b479520 0x55b08b81f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33db7fe640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f33d40b6590 0x7f33d40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33ea59c640 1 --2- 172.21.15.22:0/1168900132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b450660 0x55b08b81fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33e9d9b640 1 -- 172.21.15.22:0/1168900132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b479520 msgr2=0x55b08b81f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/1168900132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b479520 0x55b08b81f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33e9d9b640 1 -- 172.21.15.22:0/1168900132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b450660 msgr2=0x55b08b81fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33ead9d640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f33d40b6590 0x7f33d40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/1168900132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b450660 0x55b08b81fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33e9d9b640 1 -- 172.21.15.22:0/1168900132 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b08b74efd0 con 0x55b08b458840 2024-09-21T04:10:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.867+0000 7f33ea59c640 1 --2- 172.21.15.22:0/1168900132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b450660 0x55b08b81fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:10:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.868+0000 7f33db7fe640 1 -- 172.21.15.22:0/1491519776 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f33dc0e7990 con 0x7f33ec103b60 2024-09-21T04:10:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.868+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/1168900132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b81ff90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f33e00057c0 tx=0x7f33e0031a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=973a766ea18641f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:24.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.868+0000 7f33d8ff9640 1 -- 172.21.15.22:0/1168900132 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0040070 con 0x55b08b458840 2024-09-21T04:10:24.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.868+0000 7f33d8ff9640 1 -- 172.21.15.22:0/1168900132 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33e0004030 con 0x55b08b458840 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.868+0000 7f33d8ff9640 1 -- 172.21.15.22:0/1168900132 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0035040 con 0x55b08b458840 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33f726a740 1 -- 172.21.15.22:0/1168900132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 msgr2=0x55b08b81ff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33f726a740 1 --2- 172.21.15.22:0/1168900132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b81ff90 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f33e00057c0 tx=0x7f33e0031a70 comp rx=0 tx=0).stop 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33ead9d640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f33d40b6590 0x7f33d40b8aa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33e4005c40 tx=0x7f33e4004ab0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33f726a740 1 -- 172.21.15.22:0/1168900132 shutdown_connections 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33f726a740 1 --2- 172.21.15.22:0/1168900132 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b81ff90 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33f726a740 1 --2- 172.21.15.22:0/1168900132 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b450660 0x55b08b81fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33f726a740 1 --2- 172.21.15.22:0/1168900132 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b479520 0x55b08b81f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33f726a740 1 -- 172.21.15.22:0/1168900132 >> 172.21.15.22:0/1168900132 conn(0x55b08b46d910 msgr2=0x55b08b81d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33f726a740 1 -- 172.21.15.22:0/1168900132 shutdown_connections 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33f726a740 1 -- 172.21.15.22:0/1168900132 wait complete. 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.869+0000 7f33f726a740 1 -- start start 2024-09-21T04:10:24.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33f726a740 1 Processor -- start 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33f726a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b82ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33f726a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33f726a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 0x55b08b82b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33f726a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55b08b721300 con 0x55b08b458840 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33f726a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55b08b78a430 con 0x55b08b479520 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33f726a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55b08b5e7bb0 con 0x55b08b450660 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33f726a740 10 client.0 _ll_register_callbacks cb 0x55b08b73b120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33e9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33e9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52272/0 (socket says 172.21.15.22:52272) 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.870+0000 7f33e9d9b640 1 -- 172.21.15.22:0/3884126974 learned_addr learned my addr 172.21.15.22:0/3884126974 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33ea59c640 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b82ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33ead9d640 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 0x55b08b82b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33e9d9b640 1 -- 172.21.15.22:0/3884126974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 msgr2=0x55b08b82ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:24.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b82ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33e9d9b640 1 -- 172.21.15.22:0/3884126974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 msgr2=0x55b08b82b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 0x55b08b82b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33e9d9b640 1 -- 172.21.15.22:0/3884126974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b08b710780 con 0x55b08b458840 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33ead9d640 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 0x55b08b82b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82b060 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f33e0032fd0 tx=0x7f33e00041e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f67ba0d28311245 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33d1ffb640 1 -- 172.21.15.22:0/3884126974 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0055030 con 0x55b08b458840 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33d1ffb640 1 -- 172.21.15.22:0/3884126974 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f33e0031400 con 0x55b08b458840 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.871+0000 7f33f726a740 1 -- 172.21.15.22:0/3884126974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33e0004030 con 0x55b08b458840 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33d1ffb640 1 -- 172.21.15.22:0/3884126974 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f33e005f050 con 0x55b08b458840 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33f726a740 10 client.15969 fetch_fsmap learned FSMap version 46 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33f726a740 1 -- 172.21.15.22:0/3884126974 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b08b4e4b00 con 0x55b08b458840 2024-09-21T04:10:24.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33d1ffb640 1 -- 172.21.15.22:0/3884126974 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33e0004030 con 0x55b08b458840 2024-09-21T04:10:24.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33d1ffb640 1 -- 172.21.15.22:0/3884126974 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 46) ==== 8386+0+0 (secure 0 0 0) 0x7f33e0003860 con 0x55b08b458840 2024-09-21T04:10:24.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33f726a740 10 client.15969 fetch_fsmap finished waiting for FSMap version 46 2024-09-21T04:10:24.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33f726a740 10 client.15969 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:10:24.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33f726a740 20 client.15969 populate_metadata read hostname 'smithi022' 2024-09-21T04:10:24.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33f726a740 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55b08b437ea0 0x55b08b83ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33f726a740 4 client.15969 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:10:24.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33f726a740 1 -- 172.21.15.22:0/3884126974 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b08b799140 con 0x55b08b437ea0 2024-09-21T04:10:24.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.872+0000 7f33ea59c640 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55b08b437ea0 0x55b08b83ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.873+0000 7f33d1ffb640 10 client.15969 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.873+0000 7f33ea59c640 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55b08b437ea0 0x55b08b83ccb0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c24cde90801f9f10 server_cookie=e7619fae56f1f1c5 in_seq=0 out_seq=0 2024-09-21T04:10:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33d1ffb640 1 -- 172.21.15.22:0/3884126974 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55b08b799140 con 0x55b08b437ea0 2024-09-21T04:10:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33d1ffb640 10 client.15969 handle_command_reply: tid=0 2024-09-21T04:10:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 client.15969 shutdown 2024-09-21T04:10:24.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 -- 172.21.15.22:0/3884126974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 msgr2=0x55b08b82b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82b060 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f33e0032fd0 tx=0x7f33e00041e0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 -- 172.21.15.22:0/3884126974 shutdown_connections 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55b08b437ea0 0x55b08b83ccb0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 0x55b08b82b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82b060 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33d1ffb640 0 client.15969 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 --2- 172.21.15.22:0/3884126974 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b82ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 -- 172.21.15.22:0/3884126974 >> 172.21.15.22:0/3884126974 conn(0x55b08b46d910 msgr2=0x55b08b8226a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 -- 172.21.15.22:0/3884126974 shutdown_connections 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 1 -- 172.21.15.22:0/3884126974 wait complete. 2024-09-21T04:10:24.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.874+0000 7f33f726a740 20 client.15969 trim_cache size 0 max 16384 2024-09-21T04:10:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.891+0000 7f33f726a740 1 Processor -- start 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.891+0000 7f33f726a740 1 -- start start 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33f726a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b820f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33f726a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33f726a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 0x55b08b83fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33f726a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec1ae880 con 0x55b08b458840 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33f726a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec1b0480 con 0x55b08b479520 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33f726a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec1aef50 con 0x55b08b450660 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33e9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33e9d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82c750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52274/0 (socket says 172.21.15.22:52274) 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33e9d9b640 1 -- 172.21.15.22:0/792149772 learned_addr learned my addr 172.21.15.22:0/792149772 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33ea59c640 1 --2- 172.21.15.22:0/792149772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b820f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33ead9d640 1 --2- 172.21.15.22:0/792149772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 0x55b08b83fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33e9d9b640 1 -- 172.21.15.22:0/792149772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 msgr2=0x55b08b820f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/792149772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b820f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33e9d9b640 1 -- 172.21.15.22:0/792149772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 msgr2=0x55b08b83fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/792149772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 0x55b08b83fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33e9d9b640 1 -- 172.21.15.22:0/792149772 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b08b55b960 con 0x55b08b458840 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33ea59c640 1 --2- 172.21.15.22:0/792149772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b820f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.892+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/792149772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82c750 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f33e002a450 tx=0x7f33e0004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64cfaebb6a752b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33d3fff640 1 -- 172.21.15.22:0/792149772 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0055030 con 0x55b08b458840 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33d3fff640 1 -- 172.21.15.22:0/792149772 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33e0031a70 con 0x55b08b458840 2024-09-21T04:10:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33d3fff640 1 -- 172.21.15.22:0/792149772 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e0035070 con 0x55b08b458840 2024-09-21T04:10:24.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33f726a740 1 -- 172.21.15.22:0/792149772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 msgr2=0x55b08b82c750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:24.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33f726a740 1 --2- 172.21.15.22:0/792149772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82c750 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f33e002a450 tx=0x7f33e0004610 comp rx=0 tx=0).stop 2024-09-21T04:10:24.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33f726a740 1 -- 172.21.15.22:0/792149772 shutdown_connections 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33f726a740 1 --2- 172.21.15.22:0/792149772 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b479520 0x55b08b83fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33f726a740 1 --2- 172.21.15.22:0/792149772 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b458840 0x55b08b82c750 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33f726a740 1 --2- 172.21.15.22:0/792149772 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b820f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33f726a740 1 -- 172.21.15.22:0/792149772 >> 172.21.15.22:0/792149772 conn(0x55b08b46d910 msgr2=0x55b08b82c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.893+0000 7f33f726a740 1 -- 172.21.15.22:0/792149772 shutdown_connections 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33f726a740 1 -- 172.21.15.22:0/792149772 wait complete. 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33f726a740 1 -- start start 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33f726a740 1 Processor -- start 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33f726a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b89b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33f726a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b458840 0x55b08b89bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33f726a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b479520 0x55b08b8a6440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33f726a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec1afdb0 con 0x55b08b479520 2024-09-21T04:10:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33f726a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec1af620 con 0x55b08b458840 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33f726a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f33ec1ac880 con 0x55b08b450660 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33f726a740 10 client.0 _ll_register_callbacks cb 0x7f33e4009b30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33ead9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b479520 0x55b08b8a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33ead9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b479520 0x55b08b8a6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:52276/0 (socket says 172.21.15.22:52276) 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.894+0000 7f33ead9d640 1 -- 172.21.15.22:0/963181411 learned_addr learned my addr 172.21.15.22:0/963181411 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33ea59c640 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b89b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33e9d9b640 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b458840 0x55b08b89bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33ead9d640 1 -- 172.21.15.22:0/963181411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 msgr2=0x55b08b89b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33ead9d640 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b89b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33ead9d640 1 -- 172.21.15.22:0/963181411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b458840 msgr2=0x55b08b89bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33ead9d640 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b458840 0x55b08b89bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33ead9d640 1 -- 172.21.15.22:0/963181411 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b08b8a6ab0 con 0x55b08b479520 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33ead9d640 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b479520 0x55b08b8a6440 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f33e4003bd0 tx=0x7f33e4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e8559d24fe941 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33d1ffb640 1 -- 172.21.15.22:0/963181411 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33e4004d20 con 0x55b08b479520 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33d1ffb640 1 -- 172.21.15.22:0/963181411 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f33e4004320 con 0x55b08b479520 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33f726a740 1 -- 172.21.15.22:0/963181411 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f33e0031a70 con 0x55b08b479520 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33d1ffb640 1 -- 172.21.15.22:0/963181411 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f33e4032050 con 0x55b08b479520 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33f726a740 10 client.15975 fetch_fsmap learned FSMap version 46 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.895+0000 7f33f726a740 1 -- 172.21.15.22:0/963181411 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55b08b8a7db0 con 0x55b08b479520 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.896+0000 7f33d1ffb640 1 -- 172.21.15.22:0/963181411 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33e0031a70 con 0x55b08b479520 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.896+0000 7f33d1ffb640 1 -- 172.21.15.22:0/963181411 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 46) ==== 8386+0+0 (secure 0 0 0) 0x7f33e401f040 con 0x55b08b479520 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.896+0000 7f33f726a740 10 client.15975 fetch_fsmap finished waiting for FSMap version 46 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.896+0000 7f33f726a740 10 client.15975 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:10:24.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.896+0000 7f33f726a740 20 client.15975 populate_metadata read hostname 'smithi022' 2024-09-21T04:10:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.896+0000 7f33f726a740 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55b08b40d250 0x55b08b8aa560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.896+0000 7f33f726a740 4 client.15975 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c2d6d638", "release": true, "await": true}] 2024-09-21T04:10:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.896+0000 7f33f726a740 1 -- 172.21.15.22:0/963181411 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c2d6d638", "release": true, "await": true}) -- 0x55b08b794bf0 con 0x55b08b40d250 2024-09-21T04:10:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.896+0000 7f33ea59c640 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55b08b40d250 0x55b08b8aa560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.897+0000 7f33d1ffb640 10 client.15975 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:24.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.897+0000 7f33ea59c640 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55b08b40d250 0x55b08b8aa560 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=586415eec429055a server_cookie=2132b6f40c4863e2 in_seq=0 out_seq=0 2024-09-21T04:10:24.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33d1ffb640 1 -- 172.21.15.22:0/963181411 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55b08b794bf0 con 0x55b08b40d250 2024-09-21T04:10:24.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33d1ffb640 10 client.15975 handle_command_reply: tid=0 2024-09-21T04:10:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 client.15975 shutdown 2024-09-21T04:10:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 -- 172.21.15.22:0/963181411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b479520 msgr2=0x55b08b8a6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b479520 0x55b08b8a6440 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f33e4003bd0 tx=0x7f33e4004a40 comp rx=0 tx=0).stop 2024-09-21T04:10:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 -- 172.21.15.22:0/963181411 shutdown_connections 2024-09-21T04:10:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55b08b40d250 0x55b08b8aa560 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55b08b479520 0x55b08b8a6440 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33d1ffb640 0 client.15975 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55b08b458840 0x55b08b89bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 --2- 172.21.15.22:0/963181411 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55b08b450660 0x55b08b89b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 -- 172.21.15.22:0/963181411 >> 172.21.15.22:0/963181411 conn(0x55b08b46d910 msgr2=0x55b08b835d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 -- 172.21.15.22:0/963181411 shutdown_connections 2024-09-21T04:10:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.952+0000 7f33f726a740 1 -- 172.21.15.22:0/963181411 wait complete. 2024-09-21T04:10:24.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f726a740 20 client.15975 trim_cache size 0 max 16384 2024-09-21T04:10:24.956 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:10:24.956 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 46, 2024-09-21T04:10:24.956 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 32, 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "c2d6d638": { 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 32, 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 141.1, 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:10:24.957 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:10:24.958 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:10:24.958 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:10:24.958 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:24.958 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:24.958 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:24.958 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:24.958 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:24.958 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:10:24.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f0cf6640 1 -- 172.21.15.22:0/1491519776 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f33d40b6590 msgr2=0x7f33d40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:24.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f0cf6640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f33d40b6590 0x7f33d40b8aa0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f33e4005c40 tx=0x7f33e4004ab0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f0cf6640 1 -- 172.21.15.22:0/1491519776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33ec103b60 msgr2=0x7f33ec19a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:24.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f0cf6640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33ec103b60 0x7f33ec19a3d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f33dc00e9f0 tx=0x7f33dc00eeb0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f0cf6640 1 -- 172.21.15.22:0/1491519776 shutdown_connections 2024-09-21T04:10:24.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f0cf6640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f33d40b6590 0x7f33d40b8aa0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f0cf6640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f33ec109df0 0x7f33ec19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f0cf6640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f33ec1094a0 0x7f33ec19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f0cf6640 1 --2- 172.21.15.22:0/1491519776 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f33ec103b60 0x7f33ec19a3d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:24.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.953+0000 7f33f0cf6640 1 -- 172.21.15.22:0/1491519776 >> 172.21.15.22:0/1491519776 conn(0x7f33ec07b850 msgr2=0x7f33ec105570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:24.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.954+0000 7f33f0cf6640 1 -- 172.21.15.22:0/1491519776 shutdown_connections 2024-09-21T04:10:24.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:24.954+0000 7f33f0cf6640 1 -- 172.21.15.22:0/1491519776 wait complete. 2024-09-21T04:10:25.855 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c2d6d638', total seconds elapsed: 24.9 2024-09-21T04:10:25.855 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.05 2024-09-21T04:10:25.856 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:10:26.330 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:10:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:26 smithi060 ceph-mon[33722]: pgmap v613: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 196 KiB/s wr, 35 op/s 2024-09-21T04:10:26.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:26 smithi022 ceph-mon[31015]: pgmap v613: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 196 KiB/s wr, 35 op/s 2024-09-21T04:10:26.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:26 smithi073 ceph-mon[34443]: pgmap v613: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 196 KiB/s wr, 35 op/s 2024-09-21T04:10:27.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.206+0000 7f666cb88640 1 -- 172.21.15.22:0/3645884099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6668115720 msgr2=0x7f6668117b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.206+0000 7f666cb88640 1 --2- 172.21.15.22:0/3645884099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6668115720 0x7f6668117b40 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f6660009ca0 tx=0x7f666002a8b0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.206+0000 7f666cb88640 1 -- 172.21.15.22:0/3645884099 shutdown_connections 2024-09-21T04:10:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.206+0000 7f666cb88640 1 --2- 172.21.15.22:0/3645884099 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6668112dc0 0x7f66681151e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.206+0000 7f666cb88640 1 --2- 172.21.15.22:0/3645884099 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6668115720 0x7f6668117b40 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.206+0000 7f666cb88640 1 --2- 172.21.15.22:0/3645884099 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f666810bff0 0x7f666810c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.206+0000 7f666cb88640 1 -- 172.21.15.22:0/3645884099 >> 172.21.15.22:0/3645884099 conn(0x7f66680712f0 msgr2=0x7f6668073e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:27.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.210+0000 7f666cb88640 1 -- 172.21.15.22:0/3645884099 shutdown_connections 2024-09-21T04:10:27.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.212+0000 7f666cb88640 1 -- 172.21.15.22:0/3645884099 wait complete. 2024-09-21T04:10:27.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.213+0000 7f666cb88640 1 Processor -- start 2024-09-21T04:10:27.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.213+0000 7f666cb88640 1 -- start start 2024-09-21T04:10:27.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.213+0000 7f666cb88640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f666810bff0 0x7f66681a2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:27.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.213+0000 7f666cb88640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6668112dc0 0x7f66681a31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:27.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.213+0000 7f666cb88640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6668115720 0x7f66681a8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:27.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.213+0000 7f666cb88640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f666811c180 con 0x7f6668115720 2024-09-21T04:10:27.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.213+0000 7f666cb88640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f666811c000 con 0x7f6668112dc0 2024-09-21T04:10:27.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.213+0000 7f666cb88640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f666811c300 con 0x7f666810bff0 2024-09-21T04:10:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.214+0000 7f666659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f666810bff0 0x7f66681a2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.214+0000 7f666659c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f666810bff0 0x7f66681a2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:45830/0 (socket says 172.21.15.22:45830) 2024-09-21T04:10:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.214+0000 7f666659c640 1 -- 172.21.15.22:0/2193453042 learned_addr learned my addr 172.21.15.22:0/2193453042 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.214+0000 7f666659c640 1 -- 172.21.15.22:0/2193453042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6668112dc0 msgr2=0x7f66681a31b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T04:10:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.214+0000 7f666659c640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6668112dc0 0x7f66681a31b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.214+0000 7f666659c640 1 -- 172.21.15.22:0/2193453042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6668115720 msgr2=0x7f66681a8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.214+0000 7f666659c640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6668115720 0x7f66681a8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.214+0000 7f666659c640 1 -- 172.21.15.22:0/2193453042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66681a8990 con 0x7f666810bff0 2024-09-21T04:10:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.214+0000 7f666659c640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f666810bff0 0x7f66681a2c10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f665800c920 tx=0x7f665800cde0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:27.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.215+0000 7f665f7fe640 1 -- 172.21.15.22:0/2193453042 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658007c70 con 0x7f666810bff0 2024-09-21T04:10:27.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.215+0000 7f666cb88640 1 -- 172.21.15.22:0/2193453042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66681a8c80 con 0x7f666810bff0 2024-09-21T04:10:27.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.215+0000 7f666cb88640 1 -- 172.21.15.22:0/2193453042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66681a91c0 con 0x7f666810bff0 2024-09-21T04:10:27.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.215+0000 7f665f7fe640 1 -- 172.21.15.22:0/2193453042 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6658007e10 con 0x7f666810bff0 2024-09-21T04:10:27.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.215+0000 7f665f7fe640 1 -- 172.21.15.22:0/2193453042 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6658018780 con 0x7f666810bff0 2024-09-21T04:10:27.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.219+0000 7f666cb88640 1 -- 172.21.15.22:0/2193453042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66480052c0 con 0x7f666810bff0 2024-09-21T04:10:27.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.220+0000 7f665f7fe640 1 -- 172.21.15.22:0/2193453042 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f66580189c0 con 0x7f666810bff0 2024-09-21T04:10:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.221+0000 7f665f7fe640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66540b6710 0x7f66540b8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:27.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.221+0000 7f665ffff640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66540b6710 0x7f66540b8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.222+0000 7f665f7fe640 1 -- 172.21.15.22:0/2193453042 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f66580e75c0 con 0x7f666810bff0 2024-09-21T04:10:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.223+0000 7f665ffff640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66540b6710 0x7f66540b8c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6668117de0 tx=0x7f6650005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:27.229 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.227+0000 7f665f7fe640 1 -- 172.21.15.22:0/2193453042 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6658014030 con 0x7f666810bff0 2024-09-21T04:10:27.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.673+0000 7f666cb88640 1 -- 172.21.15.22:0/2193453042 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f66480055b0 con 0x7f666810bff0 2024-09-21T04:10:27.679 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:10:27.679 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":46,"btime":"2024-09-21T04:09:37:240006+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:09:36.909677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:10:27.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.674+0000 7f665f7fe640 1 -- 172.21.15.22:0/2193453042 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11966 (secure 0 0 0) 0x7f66580ada30 con 0x7f666810bff0 2024-09-21T04:10:27.679 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 46 2024-09-21T04:10:27.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.681+0000 7f666cb88640 1 -- 172.21.15.22:0/2193453042 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66540b6710 msgr2=0x7f66540b8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:27.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.681+0000 7f666cb88640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66540b6710 0x7f66540b8c20 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6668117de0 tx=0x7f6650005f90 comp rx=0 tx=0).stop 2024-09-21T04:10:27.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.681+0000 7f666cb88640 1 -- 172.21.15.22:0/2193453042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f666810bff0 msgr2=0x7f66681a2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:27.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.681+0000 7f666cb88640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f666810bff0 0x7f66681a2c10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f665800c920 tx=0x7f665800cde0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.681+0000 7f666cb88640 1 -- 172.21.15.22:0/2193453042 shutdown_connections 2024-09-21T04:10:27.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.681+0000 7f666cb88640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f66540b6710 0x7f66540b8c20 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.681+0000 7f666cb88640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6668115720 0x7f66681a8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.681+0000 7f666cb88640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6668112dc0 0x7f66681a31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.681+0000 7f666cb88640 1 --2- 172.21.15.22:0/2193453042 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f666810bff0 0x7f66681a2c10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:27.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.681+0000 7f666cb88640 1 -- 172.21.15.22:0/2193453042 >> 172.21.15.22:0/2193453042 conn(0x7f66680712f0 msgr2=0x7f6668115b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:27.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.682+0000 7f666cb88640 1 -- 172.21.15.22:0/2193453042 shutdown_connections 2024-09-21T04:10:27.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:27.682+0000 7f666cb88640 1 -- 172.21.15.22:0/2193453042 wait complete. 2024-09-21T04:10:28.379 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0' 2024-09-21T04:10:28.379 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 141.05 --await-for 45.0 2024-09-21T04:10:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:28 smithi022 ceph-mon[31015]: pgmap v614: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 361 KiB/s wr, 55 op/s 2024-09-21T04:10:28.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:28 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2193453042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:28.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:28 smithi060 ceph-mon[33722]: pgmap v614: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 361 KiB/s wr, 55 op/s 2024-09-21T04:10:28.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:28 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2193453042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:28.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 365.0 s, 582.8 tps, lat 807.523 ms stddev 3605.958 2024-09-21T04:10:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:28 smithi073 ceph-mon[34443]: pgmap v614: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 361 KiB/s wr, 55 op/s 2024-09-21T04:10:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:28 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2193453042' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:28.893 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:10:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:30 smithi060 ceph-mon[33722]: pgmap v615: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2024-09-21T04:10:30.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:30 smithi022 ceph-mon[31015]: pgmap v615: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2024-09-21T04:10:30.854 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:30 smithi073 ceph-mon[34443]: pgmap v615: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 1.2 MiB/s wr, 117 op/s 2024-09-21T04:10:32.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.512+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/2788423762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a44108d10 msgr2=0x7f8a4410f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:32.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.512+0000 7f8a4bc5a640 1 --2- 172.21.15.22:0/2788423762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a44108d10 0x7f8a4410f540 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c009ca0 tx=0x7f8a3c02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.512+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/2788423762 shutdown_connections 2024-09-21T04:10:32.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.512+0000 7f8a4bc5a640 1 --2- 172.21.15.22:0/2788423762 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a44108d10 0x7f8a4410f540 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.512+0000 7f8a4bc5a640 1 --2- 172.21.15.22:0/2788423762 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a441083c0 0x7f8a441087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.512+0000 7f8a4bc5a640 1 --2- 172.21.15.22:0/2788423762 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a44103150 0x7f8a44103560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.512+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/2788423762 >> 172.21.15.22:0/2788423762 conn(0x7f8a44079f50 msgr2=0x7f8a4407a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.512+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/2788423762 shutdown_connections 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.512+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/2788423762 wait complete. 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.513+0000 7f8a4bc5a640 1 Processor -- start 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.513+0000 7f8a4bc5a640 1 -- start start 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.513+0000 7f8a4bc5a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a44103150 0x7f8a4419a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.513+0000 7f8a4bc5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a441083c0 0x7f8a4419a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.513+0000 7f8a4bc5a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a44108d10 0x7f8a4419fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a4bc5a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441139d0 con 0x7f8a441083c0 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a4bc5a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a44113850 con 0x7f8a44108d10 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a4bc5a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a44113b50 con 0x7f8a44103150 2024-09-21T04:10:32.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a491f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a441083c0 0x7f8a4419a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a499f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a44103150 0x7f8a4419a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a499f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a44103150 0x7f8a4419a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:50574/0 (socket says 172.21.15.22:50574) 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a499f6640 1 -- 172.21.15.22:0/3320532478 learned_addr learned my addr 172.21.15.22:0/3320532478 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a491f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a441083c0 0x7f8a4419a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41358/0 (socket says 172.21.15.22:41358) 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a4a1f7640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a44108d10 0x7f8a4419fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a491f5640 1 -- 172.21.15.22:0/3320532478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a44103150 msgr2=0x7f8a4419a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a491f5640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a44103150 0x7f8a4419a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a491f5640 1 -- 172.21.15.22:0/3320532478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a44108d10 msgr2=0x7f8a4419fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a491f5640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a44108d10 0x7f8a4419fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a491f5640 1 -- 172.21.15.22:0/3320532478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a441a02d0 con 0x7f8a441083c0 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a499f6640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a44103150 0x7f8a4419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a491f5640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a441083c0 0x7f8a4419a900 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8a44075a40 tx=0x7f8a3400ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:32.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.514+0000 7f8a3affd640 1 -- 172.21.15.22:0/3320532478 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a3400cc40 con 0x7f8a441083c0 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.515+0000 7f8a3affd640 1 -- 172.21.15.22:0/3320532478 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a3400cde0 con 0x7f8a441083c0 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.515+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/3320532478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a441a05c0 con 0x7f8a441083c0 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.515+0000 7f8a3affd640 1 -- 172.21.15.22:0/3320532478 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340186f0 con 0x7f8a441083c0 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.515+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/3320532478 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a441a6d20 con 0x7f8a441083c0 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.517+0000 7f8a521ce740 1 Processor -- start 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a521ce740 1 -- start start 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a3affd640 1 -- 172.21.15.22:0/3320532478 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8a34010a70 con 0x7f8a441083c0 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb22e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb233b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb238f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a521ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5637bca99bb0 con 0x5637bc75bb70 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a521ce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5637bca88fe0 con 0x5637bc753990 2024-09-21T04:10:32.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a521ce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5637bca8cdf0 con 0x5637bc77c850 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a491f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb238f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a491f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb238f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41372/0 (socket says 172.21.15.22:41372) 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a491f5640 1 -- 172.21.15.22:0/1646940819 learned_addr learned my addr 172.21.15.22:0/1646940819 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a499f6640 1 --2- 172.21.15.22:0/1646940819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb233b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.518+0000 7f8a4a1f7640 1 --2- 172.21.15.22:0/1646940819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb22e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a499f6640 1 -- 172.21.15.22:0/1646940819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 msgr2=0x5637bcb22e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a499f6640 1 --2- 172.21.15.22:0/1646940819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb22e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a499f6640 1 -- 172.21.15.22:0/1646940819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 msgr2=0x5637bcb238f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a499f6640 1 --2- 172.21.15.22:0/1646940819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb238f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a499f6640 1 -- 172.21.15.22:0/1646940819 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637bc7f6ba0 con 0x5637bc753990 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a491f5640 1 --2- 172.21.15.22:0/1646940819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb238f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a3affd640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8a300b6510 0x7f8a300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a4a1f7640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8a300b6510 0x7f8a300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a499f6640 1 --2- 172.21.15.22:0/1646940819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb233b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a40011510 tx=0x7f8a400119d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ef6077578effbef server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a3affd640 1 -- 172.21.15.22:0/3320532478 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f8a340e7940 con 0x7f8a441083c0 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a2ffff640 1 -- 172.21.15.22:0/1646940819 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40005020 con 0x5637bc753990 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a2ffff640 1 -- 172.21.15.22:0/1646940819 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a400047a0 con 0x5637bc753990 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.519+0000 7f8a2ffff640 1 -- 172.21.15.22:0/1646940819 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4000f8e0 con 0x5637bc753990 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.520+0000 7f8a521ce740 1 -- 172.21.15.22:0/1646940819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 msgr2=0x5637bcb233b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.520+0000 7f8a4a1f7640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8a300b6510 0x7f8a300b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c006010 tx=0x7f8a3c005c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.520+0000 7f8a521ce740 1 --2- 172.21.15.22:0/1646940819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb233b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8a40011510 tx=0x7f8a400119d0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.520+0000 7f8a521ce740 1 -- 172.21.15.22:0/1646940819 shutdown_connections 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.520+0000 7f8a521ce740 1 --2- 172.21.15.22:0/1646940819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb238f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.520+0000 7f8a521ce740 1 --2- 172.21.15.22:0/1646940819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb233b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.520+0000 7f8a521ce740 1 --2- 172.21.15.22:0/1646940819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb22e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.520+0000 7f8a521ce740 1 -- 172.21.15.22:0/1646940819 >> 172.21.15.22:0/1646940819 conn(0x5637bc770c40 msgr2=0x5637bcb20d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:32.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.521+0000 7f8a521ce740 1 -- 172.21.15.22:0/1646940819 shutdown_connections 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.521+0000 7f8a521ce740 1 -- 172.21.15.22:0/1646940819 wait complete. 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.521+0000 7f8a521ce740 1 -- start start 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.521+0000 7f8a521ce740 1 Processor -- start 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.521+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc753990 0x5637bcb2ea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.521+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc75bb70 0x5637bcb2ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.521+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb3a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.521+0000 7f8a521ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5637bc8ea7b0 con 0x5637bc753990 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.521+0000 7f8a521ce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5637bca23e90 con 0x5637bc75bb70 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.521+0000 7f8a521ce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5637bcb31650 con 0x5637bc77c850 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a521ce740 10 client.0 _ll_register_callbacks cb 0x5637bca86710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a499f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc753990 0x5637bcb2ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a499f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc753990 0x5637bcb2ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41386/0 (socket says 172.21.15.22:41386) 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a499f6640 1 -- 172.21.15.22:0/3576497129 learned_addr learned my addr 172.21.15.22:0/3576497129 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:32.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a491f5640 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc75bb70 0x5637bcb2ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a4a1f7640 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb3a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a499f6640 1 -- 172.21.15.22:0/3576497129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 msgr2=0x5637bcb3a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a499f6640 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb3a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a499f6640 1 -- 172.21.15.22:0/3576497129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc75bb70 msgr2=0x5637bcb2ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a499f6640 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc75bb70 0x5637bcb2ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a499f6640 1 -- 172.21.15.22:0/3576497129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637bcb3af30 con 0x5637bc753990 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a491f5640 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc75bb70 0x5637bcb2ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a499f6640 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc753990 0x5637bcb2ea40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8a40000c00 tx=0x7f8a40004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a4066ea0b47da38 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.522+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3576497129 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40030060 con 0x5637bc753990 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3576497129 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f8a40016050 con 0x5637bc753990 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a521ce740 1 -- 172.21.15.22:0/3576497129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a400047a0 con 0x5637bc753990 2024-09-21T04:10:32.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3576497129 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f8a40037050 con 0x5637bc753990 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a521ce740 10 client.15990 fetch_fsmap learned FSMap version 46 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a521ce740 1 -- 172.21.15.22:0/3576497129 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5637bcb3d840 con 0x5637bc753990 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3576497129 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a400047a0 con 0x5637bc753990 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3576497129 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 46) ==== 8386+0+0 (secure 0 0 0) 0x7f8a4000faa0 con 0x5637bc753990 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a521ce740 10 client.15990 fetch_fsmap finished waiting for FSMap version 46 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a521ce740 10 client.15990 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a521ce740 20 client.15990 populate_metadata read hostname 'smithi022' 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5637bc73b1d0 0x5637bcb40c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a521ce740 4 client.15990 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.523+0000 7f8a521ce740 1 -- 172.21.15.22:0/3576497129 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637bca9bb00 con 0x5637bc73b1d0 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.524+0000 7f8a491f5640 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5637bc73b1d0 0x5637bcb40c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.524+0000 7f8a2d7fa640 10 client.15990 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:32.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.524+0000 7f8a491f5640 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5637bc73b1d0 0x5637bcb40c00 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57cb8b9609457c03 server_cookie=39225e399a276706 in_seq=0 out_seq=0 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3576497129 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5637bca9bb00 con 0x5637bc73b1d0 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a2d7fa640 10 client.15990 handle_command_reply: tid=0 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 client.15990 shutdown 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 -- 172.21.15.22:0/3576497129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc753990 msgr2=0x5637bcb2ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc753990 0x5637bcb2ea40 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8a40000c00 tx=0x7f8a40004270 comp rx=0 tx=0).stop 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 -- 172.21.15.22:0/3576497129 shutdown_connections 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5637bc73b1d0 0x5637bcb40c00 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb3a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc75bb70 0x5637bcb2ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a2d7fa640 0 client.15990 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3576497129 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc753990 0x5637bcb2ea40 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 -- 172.21.15.22:0/3576497129 >> 172.21.15.22:0/3576497129 conn(0x5637bc770c40 msgr2=0x5637bcb26000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 -- 172.21.15.22:0/3576497129 shutdown_connections 2024-09-21T04:10:32.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 1 -- 172.21.15.22:0/3576497129 wait complete. 2024-09-21T04:10:32.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.525+0000 7f8a521ce740 20 client.15990 trim_cache size 0 max 16384 2024-09-21T04:10:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.543+0000 7f8a521ce740 1 Processor -- start 2024-09-21T04:10:32.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.543+0000 7f8a521ce740 1 -- start start 2024-09-21T04:10:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.543+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb24510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.543+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb29980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.543+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb2e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.543+0000 7f8a521ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441ae930 con 0x5637bc75bb70 2024-09-21T04:10:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.543+0000 7f8a521ce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441b0530 con 0x5637bc753990 2024-09-21T04:10:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.543+0000 7f8a521ce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441af000 con 0x5637bc77c850 2024-09-21T04:10:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a491f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb29980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a491f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb29980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41392/0 (socket says 172.21.15.22:41392) 2024-09-21T04:10:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a491f5640 1 -- 172.21.15.22:0/2621734694 learned_addr learned my addr 172.21.15.22:0/2621734694 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a4a1f7640 1 --2- 172.21.15.22:0/2621734694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb2e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a499f6640 1 --2- 172.21.15.22:0/2621734694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb24510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a491f5640 1 -- 172.21.15.22:0/2621734694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 msgr2=0x5637bcb2e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a491f5640 1 --2- 172.21.15.22:0/2621734694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb2e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a491f5640 1 -- 172.21.15.22:0/2621734694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 msgr2=0x5637bcb24510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a491f5640 1 --2- 172.21.15.22:0/2621734694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb24510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a491f5640 1 -- 172.21.15.22:0/2621734694 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637bcb1af80 con 0x5637bc75bb70 2024-09-21T04:10:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a4a1f7640 1 --2- 172.21.15.22:0/2621734694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb2e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:10:32.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.544+0000 7f8a491f5640 1 --2- 172.21.15.22:0/2621734694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb29980 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009250 tx=0x7f8a340e4f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4adb8de7fd401ed server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:32.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.545+0000 7f8a2f7fe640 1 -- 172.21.15.22:0/2621734694 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340ed040 con 0x5637bc75bb70 2024-09-21T04:10:32.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.545+0000 7f8a2f7fe640 1 -- 172.21.15.22:0/2621734694 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a340ad2d0 con 0x5637bc75bb70 2024-09-21T04:10:32.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.545+0000 7f8a2f7fe640 1 -- 172.21.15.22:0/2621734694 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a340b3380 con 0x5637bc75bb70 2024-09-21T04:10:32.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 -- 172.21.15.22:0/2621734694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 msgr2=0x5637bcb29980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:32.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 --2- 172.21.15.22:0/2621734694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb29980 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8a34009250 tx=0x7f8a340e4f50 comp rx=0 tx=0).stop 2024-09-21T04:10:32.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 -- 172.21.15.22:0/2621734694 shutdown_connections 2024-09-21T04:10:32.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 --2- 172.21.15.22:0/2621734694 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcb2e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 --2- 172.21.15.22:0/2621734694 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb29980 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 --2- 172.21.15.22:0/2621734694 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb24510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 -- 172.21.15.22:0/2621734694 >> 172.21.15.22:0/2621734694 conn(0x5637bc770c40 msgr2=0x5637bcb27f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:32.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 -- 172.21.15.22:0/2621734694 shutdown_connections 2024-09-21T04:10:32.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 -- 172.21.15.22:0/2621734694 wait complete. 2024-09-21T04:10:32.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 -- start start 2024-09-21T04:10:32.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.546+0000 7f8a521ce740 1 Processor -- start 2024-09-21T04:10:32.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb33280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb33860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a521ce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcba4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a521ce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441afe60 con 0x5637bc75bb70 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a521ce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441af6d0 con 0x5637bc753990 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a521ce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8a441ac910 con 0x5637bc77c850 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a521ce740 10 client.0 _ll_register_callbacks cb 0x7f8a340ed420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a491f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb33860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a491f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb33860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:41398/0 (socket says 172.21.15.22:41398) 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a491f5640 1 -- 172.21.15.22:0/3465423635 learned_addr learned my addr 172.21.15.22:0/3465423635 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a4a1f7640 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcba4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a499f6640 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb33280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a499f6640 1 -- 172.21.15.22:0/3465423635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 msgr2=0x5637bcba4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:32.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a499f6640 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcba4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a499f6640 1 -- 172.21.15.22:0/3465423635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 msgr2=0x5637bcb33860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a499f6640 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb33860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.547+0000 7f8a499f6640 1 -- 172.21.15.22:0/3465423635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637bcba4ad0 con 0x5637bc753990 2024-09-21T04:10:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a4a1f7640 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcba4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:10:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a491f5640 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb33860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:10:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a499f6640 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb33280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8a40004e90 tx=0x7f8a400035f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d810a0f877311f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a2d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:10:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3465423635 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40030030 con 0x5637bc753990 2024-09-21T04:10:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3465423635 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f8a40004750 con 0x5637bc753990 2024-09-21T04:10:32.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a521ce740 1 -- 172.21.15.22:0/3465423635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a340ad2d0 con 0x5637bc753990 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3465423635 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f8a40009470 con 0x5637bc753990 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a521ce740 10 client.25604 fetch_fsmap learned FSMap version 46 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a521ce740 1 -- 172.21.15.22:0/3465423635 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5637bcbabea0 con 0x5637bc753990 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.548+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3465423635 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a340ad2d0 con 0x5637bc753990 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.549+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3465423635 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 46) ==== 8386+0+0 (secure 0 0 0) 0x7f8a40003c70 con 0x5637bc753990 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.549+0000 7f8a521ce740 10 client.25604 fetch_fsmap finished waiting for FSMap version 46 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.549+0000 7f8a521ce740 10 client.25604 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.549+0000 7f8a521ce740 20 client.25604 populate_metadata read hostname 'smithi022' 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.549+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5637bc710580 0x5637bcbae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.549+0000 7f8a521ce740 4 client.25604 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}] 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.549+0000 7f8a521ce740 1 -- 172.21.15.22:0/3465423635 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.05, "await_for": 45.0}) -- 0x5637bca975b0 con 0x5637bc710580 2024-09-21T04:10:32.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.549+0000 7f8a491f5640 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5637bc710580 0x5637bcbae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:32.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.549+0000 7f8a2d7fa640 10 client.25604 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:32.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.549+0000 7f8a491f5640 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5637bc710580 0x5637bcbae6c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29454b1a6376f2cb server_cookie=3c6e708afb846a77 in_seq=0 out_seq=0 2024-09-21T04:10:32.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a2d7fa640 1 -- 172.21.15.22:0/3465423635 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5637bca975b0 con 0x5637bc710580 2024-09-21T04:10:32.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a2d7fa640 10 client.25604 handle_command_reply: tid=0 2024-09-21T04:10:32.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 client.25604 shutdown 2024-09-21T04:10:32.831 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:32 smithi022 ceph-mon[31015]: pgmap v616: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 272 op/s 2024-09-21T04:10:32.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 -- 172.21.15.22:0/3465423635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 msgr2=0x5637bcb33280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:32.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb33280 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8a40004e90 tx=0x7f8a400035f0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 -- 172.21.15.22:0/3465423635 shutdown_connections 2024-09-21T04:10:32.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5637bc710580 0x5637bcbae6c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5637bc77c850 0x5637bcba4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5637bc75bb70 0x5637bcb33860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 --2- 172.21.15.22:0/3465423635 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5637bc753990 0x5637bcb33280 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a2d7fa640 0 client.25604 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:32.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 -- 172.21.15.22:0/3465423635 >> 172.21.15.22:0/3465423635 conn(0x5637bc770c40 msgr2=0x5637bcb27f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:32.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 -- 172.21.15.22:0/3465423635 shutdown_connections 2024-09-21T04:10:32.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 1 -- 172.21.15.22:0/3465423635 wait complete. 2024-09-21T04:10:32.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.829+0000 7f8a521ce740 20 client.25604 trim_cache size 0 max 16384 2024-09-21T04:10:32.833 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:10:32.833 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 46, 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 34, 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "6a088055": { 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 34, 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:10:32.834 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 141.1, 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:32.835 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:10:32.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/3320532478 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8a300b6510 msgr2=0x7f8a300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:32.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8a300b6510 0x7f8a300b8a20 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c006010 tx=0x7f8a3c005c30 comp rx=0 tx=0).stop 2024-09-21T04:10:32.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/3320532478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a441083c0 msgr2=0x7f8a4419a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:32.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a441083c0 0x7f8a4419a900 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8a44075a40 tx=0x7f8a3400ee50 comp rx=0 tx=0).stop 2024-09-21T04:10:32.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/3320532478 shutdown_connections 2024-09-21T04:10:32.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8a300b6510 0x7f8a300b8a20 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8a44108d10 0x7f8a4419fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a441083c0 0x7f8a4419a900 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 --2- 172.21.15.22:0/3320532478 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8a44103150 0x7f8a4419a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/3320532478 >> 172.21.15.22:0/3320532478 conn(0x7f8a44079f50 msgr2=0x7f8a44106450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/3320532478 shutdown_connections 2024-09-21T04:10:32.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:32.830+0000 7f8a4bc5a640 1 -- 172.21.15.22:0/3320532478 wait complete. 2024-09-21T04:10:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:32 smithi073 ceph-mon[34443]: pgmap v616: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 272 op/s 2024-09-21T04:10:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:32 smithi060 ceph-mon[33722]: pgmap v616: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 3.0 MiB/s wr, 272 op/s 2024-09-21T04:10:33.630 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '6a088055', quiesce took 7.8 seconds. Will release after: 13.25 2024-09-21T04:10:33.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 370.0 s, 612.1 tps, lat 127.237 ms stddev 89.005 2024-09-21T04:10:34.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:34 smithi022 ceph-mon[31015]: pgmap v617: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.1 MiB/s wr, 389 op/s 2024-09-21T04:10:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:34 smithi073 ceph-mon[34443]: pgmap v617: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.1 MiB/s wr, 389 op/s 2024-09-21T04:10:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:34 smithi060 ceph-mon[33722]: pgmap v617: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 4.1 MiB/s wr, 389 op/s 2024-09-21T04:10:36.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:36 smithi022 ceph-mon[31015]: pgmap v618: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 448 op/s 2024-09-21T04:10:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:36 smithi073 ceph-mon[34443]: pgmap v618: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 448 op/s 2024-09-21T04:10:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:36 smithi060 ceph-mon[33722]: pgmap v618: 129 pgs: 129 active+clean; 1.3 GiB data, 7.2 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.5 MiB/s wr, 448 op/s 2024-09-21T04:10:38.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 375.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:10:38.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:38 smithi022 ceph-mon[31015]: pgmap v619: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.0 MiB/s wr, 486 op/s 2024-09-21T04:10:38.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:38 smithi073 ceph-mon[34443]: pgmap v619: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.0 MiB/s wr, 486 op/s 2024-09-21T04:10:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:38 smithi060 ceph-mon[33722]: pgmap v619: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.0 MiB/s wr, 486 op/s 2024-09-21T04:10:40.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:40 smithi022 ceph-mon[31015]: pgmap v620: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.9 MiB/s wr, 465 op/s 2024-09-21T04:10:40.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:40 smithi073 ceph-mon[34443]: pgmap v620: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.9 MiB/s wr, 465 op/s 2024-09-21T04:10:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:40 smithi060 ceph-mon[33722]: pgmap v620: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 4.9 MiB/s wr, 465 op/s 2024-09-21T04:10:42.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:42 smithi022 ceph-mon[31015]: pgmap v621: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 405 op/s 2024-09-21T04:10:42.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:42 smithi060 ceph-mon[33722]: pgmap v621: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 405 op/s 2024-09-21T04:10:42.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:42 smithi073 ceph-mon[34443]: pgmap v621: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 4.0 MiB/s wr, 405 op/s 2024-09-21T04:10:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 380.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:10:44.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:44 smithi022 ceph-mon[31015]: pgmap v622: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.3 MiB/s wr, 252 op/s 2024-09-21T04:10:44.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:44 smithi073 ceph-mon[34443]: pgmap v622: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.3 MiB/s wr, 252 op/s 2024-09-21T04:10:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:44 smithi060 ceph-mon[33722]: pgmap v622: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 2.3 MiB/s wr, 252 op/s 2024-09-21T04:10:46.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:46 smithi022 ceph-mon[31015]: pgmap v623: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-09-21T04:10:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:46 smithi073 ceph-mon[34443]: pgmap v623: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-09-21T04:10:46.881 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:10:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:46 smithi060 ceph-mon[33722]: pgmap v623: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 1.2 MiB/s wr, 133 op/s 2024-09-21T04:10:47.178 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:10:47.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.694+0000 7f672ce4d640 1 -- 172.21.15.22:0/2247346573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6728108d20 msgr2=0x7f672810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:47.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.694+0000 7f672ce4d640 1 --2- 172.21.15.22:0/2247346573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6728108d20 0x7f672810f550 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f6718009900 tx=0x7f671802a3f0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.695+0000 7f672ce4d640 1 -- 172.21.15.22:0/2247346573 shutdown_connections 2024-09-21T04:10:47.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.695+0000 7f672ce4d640 1 --2- 172.21.15.22:0/2247346573 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6728108d20 0x7f672810f550 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.695+0000 7f672ce4d640 1 --2- 172.21.15.22:0/2247346573 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67281083d0 0x7f67281087e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.695+0000 7f672ce4d640 1 --2- 172.21.15.22:0/2247346573 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6728102a90 0x7f6728102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.695+0000 7f672ce4d640 1 -- 172.21.15.22:0/2247346573 >> 172.21.15.22:0/2247346573 conn(0x7f6728079750 msgr2=0x7f6728079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:47.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.695+0000 7f672ce4d640 1 -- 172.21.15.22:0/2247346573 shutdown_connections 2024-09-21T04:10:47.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.695+0000 7f672ce4d640 1 -- 172.21.15.22:0/2247346573 wait complete. 2024-09-21T04:10:47.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.695+0000 7f672ce4d640 1 Processor -- start 2024-09-21T04:10:47.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.695+0000 7f672ce4d640 1 -- start start 2024-09-21T04:10:47.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f672ce4d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6728102a90 0x7f67280ff5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:47.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f672ce4d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67281083d0 0x7f67280ffb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:47.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f672ce4d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6728108d20 0x7f6728100070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:47.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f672ce4d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6728112840 con 0x7f6728108d20 2024-09-21T04:10:47.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f672ce4d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f67281126c0 con 0x7f67281083d0 2024-09-21T04:10:47.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f672ce4d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f67281129c0 con 0x7f6728102a90 2024-09-21T04:10:47.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f6726d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6728108d20 0x7f6728100070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:47.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f6726d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6728108d20 0x7f6728100070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32826/0 (socket says 172.21.15.22:32826) 2024-09-21T04:10:47.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f6726d9d640 1 -- 172.21.15.22:0/3859230525 learned_addr learned my addr 172.21.15.22:0/3859230525 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:47.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f672659c640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6728102a90 0x7f67280ff5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:47.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f6725d9b640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67281083d0 0x7f67280ffb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:47.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f6726d9d640 1 -- 172.21.15.22:0/3859230525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6728102a90 msgr2=0x7f67280ff5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:47.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f6726d9d640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6728102a90 0x7f67280ff5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f6726d9d640 1 -- 172.21.15.22:0/3859230525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67281083d0 msgr2=0x7f67280ffb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:47.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f6726d9d640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67281083d0 0x7f67280ffb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f6726d9d640 1 -- 172.21.15.22:0/3859230525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67281a8590 con 0x7f6728108d20 2024-09-21T04:10:47.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f672659c640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6728102a90 0x7f67280ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:10:47.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.696+0000 7f6726d9d640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6728108d20 0x7f6728100070 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6718005ab0 tx=0x7f67180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:47.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.697+0000 7f671f7fe640 1 -- 172.21.15.22:0/3859230525 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671803f030 con 0x7f6728108d20 2024-09-21T04:10:47.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.697+0000 7f672ce4d640 1 -- 172.21.15.22:0/3859230525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67281a8820 con 0x7f6728108d20 2024-09-21T04:10:47.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.697+0000 7f671f7fe640 1 -- 172.21.15.22:0/3859230525 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6718003c90 con 0x7f6728108d20 2024-09-21T04:10:47.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.697+0000 7f671f7fe640 1 -- 172.21.15.22:0/3859230525 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6718035070 con 0x7f6728108d20 2024-09-21T04:10:47.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.697+0000 7f672ce4d640 1 -- 172.21.15.22:0/3859230525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67281a8d50 con 0x7f6728108d20 2024-09-21T04:10:47.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.698+0000 7f672ce4d640 1 -- 172.21.15.22:0/3859230525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6728103d10 con 0x7f6728108d20 2024-09-21T04:10:47.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.699+0000 7f671f7fe640 1 -- 172.21.15.22:0/3859230525 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6718042030 con 0x7f6728108d20 2024-09-21T04:10:47.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.700+0000 7f671f7fe640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67140b6510 0x7f67140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:47.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.700+0000 7f672659c640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67140b6510 0x7f67140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:47.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.700+0000 7f671f7fe640 1 -- 172.21.15.22:0/3859230525 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6718108100 con 0x7f6728108d20 2024-09-21T04:10:47.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.701+0000 7f672659c640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67140b6510 0x7f67140b8a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6720005c40 tx=0x7f672000a410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:47.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.705+0000 7f671f7fe640 1 -- 172.21.15.22:0/3859230525 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f67180ce5d0 con 0x7f6728108d20 2024-09-21T04:10:47.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.934+0000 7f672ce4d640 1 -- 172.21.15.22:0/3859230525 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f672810bb30 con 0x7f6728108d20 2024-09-21T04:10:47.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.935+0000 7f671f7fe640 1 -- 172.21.15.22:0/3859230525 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 46 v46) ==== 94+0+11966 (secure 0 0 0) 0x7f67180d29b0 con 0x7f6728108d20 2024-09-21T04:10:47.938 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:10:47.938 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":46,"btime":"2024-09-21T04:09:37:240006+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":46,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:09:36.909677+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:10:47.939 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 46 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.937+0000 7f672ce4d640 1 -- 172.21.15.22:0/3859230525 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67140b6510 msgr2=0x7f67140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.937+0000 7f672ce4d640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67140b6510 0x7f67140b8a20 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6720005c40 tx=0x7f672000a410 comp rx=0 tx=0).stop 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.937+0000 7f672ce4d640 1 -- 172.21.15.22:0/3859230525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6728108d20 msgr2=0x7f6728100070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.937+0000 7f672ce4d640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6728108d20 0x7f6728100070 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6718005ab0 tx=0x7f67180042f0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.938+0000 7f672ce4d640 1 -- 172.21.15.22:0/3859230525 shutdown_connections 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.938+0000 7f672ce4d640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f67140b6510 0x7f67140b8a20 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.938+0000 7f672ce4d640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6728108d20 0x7f6728100070 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.938+0000 7f672ce4d640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f67281083d0 0x7f67280ffb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.938+0000 7f672ce4d640 1 --2- 172.21.15.22:0/3859230525 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6728102a90 0x7f67280ff5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.938+0000 7f672ce4d640 1 -- 172.21.15.22:0/3859230525 >> 172.21.15.22:0/3859230525 conn(0x7f6728079750 msgr2=0x7f6728101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.938+0000 7f672ce4d640 1 -- 172.21.15.22:0/3859230525 shutdown_connections 2024-09-21T04:10:47.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:47.938+0000 7f672ce4d640 1 -- 172.21.15.22:0/3859230525 wait complete. 2024-09-21T04:10:48.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:48 smithi022 ceph-mon[31015]: pgmap v624: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 733 KiB/s wr, 73 op/s 2024-09-21T04:10:48.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:48 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3859230525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:48.685 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id 6a088055 --release --await' 2024-09-21T04:10:48.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id 6a088055 --release --await 2024-09-21T04:10:48.707 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 385.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:10:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:48 smithi073 ceph-mon[34443]: pgmap v624: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 733 KiB/s wr, 73 op/s 2024-09-21T04:10:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:48 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3859230525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:48 smithi060 ceph-mon[33722]: pgmap v624: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 733 KiB/s wr, 73 op/s 2024-09-21T04:10:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:48 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3859230525' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:10:48.953 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:10:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.445+0000 7f5055583640 1 -- 172.21.15.22:0/3981124518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5050109df0 msgr2=0x7f5050110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.445+0000 7f5055583640 1 --2- 172.21.15.22:0/3981124518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5050109df0 0x7f5050110620 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f5048009ca0 tx=0x7f504802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.445+0000 7f5055583640 1 -- 172.21.15.22:0/3981124518 shutdown_connections 2024-09-21T04:10:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.445+0000 7f5055583640 1 --2- 172.21.15.22:0/3981124518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f50501094a0 0x7f50501098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.445+0000 7f5055583640 1 --2- 172.21.15.22:0/3981124518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5050109df0 0x7f5050110620 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.445+0000 7f5055583640 1 --2- 172.21.15.22:0/3981124518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5050103b60 0x7f5050103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.445+0000 7f5055583640 1 -- 172.21.15.22:0/3981124518 >> 172.21.15.22:0/3981124518 conn(0x7f505007b850 msgr2=0x7f505007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.445+0000 7f5055583640 1 -- 172.21.15.22:0/3981124518 shutdown_connections 2024-09-21T04:10:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.445+0000 7f5055583640 1 -- 172.21.15.22:0/3981124518 wait complete. 2024-09-21T04:10:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.446+0000 7f5055583640 1 Processor -- start 2024-09-21T04:10:49.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.446+0000 7f5055583640 1 -- start start 2024-09-21T04:10:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f5055583640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5050103b60 0x7f505019a400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f5055583640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501094a0 0x7f505019a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f5055583640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5050109df0 0x7f505019fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f5055583640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f50501139b0 con 0x7f50501094a0 2024-09-21T04:10:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f5055583640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5050113830 con 0x7f5050103b60 2024-09-21T04:10:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f5055583640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f5050113b30 con 0x7f5050109df0 2024-09-21T04:10:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501094a0 0x7f505019a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504e7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501094a0 0x7f505019a9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32838/0 (socket says 172.21.15.22:32838) 2024-09-21T04:10:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504e7fc640 1 -- 172.21.15.22:0/2264891933 learned_addr learned my addr 172.21.15.22:0/2264891933 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:49.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504effd640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5050103b60 0x7f505019a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504f7fe640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5050109df0 0x7f505019fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504e7fc640 1 -- 172.21.15.22:0/2264891933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5050109df0 msgr2=0x7f505019fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504e7fc640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5050109df0 0x7f505019fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504e7fc640 1 -- 172.21.15.22:0/2264891933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5050103b60 msgr2=0x7f505019a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504e7fc640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5050103b60 0x7f505019a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504e7fc640 1 -- 172.21.15.22:0/2264891933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50501a0370 con 0x7f50501094a0 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504f7fe640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5050109df0 0x7f505019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f504e7fc640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501094a0 0x7f505019a9a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f504400c970 tx=0x7f504400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.447+0000 7f5037fff640 1 -- 172.21.15.22:0/2264891933 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5044004220 con 0x7f50501094a0 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.448+0000 7f5037fff640 1 -- 172.21.15.22:0/2264891933 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5044007e40 con 0x7f50501094a0 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.448+0000 7f5055583640 1 -- 172.21.15.22:0/2264891933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50501a0660 con 0x7f50501094a0 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.448+0000 7f5037fff640 1 -- 172.21.15.22:0/2264891933 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50440047a0 con 0x7f50501094a0 2024-09-21T04:10:49.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.448+0000 7f5055583640 1 -- 172.21.15.22:0/2264891933 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50501a6dc0 con 0x7f50501094a0 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.450+0000 7f505baf7740 1 Processor -- start 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.450+0000 7f505baf7740 1 -- start start 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f505baf7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f506520 0x56020f8ac510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f505baf7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4dd660 0x56020f8aca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f505baf7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4e5840 0x56020f8acf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f505baf7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56020f797dc0 con 0x56020f506520 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f505baf7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56020f8241f0 con 0x56020f4dd660 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f505baf7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56020f813620 con 0x56020f4e5840 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f5037fff640 1 -- 172.21.15.22:0/2264891933 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f50440079b0 con 0x7f50501094a0 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f504f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f506520 0x56020f8ac510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f504f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f506520 0x56020f8ac510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32848/0 (socket says 172.21.15.22:32848) 2024-09-21T04:10:49.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f504f7fe640 1 -- 172.21.15.22:0/1276668645 learned_addr learned my addr 172.21.15.22:0/1276668645 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f504effd640 1 --2- 172.21.15.22:0/1276668645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4dd660 0x56020f8aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f504e7fc640 1 --2- 172.21.15.22:0/1276668645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4e5840 0x56020f8acf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f504f7fe640 1 -- 172.21.15.22:0/1276668645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4e5840 msgr2=0x56020f8acf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f504f7fe640 1 --2- 172.21.15.22:0/1276668645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4e5840 0x56020f8acf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f504f7fe640 1 -- 172.21.15.22:0/1276668645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4dd660 msgr2=0x56020f8aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f504f7fe640 1 --2- 172.21.15.22:0/1276668645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4dd660 0x56020f8aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.451+0000 7f504f7fe640 1 -- 172.21.15.22:0/1276668645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020f7dbfd0 con 0x56020f506520 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.452+0000 7f504f7fe640 1 --2- 172.21.15.22:0/1276668645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f506520 0x56020f8ac510 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5048009a60 tx=0x7f5048031610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb1fc69d59efbc4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.452+0000 7f50357fa640 1 -- 172.21.15.22:0/1276668645 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048031b80 con 0x56020f506520 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.452+0000 7f50357fa640 1 -- 172.21.15.22:0/1276668645 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5048036040 con 0x56020f506520 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.452+0000 7f50357fa640 1 -- 172.21.15.22:0/1276668645 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5048004530 con 0x56020f506520 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.452+0000 7f5037fff640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f50380b6510 0x7f50380b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.452+0000 7f504effd640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f50380b6510 0x7f50380b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.452+0000 7f5037fff640 1 -- 172.21.15.22:0/2264891933 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f50440e7380 con 0x7f50501094a0 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 -- 172.21.15.22:0/1276668645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f506520 msgr2=0x56020f8ac510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f504effd640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f50380b6510 0x7f50380b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x56020f8ab190 tx=0x7f504000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 --2- 172.21.15.22:0/1276668645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f506520 0x56020f8ac510 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f5048009a60 tx=0x7f5048031610 comp rx=0 tx=0).stop 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 -- 172.21.15.22:0/1276668645 shutdown_connections 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 --2- 172.21.15.22:0/1276668645 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4e5840 0x56020f8acf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 --2- 172.21.15.22:0/1276668645 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4dd660 0x56020f8aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 --2- 172.21.15.22:0/1276668645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f506520 0x56020f8ac510 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 -- 172.21.15.22:0/1276668645 >> 172.21.15.22:0/1276668645 conn(0x56020f4fa910 msgr2=0x56020f8aa400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 -- 172.21.15.22:0/1276668645 shutdown_connections 2024-09-21T04:10:49.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 -- 172.21.15.22:0/1276668645 wait complete. 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 -- start start 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.453+0000 7f505baf7740 1 Processor -- start 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f505baf7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4dd660 0x56020f8b7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f505baf7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4e5840 0x56020f8b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f505baf7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f506520 0x56020f8c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f505baf7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56020f7ae300 con 0x56020f4dd660 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f505baf7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56020f817430 con 0x56020f4e5840 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f505baf7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56020f674bb0 con 0x56020f506520 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f505baf7740 10 client.0 _ll_register_callbacks cb 0x56020f7c8120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4dd660 0x56020f8b7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4dd660 0x56020f8b7ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32856/0 (socket says 172.21.15.22:32856) 2024-09-21T04:10:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504effd640 1 -- 172.21.15.22:0/3237206326 learned_addr learned my addr 172.21.15.22:0/3237206326 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504f7fe640 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f506520 0x56020f8c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504e7fc640 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4e5840 0x56020f8b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504effd640 1 -- 172.21.15.22:0/3237206326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f506520 msgr2=0x56020f8c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504effd640 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f506520 0x56020f8c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504effd640 1 -- 172.21.15.22:0/3237206326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4e5840 msgr2=0x56020f8b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504effd640 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4e5840 0x56020f8b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504effd640 1 -- 172.21.15.22:0/3237206326 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020f79d780 con 0x56020f4dd660 2024-09-21T04:10:49.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f504effd640 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4dd660 0x56020f8b7ba0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5040003cb0 tx=0x7f50400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfe03e9e76fa91f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.454+0000 7f5032ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f5032ff5640 1 -- 172.21.15.22:0/3237206326 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504002c060 con 0x56020f4dd660 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f5032ff5640 1 -- 172.21.15.22:0/3237206326 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f5040017030 con 0x56020f4dd660 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f505baf7740 1 -- 172.21.15.22:0/3237206326 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5048036040 con 0x56020f4dd660 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f5032ff5640 1 -- 172.21.15.22:0/3237206326 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f5040033050 con 0x56020f4dd660 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f505baf7740 10 client.16014 fetch_fsmap learned FSMap version 46 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f505baf7740 1 -- 172.21.15.22:0/3237206326 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x56020f571b00 con 0x56020f4dd660 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f5032ff5640 1 -- 172.21.15.22:0/3237206326 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5048036040 con 0x56020f4dd660 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f5032ff5640 1 -- 172.21.15.22:0/3237206326 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 46) ==== 8386+0+0 (secure 0 0 0) 0x7f504001c3f0 con 0x56020f4dd660 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f505baf7740 10 client.16014 fetch_fsmap finished waiting for FSMap version 46 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f505baf7740 10 client.16014 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f505baf7740 20 client.16014 populate_metadata read hostname 'smithi022' 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f505baf7740 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56020f4c4ea0 0x56020f8c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f505baf7740 4 client.16014 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:10:49.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.455+0000 7f505baf7740 1 -- 172.21.15.22:0/3237206326 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56020f826140 con 0x56020f4c4ea0 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.456+0000 7f504e7fc640 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56020f4c4ea0 0x56020f8c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.456+0000 7f504e7fc640 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56020f4c4ea0 0x56020f8c9fa0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ca3aae167c21ee5 server_cookie=ef90294c04d0d6f in_seq=0 out_seq=0 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.456+0000 7f5032ff5640 10 client.16014 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f5032ff5640 1 -- 172.21.15.22:0/3237206326 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56020f826140 con 0x56020f4c4ea0 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f5032ff5640 10 client.16014 handle_command_reply: tid=0 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f505baf7740 1 client.16014 shutdown 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f505baf7740 1 -- 172.21.15.22:0/3237206326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4dd660 msgr2=0x56020f8b7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f505baf7740 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4dd660 0x56020f8b7ba0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5040003cb0 tx=0x7f50400046c0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f505baf7740 1 -- 172.21.15.22:0/3237206326 shutdown_connections 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f505baf7740 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56020f4c4ea0 0x56020f8c9fa0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f5032ff5640 0 client.16014 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f505baf7740 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f506520 0x56020f8c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f505baf7740 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4e5840 0x56020f8b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f505baf7740 1 --2- 172.21.15.22:0/3237206326 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4dd660 0x56020f8b7ba0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f505baf7740 1 -- 172.21.15.22:0/3237206326 >> 172.21.15.22:0/3237206326 conn(0x56020f4fa910 msgr2=0x56020f8af6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.457+0000 7f505baf7740 1 -- 172.21.15.22:0/3237206326 shutdown_connections 2024-09-21T04:10:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.458+0000 7f505baf7740 1 -- 172.21.15.22:0/3237206326 wait complete. 2024-09-21T04:10:49.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.458+0000 7f505baf7740 20 client.16014 trim_cache size 0 max 16384 2024-09-21T04:10:49.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f505baf7740 1 Processor -- start 2024-09-21T04:10:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f505baf7740 1 -- start start 2024-09-21T04:10:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f505baf7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4c4ea0 0x56020f8adc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f505baf7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4dd660 0x56020f8b15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f505baf7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4e5840 0x56020f8b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f505baf7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f50501b0b30 con 0x56020f4c4ea0 2024-09-21T04:10:49.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f505baf7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50501b2730 con 0x56020f4e5840 2024-09-21T04:10:49.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f505baf7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f50501b1200 con 0x56020f4dd660 2024-09-21T04:10:49.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f504effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4c4ea0 0x56020f8adc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f504effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4c4ea0 0x56020f8adc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32870/0 (socket says 172.21.15.22:32870) 2024-09-21T04:10:49.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f504effd640 1 -- 172.21.15.22:0/3082493389 learned_addr learned my addr 172.21.15.22:0/3082493389 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f504e7fc640 1 --2- 172.21.15.22:0/3082493389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4dd660 0x56020f8b15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.475+0000 7f504f7fe640 1 --2- 172.21.15.22:0/3082493389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4e5840 0x56020f8b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.476+0000 7f504effd640 1 -- 172.21.15.22:0/3082493389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4dd660 msgr2=0x56020f8b15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.476+0000 7f504effd640 1 --2- 172.21.15.22:0/3082493389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4dd660 0x56020f8b15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.476+0000 7f504effd640 1 -- 172.21.15.22:0/3082493389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4e5840 msgr2=0x56020f8b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:49.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.476+0000 7f504effd640 1 --2- 172.21.15.22:0/3082493389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4e5840 0x56020f8b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.476+0000 7f504effd640 1 -- 172.21.15.22:0/3082493389 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56020f5e8960 con 0x56020f4c4ea0 2024-09-21T04:10:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.476+0000 7f504effd640 1 --2- 172.21.15.22:0/3082493389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4c4ea0 0x56020f8adc50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5040018040 tx=0x7f504001fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eebc5dcf669a707 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.476+0000 7f5034ff9640 1 -- 172.21.15.22:0/3082493389 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504000be80 con 0x56020f4c4ea0 2024-09-21T04:10:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.476+0000 7f5034ff9640 1 -- 172.21.15.22:0/3082493389 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5040005040 con 0x56020f4c4ea0 2024-09-21T04:10:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.476+0000 7f5034ff9640 1 -- 172.21.15.22:0/3082493389 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5040004990 con 0x56020f4c4ea0 2024-09-21T04:10:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 -- 172.21.15.22:0/3082493389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4c4ea0 msgr2=0x56020f8adc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:49.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 --2- 172.21.15.22:0/3082493389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4c4ea0 0x56020f8adc50 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5040018040 tx=0x7f504001fc90 comp rx=0 tx=0).stop 2024-09-21T04:10:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 -- 172.21.15.22:0/3082493389 shutdown_connections 2024-09-21T04:10:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 --2- 172.21.15.22:0/3082493389 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4dd660 0x56020f8b15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 --2- 172.21.15.22:0/3082493389 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4e5840 0x56020f8b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 --2- 172.21.15.22:0/3082493389 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4c4ea0 0x56020f8adc50 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 -- 172.21.15.22:0/3082493389 >> 172.21.15.22:0/3082493389 conn(0x56020f4fa910 msgr2=0x56020f8ad540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 -- 172.21.15.22:0/3082493389 shutdown_connections 2024-09-21T04:10:49.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 -- 172.21.15.22:0/3082493389 wait complete. 2024-09-21T04:10:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 -- start start 2024-09-21T04:10:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.477+0000 7f505baf7740 1 Processor -- start 2024-09-21T04:10:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f505baf7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4c4ea0 0x56020f8bbe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f505baf7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4dd660 0x56020f8bc360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f505baf7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4e5840 0x56020f8bc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f505baf7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f50501b2060 con 0x56020f4e5840 2024-09-21T04:10:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f505baf7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f50501b18d0 con 0x56020f4c4ea0 2024-09-21T04:10:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f505baf7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f50501aeb10 con 0x56020f4dd660 2024-09-21T04:10:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f505baf7740 10 client.0 _ll_register_callbacks cb 0x7f5040005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:10:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4e5840 0x56020f8bc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4e5840 0x56020f8bc8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32886/0 (socket says 172.21.15.22:32886) 2024-09-21T04:10:49.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504f7fe640 1 -- 172.21.15.22:0/3872668228 learned_addr learned my addr 172.21.15.22:0/3872668228 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:10:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504e7fc640 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4dd660 0x56020f8bc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504effd640 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4c4ea0 0x56020f8bbe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504f7fe640 1 -- 172.21.15.22:0/3872668228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4dd660 msgr2=0x56020f8bc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504f7fe640 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4dd660 0x56020f8bc360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504f7fe640 1 -- 172.21.15.22:0/3872668228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4c4ea0 msgr2=0x56020f8bbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:10:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504f7fe640 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4c4ea0 0x56020f8bbe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504f7fe640 1 -- 172.21.15.22:0/3872668228 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56020f933a20 con 0x56020f4e5840 2024-09-21T04:10:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f504f7fe640 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4e5840 0x56020f8bc8a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f50480094e0 tx=0x7f5048031830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef1130cee70e2cd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:10:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.478+0000 7f5032ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:10:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f5032ff5640 1 -- 172.21.15.22:0/3872668228 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f504804a040 con 0x56020f4e5840 2024-09-21T04:10:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f5032ff5640 1 -- 172.21.15.22:0/3872668228 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f5048031980 con 0x56020f4e5840 2024-09-21T04:10:49.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f505baf7740 1 -- 172.21.15.22:0/3872668228 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5040005040 con 0x56020f4e5840 2024-09-21T04:10:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f5032ff5640 1 -- 172.21.15.22:0/3872668228 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f504805e050 con 0x56020f4e5840 2024-09-21T04:10:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f505baf7740 10 client.16020 fetch_fsmap learned FSMap version 46 2024-09-21T04:10:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f505baf7740 1 -- 172.21.15.22:0/3872668228 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x56020f934ce0 con 0x56020f4e5840 2024-09-21T04:10:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f5032ff5640 1 -- 172.21.15.22:0/3872668228 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5040005040 con 0x56020f4e5840 2024-09-21T04:10:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f5032ff5640 1 -- 172.21.15.22:0/3872668228 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 46) ==== 8386+0+0 (secure 0 0 0) 0x7f5048003970 con 0x56020f4e5840 2024-09-21T04:10:49.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f505baf7740 10 client.16020 fetch_fsmap finished waiting for FSMap version 46 2024-09-21T04:10:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f505baf7740 10 client.16020 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:10:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f505baf7740 20 client.16020 populate_metadata read hostname 'smithi022' 2024-09-21T04:10:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f505baf7740 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56020f506520 0x56020f937020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:10:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f505baf7740 4 client.16020 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "6a088055", "release": true, "await": true}] 2024-09-21T04:10:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.479+0000 7f505baf7740 1 -- 172.21.15.22:0/3872668228 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "6a088055", "release": true, "await": true}) -- 0x56020f821bf0 con 0x56020f506520 2024-09-21T04:10:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.480+0000 7f504effd640 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56020f506520 0x56020f937020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:10:49.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.480+0000 7f504effd640 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56020f506520 0x56020f937020 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25bbdf298b816880 server_cookie=8d262641d29d3168 in_seq=0 out_seq=0 2024-09-21T04:10:49.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.480+0000 7f5032ff5640 10 client.16020 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:49.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f5032ff5640 1 -- 172.21.15.22:0/3872668228 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56020f821bf0 con 0x56020f506520 2024-09-21T04:10:49.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f5032ff5640 10 client.16020 handle_command_reply: tid=0 2024-09-21T04:10:49.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 client.16020 shutdown 2024-09-21T04:10:49.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 -- 172.21.15.22:0/3872668228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4e5840 msgr2=0x56020f8bc8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:49.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4e5840 0x56020f8bc8a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f50480094e0 tx=0x7f5048031830 comp rx=0 tx=0).stop 2024-09-21T04:10:49.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 -- 172.21.15.22:0/3872668228 shutdown_connections 2024-09-21T04:10:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56020f506520 0x56020f937020 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56020f4dd660 0x56020f8bc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56020f4e5840 0x56020f8bc8a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f5032ff5640 0 client.16020 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:10:49.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 --2- 172.21.15.22:0/3872668228 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56020f4c4ea0 0x56020f8bbe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 -- 172.21.15.22:0/3872668228 >> 172.21.15.22:0/3872668228 conn(0x56020f4fa910 msgr2=0x56020f8b9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:49.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 -- 172.21.15.22:0/3872668228 shutdown_connections 2024-09-21T04:10:49.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.536+0000 7f505baf7740 1 -- 172.21.15.22:0/3872668228 wait complete. 2024-09-21T04:10:49.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.537+0000 7f505baf7740 20 client.16020 trim_cache size 0 max 16384 2024-09-21T04:10:49.544 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:10:49.544 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 46, 2024-09-21T04:10:49.544 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:10:49.544 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 36, 2024-09-21T04:10:49.544 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:10:49.545 INFO:teuthology.orchestra.run.smithi022.stdout: "6a088055": { 2024-09-21T04:10:49.545 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 36, 2024-09-21T04:10:49.545 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:10:49.545 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:10:49.545 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:10:49.545 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:10:49.545 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:10:49.546 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:10:49.546 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 141.1, 2024-09-21T04:10:49.546 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:10:49.546 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:10:49.546 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:10:49.546 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:10:49.547 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:10:49.547 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:10:49.547 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:49.547 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:49.547 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:49.547 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:49.548 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:10:49.548 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:10:49.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 -- 172.21.15.22:0/2264891933 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f50380b6510 msgr2=0x7f50380b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f50380b6510 0x7f50380b8a20 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x56020f8ab190 tx=0x7f504000b390 comp rx=0 tx=0).stop 2024-09-21T04:10:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 -- 172.21.15.22:0/2264891933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501094a0 msgr2=0x7f505019a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:10:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501094a0 0x7f505019a9a0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f504400c970 tx=0x7f504400ce30 comp rx=0 tx=0).stop 2024-09-21T04:10:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 -- 172.21.15.22:0/2264891933 shutdown_connections 2024-09-21T04:10:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f50380b6510 0x7f50380b8a20 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5050109df0 0x7f505019fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f50501094a0 0x7f505019a9a0 secure :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f504400c970 tx=0x7f504400ce30 comp rx=0 tx=0).stop 2024-09-21T04:10:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 --2- 172.21.15.22:0/2264891933 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5050103b60 0x7f505019a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:10:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 -- 172.21.15.22:0/2264891933 >> 172.21.15.22:0/2264891933 conn(0x7f505007b850 msgr2=0x7f50501075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:10:49.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 -- 172.21.15.22:0/2264891933 shutdown_connections 2024-09-21T04:10:49.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:10:49.538+0000 7f5055583640 1 -- 172.21.15.22:0/2264891933 wait complete. 2024-09-21T04:10:50.436 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '6a088055', total seconds elapsed: 24.6 2024-09-21T04:10:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:50 smithi022 ceph-mon[31015]: pgmap v625: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 172 KiB/s wr, 32 op/s 2024-09-21T04:10:50.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:50 smithi073 ceph-mon[34443]: pgmap v625: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 172 KiB/s wr, 32 op/s 2024-09-21T04:10:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:50 smithi060 ceph-mon[33722]: pgmap v625: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 172 KiB/s wr, 32 op/s 2024-09-21T04:10:51.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:51 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:10:51.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:51 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:10:51.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:51 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:10:52.852 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:52 smithi022 ceph-mon[31015]: pgmap v626: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 455 KiB/s wr, 54 op/s 2024-09-21T04:10:52.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:52 smithi073 ceph-mon[34443]: pgmap v626: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 455 KiB/s wr, 54 op/s 2024-09-21T04:10:52.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:52 smithi060 ceph-mon[33722]: pgmap v626: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 455 KiB/s wr, 54 op/s 2024-09-21T04:10:53.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 390.0 s, 925.0 tps, lat 459.776 ms stddev 2475.568 2024-09-21T04:10:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:54 smithi022 ceph-mon[31015]: pgmap v627: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-09-21T04:10:54.872 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:54 smithi073 ceph-mon[34443]: pgmap v627: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-09-21T04:10:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:54 smithi060 ceph-mon[33722]: pgmap v627: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 5.9 KiB/s rd, 1.0 MiB/s wr, 126 op/s 2024-09-21T04:10:56.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:56 smithi022 ceph-mon[31015]: pgmap v628: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 MiB/s wr, 289 op/s 2024-09-21T04:10:56.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:56 smithi073 ceph-mon[34443]: pgmap v628: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 MiB/s wr, 289 op/s 2024-09-21T04:10:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:56 smithi060 ceph-mon[33722]: pgmap v628: 129 pgs: 129 active+clean; 1.3 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.1 MiB/s wr, 289 op/s 2024-09-21T04:10:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 395.0 s, 658.2 tps, lat 149.249 ms stddev 160.203 2024-09-21T04:10:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:10:58 smithi022 ceph-mon[31015]: pgmap v629: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 391 op/s 2024-09-21T04:10:58.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:10:58 smithi073 ceph-mon[34443]: pgmap v629: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 391 op/s 2024-09-21T04:10:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:10:58 smithi060 ceph-mon[33722]: pgmap v629: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 4.0 MiB/s wr, 391 op/s 2024-09-21T04:11:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:00 smithi022 ceph-mon[31015]: pgmap v630: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.6 MiB/s wr, 470 op/s 2024-09-21T04:11:00.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:00 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:11:00.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:00 smithi073 ceph-mon[34443]: pgmap v630: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.6 MiB/s wr, 470 op/s 2024-09-21T04:11:00.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:00 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:11:00.954 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:00 smithi060 ceph-mon[33722]: pgmap v630: 129 pgs: 129 active+clean; 1.3 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 4.6 MiB/s wr, 470 op/s 2024-09-21T04:11:00.954 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:00 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:11:02.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:02 smithi022 ceph-mon[31015]: pgmap v631: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 636 op/s 2024-09-21T04:11:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:02 smithi073 ceph-mon[34443]: pgmap v631: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 636 op/s 2024-09-21T04:11:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:02 smithi060 ceph-mon[33722]: pgmap v631: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 6.4 MiB/s wr, 636 op/s 2024-09-21T04:11:03.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 400.0 s, 870.0 tps, lat 116.181 ms stddev 84.091 2024-09-21T04:11:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:04 smithi022 ceph-mon[31015]: pgmap v632: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 741 op/s 2024-09-21T04:11:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:04 smithi073 ceph-mon[34443]: pgmap v632: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 741 op/s 2024-09-21T04:11:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:04 smithi060 ceph-mon[33722]: pgmap v632: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.2 MiB/s wr, 741 op/s 2024-09-21T04:11:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:06 smithi022 ceph-mon[31015]: pgmap v633: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 801 op/s 2024-09-21T04:11:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:06 smithi073 ceph-mon[34443]: pgmap v633: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 801 op/s 2024-09-21T04:11:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:06 smithi060 ceph-mon[33722]: pgmap v633: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.1 MiB/s wr, 801 op/s 2024-09-21T04:11:08.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 405.0 s, 855.0 tps, lat 117.837 ms stddev 58.348 2024-09-21T04:11:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:08 smithi022 ceph-mon[31015]: pgmap v634: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.4 MiB/s wr, 763 op/s 2024-09-21T04:11:08.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:08 smithi073 ceph-mon[34443]: pgmap v634: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.4 MiB/s wr, 763 op/s 2024-09-21T04:11:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:08 smithi060 ceph-mon[33722]: pgmap v634: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.4 MiB/s wr, 763 op/s 2024-09-21T04:11:10.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:10 smithi022 ceph-mon[31015]: pgmap v635: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.3 MiB/s wr, 751 op/s 2024-09-21T04:11:10.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:10 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:11:10.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:10 smithi073 ceph-mon[34443]: pgmap v635: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.3 MiB/s wr, 751 op/s 2024-09-21T04:11:10.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:10 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:11:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:10 smithi060 ceph-mon[33722]: pgmap v635: 129 pgs: 129 active+clean; 1.3 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.3 MiB/s wr, 751 op/s 2024-09-21T04:11:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:10 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:11:11.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:11 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:11:11.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:11 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:11:11.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:11 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:11:12.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:12 smithi022 ceph-mon[31015]: pgmap v636: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 833 op/s 2024-09-21T04:11:12.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:12 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:11:12.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:12 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:11:12.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:12 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:11:12.853 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:12 smithi060 ceph-mon[33722]: pgmap v636: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 833 op/s 2024-09-21T04:11:12.853 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:12 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:11:12.854 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:12 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:11:12.854 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:12 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:11:12.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:12 smithi073 ceph-mon[34443]: pgmap v636: 129 pgs: 129 active+clean; 1.3 GiB data, 7.6 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.2 MiB/s wr, 833 op/s 2024-09-21T04:11:12.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:12 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:11:12.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:12 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:11:12.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:12 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:11:13.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 410.0 s, 865.8 tps, lat 114.883 ms stddev 53.007 2024-09-21T04:11:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:14 smithi022 ceph-mon[31015]: pgmap v637: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 823 op/s 2024-09-21T04:11:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:14 smithi073 ceph-mon[34443]: pgmap v637: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 823 op/s 2024-09-21T04:11:14.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:14 smithi060 ceph-mon[33722]: pgmap v637: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 823 op/s 2024-09-21T04:11:15.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:15 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:11:15.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:15 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:11:15.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:15 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:11:16.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:16 smithi022 ceph-mon[31015]: pgmap v638: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.9 MiB/s wr, 810 op/s 2024-09-21T04:11:16.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:16 smithi073 ceph-mon[34443]: pgmap v638: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.9 MiB/s wr, 810 op/s 2024-09-21T04:11:16.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:16 smithi060 ceph-mon[33722]: pgmap v638: 129 pgs: 129 active+clean; 1.3 GiB data, 7.7 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.9 MiB/s wr, 810 op/s 2024-09-21T04:11:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 415.0 s, 835.4 tps, lat 119.524 ms stddev 60.339 2024-09-21T04:11:18.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:18 smithi060 ceph-mon[33722]: pgmap v639: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.3 MiB/s wr, 875 op/s 2024-09-21T04:11:19.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:18 smithi022 ceph-mon[31015]: pgmap v639: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.3 MiB/s wr, 875 op/s 2024-09-21T04:11:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:18 smithi073 ceph-mon[34443]: pgmap v639: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 8.3 MiB/s wr, 875 op/s 2024-09-21T04:11:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:20 smithi060 ceph-mon[33722]: pgmap v640: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.6 MiB/s wr, 804 op/s 2024-09-21T04:11:21.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:20 smithi022 ceph-mon[31015]: pgmap v640: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.6 MiB/s wr, 804 op/s 2024-09-21T04:11:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:20 smithi073 ceph-mon[34443]: pgmap v640: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.6 MiB/s wr, 804 op/s 2024-09-21T04:11:22.902 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:22 smithi022 ceph-mon[31015]: pgmap v641: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.1 MiB/s wr, 866 op/s 2024-09-21T04:11:22.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:22 smithi060 ceph-mon[33722]: pgmap v641: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.1 MiB/s wr, 866 op/s 2024-09-21T04:11:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:22 smithi073 ceph-mon[34443]: pgmap v641: 129 pgs: 129 active+clean; 1.3 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.1 MiB/s wr, 866 op/s 2024-09-21T04:11:23.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 420.0 s, 775.6 tps, lat 128.591 ms stddev 96.663 2024-09-21T04:11:24.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:24 smithi060 ceph-mon[33722]: pgmap v642: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.2 MiB/s wr, 871 op/s 2024-09-21T04:11:25.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:24 smithi022 ceph-mon[31015]: pgmap v642: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.2 MiB/s wr, 871 op/s 2024-09-21T04:11:25.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:24 smithi073 ceph-mon[34443]: pgmap v642: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.2 MiB/s wr, 871 op/s 2024-09-21T04:11:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:26 smithi060 ceph-mon[33722]: pgmap v643: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.9 MiB/s wr, 837 op/s 2024-09-21T04:11:27.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:26 smithi022 ceph-mon[31015]: pgmap v643: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.9 MiB/s wr, 837 op/s 2024-09-21T04:11:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:26 smithi073 ceph-mon[34443]: pgmap v643: 129 pgs: 129 active+clean; 1.3 GiB data, 7.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 7.9 MiB/s wr, 837 op/s 2024-09-21T04:11:28.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 425.0 s, 763.8 tps, lat 131.524 ms stddev 105.933 2024-09-21T04:11:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:28 smithi060 ceph-mon[33722]: pgmap v644: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.1 MiB/s wr, 859 op/s 2024-09-21T04:11:29.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:28 smithi022 ceph-mon[31015]: pgmap v644: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.1 MiB/s wr, 859 op/s 2024-09-21T04:11:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:28 smithi073 ceph-mon[34443]: pgmap v644: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 8.1 MiB/s wr, 859 op/s 2024-09-21T04:11:30.954 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:30 smithi060 ceph-mon[33722]: pgmap v645: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.4 MiB/s wr, 689 op/s 2024-09-21T04:11:31.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:30 smithi022 ceph-mon[31015]: pgmap v645: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.4 MiB/s wr, 689 op/s 2024-09-21T04:11:31.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:30 smithi073 ceph-mon[34443]: pgmap v645: 129 pgs: 129 active+clean; 1.3 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.4 MiB/s wr, 689 op/s 2024-09-21T04:11:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:32 smithi060 ceph-mon[33722]: pgmap v646: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 829 op/s 2024-09-21T04:11:33.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:32 smithi022 ceph-mon[31015]: pgmap v646: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 829 op/s 2024-09-21T04:11:33.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:32 smithi073 ceph-mon[34443]: pgmap v646: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.8 MiB/s wr, 829 op/s 2024-09-21T04:11:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 430.0 s, 942.4 tps, lat 106.463 ms stddev 42.490 2024-09-21T04:11:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:34 smithi060 ceph-mon[33722]: pgmap v647: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.3 MiB/s wr, 846 op/s 2024-09-21T04:11:35.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:34 smithi022 ceph-mon[31015]: pgmap v647: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.3 MiB/s wr, 846 op/s 2024-09-21T04:11:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:34 smithi073 ceph-mon[34443]: pgmap v647: 129 pgs: 129 active+clean; 1.3 GiB data, 8.1 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.3 MiB/s wr, 846 op/s 2024-09-21T04:11:36.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:36 smithi022 ceph-mon[31015]: pgmap v648: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 789 op/s 2024-09-21T04:11:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:36 smithi060 ceph-mon[33722]: pgmap v648: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 789 op/s 2024-09-21T04:11:37.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:36 smithi073 ceph-mon[34443]: pgmap v648: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 7.5 MiB/s wr, 789 op/s 2024-09-21T04:11:38.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 435.0 s, 1015.0 tps, lat 97.763 ms stddev 34.591 2024-09-21T04:11:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:38 smithi060 ceph-mon[33722]: pgmap v649: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 MiB/s wr, 863 op/s 2024-09-21T04:11:39.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:38 smithi022 ceph-mon[31015]: pgmap v649: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 MiB/s wr, 863 op/s 2024-09-21T04:11:39.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:38 smithi073 ceph-mon[34443]: pgmap v649: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.0 MiB/s wr, 863 op/s 2024-09-21T04:11:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:40 smithi060 ceph-mon[33722]: pgmap v650: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 819 op/s 2024-09-21T04:11:41.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:40 smithi022 ceph-mon[31015]: pgmap v650: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 819 op/s 2024-09-21T04:11:41.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:40 smithi073 ceph-mon[34443]: pgmap v650: 129 pgs: 129 active+clean; 1.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.0 MiB/s wr, 819 op/s 2024-09-21T04:11:42.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:42 smithi060 ceph-mon[33722]: pgmap v651: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.1 MiB/s wr, 955 op/s 2024-09-21T04:11:43.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:42 smithi022 ceph-mon[31015]: pgmap v651: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.1 MiB/s wr, 955 op/s 2024-09-21T04:11:43.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:42 smithi073 ceph-mon[34443]: pgmap v651: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 9.1 MiB/s wr, 955 op/s 2024-09-21T04:11:43.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 440.0 s, 809.6 tps, lat 123.809 ms stddev 72.633 2024-09-21T04:11:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:44 smithi060 ceph-mon[33722]: pgmap v652: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.5 MiB/s wr, 914 op/s 2024-09-21T04:11:45.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:44 smithi022 ceph-mon[31015]: pgmap v652: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.5 MiB/s wr, 914 op/s 2024-09-21T04:11:45.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:44 smithi073 ceph-mon[34443]: pgmap v652: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 8.5 MiB/s wr, 914 op/s 2024-09-21T04:11:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:46 smithi060 ceph-mon[33722]: pgmap v653: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 882 op/s 2024-09-21T04:11:47.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:46 smithi022 ceph-mon[31015]: pgmap v653: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 882 op/s 2024-09-21T04:11:47.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:46 smithi073 ceph-mon[34443]: pgmap v653: 129 pgs: 129 active+clean; 1.3 GiB data, 8.3 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 882 op/s 2024-09-21T04:11:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 445.0 s, 827.4 tps, lat 121.005 ms stddev 52.740 2024-09-21T04:11:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:48 smithi060 ceph-mon[33722]: pgmap v654: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 938 op/s 2024-09-21T04:11:49.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:48 smithi022 ceph-mon[31015]: pgmap v654: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 938 op/s 2024-09-21T04:11:49.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:48 smithi073 ceph-mon[34443]: pgmap v654: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.7 MiB/s wr, 938 op/s 2024-09-21T04:11:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:50 smithi060 ceph-mon[33722]: pgmap v655: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.3 MiB/s wr, 774 op/s 2024-09-21T04:11:51.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:50 smithi022 ceph-mon[31015]: pgmap v655: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.3 MiB/s wr, 774 op/s 2024-09-21T04:11:51.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:50 smithi073 ceph-mon[34443]: pgmap v655: 129 pgs: 129 active+clean; 1.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.3 MiB/s wr, 774 op/s 2024-09-21T04:11:52.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:52 smithi060 ceph-mon[33722]: pgmap v656: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 855 op/s 2024-09-21T04:11:53.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:52 smithi022 ceph-mon[31015]: pgmap v656: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 855 op/s 2024-09-21T04:11:53.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:52 smithi073 ceph-mon[34443]: pgmap v656: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 7.8 MiB/s wr, 855 op/s 2024-09-21T04:11:53.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 450.0 s, 1009.2 tps, lat 99.170 ms stddev 36.002 2024-09-21T04:11:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:54 smithi060 ceph-mon[33722]: pgmap v657: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 826 op/s 2024-09-21T04:11:55.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:54 smithi022 ceph-mon[31015]: pgmap v657: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 826 op/s 2024-09-21T04:11:55.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:54 smithi073 ceph-mon[34443]: pgmap v657: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.6 MiB/s wr, 826 op/s 2024-09-21T04:11:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:56 smithi060 ceph-mon[33722]: pgmap v658: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 840 op/s 2024-09-21T04:11:57.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:56 smithi022 ceph-mon[31015]: pgmap v658: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 840 op/s 2024-09-21T04:11:57.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:56 smithi073 ceph-mon[34443]: pgmap v658: 129 pgs: 129 active+clean; 1.3 GiB data, 8.5 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.8 MiB/s wr, 840 op/s 2024-09-21T04:11:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 455.0 s, 1035.4 tps, lat 95.972 ms stddev 41.933 2024-09-21T04:11:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:11:58 smithi060 ceph-mon[33722]: pgmap v659: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 MiB/s wr, 891 op/s 2024-09-21T04:11:59.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:11:58 smithi022 ceph-mon[31015]: pgmap v659: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 MiB/s wr, 891 op/s 2024-09-21T04:11:59.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:11:58 smithi073 ceph-mon[34443]: pgmap v659: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.8 MiB/s wr, 891 op/s 2024-09-21T04:12:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:00 smithi060 ceph-mon[33722]: pgmap v660: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.4 MiB/s wr, 817 op/s 2024-09-21T04:12:01.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:00 smithi022 ceph-mon[31015]: pgmap v660: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.4 MiB/s wr, 817 op/s 2024-09-21T04:12:01.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:00 smithi073 ceph-mon[34443]: pgmap v660: 129 pgs: 129 active+clean; 1.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.4 MiB/s wr, 817 op/s 2024-09-21T04:12:03.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:02 smithi022 ceph-mon[31015]: pgmap v661: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 997 op/s 2024-09-21T04:12:03.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:02 smithi073 ceph-mon[34443]: pgmap v661: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 997 op/s 2024-09-21T04:12:03.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:02 smithi060 ceph-mon[33722]: pgmap v661: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 9.1 MiB/s wr, 997 op/s 2024-09-21T04:12:03.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 460.0 s, 968.8 tps, lat 103.805 ms stddev 60.163 2024-09-21T04:12:05.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:04 smithi022 ceph-mon[31015]: pgmap v662: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 981 op/s 2024-09-21T04:12:05.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:04 smithi073 ceph-mon[34443]: pgmap v662: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 981 op/s 2024-09-21T04:12:05.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:04 smithi060 ceph-mon[33722]: pgmap v662: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.7 MiB/s wr, 981 op/s 2024-09-21T04:12:07.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:06 smithi022 ceph-mon[31015]: pgmap v663: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.1 MiB/s wr, 999 op/s 2024-09-21T04:12:07.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:06 smithi073 ceph-mon[34443]: pgmap v663: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.1 MiB/s wr, 999 op/s 2024-09-21T04:12:07.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:06 smithi060 ceph-mon[33722]: pgmap v663: 129 pgs: 129 active+clean; 1.3 GiB data, 8.7 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 9.1 MiB/s wr, 999 op/s 2024-09-21T04:12:08.622 INFO:tasks.quiescer.fs.[cephfs]:Total duration (49.0) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T04:12:08.622 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-21T04:12:08.623 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:12:08.705 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 465.0 s, 868.0 tps, lat 114.722 ms stddev 45.919 2024-09-21T04:12:09.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:08 smithi022 ceph-mon[31015]: pgmap v664: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 997 op/s 2024-09-21T04:12:09.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:08 smithi073 ceph-mon[34443]: pgmap v664: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 997 op/s 2024-09-21T04:12:09.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:08 smithi060 ceph-mon[33722]: pgmap v664: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.8 MiB/s wr, 997 op/s 2024-09-21T04:12:09.252 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:12:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.886+0000 7fa6267fc640 1 -- 172.21.15.22:0/3612803267 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa61c031800 con 0x7fa6200ad3f0 2024-09-21T04:12:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.887+0000 7fa62ca85640 1 -- 172.21.15.22:0/3612803267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6200ad3f0 msgr2=0x7fa6200b3c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.887+0000 7fa62ca85640 1 --2- 172.21.15.22:0/3612803267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6200ad3f0 0x7fa6200b3c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa61c009930 tx=0x7fa61c02a420 comp rx=0 tx=0).stop 2024-09-21T04:12:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.887+0000 7fa62ca85640 1 -- 172.21.15.22:0/3612803267 shutdown_connections 2024-09-21T04:12:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.887+0000 7fa62ca85640 1 --2- 172.21.15.22:0/3612803267 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6200ad3f0 0x7fa6200b3c20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:09.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.888+0000 7fa62ca85640 1 --2- 172.21.15.22:0/3612803267 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200acaa0 0x7fa6200aceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.888+0000 7fa62ca85640 1 --2- 172.21.15.22:0/3612803267 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6200a50d0 0x7fa6200a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:09.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.888+0000 7fa62ca85640 1 -- 172.21.15.22:0/3612803267 >> 172.21.15.22:0/3612803267 conn(0x7fa62001cc20 msgr2=0x7fa62001d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:09.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.889+0000 7fa62ca85640 1 -- 172.21.15.22:0/3612803267 shutdown_connections 2024-09-21T04:12:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.892+0000 7fa62ca85640 1 -- 172.21.15.22:0/3612803267 wait complete. 2024-09-21T04:12:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.893+0000 7fa62ca85640 1 Processor -- start 2024-09-21T04:12:09.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.893+0000 7fa62ca85640 1 -- start start 2024-09-21T04:12:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.894+0000 7fa62ca85640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6200a50d0 0x7fa62013c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.894+0000 7fa62ca85640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200acaa0 0x7fa62013c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.894+0000 7fa6277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6200a50d0 0x7fa62013c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.894+0000 7fa6277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6200a50d0 0x7fa62013c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36744/0 (socket says 172.21.15.22:36744) 2024-09-21T04:12:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.894+0000 7fa6277fe640 1 -- 172.21.15.22:0/643313946 learned_addr learned my addr 172.21.15.22:0/643313946 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.894+0000 7fa62ca85640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6200ad3f0 0x7fa620143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.895+0000 7fa62ca85640 1 -- 172.21.15.22:0/643313946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6200b6f30 con 0x7fa6200a50d0 2024-09-21T04:12:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.895+0000 7fa62ca85640 1 -- 172.21.15.22:0/643313946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa6200b6db0 con 0x7fa6200acaa0 2024-09-21T04:12:09.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.895+0000 7fa62ca85640 1 -- 172.21.15.22:0/643313946 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa6200b70b0 con 0x7fa6200ad3f0 2024-09-21T04:12:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.895+0000 7fa626ffd640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200acaa0 0x7fa62013c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:09.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.895+0000 7fa627fff640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6200ad3f0 0x7fa620143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.896+0000 7fa626ffd640 1 -- 172.21.15.22:0/643313946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6200ad3f0 msgr2=0x7fa620143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.896+0000 7fa626ffd640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6200ad3f0 0x7fa620143460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.896+0000 7fa626ffd640 1 -- 172.21.15.22:0/643313946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6200a50d0 msgr2=0x7fa62013c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.896+0000 7fa626ffd640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6200a50d0 0x7fa62013c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.896+0000 7fa626ffd640 1 -- 172.21.15.22:0/643313946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa62013d220 con 0x7fa6200acaa0 2024-09-21T04:12:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.896+0000 7fa6277fe640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6200a50d0 0x7fa62013c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:12:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.896+0000 7fa626ffd640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200acaa0 0x7fa62013c940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa6200186b0 tx=0x7fa61400cdd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:09.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.897+0000 7fa624ff9640 1 -- 172.21.15.22:0/643313946 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614007bb0 con 0x7fa6200acaa0 2024-09-21T04:12:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.897+0000 7fa624ff9640 1 -- 172.21.15.22:0/643313946 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa614007d50 con 0x7fa6200acaa0 2024-09-21T04:12:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.897+0000 7fa62ca85640 1 -- 172.21.15.22:0/643313946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa620143ac0 con 0x7fa6200acaa0 2024-09-21T04:12:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.897+0000 7fa624ff9640 1 -- 172.21.15.22:0/643313946 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa614004d10 con 0x7fa6200acaa0 2024-09-21T04:12:09.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.897+0000 7fa62ca85640 1 -- 172.21.15.22:0/643313946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa620143fd0 con 0x7fa6200acaa0 2024-09-21T04:12:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.901+0000 7fa62ca85640 1 -- 172.21.15.22:0/643313946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa60c0052c0 con 0x7fa6200acaa0 2024-09-21T04:12:09.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.901+0000 7fa624ff9640 1 -- 172.21.15.22:0/643313946 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa61400f450 con 0x7fa6200acaa0 2024-09-21T04:12:09.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.902+0000 7fa624ff9640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6180b6660 0x7fa6180b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:09.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.903+0000 7fa624ff9640 1 -- 172.21.15.22:0/643313946 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa6140e7330 con 0x7fa6200acaa0 2024-09-21T04:12:09.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.903+0000 7fa6277fe640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6180b6660 0x7fa6180b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:09.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.904+0000 7fa6277fe640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6180b6660 0x7fa6180b8b70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa628069050 tx=0x7fa628068db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:09.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:09.908+0000 7fa624ff9640 1 -- 172.21.15.22:0/643313946 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa614014030 con 0x7fa6200acaa0 2024-09-21T04:12:10.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.362+0000 7fa62ca85640 1 -- 172.21.15.22:0/643313946 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa60c0055b0 con 0x7fa6200acaa0 2024-09-21T04:12:10.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.364+0000 7fa624ff9640 1 -- 172.21.15.22:0/643313946 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7fa6140ad7a0 con 0x7fa6200acaa0 2024-09-21T04:12:10.367 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:12:10.367 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:12:10.368 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:12:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.369+0000 7fa6127fc640 1 -- 172.21.15.22:0/643313946 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6180b6660 msgr2=0x7fa6180b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.369+0000 7fa6127fc640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6180b6660 0x7fa6180b8b70 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa628069050 tx=0x7fa628068db0 comp rx=0 tx=0).stop 2024-09-21T04:12:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.369+0000 7fa6127fc640 1 -- 172.21.15.22:0/643313946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200acaa0 msgr2=0x7fa62013c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:10.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.369+0000 7fa6127fc640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200acaa0 0x7fa62013c940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fa6200186b0 tx=0x7fa61400cdd0 comp rx=0 tx=0).stop 2024-09-21T04:12:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.369+0000 7fa6127fc640 1 -- 172.21.15.22:0/643313946 shutdown_connections 2024-09-21T04:12:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.369+0000 7fa6127fc640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa6180b6660 0x7fa6180b8b70 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.369+0000 7fa6127fc640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa6200ad3f0 0x7fa620143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.369+0000 7fa6127fc640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa6200acaa0 0x7fa62013c940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.369+0000 7fa6127fc640 1 --2- 172.21.15.22:0/643313946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6200a50d0 0x7fa62013c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:10.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.369+0000 7fa6127fc640 1 -- 172.21.15.22:0/643313946 >> 172.21.15.22:0/643313946 conn(0x7fa62001cc20 msgr2=0x7fa6200a8820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.370+0000 7fa6127fc640 1 -- 172.21.15.22:0/643313946 shutdown_connections 2024-09-21T04:12:10.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:10.371+0000 7fa6127fc640 1 -- 172.21.15.22:0/643313946 wait complete. 2024-09-21T04:12:11.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:10 smithi022 ceph-mon[31015]: pgmap v665: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.9 MiB/s wr, 864 op/s 2024-09-21T04:12:11.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:10 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/643313946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:12:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:10 smithi073 ceph-mon[34443]: pgmap v665: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.9 MiB/s wr, 864 op/s 2024-09-21T04:12:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:10 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/643313946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:12:11.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:10 smithi060 ceph-mon[33722]: pgmap v665: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.9 MiB/s wr, 864 op/s 2024-09-21T04:12:11.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:10 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/643313946' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:12:11.358 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-21T04:12:11.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-21T04:12:11.858 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:12:12.995 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:12 smithi073 ceph-mon[34443]: pgmap v666: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.8 MiB/s wr, 894 op/s 2024-09-21T04:12:12.995 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:12 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:12:13.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:12 smithi060 ceph-mon[33722]: pgmap v666: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.8 MiB/s wr, 894 op/s 2024-09-21T04:12:13.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:12 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:12:13.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:12 smithi022 ceph-mon[31015]: pgmap v666: 129 pgs: 129 active+clean; 1.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.8 MiB/s wr, 894 op/s 2024-09-21T04:12:13.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:12 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:12:13.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 470.0 s, 627.0 tps, lat 158.238 ms stddev 119.529 2024-09-21T04:12:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:14 smithi073 ceph-mon[34443]: pgmap v667: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 845 op/s 2024-09-21T04:12:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:14 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:15.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:14 smithi022 ceph-mon[31015]: pgmap v667: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 845 op/s 2024-09-21T04:12:15.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:15.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:15.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:15.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:14 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:15.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:14 smithi060 ceph-mon[33722]: pgmap v667: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.5 MiB/s wr, 845 op/s 2024-09-21T04:12:15.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:15.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:15.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:15.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:14 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.961+0000 7fa1de9cd640 1 -- 172.21.15.22:0/1251997524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d8102a80 msgr2=0x7fa1d8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.961+0000 7fa1de9cd640 1 --2- 172.21.15.22:0/1251997524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d8102a80 0x7fa1d8102e90 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa1d001acb0 tx=0x7fa1d003b8e0 comp rx=0 tx=0).stop 2024-09-21T04:12:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.962+0000 7fa1de9cd640 1 -- 172.21.15.22:0/1251997524 shutdown_connections 2024-09-21T04:12:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.962+0000 7fa1de9cd640 1 --2- 172.21.15.22:0/1251997524 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d8108d10 0x7fa1d810f540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.962+0000 7fa1de9cd640 1 --2- 172.21.15.22:0/1251997524 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d81083c0 0x7fa1d81087d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.962+0000 7fa1de9cd640 1 --2- 172.21.15.22:0/1251997524 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d8102a80 0x7fa1d8102e90 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.962+0000 7fa1de9cd640 1 -- 172.21.15.22:0/1251997524 >> 172.21.15.22:0/1251997524 conn(0x7fa1d8079760 msgr2=0x7fa1d8079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:15.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.963+0000 7fa1de9cd640 1 -- 172.21.15.22:0/1251997524 shutdown_connections 2024-09-21T04:12:15.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.964+0000 7fa1de9cd640 1 -- 172.21.15.22:0/1251997524 wait complete. 2024-09-21T04:12:15.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.965+0000 7fa1de9cd640 1 Processor -- start 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.965+0000 7fa1de9cd640 1 -- start start 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1de9cd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d8102a80 0x7fa1d8074c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1de9cd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d81083c0 0x7fa1d806ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1de9cd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d8108d10 0x7fa1d8070480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1de9cd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d806e3f0 con 0x7fa1d8102a80 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1de9cd640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d806e270 con 0x7fa1d81083c0 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1de9cd640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d806e570 con 0x7fa1d8108d10 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d81083c0 0x7fa1d806ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1dcf6a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d8108d10 0x7fa1d8070480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1dcf6a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d8108d10 0x7fa1d8070480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:49124/0 (socket says 172.21.15.22:49124) 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1dcf6a640 1 -- 172.21.15.22:0/2143603587 learned_addr learned my addr 172.21.15.22:0/2143603587 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:15.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.966+0000 7fa1d7fff640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d8102a80 0x7fa1d8074c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.967+0000 7fa1d77fe640 1 -- 172.21.15.22:0/2143603587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d8108d10 msgr2=0x7fa1d8070480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.967+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d8108d10 0x7fa1d8070480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.967+0000 7fa1d77fe640 1 -- 172.21.15.22:0/2143603587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d8102a80 msgr2=0x7fa1d8074c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.967+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d8102a80 0x7fa1d8074c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.967+0000 7fa1d77fe640 1 -- 172.21.15.22:0/2143603587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d8070b60 con 0x7fa1d81083c0 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.968+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d81083c0 0x7fa1d806ff40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000d6a0 tx=0x7fa1c000db60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.969+0000 7fa1d57fa640 1 -- 172.21.15.22:0/2143603587 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0017070 con 0x7fa1d81083c0 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.969+0000 7fa1d57fa640 1 -- 172.21.15.22:0/2143603587 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c0009820 con 0x7fa1d81083c0 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.970+0000 7fa1de9cd640 1 -- 172.21.15.22:0/2143603587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d8117180 con 0x7fa1d81083c0 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.970+0000 7fa1de9cd640 1 -- 172.21.15.22:0/2143603587 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d81176c0 con 0x7fa1d81083c0 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.971+0000 7fa1d57fa640 1 -- 172.21.15.22:0/2143603587 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0004bc0 con 0x7fa1d81083c0 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.975+0000 7fa1d57fa640 1 -- 172.21.15.22:0/2143603587 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa1c0005220 con 0x7fa1d81083c0 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.976+0000 7fa1d57fa640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c40b6600 0x7fa1c40b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:15.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.976+0000 7fa1d57fa640 1 -- 172.21.15.22:0/2143603587 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa1c00e6e70 con 0x7fa1d81083c0 2024-09-21T04:12:15.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.978+0000 7fa1d7fff640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c40b6600 0x7fa1c40b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:15.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.983+0000 7fa1d7fff640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c40b6600 0x7fa1c40b8b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0000f80 tx=0x7fa1d001a830 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:15.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.989+0000 7fa1e4f41740 1 Processor -- start 2024-09-21T04:12:15.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.989+0000 7fa1e4f41740 1 -- start start 2024-09-21T04:12:15.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5567296b5840 0x556729a5c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:15.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a5cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:15.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a5d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:15.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1e4f41740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5567299d2b90 con 0x5567296b5840 2024-09-21T04:12:15.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1e4f41740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5567299c1fc0 con 0x55672968c980 2024-09-21T04:12:15.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1e4f41740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5567299c5dd0 con 0x556729694b60 2024-09-21T04:12:15.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a5cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:15.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a5cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:33380/0 (socket says 172.21.15.22:33380) 2024-09-21T04:12:15.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1d77fe640 1 -- 172.21.15.22:0/2621567204 learned_addr learned my addr 172.21.15.22:0/2621567204 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:15.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1dcf6a640 1 --2- 172.21.15.22:0/2621567204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a5d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:15.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1d77fe640 1 -- 172.21.15.22:0/2621567204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 msgr2=0x556729a5d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:15.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/2621567204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a5d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:15.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1d77fe640 1 -- 172.21.15.22:0/2621567204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5567296b5840 msgr2=0x556729a5c600 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T04:12:15.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/2621567204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5567296b5840 0x556729a5c600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:15.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.990+0000 7fa1d77fe640 1 -- 172.21.15.22:0/2621567204 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556729949060 con 0x55672968c980 2024-09-21T04:12:15.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.991+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/2621567204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a5cb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00a91b0 tx=0x7fa1c0005510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cab83ebf61618249 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:15.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.991+0000 7fa1ce7fc640 1 -- 172.21.15.22:0/2621567204 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c00b1020 con 0x55672968c980 2024-09-21T04:12:15.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.991+0000 7fa1ce7fc640 1 -- 172.21.15.22:0/2621567204 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c00ac6f0 con 0x55672968c980 2024-09-21T04:12:15.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.991+0000 7fa1ce7fc640 1 -- 172.21.15.22:0/2621567204 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0020040 con 0x55672968c980 2024-09-21T04:12:15.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.992+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2621567204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 msgr2=0x556729a5cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:15.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.992+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2621567204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a5cb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00a91b0 tx=0x7fa1c0005510 comp rx=0 tx=0).stop 2024-09-21T04:12:16.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.997+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2621567204 shutdown_connections 2024-09-21T04:12:16.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.997+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2621567204 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a5d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.997+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2621567204 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a5cb40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.997+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2621567204 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5567296b5840 0x556729a5c600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:15.997+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2621567204 >> 172.21.15.22:0/2621567204 conn(0x5567296a9990 msgr2=0x556729a5a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:16.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.000+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2621567204 shutdown_connections 2024-09-21T04:12:16.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.001+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2621567204 wait complete. 2024-09-21T04:12:16.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.001+0000 7fa1e4f41740 1 -- start start 2024-09-21T04:12:16.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.001+0000 7fa1e4f41740 1 Processor -- start 2024-09-21T04:12:16.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.004+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.004+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556729694b60 0x556729a688c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.004+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5567296b5840 0x556729a740d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.004+0000 7fa1e4f41740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5567298237a0 con 0x556729694b60 2024-09-21T04:12:16.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.004+0000 7fa1e4f41740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5567299670a0 con 0x55672968c980 2024-09-21T04:12:16.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.004+0000 7fa1e4f41740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x556729a6ade0 con 0x5567296b5840 2024-09-21T04:12:16.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.004+0000 7fa1e4f41740 10 client.0 _ll_register_callbacks cb 0x5567299443c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:12:16.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.006+0000 7fa1d7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:16.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.006+0000 7fa1d7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a682e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:33384/0 (socket says 172.21.15.22:33384) 2024-09-21T04:12:16.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.006+0000 7fa1d7fff640 1 -- 172.21.15.22:0/3221810818 learned_addr learned my addr 172.21.15.22:0/3221810818 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:16.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.006+0000 7fa1dcf6a640 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5567296b5840 0x556729a740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:16.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.006+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556729694b60 0x556729a688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:16.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.006+0000 7fa1d7fff640 1 -- 172.21.15.22:0/3221810818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5567296b5840 msgr2=0x556729a740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:16.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.006+0000 7fa1d7fff640 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5567296b5840 0x556729a740d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.006+0000 7fa1d7fff640 1 -- 172.21.15.22:0/3221810818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556729694b60 msgr2=0x556729a688c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:16.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.006+0000 7fa1d7fff640 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556729694b60 0x556729a688c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.006+0000 7fa1d7fff640 1 -- 172.21.15.22:0/3221810818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556729955880 con 0x55672968c980 2024-09-21T04:12:16.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.007+0000 7fa1d7fff640 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a682e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0046000 tx=0x7fa1d001a5d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12ed92f40adfab99 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:16.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.007+0000 7fa1bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:12:16.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.007+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/3221810818 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1d005d070 con 0x55672968c980 2024-09-21T04:12:16.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.007+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3221810818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1c00ac6f0 con 0x55672968c980 2024-09-21T04:12:16.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.007+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/3221810818 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa1d0004750 con 0x55672968c980 2024-09-21T04:12:16.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.008+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/3221810818 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fa1d0069050 con 0x55672968c980 2024-09-21T04:12:16.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.009+0000 7fa1e4f41740 10 client.25640 fetch_fsmap learned FSMap version 50 2024-09-21T04:12:16.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.009+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3221810818 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55672972fb90 con 0x55672968c980 2024-09-21T04:12:16.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.010+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/3221810818 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c00ac6f0 con 0x55672968c980 2024-09-21T04:12:16.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.010+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/3221810818 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7fa1d0059450 con 0x55672968c980 2024-09-21T04:12:16.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.010+0000 7fa1e4f41740 10 client.25640 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:12:16.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.010+0000 7fa1e4f41740 10 client.25640 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:12:16.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.010+0000 7fa1e4f41740 20 client.25640 populate_metadata read hostname 'smithi022' 2024-09-21T04:12:16.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.010+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5567296741c0 0x556729a7a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.010+0000 7fa1e4f41740 4 client.25640 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:12:16.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.010+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3221810818 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567299d4ae0 con 0x5567296741c0 2024-09-21T04:12:16.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.012+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5567296741c0 0x556729a7a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:16.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.019+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5567296741c0 0x556729a7a560 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c7fdcec7b03139cc server_cookie=dd62cabc8c50c536 in_seq=0 out_seq=0 2024-09-21T04:12:16.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.020+0000 7fa1bf7fe640 10 client.25640 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:16.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.022+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/3221810818 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5567299d4ae0 con 0x5567296741c0 2024-09-21T04:12:16.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.022+0000 7fa1bf7fe640 10 client.25640 handle_command_reply: tid=0 2024-09-21T04:12:16.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.022+0000 7fa1e4f41740 1 client.25640 shutdown 2024-09-21T04:12:16.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.025+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3221810818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 msgr2=0x556729a682e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:16.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.025+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a682e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0046000 tx=0x7fa1d001a5d0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.030+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3221810818 shutdown_connections 2024-09-21T04:12:16.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.030+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5567296741c0 0x556729a7a560 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.030+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5567296b5840 0x556729a740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.030+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556729694b60 0x556729a688c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.030+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/3221810818 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a682e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.030+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3221810818 >> 172.21.15.22:0/3221810818 conn(0x5567296a9990 msgr2=0x556729a5f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:16.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.030+0000 7fa1bf7fe640 0 client.25640 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:16.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.030+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3221810818 shutdown_connections 2024-09-21T04:12:16.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.030+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3221810818 wait complete. 2024-09-21T04:12:16.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.031+0000 7fa1e4f41740 20 client.25640 trim_cache size 0 max 16384 2024-09-21T04:12:16.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.070+0000 7fa1e4f41740 1 Processor -- start 2024-09-21T04:12:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.073+0000 7fa1e4f41740 1 -- start start 2024-09-21T04:12:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.073+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55672968c980 0x556729a61710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.073+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a61c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.074+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567296b5840 0x556729a59ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.074+0000 7fa1d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a61c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:16.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.074+0000 7fa1d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a61c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:49148/0 (socket says 172.21.15.22:49148) 2024-09-21T04:12:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.074+0000 7fa1d77fe640 1 -- 172.21.15.22:0/3452851012 learned_addr learned my addr 172.21.15.22:0/3452851012 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.074+0000 7fa1dcf6a640 1 --2- 172.21.15.22:0/3452851012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567296b5840 0x556729a59ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.074+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3452851012 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d81212c0 con 0x55672968c980 2024-09-21T04:12:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.074+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3452851012 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d8122e00 con 0x5567296b5840 2024-09-21T04:12:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.074+0000 7fa1d7fff640 1 --2- 172.21.15.22:0/3452851012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55672968c980 0x556729a61710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:16.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.074+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3452851012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d8121990 con 0x556729694b60 2024-09-21T04:12:16.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.075+0000 7fa1d77fe640 1 -- 172.21.15.22:0/3452851012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567296b5840 msgr2=0x556729a59ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:16.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.075+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/3452851012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567296b5840 0x556729a59ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.075+0000 7fa1d77fe640 1 -- 172.21.15.22:0/3452851012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55672968c980 msgr2=0x556729a61710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:16.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.075+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/3452851012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55672968c980 0x556729a61710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.075+0000 7fa1d77fe640 1 -- 172.21.15.22:0/3452851012 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556729a67040 con 0x556729694b60 2024-09-21T04:12:16.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.075+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/3452851012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a61c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00a9e50 tx=0x7fa1c0005640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42f8efb93ea241c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:16.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.075+0000 7fa1cdffb640 1 -- 172.21.15.22:0/3452851012 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0020040 con 0x556729694b60 2024-09-21T04:12:16.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.075+0000 7fa1cdffb640 1 -- 172.21.15.22:0/3452851012 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1c00ad2e0 con 0x556729694b60 2024-09-21T04:12:16.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.075+0000 7fa1cdffb640 1 -- 172.21.15.22:0/3452851012 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c00b1040 con 0x556729694b60 2024-09-21T04:12:16.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.077+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3452851012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 msgr2=0x556729a61c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:16.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.077+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/3452851012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a61c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00a9e50 tx=0x7fa1c0005640 comp rx=0 tx=0).stop 2024-09-21T04:12:16.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.077+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3452851012 shutdown_connections 2024-09-21T04:12:16.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.077+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/3452851012 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a61c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.077+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/3452851012 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5567296b5840 0x556729a59ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.077+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/3452851012 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55672968c980 0x556729a61710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.077+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3452851012 >> 172.21.15.22:0/3452851012 conn(0x5567296a9990 msgr2=0x556729a741e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:16.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.078+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3452851012 shutdown_connections 2024-09-21T04:12:16.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.078+0000 7fa1e4f41740 1 -- 172.21.15.22:0/3452851012 wait complete. 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.079+0000 7fa1e4f41740 1 -- start start 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.079+0000 7fa1e4f41740 1 Processor -- start 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.080+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a70240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.080+0000 7fa1d7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a70240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.080+0000 7fa1d7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a70240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:33398/0 (socket says 172.21.15.22:33398) 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.080+0000 7fa1e4f41740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a70780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.081+0000 7fa1d7fff640 1 -- 172.21.15.22:0/2462928767 learned_addr learned my addr 172.21.15.22:0/2462928767 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.081+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5567296b5840 0x556729a6aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.081+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a70780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.081+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d8122730 con 0x5567296b5840 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.081+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d8122060 con 0x55672968c980 2024-09-21T04:12:16.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.081+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d811f2a0 con 0x556729694b60 2024-09-21T04:12:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.082+0000 7fa1d77fe640 1 -- 172.21.15.22:0/2462928767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 msgr2=0x556729a70240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.082+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a70240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.082+0000 7fa1d77fe640 1 -- 172.21.15.22:0/2462928767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5567296b5840 msgr2=0x556729a6aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.082+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5567296b5840 0x556729a6aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.082+0000 7fa1d77fe640 1 -- 172.21.15.22:0/2462928767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556729a6b5e0 con 0x556729694b60 2024-09-21T04:12:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.082+0000 7fa1d7fff640 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a70240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:12:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.083+0000 7fa1d77fe640 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a70780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x5567298238f0 tx=0x7fa1c00b6760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efac92a596f0dc52 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.083+0000 7fa1e4f41740 10 client.0 _ll_register_callbacks cb 0x7fa1d0050070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:12:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.083+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1c00ad2e0 con 0x556729694b60 2024-09-21T04:12:16.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.085+0000 7fa1bf7fe640 10 client.25666 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:12:16.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.085+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/2462928767 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c0020050 con 0x556729694b60 2024-09-21T04:12:16.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.085+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/2462928767 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa1c00d0070 con 0x556729694b60 2024-09-21T04:12:16.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.085+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/2462928767 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fa1c00b1040 con 0x556729694b60 2024-09-21T04:12:16.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.085+0000 7fa1e4f41740 10 client.25666 fetch_fsmap learned FSMap version 50 2024-09-21T04:12:16.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.085+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({fsmap=50}) -- 0x556729ae5590 con 0x556729694b60 2024-09-21T04:12:16.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.090+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/2462928767 <== mon.1 v2:172.21.15.73:3300/0 4 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7fa1c00b11e0 con 0x556729694b60 2024-09-21T04:12:16.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.090+0000 7fa1e4f41740 10 client.25666 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:12:16.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.090+0000 7fa1e4f41740 10 client.25666 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:12:16.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.090+0000 7fa1e4f41740 20 client.25666 populate_metadata read hostname 'smithi022' 2024-09-21T04:12:16.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.090+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556729649570 0x556729ae7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:16.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.090+0000 7fa1e4f41740 4 client.25666 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-21T04:12:16.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.090+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x7fa1c00ad2e0 con 0x556729649570 2024-09-21T04:12:16.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.091+0000 7fa1d7fff640 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556729649570 0x556729ae7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:16.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.096+0000 7fa1d7fff640 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556729649570 0x556729ae7c30 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4c9effa402c82699 server_cookie=20edfcb5cd1c920a in_seq=0 out_seq=0 2024-09-21T04:12:16.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.096+0000 7fa1bf7fe640 10 client.25666 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1bf7fe640 1 -- 172.21.15.22:0/2462928767 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7fa1c00ad2e0 con 0x556729649570 2024-09-21T04:12:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1bf7fe640 10 client.25666 handle_command_reply: tid=0 2024-09-21T04:12:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 client.25666 shutdown 2024-09-21T04:12:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 msgr2=0x556729a70780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a70780 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x5567298238f0 tx=0x7fa1c00b6760 comp rx=0 tx=0).stop 2024-09-21T04:12:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 shutdown_connections 2024-09-21T04:12:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556729649570 0x556729ae7c30 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556729694b60 0x556729a70780 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1bf7fe640 0 client.25666 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:16.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5567296b5840 0x556729a6aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 --2- 172.21.15.22:0/2462928767 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55672968c980 0x556729a70240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 >> 172.21.15.22:0/2462928767 conn(0x5567296a9990 msgr2=0x556729a741e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 shutdown_connections 2024-09-21T04:12:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 1 -- 172.21.15.22:0/2462928767 wait complete. 2024-09-21T04:12:16.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.406+0000 7fa1e4f41740 20 client.25666 trim_cache size 0 max 16384 2024-09-21T04:12:16.411 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:12:16.411 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:12:16.411 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:12:16.411 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 38, 2024-09-21T04:12:16.411 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "9592f75e": { 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 38, 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.5, 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:12:16.412 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:12:16.413 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:12:16.413 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:16.413 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:16.413 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:16.413 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:16.413 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:16.413 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 -- 172.21.15.22:0/2143603587 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c40b6600 msgr2=0x7fa1c40b8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c40b6600 0x7fa1c40b8b10 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fa1d0000f80 tx=0x7fa1d001a830 comp rx=0 tx=0).stop 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 -- 172.21.15.22:0/2143603587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d81083c0 msgr2=0x7fa1d806ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d81083c0 0x7fa1d806ff40 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa1c000d6a0 tx=0x7fa1c000db60 comp rx=0 tx=0).stop 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 -- 172.21.15.22:0/2143603587 shutdown_connections 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa1c40b6600 0x7fa1c40b8b10 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa1d8108d10 0x7fa1d8070480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa1d81083c0 0x7fa1d806ff40 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 --2- 172.21.15.22:0/2143603587 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa1d8102a80 0x7fa1d8074c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 -- 172.21.15.22:0/2143603587 >> 172.21.15.22:0/2143603587 conn(0x7fa1d8079760 msgr2=0x7fa1d8101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 -- 172.21.15.22:0/2143603587 shutdown_connections 2024-09-21T04:12:16.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:16.407+0000 7fa1de9cd640 1 -- 172.21.15.22:0/2143603587 wait complete. 2024-09-21T04:12:17.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:16 smithi022 ceph-mon[31015]: pgmap v668: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.2 MiB/s wr, 804 op/s 2024-09-21T04:12:17.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:16 smithi073 ceph-mon[34443]: pgmap v668: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.2 MiB/s wr, 804 op/s 2024-09-21T04:12:17.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:16 smithi060 ceph-mon[33722]: pgmap v668: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.2 MiB/s wr, 804 op/s 2024-09-21T04:12:17.709 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9592f75e', quiesce took 9.1 seconds. Will release after: 15.4 2024-09-21T04:12:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 475.0 s, 140.1 tps, lat 309.636 ms stddev 346.180 2024-09-21T04:12:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:18 smithi022 ceph-mon[31015]: pgmap v669: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.0 MiB/s wr, 799 op/s 2024-09-21T04:12:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:12:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:12:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:18 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:18 smithi073 ceph-mon[34443]: pgmap v669: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.0 MiB/s wr, 799 op/s 2024-09-21T04:12:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:12:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:12:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:18 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:19.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:18 smithi060 ceph-mon[33722]: pgmap v669: 129 pgs: 129 active+clean; 1.3 GiB data, 8.9 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.0 MiB/s wr, 799 op/s 2024-09-21T04:12:19.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:12:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:12:19.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:18 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:12:21.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:20 smithi022 ceph-mon[31015]: pgmap v670: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 662 op/s 2024-09-21T04:12:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:20 smithi073 ceph-mon[34443]: pgmap v670: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 662 op/s 2024-09-21T04:12:21.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:20 smithi060 ceph-mon[33722]: pgmap v670: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 6.0 MiB/s wr, 662 op/s 2024-09-21T04:12:23.001 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:22 smithi022 ceph-mon[31015]: pgmap v671: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 662 op/s 2024-09-21T04:12:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:22 smithi073 ceph-mon[34443]: pgmap v671: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 662 op/s 2024-09-21T04:12:23.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:22 smithi060 ceph-mon[33722]: pgmap v671: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.0 MiB/s wr, 662 op/s 2024-09-21T04:12:23.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 480.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:12:25.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:24 smithi022 ceph-mon[31015]: pgmap v672: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 537 op/s 2024-09-21T04:12:25.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:24 smithi073 ceph-mon[34443]: pgmap v672: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 537 op/s 2024-09-21T04:12:25.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:24 smithi060 ceph-mon[33722]: pgmap v672: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.0 MiB/s wr, 537 op/s 2024-09-21T04:12:27.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:26 smithi022 ceph-mon[31015]: pgmap v673: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 376 op/s 2024-09-21T04:12:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:26 smithi073 ceph-mon[34443]: pgmap v673: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 376 op/s 2024-09-21T04:12:27.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:26 smithi060 ceph-mon[33722]: pgmap v673: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.4 MiB/s wr, 376 op/s 2024-09-21T04:12:28.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 485.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:12:29.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:28 smithi022 ceph-mon[31015]: pgmap v674: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.5 MiB/s wr, 265 op/s 2024-09-21T04:12:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:28 smithi073 ceph-mon[34443]: pgmap v674: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.5 MiB/s wr, 265 op/s 2024-09-21T04:12:29.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:28 smithi060 ceph-mon[33722]: pgmap v674: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 2.5 MiB/s wr, 265 op/s 2024-09-21T04:12:31.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:30 smithi022 ceph-mon[31015]: pgmap v675: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-09-21T04:12:31.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:30 smithi073 ceph-mon[34443]: pgmap v675: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-09-21T04:12:31.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:30 smithi060 ceph-mon[33722]: pgmap v675: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.2 KiB/s rd, 1.1 MiB/s wr, 109 op/s 2024-09-21T04:12:33.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:32 smithi022 ceph-mon[31015]: pgmap v676: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 808 KiB/s wr, 81 op/s 2024-09-21T04:12:33.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:32 smithi073 ceph-mon[34443]: pgmap v676: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 808 KiB/s wr, 81 op/s 2024-09-21T04:12:33.111 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:12:33.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:32 smithi060 ceph-mon[33722]: pgmap v676: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 808 KiB/s wr, 81 op/s 2024-09-21T04:12:33.412 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:12:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 490.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:12:33.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.892+0000 7f715b61a640 1 -- 172.21.15.22:0/1869366701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71541083a0 msgr2=0x7f71541087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:33.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.892+0000 7f715b61a640 1 --2- 172.21.15.22:0/1869366701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71541083a0 0x7f71541087b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f7144009900 tx=0x7f714402a410 comp rx=0 tx=0).stop 2024-09-21T04:12:33.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.892+0000 7f715b61a640 1 -- 172.21.15.22:0/1869366701 shutdown_connections 2024-09-21T04:12:33.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.892+0000 7f715b61a640 1 --2- 172.21.15.22:0/1869366701 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7154108cf0 0x7f715410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:33.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.892+0000 7f715b61a640 1 --2- 172.21.15.22:0/1869366701 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f71541083a0 0x7f71541087b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:33.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.892+0000 7f715b61a640 1 --2- 172.21.15.22:0/1869366701 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7154102a60 0x7f7154102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:33.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.892+0000 7f715b61a640 1 -- 172.21.15.22:0/1869366701 >> 172.21.15.22:0/1869366701 conn(0x7f7154079730 msgr2=0x7f7154079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:33.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.892+0000 7f715b61a640 1 -- 172.21.15.22:0/1869366701 shutdown_connections 2024-09-21T04:12:33.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.892+0000 7f715b61a640 1 -- 172.21.15.22:0/1869366701 wait complete. 2024-09-21T04:12:33.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.893+0000 7f715b61a640 1 Processor -- start 2024-09-21T04:12:33.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.893+0000 7f715b61a640 1 -- start start 2024-09-21T04:12:33.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.893+0000 7f715b61a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7154102a60 0x7f7154199340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:33.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.893+0000 7f715b61a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71541083a0 0x7f71541998e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:33.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.893+0000 7f715b61a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7154108cf0 0x7f715419eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:33.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.893+0000 7f715b61a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7154112810 con 0x7f7154102a60 2024-09-21T04:12:33.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.893+0000 7f715b61a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7154112690 con 0x7f7154108cf0 2024-09-21T04:12:33.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.893+0000 7f715b61a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7154112990 con 0x7f71541083a0 2024-09-21T04:12:33.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f71593b6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7154102a60 0x7f7154199340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:33.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f71593b6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7154102a60 0x7f7154199340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55056/0 (socket says 172.21.15.22:55056) 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f71593b6640 1 -- 172.21.15.22:0/3504145135 learned_addr learned my addr 172.21.15.22:0/3504145135 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f7158bb5640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71541083a0 0x7f71541998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f7159bb7640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7154108cf0 0x7f715419eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f71593b6640 1 -- 172.21.15.22:0/3504145135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71541083a0 msgr2=0x7f71541998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f71593b6640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71541083a0 0x7f71541998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f71593b6640 1 -- 172.21.15.22:0/3504145135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7154108cf0 msgr2=0x7f715419eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f71593b6640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7154108cf0 0x7f715419eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f71593b6640 1 -- 172.21.15.22:0/3504145135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f715419f1f0 con 0x7f7154102a60 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f7158bb5640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71541083a0 0x7f71541998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f7159bb7640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7154108cf0 0x7f715419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f71593b6640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7154102a60 0x7f7154199340 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f715000d950 tx=0x7f715000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.894+0000 7f714a7fc640 1 -- 172.21.15.22:0/3504145135 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7150017030 con 0x7f7154102a60 2024-09-21T04:12:33.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.895+0000 7f715b61a640 1 -- 172.21.15.22:0/3504145135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f715419f4e0 con 0x7f7154102a60 2024-09-21T04:12:33.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.895+0000 7f714a7fc640 1 -- 172.21.15.22:0/3504145135 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7150004020 con 0x7f7154102a60 2024-09-21T04:12:33.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.895+0000 7f715b61a640 1 -- 172.21.15.22:0/3504145135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71541a5d00 con 0x7f7154102a60 2024-09-21T04:12:33.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.895+0000 7f714a7fc640 1 -- 172.21.15.22:0/3504145135 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71500055d0 con 0x7f7154102a60 2024-09-21T04:12:33.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.896+0000 7f715b61a640 1 -- 172.21.15.22:0/3504145135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7154102e70 con 0x7f7154102a60 2024-09-21T04:12:33.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.898+0000 7f714a7fc640 1 -- 172.21.15.22:0/3504145135 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7150009a30 con 0x7f7154102a60 2024-09-21T04:12:33.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.899+0000 7f714a7fc640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f71400b6540 0x7f71400b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:33.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.899+0000 7f7158bb5640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f71400b6540 0x7f71400b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:33.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.899+0000 7f714a7fc640 1 -- 172.21.15.22:0/3504145135 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f71500e7800 con 0x7f7154102a60 2024-09-21T04:12:33.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.900+0000 7f7158bb5640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f71400b6540 0x7f71400b8a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7144006010 tx=0x7f7144005de0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:33.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:33.903+0000 7f714a7fc640 1 -- 172.21.15.22:0/3504145135 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71500adc70 con 0x7f7154102a60 2024-09-21T04:12:34.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.127+0000 7f715b61a640 1 -- 172.21.15.22:0/3504145135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f715419a470 con 0x7f7154102a60 2024-09-21T04:12:34.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.128+0000 7f714a7fc640 1 -- 172.21.15.22:0/3504145135 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7f71500b2050 con 0x7f7154102a60 2024-09-21T04:12:34.131 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:12:34.131 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:12:34.132 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:12:34.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 -- 172.21.15.22:0/3504145135 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f71400b6540 msgr2=0x7f71400b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:34.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f71400b6540 0x7f71400b8a50 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7144006010 tx=0x7f7144005de0 comp rx=0 tx=0).stop 2024-09-21T04:12:34.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 -- 172.21.15.22:0/3504145135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7154102a60 msgr2=0x7f7154199340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:34.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7154102a60 0x7f7154199340 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f715000d950 tx=0x7f715000de10 comp rx=0 tx=0).stop 2024-09-21T04:12:34.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 -- 172.21.15.22:0/3504145135 shutdown_connections 2024-09-21T04:12:34.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f71400b6540 0x7f71400b8a50 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:34.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f71541083a0 0x7f71541998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:34.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7154108cf0 0x7f715419eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:34.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 --2- 172.21.15.22:0/3504145135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7154102a60 0x7f7154199340 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:34.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 -- 172.21.15.22:0/3504145135 >> 172.21.15.22:0/3504145135 conn(0x7f7154079730 msgr2=0x7f7154104570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:34.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 -- 172.21.15.22:0/3504145135 shutdown_connections 2024-09-21T04:12:34.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:34.130+0000 7f715b61a640 1 -- 172.21.15.22:0/3504145135 wait complete. 2024-09-21T04:12:34.832 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id 9592f75e --release --await' 2024-09-21T04:12:34.832 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id 9592f75e --release --await 2024-09-21T04:12:35.091 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:12:35.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:34 smithi022 ceph-mon[31015]: pgmap v677: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 236 KiB/s wr, 31 op/s 2024-09-21T04:12:35.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:34 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3504145135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:12:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:34 smithi073 ceph-mon[34443]: pgmap v677: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 236 KiB/s wr, 31 op/s 2024-09-21T04:12:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:34 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3504145135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:12:35.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:34 smithi060 ceph-mon[33722]: pgmap v677: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 236 KiB/s wr, 31 op/s 2024-09-21T04:12:35.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:34 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3504145135' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:12:35.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.579+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3912867906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8109df0 msgr2=0x7f06e8110620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.579+0000 7f06eeb7c640 1 --2- 172.21.15.22:0/3912867906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8109df0 0x7f06e8110620 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f06e0009ca0 tx=0x7f06e002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.579+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3912867906 shutdown_connections 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.579+0000 7f06eeb7c640 1 --2- 172.21.15.22:0/3912867906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8109df0 0x7f06e8110620 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.579+0000 7f06eeb7c640 1 --2- 172.21.15.22:0/3912867906 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06e81094a0 0x7f06e81098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.579+0000 7f06eeb7c640 1 --2- 172.21.15.22:0/3912867906 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e8103b60 0x7f06e8103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.579+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3912867906 >> 172.21.15.22:0/3912867906 conn(0x7f06e807b850 msgr2=0x7f06e807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.579+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3912867906 shutdown_connections 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.579+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3912867906 wait complete. 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06eeb7c640 1 Processor -- start 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06eeb7c640 1 -- start start 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06eeb7c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e8103b60 0x7f06e819a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06eeb7c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06e81094a0 0x7f06e819a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06eeb7c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8109df0 0x7f06e819fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06eeb7c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f06e81139b0 con 0x7f06e8109df0 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06eeb7c640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8113830 con 0x7f06e81094a0 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06eeb7c640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f06e8113b30 con 0x7f06e8103b60 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06ed119640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8109df0 0x7f06e819fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06ed119640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8109df0 0x7f06e819fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55074/0 (socket says 172.21.15.22:55074) 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06ed119640 1 -- 172.21.15.22:0/3811552439 learned_addr learned my addr 172.21.15.22:0/3811552439 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06e7fff640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06e81094a0 0x7f06e819a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.580+0000 7f06ec918640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e8103b60 0x7f06e819a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06ed119640 1 -- 172.21.15.22:0/3811552439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e8103b60 msgr2=0x7f06e819a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06ed119640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e8103b60 0x7f06e819a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06ed119640 1 -- 172.21.15.22:0/3811552439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06e81094a0 msgr2=0x7f06e819a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:35.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06ed119640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06e81094a0 0x7f06e819a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06ed119640 1 -- 172.21.15.22:0/3811552439 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e81a0250 con 0x7f06e8109df0 2024-09-21T04:12:35.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06ed119640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8109df0 0x7f06e819fbe0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f06e0005cc0 tx=0x7f06e0032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:35.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06e5ffb640 1 -- 172.21.15.22:0/3811552439 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0032e00 con 0x7f06e8109df0 2024-09-21T04:12:35.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06e5ffb640 1 -- 172.21.15.22:0/3811552439 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06e00044d0 con 0x7f06e8109df0 2024-09-21T04:12:35.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3811552439 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06e81a04e0 con 0x7f06e8109df0 2024-09-21T04:12:35.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06e5ffb640 1 -- 172.21.15.22:0/3811552439 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06e0030b70 con 0x7f06e8109df0 2024-09-21T04:12:35.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.581+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3811552439 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06e81a0a20 con 0x7f06e8109df0 2024-09-21T04:12:35.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.584+0000 7f06e5ffb640 1 -- 172.21.15.22:0/3811552439 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f06e0030d10 con 0x7f06e8109df0 2024-09-21T04:12:35.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.584+0000 7f06f50f0740 1 Processor -- start 2024-09-21T04:12:35.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.584+0000 7f06f50f0740 1 -- start start 2024-09-21T04:12:35.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.584+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f7832ba520 0x55f783660510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.584+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783660a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.584+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783299840 0x55f783660f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.584+0000 7f06f50f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f78354bdc0 con 0x55f783291660 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.584+0000 7f06f50f0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f7835d81f0 con 0x55f783299840 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.584+0000 7f06f50f0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f7835c7620 con 0x55f7832ba520 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06ec918640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783660a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06ec918640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783660a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55088/0 (socket says 172.21.15.22:55088) 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06ec918640 1 -- 172.21.15.22:0/311150467 learned_addr learned my addr 172.21.15.22:0/311150467 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06e7fff640 1 --2- 172.21.15.22:0/311150467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f7832ba520 0x55f783660510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06e7fff640 1 --2- 172.21.15.22:0/311150467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783299840 0x55f783660f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06e5ffb640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06d00b6540 0x7f06d00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06ec918640 1 -- 172.21.15.22:0/311150467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f7832ba520 msgr2=0x55f783660510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06ec918640 1 --2- 172.21.15.22:0/311150467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f7832ba520 0x55f783660510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06ec918640 1 -- 172.21.15.22:0/311150467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783299840 msgr2=0x55f783660f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06ec918640 1 --2- 172.21.15.22:0/311150467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783299840 0x55f783660f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06ec918640 1 -- 172.21.15.22:0/311150467 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f78358ffd0 con 0x55f783291660 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06ed119640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06d00b6540 0x7f06d00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06e5ffb640 1 -- 172.21.15.22:0/3811552439 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f06e0108a80 con 0x7f06e8109df0 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.585+0000 7f06ec918640 1 --2- 172.21.15.22:0/311150467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783660a50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f06d800ad00 tx=0x7f06d800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c0bc84d42e7fdbc server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.586+0000 7f06ceffd640 1 -- 172.21.15.22:0/311150467 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d801d070 con 0x55f783291660 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.586+0000 7f06ceffd640 1 -- 172.21.15.22:0/311150467 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06d8018ad0 con 0x55f783291660 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.586+0000 7f06ceffd640 1 -- 172.21.15.22:0/311150467 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8010a20 con 0x55f783291660 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.586+0000 7f06f50f0740 1 -- 172.21.15.22:0/311150467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 msgr2=0x55f783660a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.586+0000 7f06ed119640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06d00b6540 0x7f06d00b8a50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f06e00ce550 tx=0x7f06e003e040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.586+0000 7f06f50f0740 1 --2- 172.21.15.22:0/311150467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783660a50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f06d800ad00 tx=0x7f06d800f790 comp rx=0 tx=0).stop 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.586+0000 7f06f50f0740 1 -- 172.21.15.22:0/311150467 shutdown_connections 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.587+0000 7f06f50f0740 1 --2- 172.21.15.22:0/311150467 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783299840 0x55f783660f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.587+0000 7f06f50f0740 1 --2- 172.21.15.22:0/311150467 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783660a50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.587+0000 7f06f50f0740 1 --2- 172.21.15.22:0/311150467 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f7832ba520 0x55f783660510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.587+0000 7f06f50f0740 1 -- 172.21.15.22:0/311150467 >> 172.21.15.22:0/311150467 conn(0x55f7832ae910 msgr2=0x55f78365e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:35.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.587+0000 7f06f50f0740 1 -- 172.21.15.22:0/311150467 shutdown_connections 2024-09-21T04:12:35.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.587+0000 7f06f50f0740 1 -- 172.21.15.22:0/311150467 wait complete. 2024-09-21T04:12:35.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.587+0000 7f06f50f0740 1 -- start start 2024-09-21T04:12:35.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.587+0000 7f06f50f0740 1 Processor -- start 2024-09-21T04:12:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f78366bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 0x55f78366c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7832ba520 0x55f78367c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06f50f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f783562300 con 0x55f783291660 2024-09-21T04:12:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06f50f0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55f7835cb430 con 0x55f7832ba520 2024-09-21T04:12:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06f50f0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55f783428bb0 con 0x55f783299840 2024-09-21T04:12:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06f50f0740 10 client.0 _ll_register_callbacks cb 0x55f78357c120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:12:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f78366bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f78366bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55096/0 (socket says 172.21.15.22:55096) 2024-09-21T04:12:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06e7fff640 1 -- 172.21.15.22:0/2996650126 learned_addr learned my addr 172.21.15.22:0/2996650126 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06ec918640 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 0x55f78366c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06e7fff640 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7832ba520 0x55f78367c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06e7fff640 1 -- 172.21.15.22:0/2996650126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 msgr2=0x55f78366c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:35.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06e7fff640 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 0x55f78366c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06e7fff640 1 -- 172.21.15.22:0/2996650126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7832ba520 msgr2=0x55f78367c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06e7fff640 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7832ba520 0x55f78367c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06e7fff640 1 -- 172.21.15.22:0/2996650126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f783551780 con 0x55f783291660 2024-09-21T04:12:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06e7fff640 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f78366bb70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00bec0 tx=0x7f06dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4b5048f3dab3479 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:12:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06c7fff640 1 -- 172.21.15.22:0/2996650126 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc01b040 con 0x55f783291660 2024-09-21T04:12:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.588+0000 7f06c7fff640 1 -- 172.21.15.22:0/2996650126 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f06dc005020 con 0x55f783291660 2024-09-21T04:12:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06f50f0740 1 -- 172.21.15.22:0/2996650126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06d8018ad0 con 0x55f783291660 2024-09-21T04:12:35.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06c7fff640 1 -- 172.21.15.22:0/2996650126 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f06dc026050 con 0x55f783291660 2024-09-21T04:12:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06f50f0740 10 client.16056 fetch_fsmap learned FSMap version 50 2024-09-21T04:12:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06f50f0740 1 -- 172.21.15.22:0/2996650126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55f783325b00 con 0x55f783291660 2024-09-21T04:12:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06c7fff640 1 -- 172.21.15.22:0/2996650126 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06d8018ad0 con 0x55f783291660 2024-09-21T04:12:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06c7fff640 1 -- 172.21.15.22:0/2996650126 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f06dc004cd0 con 0x55f783291660 2024-09-21T04:12:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06f50f0740 10 client.16056 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:12:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06f50f0740 10 client.16056 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:12:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06f50f0740 20 client.16056 populate_metadata read hostname 'smithi022' 2024-09-21T04:12:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06f50f0740 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f783278ea0 0x55f783682380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06f50f0740 4 client.16056 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:12:35.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.589+0000 7f06f50f0740 1 -- 172.21.15.22:0/2996650126 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7835da140 con 0x55f783278ea0 2024-09-21T04:12:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.590+0000 7f06ec918640 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f783278ea0 0x55f783682380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.590+0000 7f06ec918640 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f783278ea0 0x55f783682380 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f090d7a6a83c5286 server_cookie=7edd12eecc999076 in_seq=0 out_seq=0 2024-09-21T04:12:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.590+0000 7f06c7fff640 10 client.16056 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06c7fff640 1 -- 172.21.15.22:0/2996650126 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55f7835da140 con 0x55f783278ea0 2024-09-21T04:12:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06c7fff640 10 client.16056 handle_command_reply: tid=0 2024-09-21T04:12:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 client.16056 shutdown 2024-09-21T04:12:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 -- 172.21.15.22:0/2996650126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 msgr2=0x55f78366bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f78366bb70 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f06dc00bec0 tx=0x7f06dc0046c0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 -- 172.21.15.22:0/2996650126 shutdown_connections 2024-09-21T04:12:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f783278ea0 0x55f783682380 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06c7fff640 0 client.16056 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 0x55f78366c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f7832ba520 0x55f78367c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 --2- 172.21.15.22:0/2996650126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f78366bb70 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 -- 172.21.15.22:0/2996650126 >> 172.21.15.22:0/2996650126 conn(0x55f7832ae910 msgr2=0x55f7836636a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 -- 172.21.15.22:0/2996650126 shutdown_connections 2024-09-21T04:12:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 1 -- 172.21.15.22:0/2996650126 wait complete. 2024-09-21T04:12:35.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.591+0000 7f06f50f0740 20 client.16056 trim_cache size 0 max 16384 2024-09-21T04:12:35.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06f50f0740 1 Processor -- start 2024-09-21T04:12:35.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06f50f0740 1 -- start start 2024-09-21T04:12:35.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783278ea0 0x55f783661f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783668d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 0x55f7836692a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06f50f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f06e81ae830 con 0x55f783291660 2024-09-21T04:12:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06f50f0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06e81b0370 con 0x55f783278ea0 2024-09-21T04:12:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06f50f0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f06e81aef00 con 0x55f783299840 2024-09-21T04:12:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06ec918640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783668d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06ec918640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783668d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55098/0 (socket says 172.21.15.22:55098) 2024-09-21T04:12:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06ec918640 1 -- 172.21.15.22:0/4068951206 learned_addr learned my addr 172.21.15.22:0/4068951206 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06e7fff640 1 --2- 172.21.15.22:0/4068951206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783278ea0 0x55f783661f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06e7fff640 1 --2- 172.21.15.22:0/4068951206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 0x55f7836692a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06ec918640 1 -- 172.21.15.22:0/4068951206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 msgr2=0x55f7836692a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06ec918640 1 --2- 172.21.15.22:0/4068951206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 0x55f7836692a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06ec918640 1 -- 172.21.15.22:0/4068951206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783278ea0 msgr2=0x55f783661f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.609+0000 7f06ec918640 1 --2- 172.21.15.22:0/4068951206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783278ea0 0x55f783661f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.610+0000 7f06ec918640 1 -- 172.21.15.22:0/4068951206 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f78339c960 con 0x55f783291660 2024-09-21T04:12:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.610+0000 7f06e7fff640 1 --2- 172.21.15.22:0/4068951206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 0x55f7836692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:12:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.610+0000 7f06ec918640 1 --2- 172.21.15.22:0/4068951206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783668d60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f06d800ad00 tx=0x7f06d800ac80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db85877fc8f31caa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.610+0000 7f06ce7fc640 1 -- 172.21.15.22:0/4068951206 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d801d040 con 0x55f783291660 2024-09-21T04:12:35.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.610+0000 7f06ce7fc640 1 -- 172.21.15.22:0/4068951206 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06d8030070 con 0x55f783291660 2024-09-21T04:12:35.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.610+0000 7f06ce7fc640 1 -- 172.21.15.22:0/4068951206 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06d8004660 con 0x55f783291660 2024-09-21T04:12:35.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 -- 172.21.15.22:0/4068951206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 msgr2=0x55f783668d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:35.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 --2- 172.21.15.22:0/4068951206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783668d60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f06d800ad00 tx=0x7f06d800ac80 comp rx=0 tx=0).stop 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 -- 172.21.15.22:0/4068951206 shutdown_connections 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 --2- 172.21.15.22:0/4068951206 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783299840 0x55f7836692a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 --2- 172.21.15.22:0/4068951206 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783291660 0x55f783668d60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 --2- 172.21.15.22:0/4068951206 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783278ea0 0x55f783661f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 -- 172.21.15.22:0/4068951206 >> 172.21.15.22:0/4068951206 conn(0x55f7832ae910 msgr2=0x55f78365dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 -- 172.21.15.22:0/4068951206 shutdown_connections 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 -- 172.21.15.22:0/4068951206 wait complete. 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 -- start start 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.611+0000 7f06f50f0740 1 Processor -- start 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783278ea0 0x55f783676410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783291660 0x55f783676950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06f50f0740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783299840 0x55f783676ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06f50f0740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f06e81afca0 con 0x55f783278ea0 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06f50f0740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f06e81af5d0 con 0x55f783299840 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06f50f0740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f06e81ac810 con 0x55f783291660 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06f50f0740 10 client.0 _ll_register_callbacks cb 0x7f06dc004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783278ea0 0x55f783676410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783278ea0 0x55f783676410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55106/0 (socket says 172.21.15.22:55106) 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06e7fff640 1 -- 172.21.15.22:0/1441861719 learned_addr learned my addr 172.21.15.22:0/1441861719 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06ec918640 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783291660 0x55f783676950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06e7fff640 1 -- 172.21.15.22:0/1441861719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783291660 msgr2=0x55f783676950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06e7fff640 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783291660 0x55f783676950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06e7fff640 1 -- 172.21.15.22:0/1441861719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783299840 msgr2=0x55f783676ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06e7fff640 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783299840 0x55f783676ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.612+0000 7f06e7fff640 1 -- 172.21.15.22:0/1441861719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7836ebfa0 con 0x55f783278ea0 2024-09-21T04:12:35.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06e7fff640 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783278ea0 0x55f783676410 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f06dc005930 tx=0x7f06dc00b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d32bd7487b62dd server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06c7fff640 1 -- 172.21.15.22:0/1441861719 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06dc02e070 con 0x55f783278ea0 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06c7fff640 1 -- 172.21.15.22:0/1441861719 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f06dc00b8c0 con 0x55f783278ea0 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06f50f0740 1 -- 172.21.15.22:0/1441861719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06d8030070 con 0x55f783278ea0 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06c7fff640 1 -- 172.21.15.22:0/1441861719 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f06dc03a050 con 0x55f783278ea0 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06f50f0740 10 client.16062 fetch_fsmap learned FSMap version 50 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06f50f0740 1 -- 172.21.15.22:0/1441861719 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55f7836ed1d0 con 0x55f783278ea0 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06c7fff640 1 -- 172.21.15.22:0/1441861719 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06d8030070 con 0x55f783278ea0 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06c7fff640 1 -- 172.21.15.22:0/1441861719 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f06dc033440 con 0x55f783278ea0 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06f50f0740 10 client.16062 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06f50f0740 10 client.16062 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06f50f0740 20 client.16062 populate_metadata read hostname 'smithi022' 2024-09-21T04:12:35.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06f50f0740 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f7832ba520 0x55f7836ef910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06f50f0740 4 client.16062 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9592f75e", "release": true, "await": true}] 2024-09-21T04:12:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.613+0000 7f06f50f0740 1 -- 172.21.15.22:0/1441861719 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9592f75e", "release": true, "await": true}) -- 0x55f7835d5bf0 con 0x55f7832ba520 2024-09-21T04:12:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.614+0000 7f06ec918640 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f7832ba520 0x55f7836ef910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.614+0000 7f06ec918640 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f7832ba520 0x55f7836ef910 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b12f62b3f73766f8 server_cookie=c9daa4bd3b86c90 in_seq=0 out_seq=0 2024-09-21T04:12:35.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.614+0000 7f06c7fff640 10 client.16062 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:35.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06c7fff640 1 -- 172.21.15.22:0/1441861719 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55f7835d5bf0 con 0x55f7832ba520 2024-09-21T04:12:35.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06c7fff640 10 client.16062 handle_command_reply: tid=0 2024-09-21T04:12:35.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06f50f0740 1 client.16062 shutdown 2024-09-21T04:12:35.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06f50f0740 1 -- 172.21.15.22:0/1441861719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783278ea0 msgr2=0x55f783676410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:35.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06f50f0740 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783278ea0 0x55f783676410 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f06dc005930 tx=0x7f06dc00b400 comp rx=0 tx=0).stop 2024-09-21T04:12:35.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06f50f0740 1 -- 172.21.15.22:0/1441861719 shutdown_connections 2024-09-21T04:12:35.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06f50f0740 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55f7832ba520 0x55f7836ef910 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06f50f0740 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55f783291660 0x55f783676950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06f50f0740 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55f783299840 0x55f783676ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06f50f0740 1 --2- 172.21.15.22:0/1441861719 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f783278ea0 0x55f783676410 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06f50f0740 1 -- 172.21.15.22:0/1441861719 >> 172.21.15.22:0/1441861719 conn(0x55f7832ae910 msgr2=0x55f78365db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:35.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06c7fff640 0 client.16062 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:35.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.669+0000 7f06f50f0740 1 -- 172.21.15.22:0/1441861719 shutdown_connections 2024-09-21T04:12:35.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.670+0000 7f06f50f0740 1 -- 172.21.15.22:0/1441861719 wait complete. 2024-09-21T04:12:35.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.670+0000 7f06f50f0740 20 client.16062 trim_cache size 0 max 16384 2024-09-21T04:12:35.675 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:12:35.676 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:12:35.676 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:12:35.676 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 40, 2024-09-21T04:12:35.676 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:12:35.676 INFO:teuthology.orchestra.run.smithi022.stdout: "9592f75e": { 2024-09-21T04:12:35.676 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 40, 2024-09-21T04:12:35.676 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:12:35.676 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:12:35.677 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:12:35.677 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:12:35.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:12:35.677 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:12:35.677 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.5, 2024-09-21T04:12:35.677 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:12:35.677 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:12:35.677 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:12:35.677 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:12:35.677 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:12:35.678 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:12:35.678 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:35.678 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:35.678 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:35.678 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:35.678 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:35.678 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.671+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3811552439 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06d00b6540 msgr2=0x7f06d00b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.671+0000 7f06eeb7c640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06d00b6540 0x7f06d00b8a50 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f06e00ce550 tx=0x7f06e003e040 comp rx=0 tx=0).stop 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.671+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3811552439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8109df0 msgr2=0x7f06e819fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.671+0000 7f06eeb7c640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8109df0 0x7f06e819fbe0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f06e0005cc0 tx=0x7f06e0032a10 comp rx=0 tx=0).stop 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.671+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3811552439 shutdown_connections 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.671+0000 7f06eeb7c640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f06d00b6540 0x7f06d00b8a50 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.671+0000 7f06eeb7c640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06e8109df0 0x7f06e819fbe0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.671+0000 7f06eeb7c640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f06e81094a0 0x7f06e819a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.671+0000 7f06eeb7c640 1 --2- 172.21.15.22:0/3811552439 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f06e8103b60 0x7f06e819a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.671+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3811552439 >> 172.21.15.22:0/3811552439 conn(0x7f06e807b850 msgr2=0x7f06e8107530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:35.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.674+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3811552439 shutdown_connections 2024-09-21T04:12:35.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:35.674+0000 7f06eeb7c640 1 -- 172.21.15.22:0/3811552439 wait complete. 2024-09-21T04:12:36.552 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9592f75e', total seconds elapsed: 27.9 2024-09-21T04:12:36.552 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.5 2024-09-21T04:12:36.553 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:12:37.024 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:12:37.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:36 smithi022 ceph-mon[31015]: pgmap v678: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 243 KiB/s wr, 32 op/s 2024-09-21T04:12:37.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:36 smithi073 ceph-mon[34443]: pgmap v678: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 243 KiB/s wr, 32 op/s 2024-09-21T04:12:37.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:36 smithi060 ceph-mon[33722]: pgmap v678: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 243 KiB/s wr, 32 op/s 2024-09-21T04:12:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.626+0000 7fa881e1d640 1 -- 172.21.15.22:0/3091923655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa87c110440 msgr2=0x7fa87c116c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.626+0000 7fa881e1d640 1 --2- 172.21.15.22:0/3091923655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa87c110440 0x7fa87c116c70 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fa874009900 tx=0x7fa87402a440 comp rx=0 tx=0).stop 2024-09-21T04:12:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.626+0000 7fa881e1d640 1 -- 172.21.15.22:0/3091923655 shutdown_connections 2024-09-21T04:12:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.626+0000 7fa881e1d640 1 --2- 172.21.15.22:0/3091923655 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa87c10faf0 0x7fa87c10ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.626+0000 7fa881e1d640 1 --2- 172.21.15.22:0/3091923655 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa87c110440 0x7fa87c116c70 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.626+0000 7fa881e1d640 1 --2- 172.21.15.22:0/3091923655 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa87c10a1b0 0x7fa87c10a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.626+0000 7fa881e1d640 1 -- 172.21.15.22:0/3091923655 >> 172.21.15.22:0/3091923655 conn(0x7fa87c0780e0 msgr2=0x7fa87c1081e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.626+0000 7fa881e1d640 1 -- 172.21.15.22:0/3091923655 shutdown_connections 2024-09-21T04:12:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.626+0000 7fa881e1d640 1 -- 172.21.15.22:0/3091923655 wait complete. 2024-09-21T04:12:37.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.627+0000 7fa881e1d640 1 Processor -- start 2024-09-21T04:12:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa881e1d640 1 -- start start 2024-09-21T04:12:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa881e1d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa87c10a1b0 0x7fa87c083cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:37.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa881e1d640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa87c10faf0 0x7fa87c07cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa881e1d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa87c110440 0x7fa87c07d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa881e1d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c119fa0 con 0x7fa87c110440 2024-09-21T04:12:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa881e1d640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c119e20 con 0x7fa87c10faf0 2024-09-21T04:12:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa881e1d640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c11a120 con 0x7fa87c10a1b0 2024-09-21T04:12:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa87bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa87c110440 0x7fa87c07d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa87affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa87c10faf0 0x7fa87c07cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa87affd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa87c10faf0 0x7fa87c07cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:45916/0 (socket says 172.21.15.22:45916) 2024-09-21T04:12:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.628+0000 7fa87affd640 1 -- 172.21.15.22:0/826037951 learned_addr learned my addr 172.21.15.22:0/826037951 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.629+0000 7fa87b7fe640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa87c10a1b0 0x7fa87c083cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:37.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.629+0000 7fa87affd640 1 -- 172.21.15.22:0/826037951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa87c10a1b0 msgr2=0x7fa87c083cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:37.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.629+0000 7fa87affd640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa87c10a1b0 0x7fa87c083cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:37.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.629+0000 7fa87affd640 1 -- 172.21.15.22:0/826037951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa87c110440 msgr2=0x7fa87c07d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:37.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.629+0000 7fa87affd640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa87c110440 0x7fa87c07d550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:37.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.629+0000 7fa87affd640 1 -- 172.21.15.22:0/826037951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c07dd70 con 0x7fa87c10faf0 2024-09-21T04:12:37.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.629+0000 7fa87affd640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa87c10faf0 0x7fa87c07cf90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa87000e9f0 tx=0x7fa87000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:37.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.629+0000 7fa878ff9640 1 -- 172.21.15.22:0/826037951 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa87000ccc0 con 0x7fa87c10faf0 2024-09-21T04:12:37.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.630+0000 7fa878ff9640 1 -- 172.21.15.22:0/826037951 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8700108c0 con 0x7fa87c10faf0 2024-09-21T04:12:37.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.631+0000 7fa878ff9640 1 -- 172.21.15.22:0/826037951 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa870018750 con 0x7fa87c10faf0 2024-09-21T04:12:37.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.631+0000 7fa881e1d640 1 -- 172.21.15.22:0/826037951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87c0829f0 con 0x7fa87c10faf0 2024-09-21T04:12:37.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.631+0000 7fa881e1d640 1 -- 172.21.15.22:0/826037951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87c082eb0 con 0x7fa87c10faf0 2024-09-21T04:12:37.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.633+0000 7fa881e1d640 1 -- 172.21.15.22:0/826037951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87c10b430 con 0x7fa87c10faf0 2024-09-21T04:12:37.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.639+0000 7fa878ff9640 1 -- 172.21.15.22:0/826037951 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa87001f020 con 0x7fa87c10faf0 2024-09-21T04:12:37.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.640+0000 7fa878ff9640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa8640b63e0 0x7fa8640b88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:37.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.640+0000 7fa87b7fe640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa8640b63e0 0x7fa8640b88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:37.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.641+0000 7fa878ff9640 1 -- 172.21.15.22:0/826037951 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa8700e7f40 con 0x7fa87c10faf0 2024-09-21T04:12:37.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.641+0000 7fa878ff9640 1 -- 172.21.15.22:0/826037951 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8700a9f20 con 0x7fa87c10faf0 2024-09-21T04:12:37.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:37.646+0000 7fa87b7fe640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa8640b63e0 0x7fa8640b88f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa86c005fd0 tx=0x7fa86c009500 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:38.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.088+0000 7fa881e1d640 1 -- 172.21.15.22:0/826037951 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa87c07e290 con 0x7fa87c10faf0 2024-09-21T04:12:38.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.090+0000 7fa878ff9640 1 -- 172.21.15.22:0/826037951 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7fa8700ae3b0 con 0x7fa87c10faf0 2024-09-21T04:12:38.093 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:12:38.093 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:12:38.093 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:12:38.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.095+0000 7fa881e1d640 1 -- 172.21.15.22:0/826037951 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa8640b63e0 msgr2=0x7fa8640b88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:38.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.095+0000 7fa881e1d640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa8640b63e0 0x7fa8640b88f0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa86c005fd0 tx=0x7fa86c009500 comp rx=0 tx=0).stop 2024-09-21T04:12:38.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.095+0000 7fa881e1d640 1 -- 172.21.15.22:0/826037951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa87c10faf0 msgr2=0x7fa87c07cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:38.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.095+0000 7fa881e1d640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa87c10faf0 0x7fa87c07cf90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa87000e9f0 tx=0x7fa87000eeb0 comp rx=0 tx=0).stop 2024-09-21T04:12:38.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.095+0000 7fa881e1d640 1 -- 172.21.15.22:0/826037951 shutdown_connections 2024-09-21T04:12:38.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.095+0000 7fa881e1d640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa8640b63e0 0x7fa8640b88f0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:38.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.095+0000 7fa881e1d640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa87c110440 0x7fa87c07d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:38.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.095+0000 7fa881e1d640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa87c10faf0 0x7fa87c07cf90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:38.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.095+0000 7fa881e1d640 1 --2- 172.21.15.22:0/826037951 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa87c10a1b0 0x7fa87c083cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:38.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.095+0000 7fa881e1d640 1 -- 172.21.15.22:0/826037951 >> 172.21.15.22:0/826037951 conn(0x7fa87c0780e0 msgr2=0x7fa87c10e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:38.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.096+0000 7fa881e1d640 1 -- 172.21.15.22:0/826037951 shutdown_connections 2024-09-21T04:12:38.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:38.096+0000 7fa881e1d640 1 -- 172.21.15.22:0/826037951 wait complete. 2024-09-21T04:12:38.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 495.0 s, 518.6 tps, lat 886.306 ms stddev 3823.062 2024-09-21T04:12:38.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:38 smithi022 ceph-mon[31015]: pgmap v679: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 636 KiB/s wr, 59 op/s 2024-09-21T04:12:38.910 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:38 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/826037951' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:12:38.964 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0' 2024-09-21T04:12:38.964 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 144.5 --await-for 45.0 2024-09-21T04:12:39.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:38 smithi073 ceph-mon[34443]: pgmap v679: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 636 KiB/s wr, 59 op/s 2024-09-21T04:12:39.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:38 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/826037951' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:12:39.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:38 smithi060 ceph-mon[33722]: pgmap v679: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 636 KiB/s wr, 59 op/s 2024-09-21T04:12:39.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:38 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/826037951' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:12:39.449 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:12:39.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:39 smithi022 ceph-mon[31015]: pgmap v680: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 624 KiB/s wr, 58 op/s 2024-09-21T04:12:40.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.073+0000 7f1a35008640 1 -- 172.21.15.22:0/2659020476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a30103110 msgr2=0x7f1a30107640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:40.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.073+0000 7f1a35008640 1 --2- 172.21.15.22:0/2659020476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a30103110 0x7f1a30107640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009ca0 tx=0x7f1a2802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.073+0000 7f1a35008640 1 -- 172.21.15.22:0/2659020476 shutdown_connections 2024-09-21T04:12:40.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.073+0000 7f1a35008640 1 --2- 172.21.15.22:0/2659020476 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a30103110 0x7f1a30107640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.073+0000 7f1a35008640 1 --2- 172.21.15.22:0/2659020476 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a30107c00 0x7f1a301080e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.073+0000 7f1a35008640 1 --2- 172.21.15.22:0/2659020476 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a301027c0 0x7f1a30102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.073+0000 7f1a35008640 1 -- 172.21.15.22:0/2659020476 >> 172.21.15.22:0/2659020476 conn(0x7f1a30079760 msgr2=0x7f1a30079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:40.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.074+0000 7f1a35008640 1 -- 172.21.15.22:0/2659020476 shutdown_connections 2024-09-21T04:12:40.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.074+0000 7f1a35008640 1 -- 172.21.15.22:0/2659020476 wait complete. 2024-09-21T04:12:40.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.075+0000 7f1a35008640 1 Processor -- start 2024-09-21T04:12:40.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.075+0000 7f1a35008640 1 -- start start 2024-09-21T04:12:40.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.076+0000 7f1a35008640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a301027c0 0x7f1a301a09d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.076+0000 7f1a35008640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a30103110 0x7f1a301a0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.076+0000 7f1a2ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a301027c0 0x7f1a301a09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.076+0000 7f1a2ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a301027c0 0x7f1a301a09d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:55258/0 (socket says 172.21.15.22:55258) 2024-09-21T04:12:40.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.076+0000 7f1a35008640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a30107c00 0x7f1a301a6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.076+0000 7f1a2e59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a30103110 0x7f1a301a0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.076+0000 7f1a2ed9d640 1 -- 172.21.15.22:0/1006631526 learned_addr learned my addr 172.21.15.22:0/1006631526 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:40.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.076+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30119f60 con 0x7f1a30107c00 2024-09-21T04:12:40.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.076+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1a30119de0 con 0x7f1a30103110 2024-09-21T04:12:40.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.076+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3011a0e0 con 0x7f1a301027c0 2024-09-21T04:12:40.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.077+0000 7f1a2e59c640 1 -- 172.21.15.22:0/1006631526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a301027c0 msgr2=0x7f1a301a09d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:40.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.077+0000 7f1a2e59c640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a301027c0 0x7f1a301a09d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.077+0000 7f1a2e59c640 1 -- 172.21.15.22:0/1006631526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a30107c00 msgr2=0x7f1a301a6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:40.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.077+0000 7f1a2e59c640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a30107c00 0x7f1a301a6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.077+0000 7f1a2e59c640 1 -- 172.21.15.22:0/1006631526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a301a6940 con 0x7f1a30103110 2024-09-21T04:12:40.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.077+0000 7f1a2e59c640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a30103110 0x7f1a301a0f70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009bf0 tx=0x7f1a28032980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:40.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.078+0000 7f1a2ed9d640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a301027c0 0x7f1a301a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:12:40.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.078+0000 7f1a17fff640 1 -- 172.21.15.22:0/1006631526 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28032e30 con 0x7f1a30103110 2024-09-21T04:12:40.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.078+0000 7f1a17fff640 1 -- 172.21.15.22:0/1006631526 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a280044d0 con 0x7f1a30103110 2024-09-21T04:12:40.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.078+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a301a6bd0 con 0x7f1a30103110 2024-09-21T04:12:40.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.078+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a301a7020 con 0x7f1a30103110 2024-09-21T04:12:40.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.078+0000 7f1a17fff640 1 -- 172.21.15.22:0/1006631526 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a28030c00 con 0x7f1a30103110 2024-09-21T04:12:40.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.083+0000 7f1a3b57c740 1 Processor -- start 2024-09-21T04:12:40.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.083+0000 7f1a17fff640 1 -- 172.21.15.22:0/1006631526 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f1a2804e440 con 0x7f1a30103110 2024-09-21T04:12:40.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.084+0000 7f1a3b57c740 1 -- start start 2024-09-21T04:12:40.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.084+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619af4840 0x55c619e9b600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.084+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619e9bb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.084+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619e9c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.084+0000 7f1a3b57c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c619e11b90 con 0x55c619acb980 2024-09-21T04:12:40.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.084+0000 7f1a3b57c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c619e00fc0 con 0x55c619af4840 2024-09-21T04:12:40.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.084+0000 7f1a3b57c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c619e04dd0 con 0x55c619ad3b60 2024-09-21T04:12:40.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.085+0000 7f1a17fff640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1a180b66a0 0x7f1a180b8bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.085+0000 7f1a2f59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619af4840 0x55c619e9b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.085+0000 7f1a2f59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619af4840 0x55c619e9b600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:45930/0 (socket says 172.21.15.22:45930) 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.085+0000 7f1a2f59e640 1 -- 172.21.15.22:0/287570 learned_addr learned my addr 172.21.15.22:0/287570 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.085+0000 7f1a2e59c640 1 --2- 172.21.15.22:0/287570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619e9c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.085+0000 7f1a17fff640 1 -- 172.21.15.22:0/1006631526 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f1a281089b0 con 0x7f1a30103110 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.085+0000 7f1a2ed9d640 1 --2- 172.21.15.22:0/287570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619e9bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.086+0000 7f1a2e59c640 1 -- 172.21.15.22:0/287570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619af4840 msgr2=0x55c619e9b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.086+0000 7f1a2e59c640 1 --2- 172.21.15.22:0/287570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619af4840 0x55c619e9b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.086+0000 7f1a2e59c640 1 -- 172.21.15.22:0/287570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 msgr2=0x55c619e9bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.086+0000 7f1a2e59c640 1 --2- 172.21.15.22:0/287570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619e9bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.086+0000 7f1a2e59c640 1 -- 172.21.15.22:0/287570 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c619d88060 con 0x55c619ad3b60 2024-09-21T04:12:40.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.086+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1a180b66a0 0x7f1a180b8bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.086+0000 7f1a2e59c640 1 --2- 172.21.15.22:0/287570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619e9c080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1a28049000 tx=0x7f1a280ce070 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e93c8ce8e79fb7bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:40.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.086+0000 7f1a157fa640 1 -- 172.21.15.22:0/287570 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a280ce230 con 0x55c619ad3b60 2024-09-21T04:12:40.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.086+0000 7f1a157fa640 1 -- 172.21.15.22:0/287570 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a28036070 con 0x55c619ad3b60 2024-09-21T04:12:40.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.086+0000 7f1a157fa640 1 -- 172.21.15.22:0/287570 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a280d7cb0 con 0x55c619ad3b60 2024-09-21T04:12:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.087+0000 7f1a3b57c740 1 -- 172.21.15.22:0/287570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 msgr2=0x55c619e9c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.087+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1a180b66a0 0x7f1a180b8bb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1a240058c0 tx=0x7f1a24005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.087+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/287570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619e9c080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1a28049000 tx=0x7f1a280ce070 comp rx=0 tx=0).stop 2024-09-21T04:12:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.088+0000 7f1a3b57c740 1 -- 172.21.15.22:0/287570 shutdown_connections 2024-09-21T04:12:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.088+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/287570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619e9c080 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.088+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/287570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619e9bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.088+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/287570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619af4840 0x55c619e9b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.088+0000 7f1a3b57c740 1 -- 172.21.15.22:0/287570 >> 172.21.15.22:0/287570 conn(0x55c619ae8990 msgr2=0x55c619e994f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:40.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.088+0000 7f1a3b57c740 1 -- 172.21.15.22:0/287570 shutdown_connections 2024-09-21T04:12:40.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.088+0000 7f1a3b57c740 1 -- 172.21.15.22:0/287570 wait complete. 2024-09-21T04:12:40.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.088+0000 7f1a3b57c740 1 -- start start 2024-09-21T04:12:40.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.088+0000 7f1a3b57c740 1 Processor -- start 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619acb980 0x55c619ea7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619ad3b60 0x55c619ea77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619af4840 0x55c619ec3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a3b57c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55c619c627a0 con 0x55c619ad3b60 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a3b57c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55c619da60a0 con 0x55c619acb980 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a3b57c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55c619e04dd0 con 0x55c619af4840 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a3b57c740 10 client.0 _ll_register_callbacks cb 0x55c619d833c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a2f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619af4840 0x55c619ec3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a2f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619af4840 0x55c619ec3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:55264/0 (socket says 172.21.15.22:55264) 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a2f59e640 1 -- 172.21.15.22:0/1287705161 learned_addr learned my addr 172.21.15.22:0/1287705161 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a2e59c640 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619ad3b60 0x55c619ea77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.089+0000 7f1a2ed9d640 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619acb980 0x55c619ea7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.090+0000 7f1a2f59e640 1 -- 172.21.15.22:0/1287705161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619acb980 msgr2=0x55c619ea7220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:40.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.090+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619acb980 0x55c619ea7220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.090+0000 7f1a2f59e640 1 -- 172.21.15.22:0/1287705161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619ad3b60 msgr2=0x55c619ea77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:40.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.090+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619ad3b60 0x55c619ea77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.090+0000 7f1a2f59e640 1 -- 172.21.15.22:0/1287705161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c619d94880 con 0x55c619af4840 2024-09-21T04:12:40.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.091+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619af4840 0x55c619ec3c90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a240038d0 tx=0x7f1a240046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=beccab08e2b1dc81 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:40.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.091+0000 7f1a12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:12:40.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.091+0000 7f1a12ff5640 1 -- 172.21.15.22:0/1287705161 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24023020 con 0x55c619af4840 2024-09-21T04:12:40.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.091+0000 7f1a12ff5640 1 -- 172.21.15.22:0/1287705161 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f1a24011910 con 0x55c619af4840 2024-09-21T04:12:40.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.091+0000 7f1a3b57c740 1 -- 172.21.15.22:0/1287705161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a28036070 con 0x55c619af4840 2024-09-21T04:12:40.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.091+0000 7f1a12ff5640 1 -- 172.21.15.22:0/1287705161 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1a24011b10 con 0x55c619af4840 2024-09-21T04:12:40.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.091+0000 7f1a3b57c740 10 client.25702 fetch_fsmap learned FSMap version 50 2024-09-21T04:12:40.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.092+0000 7f1a3b57c740 1 -- 172.21.15.22:0/1287705161 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55c619b6eb90 con 0x55c619af4840 2024-09-21T04:12:40.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.092+0000 7f1a12ff5640 1 -- 172.21.15.22:0/1287705161 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a24018030 con 0x55c619af4840 2024-09-21T04:12:40.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.092+0000 7f1a12ff5640 1 -- 172.21.15.22:0/1287705161 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f1a2400f040 con 0x55c619af4840 2024-09-21T04:12:40.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.093+0000 7f1a3b57c740 10 client.25702 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:12:40.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.093+0000 7f1a3b57c740 10 client.25702 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:12:40.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.093+0000 7f1a3b57c740 20 client.25702 populate_metadata read hostname 'smithi022' 2024-09-21T04:12:40.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.093+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c619ab31c0 0x55c619ec9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.093+0000 7f1a3b57c740 4 client.25702 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:12:40.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.093+0000 7f1a3b57c740 1 -- 172.21.15.22:0/1287705161 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f1a28036070 con 0x55c619ab31c0 2024-09-21T04:12:40.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.093+0000 7f1a2ed9d640 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c619ab31c0 0x55c619ec9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.094+0000 7f1a2ed9d640 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c619ab31c0 0x55c619ec9d10 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef6c0022794d7932 server_cookie=a1b703e5e5e843e8 in_seq=0 out_seq=0 2024-09-21T04:12:40.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.094+0000 7f1a12ff5640 10 client.25702 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:40.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.095+0000 7f1a12ff5640 1 -- 172.21.15.22:0/1287705161 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f1a28036070 con 0x55c619ab31c0 2024-09-21T04:12:40.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.095+0000 7f1a12ff5640 10 client.25702 handle_command_reply: tid=0 2024-09-21T04:12:40.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.095+0000 7f1a3b57c740 1 client.25702 shutdown 2024-09-21T04:12:40.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.096+0000 7f1a3b57c740 1 -- 172.21.15.22:0/1287705161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619af4840 msgr2=0x55c619ec3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:40.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.096+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619af4840 0x55c619ec3c90 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a240038d0 tx=0x7f1a240046c0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.096+0000 7f1a3b57c740 1 -- 172.21.15.22:0/1287705161 shutdown_connections 2024-09-21T04:12:40.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.097+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c619ab31c0 0x55c619ec9d10 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.097+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619af4840 0x55c619ec3c90 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.097+0000 7f1a12ff5640 0 client.25702 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:40.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.097+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619ad3b60 0x55c619ea77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.097+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/1287705161 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619acb980 0x55c619ea7220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.097+0000 7f1a3b57c740 1 -- 172.21.15.22:0/1287705161 >> 172.21.15.22:0/1287705161 conn(0x55c619ae8990 msgr2=0x55c619e9e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:40.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.097+0000 7f1a3b57c740 1 -- 172.21.15.22:0/1287705161 shutdown_connections 2024-09-21T04:12:40.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.097+0000 7f1a3b57c740 1 -- 172.21.15.22:0/1287705161 wait complete. 2024-09-21T04:12:40.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.097+0000 7f1a3b57c740 20 client.25702 trim_cache size 0 max 16384 2024-09-21T04:12:40.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:39 smithi073 ceph-mon[34443]: pgmap v680: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 624 KiB/s wr, 58 op/s 2024-09-21T04:12:40.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.131+0000 7f1a3b57c740 1 Processor -- start 2024-09-21T04:12:40.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.131+0000 7f1a3b57c740 1 -- start start 2024-09-21T04:12:40.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.132+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ab31c0 0x55c619ea8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.132+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619ea4210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.132+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619ea4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.132+0000 7f1a3b57c740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3010b270 con 0x55c619acb980 2024-09-21T04:12:40.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.132+0000 7f1a3b57c740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3010cdb0 con 0x55c619ab31c0 2024-09-21T04:12:40.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.132+0000 7f1a3b57c740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3010b940 con 0x55c619ad3b60 2024-09-21T04:12:40.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.133+0000 7f1a2f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619ea4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.133+0000 7f1a2f59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619ea4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:55266/0 (socket says 172.21.15.22:55266) 2024-09-21T04:12:40.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.133+0000 7f1a2f59e640 1 -- 172.21.15.22:0/2677360104 learned_addr learned my addr 172.21.15.22:0/2677360104 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:40.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.133+0000 7f1a2e59c640 1 --2- 172.21.15.22:0/2677360104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619ea4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.134+0000 7f1a2ed9d640 1 --2- 172.21.15.22:0/2677360104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ab31c0 0x55c619ea8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.134+0000 7f1a2f59e640 1 -- 172.21.15.22:0/2677360104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ab31c0 msgr2=0x55c619ea8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.134+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/2677360104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ab31c0 0x55c619ea8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.134+0000 7f1a2f59e640 1 -- 172.21.15.22:0/2677360104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 msgr2=0x55c619ea4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.134+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/2677360104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619ea4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.134+0000 7f1a2f59e640 1 -- 172.21.15.22:0/2677360104 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c619e99de0 con 0x55c619ad3b60 2024-09-21T04:12:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.134+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/2677360104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619ea4750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a2402a040 tx=0x7f1a2400b260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=31a3b1489d0a0eac server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:40.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.135+0000 7f1a14ff9640 1 -- 172.21.15.22:0/2677360104 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24023040 con 0x55c619ad3b60 2024-09-21T04:12:40.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.135+0000 7f1a14ff9640 1 -- 172.21.15.22:0/2677360104 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a24037070 con 0x55c619ad3b60 2024-09-21T04:12:40.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.135+0000 7f1a14ff9640 1 -- 172.21.15.22:0/2677360104 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a24027680 con 0x55c619ad3b60 2024-09-21T04:12:40.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.136+0000 7f1a3b57c740 1 -- 172.21.15.22:0/2677360104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 msgr2=0x55c619ea4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:40.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.136+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/2677360104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619ea4750 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1a2402a040 tx=0x7f1a2400b260 comp rx=0 tx=0).stop 2024-09-21T04:12:40.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.137+0000 7f1a3b57c740 1 -- 172.21.15.22:0/2677360104 shutdown_connections 2024-09-21T04:12:40.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.137+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/2677360104 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ad3b60 0x55c619ea4750 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.137+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/2677360104 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619ea4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.137+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/2677360104 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ab31c0 0x55c619ea8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.137+0000 7f1a3b57c740 1 -- 172.21.15.22:0/2677360104 >> 172.21.15.22:0/2677360104 conn(0x55c619ae8990 msgr2=0x55c619ea8540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:40.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.137+0000 7f1a3b57c740 1 -- 172.21.15.22:0/2677360104 shutdown_connections 2024-09-21T04:12:40.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.137+0000 7f1a3b57c740 1 -- 172.21.15.22:0/2677360104 wait complete. 2024-09-21T04:12:40.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.137+0000 7f1a3b57c740 1 -- start start 2024-09-21T04:12:40.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.138+0000 7f1a3b57c740 1 Processor -- start 2024-09-21T04:12:40.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.138+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ab31c0 0x55c619ebd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.138+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619ebd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.139+0000 7f1a3b57c740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ad3b60 0x55c619f346e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.139+0000 7f1a2ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ab31c0 0x55c619ebd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.139+0000 7f1a2ed9d640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ab31c0 0x55c619ebd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:55268/0 (socket says 172.21.15.22:55268) 2024-09-21T04:12:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.139+0000 7f1a2ed9d640 1 -- 172.21.15.22:0/3665532872 learned_addr learned my addr 172.21.15.22:0/3665532872 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:12:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.139+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ad3b60 0x55c619f346e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.139+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3010c6e0 con 0x55c619acb980 2024-09-21T04:12:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.139+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1a3010c010 con 0x55c619ad3b60 2024-09-21T04:12:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.139+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1a301a1b00 con 0x55c619ab31c0 2024-09-21T04:12:40.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.139+0000 7f1a3b57c740 10 client.0 _ll_register_callbacks cb 0x7f1a2400ba50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:12:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.140+0000 7f1a2e59c640 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619ebd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.140+0000 7f1a2f59e640 1 -- 172.21.15.22:0/3665532872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ab31c0 msgr2=0x55c619ebd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.140+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ab31c0 0x55c619ebd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.140+0000 7f1a2f59e640 1 -- 172.21.15.22:0/3665532872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 msgr2=0x55c619ebd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:12:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.140+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619ebd850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.140+0000 7f1a2f59e640 1 -- 172.21.15.22:0/3665532872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c619f34c20 con 0x55c619ad3b60 2024-09-21T04:12:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.141+0000 7f1a2f59e640 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ad3b60 0x55c619f346e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a2401ff80 tx=0x7f1a2401f670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29728fb79aa91f5b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:12:40.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.141+0000 7f1a12ff5640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:12:40.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.141+0000 7f1a12ff5640 1 -- 172.21.15.22:0/3665532872 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a2403f020 con 0x55c619ad3b60 2024-09-21T04:12:40.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.141+0000 7f1a12ff5640 1 -- 172.21.15.22:0/3665532872 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f1a2403b450 con 0x55c619ad3b60 2024-09-21T04:12:40.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.142+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a24037070 con 0x55c619ad3b60 2024-09-21T04:12:40.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.142+0000 7f1a12ff5640 1 -- 172.21.15.22:0/3665532872 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1a2403b650 con 0x55c619ad3b60 2024-09-21T04:12:40.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.142+0000 7f1a3b57c740 10 client.25685 fetch_fsmap learned FSMap version 50 2024-09-21T04:12:40.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.142+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55c619f35e80 con 0x55c619ad3b60 2024-09-21T04:12:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.142+0000 7f1a12ff5640 1 -- 172.21.15.22:0/3665532872 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a24018070 con 0x55c619ad3b60 2024-09-21T04:12:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.143+0000 7f1a12ff5640 1 -- 172.21.15.22:0/3665532872 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f1a24032780 con 0x55c619ad3b60 2024-09-21T04:12:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.143+0000 7f1a3b57c740 10 client.25685 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:12:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.143+0000 7f1a3b57c740 10 client.25685 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:12:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.143+0000 7f1a3b57c740 20 client.25685 populate_metadata read hostname 'smithi022' 2024-09-21T04:12:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.143+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c619af4840 0x55c619f384b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:12:40.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.143+0000 7f1a3b57c740 4 client.25685 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}] 2024-09-21T04:12:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.143+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.5, "await_for": 45.0}) -- 0x7f1a24037070 con 0x55c619af4840 2024-09-21T04:12:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.144+0000 7f1a2ed9d640 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c619af4840 0x55c619f384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:12:40.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.146+0000 7f1a2ed9d640 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c619af4840 0x55c619f384b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9dea18c67090815 server_cookie=e0df03de1f7570f8 in_seq=0 out_seq=0 2024-09-21T04:12:40.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.146+0000 7f1a12ff5640 10 client.25685 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:40.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:39 smithi060 ceph-mon[33722]: pgmap v680: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 624 KiB/s wr, 58 op/s 2024-09-21T04:12:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.519+0000 7f1a12ff5640 1 -- 172.21.15.22:0/3665532872 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x7f1a24037070 con 0x55c619af4840 2024-09-21T04:12:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.519+0000 7f1a12ff5640 10 client.25685 handle_command_reply: tid=0 2024-09-21T04:12:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.519+0000 7f1a3b57c740 1 client.25685 shutdown 2024-09-21T04:12:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.519+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ad3b60 msgr2=0x55c619f346e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.519+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ad3b60 0x55c619f346e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1a2401ff80 tx=0x7f1a2401f670 comp rx=0 tx=0).stop 2024-09-21T04:12:40.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 shutdown_connections 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55c619af4840 0x55c619f384b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55c619ad3b60 0x55c619f346e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55c619acb980 0x55c619ebd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a12ff5640 0 client.25685 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a3b57c740 1 --2- 172.21.15.22:0/3665532872 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55c619ab31c0 0x55c619ebd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 >> 172.21.15.22:0/3665532872 conn(0x55c619ae8990 msgr2=0x55c619e9cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 shutdown_connections 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a3b57c740 1 -- 172.21.15.22:0/3665532872 wait complete. 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a3b57c740 20 client.25685 trim_cache size 0 max 16384 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:12:40.524 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 42, 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "9c94592b": { 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 42, 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.5, 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:12:40.525 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:12:40.526 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:12:40.526 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:12:40.526 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:12:40.526 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:12:40.526 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:40.526 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:40.526 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:40.526 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:40.526 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:12:40.527 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:12:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1a180b66a0 msgr2=0x7f1a180b8bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a35008640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1a180b66a0 0x7f1a180b8bb0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f1a240058c0 tx=0x7f1a24005850 comp rx=0 tx=0).stop 2024-09-21T04:12:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a30103110 msgr2=0x7f1a301a0f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:12:40.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.520+0000 7f1a35008640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a30103110 0x7f1a301a0f70 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1a28009bf0 tx=0x7f1a28032980 comp rx=0 tx=0).stop 2024-09-21T04:12:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.521+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 shutdown_connections 2024-09-21T04:12:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.521+0000 7f1a35008640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f1a180b66a0 0x7f1a180b8bb0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.521+0000 7f1a35008640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a30107c00 0x7f1a301a6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.521+0000 7f1a35008640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1a30103110 0x7f1a301a0f70 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.521+0000 7f1a35008640 1 --2- 172.21.15.22:0/1006631526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1a301027c0 0x7f1a301a09d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:12:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.521+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 >> 172.21.15.22:0/1006631526 conn(0x7f1a30079760 msgr2=0x7f1a30105610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:12:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.521+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 shutdown_connections 2024-09-21T04:12:40.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:12:40.521+0000 7f1a35008640 1 -- 172.21.15.22:0/1006631526 wait complete. 2024-09-21T04:12:41.534 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9c94592b', quiesce took 5.0 seconds. Will release after: 19.5 2024-09-21T04:12:42.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:42 smithi022 ceph-mon[31015]: pgmap v681: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.1 MiB/s wr, 192 op/s 2024-09-21T04:12:42.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:42 smithi073 ceph-mon[34443]: pgmap v681: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.1 MiB/s wr, 192 op/s 2024-09-21T04:12:42.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:42 smithi060 ceph-mon[33722]: pgmap v681: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 2.1 MiB/s wr, 192 op/s 2024-09-21T04:12:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 500.0 s, 231.2 tps, lat 126.565 ms stddev 45.418 2024-09-21T04:12:44.522 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:44 smithi060 ceph-mon[33722]: pgmap v682: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 MiB/s wr, 283 op/s 2024-09-21T04:12:44.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:44 smithi022 ceph-mon[31015]: pgmap v682: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 MiB/s wr, 283 op/s 2024-09-21T04:12:44.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:44 smithi073 ceph-mon[34443]: pgmap v682: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 2.9 MiB/s wr, 283 op/s 2024-09-21T04:12:46.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:46 smithi022 ceph-mon[31015]: pgmap v683: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 MiB/s wr, 300 op/s 2024-09-21T04:12:46.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:46 smithi073 ceph-mon[34443]: pgmap v683: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 MiB/s wr, 300 op/s 2024-09-21T04:12:46.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:46 smithi060 ceph-mon[33722]: pgmap v683: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 MiB/s wr, 300 op/s 2024-09-21T04:12:48.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:48 smithi022 ceph-mon[31015]: pgmap v684: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.1 MiB/s wr, 302 op/s 2024-09-21T04:12:48.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:48 smithi073 ceph-mon[34443]: pgmap v684: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.1 MiB/s wr, 302 op/s 2024-09-21T04:12:48.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:48 smithi060 ceph-mon[33722]: pgmap v684: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 3.1 MiB/s wr, 302 op/s 2024-09-21T04:12:48.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 505.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:12:50.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:50 smithi022 ceph-mon[31015]: pgmap v685: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 270 op/s 2024-09-21T04:12:50.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:50 smithi073 ceph-mon[34443]: pgmap v685: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 270 op/s 2024-09-21T04:12:50.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:50 smithi060 ceph-mon[33722]: pgmap v685: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.7 MiB/s wr, 270 op/s 2024-09-21T04:12:52.501 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:52 smithi022 ceph-mon[31015]: pgmap v686: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.6 MiB/s wr, 269 op/s 2024-09-21T04:12:52.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:52 smithi073 ceph-mon[34443]: pgmap v686: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.6 MiB/s wr, 269 op/s 2024-09-21T04:12:52.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:52 smithi060 ceph-mon[33722]: pgmap v686: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 2.6 MiB/s wr, 269 op/s 2024-09-21T04:12:53.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 510.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:12:54.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:54 smithi022 ceph-mon[31015]: pgmap v687: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.2 MiB/s wr, 142 op/s 2024-09-21T04:12:54.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:54 smithi073 ceph-mon[34443]: pgmap v687: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.2 MiB/s wr, 142 op/s 2024-09-21T04:12:54.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:54 smithi060 ceph-mon[33722]: pgmap v687: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 1.2 MiB/s wr, 142 op/s 2024-09-21T04:12:56.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:56 smithi022 ceph-mon[31015]: pgmap v688: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 356 KiB/s wr, 50 op/s 2024-09-21T04:12:56.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:56 smithi073 ceph-mon[34443]: pgmap v688: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 356 KiB/s wr, 50 op/s 2024-09-21T04:12:56.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:56 smithi060 ceph-mon[33722]: pgmap v688: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 356 KiB/s wr, 50 op/s 2024-09-21T04:12:58.601 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:12:58 smithi022 ceph-mon[31015]: pgmap v689: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 180 KiB/s wr, 32 op/s 2024-09-21T04:12:58.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:12:58 smithi073 ceph-mon[34443]: pgmap v689: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 180 KiB/s wr, 32 op/s 2024-09-21T04:12:58.705 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:12:58 smithi060 ceph-mon[33722]: pgmap v689: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 180 KiB/s wr, 32 op/s 2024-09-21T04:12:58.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 515.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:13:00.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:00 smithi022 ceph-mon[31015]: pgmap v690: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 163 KiB/s wr, 29 op/s 2024-09-21T04:13:00.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:00 smithi073 ceph-mon[34443]: pgmap v690: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 163 KiB/s wr, 29 op/s 2024-09-21T04:13:00.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:00 smithi060 ceph-mon[33722]: pgmap v690: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.4 KiB/s rd, 163 KiB/s wr, 29 op/s 2024-09-21T04:13:01.035 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:13:01.320 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:13:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.872+0000 7fc03871b640 1 -- 172.21.15.22:0/263986873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0301083a0 msgr2=0x7fc0301087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.872+0000 7fc03871b640 1 --2- 172.21.15.22:0/263986873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0301083a0 0x7fc0301087b0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fc020009900 tx=0x7fc02002a410 comp rx=0 tx=0).stop 2024-09-21T04:13:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.872+0000 7fc03871b640 1 -- 172.21.15.22:0/263986873 shutdown_connections 2024-09-21T04:13:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.872+0000 7fc03871b640 1 --2- 172.21.15.22:0/263986873 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc030108cf0 0x7fc03010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.872+0000 7fc03871b640 1 --2- 172.21.15.22:0/263986873 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc0301083a0 0x7fc0301087b0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.872+0000 7fc03871b640 1 --2- 172.21.15.22:0/263986873 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc030102a60 0x7fc030102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.872+0000 7fc03871b640 1 -- 172.21.15.22:0/263986873 >> 172.21.15.22:0/263986873 conn(0x7fc030079730 msgr2=0x7fc030079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:13:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.872+0000 7fc03871b640 1 -- 172.21.15.22:0/263986873 shutdown_connections 2024-09-21T04:13:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.872+0000 7fc03871b640 1 -- 172.21.15.22:0/263986873 wait complete. 2024-09-21T04:13:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.873+0000 7fc03871b640 1 Processor -- start 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.873+0000 7fc03871b640 1 -- start start 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc03871b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc030102a60 0x7fc03019a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc03871b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0301083a0 0x7fc03019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc03871b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030108cf0 0x7fc03019fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc03871b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc030113930 con 0x7fc030108cf0 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc03871b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc0301137b0 con 0x7fc030102a60 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc03871b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc030113ab0 con 0x7fc0301083a0 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc036cb8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030108cf0 0x7fc03019fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc036cb8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030108cf0 0x7fc03019fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39152/0 (socket says 172.21.15.22:39152) 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc036cb8640 1 -- 172.21.15.22:0/1015371075 learned_addr learned my addr 172.21.15.22:0/1015371075 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc0364b7640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc030102a60 0x7fc03019a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc035cb6640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0301083a0 0x7fc03019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc036cb8640 1 -- 172.21.15.22:0/1015371075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0301083a0 msgr2=0x7fc03019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc036cb8640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0301083a0 0x7fc03019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc036cb8640 1 -- 172.21.15.22:0/1015371075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc030102a60 msgr2=0x7fc03019a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc036cb8640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc030102a60 0x7fc03019a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc036cb8640 1 -- 172.21.15.22:0/1015371075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0301a03d0 con 0x7fc030108cf0 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc035cb6640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0301083a0 0x7fc03019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.874+0000 7fc036cb8640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030108cf0 0x7fc03019fca0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc02800eaa0 tx=0x7fc02800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.875+0000 7fc0277fe640 1 -- 172.21.15.22:0/1015371075 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02800cdb0 con 0x7fc030108cf0 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.875+0000 7fc03871b640 1 -- 172.21.15.22:0/1015371075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0301a06c0 con 0x7fc030108cf0 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.875+0000 7fc0277fe640 1 -- 172.21.15.22:0/1015371075 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc028005020 con 0x7fc030108cf0 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.875+0000 7fc0277fe640 1 -- 172.21.15.22:0/1015371075 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0280116d0 con 0x7fc030108cf0 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.875+0000 7fc03871b640 1 -- 172.21.15.22:0/1015371075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0301a6e20 con 0x7fc030108cf0 2024-09-21T04:13:01.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.876+0000 7fc03871b640 1 -- 172.21.15.22:0/1015371075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc030102e70 con 0x7fc030108cf0 2024-09-21T04:13:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.877+0000 7fc0277fe640 1 -- 172.21.15.22:0/1015371075 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc0280051d0 con 0x7fc030108cf0 2024-09-21T04:13:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.878+0000 7fc0277fe640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc01c0b6510 0x7fc01c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.878+0000 7fc0364b7640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc01c0b6510 0x7fc01c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.878+0000 7fc0277fe640 1 -- 172.21.15.22:0/1015371075 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fc0280e7c50 con 0x7fc030108cf0 2024-09-21T04:13:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.879+0000 7fc0364b7640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc01c0b6510 0x7fc01c0b8a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc02c005fd0 tx=0x7fc02c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:13:01.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:01.881+0000 7fc0277fe640 1 -- 172.21.15.22:0/1015371075 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc028016030 con 0x7fc030108cf0 2024-09-21T04:13:02.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.124+0000 7fc03871b640 1 -- 172.21.15.22:0/1015371075 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc03019b590 con 0x7fc030108cf0 2024-09-21T04:13:02.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.125+0000 7fc0277fe640 1 -- 172.21.15.22:0/1015371075 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7fc03019b590 con 0x7fc030108cf0 2024-09-21T04:13:02.127 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:13:02.127 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:13:02.128 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:13:02.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 -- 172.21.15.22:0/1015371075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc01c0b6510 msgr2=0x7fc01c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:02.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc01c0b6510 0x7fc01c0b8a20 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fc02c005fd0 tx=0x7fc02c00b390 comp rx=0 tx=0).stop 2024-09-21T04:13:02.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 -- 172.21.15.22:0/1015371075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030108cf0 msgr2=0x7fc03019fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:02.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030108cf0 0x7fc03019fca0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fc02800eaa0 tx=0x7fc02800ef60 comp rx=0 tx=0).stop 2024-09-21T04:13:02.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 -- 172.21.15.22:0/1015371075 shutdown_connections 2024-09-21T04:13:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc01c0b6510 0x7fc01c0b8a20 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc0301083a0 0x7fc03019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc030108cf0 0x7fc03019fca0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 --2- 172.21.15.22:0/1015371075 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc030102a60 0x7fc03019a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 -- 172.21.15.22:0/1015371075 >> 172.21.15.22:0/1015371075 conn(0x7fc030079730 msgr2=0x7fc030104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:13:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 -- 172.21.15.22:0/1015371075 shutdown_connections 2024-09-21T04:13:02.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:02.127+0000 7fc03871b640 1 -- 172.21.15.22:0/1015371075 wait complete. 2024-09-21T04:13:02.504 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:02 smithi022 ceph-mon[31015]: pgmap v691: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 211 KiB/s wr, 37 op/s 2024-09-21T04:13:02.505 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:02 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1015371075' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:13:02.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:02 smithi073 ceph-mon[34443]: pgmap v691: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 211 KiB/s wr, 37 op/s 2024-09-21T04:13:02.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:02 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1015371075' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:13:02.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:02 smithi060 ceph-mon[33722]: pgmap v691: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 211 KiB/s wr, 37 op/s 2024-09-21T04:13:02.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:02 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1015371075' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:13:02.985 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id 9c94592b --release --await' 2024-09-21T04:13:02.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id 9c94592b --release --await 2024-09-21T04:13:03.248 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:13:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 520.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:13:03.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.743+0000 7f42cc183640 1 -- 172.21.15.22:0/2546949634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c41101a0 msgr2=0x7f42c41125c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.743+0000 7f42cc183640 1 --2- 172.21.15.22:0/2546949634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c41101a0 0x7f42c41125c0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009ca0 tx=0x7f42bc02a950 comp rx=0 tx=0).stop 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.743+0000 7f42cc183640 1 -- 172.21.15.22:0/2546949634 shutdown_connections 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.743+0000 7f42cc183640 1 --2- 172.21.15.22:0/2546949634 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c41101a0 0x7f42c41125c0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.743+0000 7f42cc183640 1 --2- 172.21.15.22:0/2546949634 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42c4102f40 0x7f42c410fc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.743+0000 7f42cc183640 1 --2- 172.21.15.22:0/2546949634 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c41025f0 0x7f42c4102a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.743+0000 7f42cc183640 1 -- 172.21.15.22:0/2546949634 >> 172.21.15.22:0/2546949634 conn(0x7f42c4079740 msgr2=0x7f42c4079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.744+0000 7f42cc183640 1 -- 172.21.15.22:0/2546949634 shutdown_connections 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.744+0000 7f42cc183640 1 -- 172.21.15.22:0/2546949634 wait complete. 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.744+0000 7f42cc183640 1 Processor -- start 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.744+0000 7f42cc183640 1 -- start start 2024-09-21T04:13:03.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42cc183640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c41025f0 0x7f42c419c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42cc183640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c4102f40 0x7f42c419cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42cc183640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42c41101a0 0x7f42c41a1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42cc183640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4115b90 con 0x7f42c41025f0 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42cc183640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4115a10 con 0x7f42c41101a0 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42cc183640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42c4115d10 con 0x7f42c4102f40 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42c9f1f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c41025f0 0x7f42c419c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42c9f1f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c41025f0 0x7f42c419c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39172/0 (socket says 172.21.15.22:39172) 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42c9f1f640 1 -- 172.21.15.22:0/3797286636 learned_addr learned my addr 172.21.15.22:0/3797286636 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42c971e640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c4102f40 0x7f42c419cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42c9f1f640 1 -- 172.21.15.22:0/3797286636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c4102f40 msgr2=0x7f42c419cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:03.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c4102f40 0x7f42c419cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42ca720640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42c41101a0 0x7f42c41a1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42c9f1f640 1 -- 172.21.15.22:0/3797286636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42c41101a0 msgr2=0x7f42c41a1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42c41101a0 0x7f42c41a1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42c9f1f640 1 -- 172.21.15.22:0/3797286636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c41a2530 con 0x7f42c41025f0 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42ca720640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42c41101a0 0x7f42c41a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.745+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c41025f0 0x7f42c419c5c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f42c000e9f0 tx=0x7f42c000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.746+0000 7f42baffd640 1 -- 172.21.15.22:0/3797286636 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c000cd80 con 0x7f42c41025f0 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.746+0000 7f42baffd640 1 -- 172.21.15.22:0/3797286636 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c00054b0 con 0x7f42c41025f0 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.746+0000 7f42cc183640 1 -- 172.21.15.22:0/3797286636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42c41a2820 con 0x7f42c41025f0 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.746+0000 7f42baffd640 1 -- 172.21.15.22:0/3797286636 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c0010430 con 0x7f42c41025f0 2024-09-21T04:13:03.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.746+0000 7f42cc183640 1 -- 172.21.15.22:0/3797286636 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42c41a8f80 con 0x7f42c41025f0 2024-09-21T04:13:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.748+0000 7f42baffd640 1 -- 172.21.15.22:0/3797286636 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f42c00046c0 con 0x7f42c41025f0 2024-09-21T04:13:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.748+0000 7f42d26f7740 1 Processor -- start 2024-09-21T04:13:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42d26f7740 1 -- start start 2024-09-21T04:13:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9815c520 0x557a98502510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a98502a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9813b840 0x557a98502f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42d26f7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a983eddc0 con 0x557a9813b840 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42d26f7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557a9847a1f0 con 0x557a9815c520 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42d26f7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557a98469620 con 0x557a98133660 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42c971e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9813b840 0x557a98502f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42c971e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9813b840 0x557a98502f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39178/0 (socket says 172.21.15.22:39178) 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42c971e640 1 -- 172.21.15.22:0/1052855908 learned_addr learned my addr 172.21.15.22:0/1052855908 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42ca720640 1 --2- 172.21.15.22:0/1052855908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9815c520 0x557a98502510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/1052855908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a98502a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.749+0000 7f42c971e640 1 -- 172.21.15.22:0/1052855908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 msgr2=0x557a98502a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42c971e640 1 --2- 172.21.15.22:0/1052855908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a98502a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42c971e640 1 -- 172.21.15.22:0/1052855908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9815c520 msgr2=0x557a98502510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:13:03.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42c971e640 1 --2- 172.21.15.22:0/1052855908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9815c520 0x557a98502510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42c971e640 1 -- 172.21.15.22:0/1052855908 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a98431fd0 con 0x557a9813b840 2024-09-21T04:13:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42baffd640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42b00b6590 0x7f42b00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42c971e640 1 --2- 172.21.15.22:0/1052855908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9813b840 0x557a98502f90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009ac0 tx=0x7f42b4009f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c373a071aa89ce48 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:13:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42ca720640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42b00b6590 0x7f42b00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42baffd640 1 -- 172.21.15.22:0/3797286636 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f42c00e7b60 con 0x7f42c41025f0 2024-09-21T04:13:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42affff640 1 -- 172.21.15.22:0/1052855908 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4016070 con 0x557a9813b840 2024-09-21T04:13:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42affff640 1 -- 172.21.15.22:0/1052855908 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42b40054b0 con 0x557a9813b840 2024-09-21T04:13:03.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.750+0000 7f42affff640 1 -- 172.21.15.22:0/1052855908 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42b4004d30 con 0x557a9813b840 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.751+0000 7f42d26f7740 1 -- 172.21.15.22:0/1052855908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9813b840 msgr2=0x557a98502f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.751+0000 7f42d26f7740 1 --2- 172.21.15.22:0/1052855908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9813b840 0x557a98502f90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f42b4009ac0 tx=0x7f42b4009f80 comp rx=0 tx=0).stop 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.751+0000 7f42ca720640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42b00b6590 0x7f42b00b8aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009a60 tx=0x7f42bc03c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.751+0000 7f42d26f7740 1 -- 172.21.15.22:0/1052855908 shutdown_connections 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.751+0000 7f42d26f7740 1 --2- 172.21.15.22:0/1052855908 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a98502a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.751+0000 7f42d26f7740 1 --2- 172.21.15.22:0/1052855908 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9813b840 0x557a98502f90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.751+0000 7f42d26f7740 1 --2- 172.21.15.22:0/1052855908 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9815c520 0x557a98502510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.751+0000 7f42d26f7740 1 -- 172.21.15.22:0/1052855908 >> 172.21.15.22:0/1052855908 conn(0x557a98150910 msgr2=0x557a98500400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.751+0000 7f42d26f7740 1 -- 172.21.15.22:0/1052855908 shutdown_connections 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.751+0000 7f42d26f7740 1 -- 172.21.15.22:0/1052855908 wait complete. 2024-09-21T04:13:03.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42d26f7740 1 -- start start 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42d26f7740 1 Processor -- start 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a9850dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a9850e010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a9850e550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42d26f7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557a98404300 con 0x557a9815c520 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42d26f7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557a9846d430 con 0x557a9813b840 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42d26f7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557a982cabb0 con 0x557a98133660 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42d26f7740 10 client.0 _ll_register_callbacks cb 0x557a9841e120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42ca720640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a9850e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42ca720640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a9850e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39182/0 (socket says 172.21.15.22:39182) 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42ca720640 1 -- 172.21.15.22:0/3793347487 learned_addr learned my addr 172.21.15.22:0/3793347487 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42c971e640 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a9850e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.752+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a9850dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42ca720640 1 -- 172.21.15.22:0/3793347487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 msgr2=0x557a9850dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42ca720640 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a9850dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42ca720640 1 -- 172.21.15.22:0/3793347487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 msgr2=0x557a9850e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42ca720640 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a9850e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42ca720640 1 -- 172.21.15.22:0/3793347487 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a983f3780 con 0x557a9815c520 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42ca720640 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a9850e550 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f42bc035000 tx=0x7f42bc02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b5bf3cdb658aa54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42ad7fa640 1 -- 172.21.15.22:0/3793347487 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc034050 con 0x557a9815c520 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42ad7fa640 1 -- 172.21.15.22:0/3793347487 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f42bc004250 con 0x557a9815c520 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42d26f7740 1 -- 172.21.15.22:0/3793347487 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42b40054b0 con 0x557a9815c520 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42ad7fa640 1 -- 172.21.15.22:0/3793347487 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f42bc004450 con 0x557a9815c520 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42d26f7740 10 client.16098 fetch_fsmap learned FSMap version 50 2024-09-21T04:13:03.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.753+0000 7f42d26f7740 1 -- 172.21.15.22:0/3793347487 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x557a981c7b00 con 0x557a9815c520 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.754+0000 7f42ad7fa640 1 -- 172.21.15.22:0/3793347487 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42b40054b0 con 0x557a9815c520 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.754+0000 7f42ad7fa640 1 -- 172.21.15.22:0/3793347487 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f42bc04f070 con 0x557a9815c520 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.754+0000 7f42d26f7740 10 client.16098 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.754+0000 7f42d26f7740 10 client.16098 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.754+0000 7f42d26f7740 20 client.16098 populate_metadata read hostname 'smithi022' 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.754+0000 7f42d26f7740 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557a9811aea0 0x557a9851fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.754+0000 7f42d26f7740 4 client.16098 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.754+0000 7f42d26f7740 1 -- 172.21.15.22:0/3793347487 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a9847c140 con 0x557a9811aea0 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.754+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557a9811aea0 0x557a9851fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.755+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557a9811aea0 0x557a9851fec0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=255132c256729ba7 server_cookie=7531974040bd7a9a in_seq=0 out_seq=0 2024-09-21T04:13:03.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.755+0000 7f42ad7fa640 10 client.16098 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:13:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42ad7fa640 1 -- 172.21.15.22:0/3793347487 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x557a9847c140 con 0x557a9811aea0 2024-09-21T04:13:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42ad7fa640 10 client.16098 handle_command_reply: tid=0 2024-09-21T04:13:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 client.16098 shutdown 2024-09-21T04:13:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 -- 172.21.15.22:0/3793347487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 msgr2=0x557a9850e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:03.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a9850e550 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f42bc035000 tx=0x7f42bc02a950 comp rx=0 tx=0).stop 2024-09-21T04:13:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 -- 172.21.15.22:0/3793347487 shutdown_connections 2024-09-21T04:13:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557a9811aea0 0x557a9851fec0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a9850e550 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a9850e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 --2- 172.21.15.22:0/3793347487 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a9850dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42ad7fa640 0 client.16098 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:13:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 -- 172.21.15.22:0/3793347487 >> 172.21.15.22:0/3793347487 conn(0x557a98150910 msgr2=0x557a985056a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:13:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 -- 172.21.15.22:0/3793347487 shutdown_connections 2024-09-21T04:13:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 1 -- 172.21.15.22:0/3793347487 wait complete. 2024-09-21T04:13:03.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.756+0000 7f42d26f7740 20 client.16098 trim_cache size 0 max 16384 2024-09-21T04:13:03.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.773+0000 7f42d26f7740 1 Processor -- start 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42d26f7740 1 -- start start 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a98133660 0x557a9850f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a9850acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a9815c520 0x557a9850b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42d26f7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b2d30 con 0x557a98133660 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42d26f7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b4870 con 0x557a9813b840 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42d26f7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b3400 con 0x557a9815c520 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42c9f1f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a98133660 0x557a9850f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42c9f1f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a98133660 0x557a9850f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39194/0 (socket says 172.21.15.22:39194) 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42c9f1f640 1 -- 172.21.15.22:0/193130359 learned_addr learned my addr 172.21.15.22:0/193130359 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42c971e640 1 --2- 172.21.15.22:0/193130359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a9850acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42c9f1f640 1 -- 172.21.15.22:0/193130359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a9815c520 msgr2=0x557a9850b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:13:03.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/193130359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a9815c520 0x557a9850b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42c9f1f640 1 -- 172.21.15.22:0/193130359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 msgr2=0x557a9850acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:13:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/193130359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a9850acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42c9f1f640 1 -- 172.21.15.22:0/193130359 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a9823e960 con 0x557a98133660 2024-09-21T04:13:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.774+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/193130359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a98133660 0x557a9850f700 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f42c000e9c0 tx=0x7f42c0009720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59677906cad8f354 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:13:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.775+0000 7f42af7fe640 1 -- 172.21.15.22:0/193130359 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00a90a0 con 0x557a98133660 2024-09-21T04:13:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.775+0000 7f42af7fe640 1 -- 172.21.15.22:0/193130359 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c00ad440 con 0x557a98133660 2024-09-21T04:13:03.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.775+0000 7f42af7fe640 1 -- 172.21.15.22:0/193130359 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42c00acb90 con 0x557a98133660 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.775+0000 7f42d26f7740 1 -- 172.21.15.22:0/193130359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a98133660 msgr2=0x557a9850f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.775+0000 7f42d26f7740 1 --2- 172.21.15.22:0/193130359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a98133660 0x557a9850f700 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f42c000e9c0 tx=0x7f42c0009720 comp rx=0 tx=0).stop 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.775+0000 7f42d26f7740 1 -- 172.21.15.22:0/193130359 shutdown_connections 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.775+0000 7f42d26f7740 1 --2- 172.21.15.22:0/193130359 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a9815c520 0x557a9850b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.775+0000 7f42d26f7740 1 --2- 172.21.15.22:0/193130359 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a9850acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.775+0000 7f42d26f7740 1 --2- 172.21.15.22:0/193130359 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a98133660 0x557a9850f700 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.775+0000 7f42d26f7740 1 -- 172.21.15.22:0/193130359 >> 172.21.15.22:0/193130359 conn(0x557a98150910 msgr2=0x557a9850eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.776+0000 7f42d26f7740 1 -- 172.21.15.22:0/193130359 shutdown_connections 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.776+0000 7f42d26f7740 1 -- 172.21.15.22:0/193130359 wait complete. 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.776+0000 7f42d26f7740 1 -- start start 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.776+0000 7f42d26f7740 1 Processor -- start 2024-09-21T04:13:03.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.776+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a98514780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.776+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a98514d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.776+0000 7f42d26f7740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a985838d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.776+0000 7f42d26f7740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b41a0 con 0x557a9815c520 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.776+0000 7f42d26f7740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b3ad0 con 0x557a9813b840 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.776+0000 7f42d26f7740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f42c41b0d10 con 0x557a98133660 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42d26f7740 10 client.0 _ll_register_callbacks cb 0x7f42bc009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ca720640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a985838d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ca720640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a985838d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39196/0 (socket says 172.21.15.22:39196) 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ca720640 1 -- 172.21.15.22:0/724538517 learned_addr learned my addr 172.21.15.22:0/724538517 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a98514780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42c971e640 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a98514d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ca720640 1 -- 172.21.15.22:0/724538517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 msgr2=0x557a98514780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:13:03.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ca720640 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a98514780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ca720640 1 -- 172.21.15.22:0/724538517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 msgr2=0x557a98514d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ca720640 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a98514d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ca720640 1 -- 172.21.15.22:0/724538517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a98583f40 con 0x557a9815c520 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42c971e640 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a98514d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ca720640 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a985838d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f42bc005e30 tx=0x7f42bc02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5bc05bcff811bb server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ad7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ad7fa640 1 -- 172.21.15.22:0/724538517 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42bc034070 con 0x557a9815c520 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42d26f7740 1 -- 172.21.15.22:0/724538517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42c00ad440 con 0x557a9815c520 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.777+0000 7f42ad7fa640 1 -- 172.21.15.22:0/724538517 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f42bc004800 con 0x557a9815c520 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42ad7fa640 1 -- 172.21.15.22:0/724538517 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f42bc068050 con 0x557a9815c520 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42d26f7740 10 client.16104 fetch_fsmap learned FSMap version 50 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42d26f7740 1 -- 172.21.15.22:0/724538517 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x557a9858b300 con 0x557a9815c520 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42ad7fa640 1 -- 172.21.15.22:0/724538517 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42c00ad440 con 0x557a9815c520 2024-09-21T04:13:03.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42ad7fa640 1 -- 172.21.15.22:0/724538517 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f42bc04f040 con 0x557a9815c520 2024-09-21T04:13:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42d26f7740 10 client.16104 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:13:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42d26f7740 10 client.16104 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:13:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42d26f7740 20 client.16104 populate_metadata read hostname 'smithi022' 2024-09-21T04:13:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42d26f7740 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557a980f0250 0x557a9858daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:13:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42d26f7740 4 client.16104 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9c94592b", "release": true, "await": true}] 2024-09-21T04:13:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42d26f7740 1 -- 172.21.15.22:0/724538517 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9c94592b", "release": true, "await": true}) -- 0x557a98477bf0 con 0x557a980f0250 2024-09-21T04:13:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.778+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557a980f0250 0x557a9858daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:13:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.779+0000 7f42c9f1f640 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557a980f0250 0x557a9858daf0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7048a0c39f71609 server_cookie=21c98653e400003 in_seq=0 out_seq=0 2024-09-21T04:13:03.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.779+0000 7f42ad7fa640 10 client.16104 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:13:03.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.829+0000 7f42ad7fa640 1 -- 172.21.15.22:0/724538517 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x557a98477bf0 con 0x557a980f0250 2024-09-21T04:13:03.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.829+0000 7f42ad7fa640 10 client.16104 handle_command_reply: tid=0 2024-09-21T04:13:03.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.829+0000 7f42d26f7740 1 client.16104 shutdown 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 1 -- 172.21.15.22:0/724538517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 msgr2=0x557a985838d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a985838d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f42bc005e30 tx=0x7f42bc02f790 comp rx=0 tx=0).stop 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 1 -- 172.21.15.22:0/724538517 shutdown_connections 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557a980f0250 0x557a9858daf0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x557a9815c520 0x557a985838d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x557a9813b840 0x557a98514d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 1 --2- 172.21.15.22:0/724538517 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x557a98133660 0x557a98514780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 1 -- 172.21.15.22:0/724538517 >> 172.21.15.22:0/724538517 conn(0x557a98150910 msgr2=0x557a984fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42ad7fa640 0 client.16104 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 1 -- 172.21.15.22:0/724538517 shutdown_connections 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 1 -- 172.21.15.22:0/724538517 wait complete. 2024-09-21T04:13:03.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.830+0000 7f42d26f7740 20 client.16104 trim_cache size 0 max 16384 2024-09-21T04:13:03.834 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:13:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:13:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:13:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 44, 2024-09-21T04:13:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:13:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: "9c94592b": { 2024-09-21T04:13:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 44, 2024-09-21T04:13:03.834 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.5, 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:13:03.835 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:13:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:13:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:13:03.836 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:13:03.836 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:13:03.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 -- 172.21.15.22:0/3797286636 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42b00b6590 msgr2=0x7f42b00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:03.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42b00b6590 0x7f42b00b8aa0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009a60 tx=0x7f42bc03c040 comp rx=0 tx=0).stop 2024-09-21T04:13:03.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 -- 172.21.15.22:0/3797286636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c41025f0 msgr2=0x7f42c419c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:13:03.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c41025f0 0x7f42c419c5c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f42c000e9f0 tx=0x7f42c000edf0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 -- 172.21.15.22:0/3797286636 shutdown_connections 2024-09-21T04:13:03.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f42b00b6590 0x7f42b00b8aa0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f42c4102f40 0x7f42c419cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f42c41101a0 0x7f42c41a1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 --2- 172.21.15.22:0/3797286636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f42c41025f0 0x7f42c419c5c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:13:03.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 -- 172.21.15.22:0/3797286636 >> 172.21.15.22:0/3797286636 conn(0x7f42c4079740 msgr2=0x7f42c4109d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:13:03.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 -- 172.21.15.22:0/3797286636 shutdown_connections 2024-09-21T04:13:03.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:13:03.831+0000 7f42cc183640 1 -- 172.21.15.22:0/3797286636 wait complete. 2024-09-21T04:13:04.583 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:04 smithi022 ceph-mon[31015]: pgmap v692: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 223 KiB/s wr, 36 op/s 2024-09-21T04:13:04.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:04 smithi073 ceph-mon[34443]: pgmap v692: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 223 KiB/s wr, 36 op/s 2024-09-21T04:13:04.638 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9c94592b', total seconds elapsed: 28.1 2024-09-21T04:13:04.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:04 smithi060 ceph-mon[33722]: pgmap v692: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 223 KiB/s wr, 36 op/s 2024-09-21T04:13:06.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:06 smithi022 ceph-mon[31015]: pgmap v693: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 852 KiB/s wr, 58 op/s 2024-09-21T04:13:06.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:06 smithi073 ceph-mon[34443]: pgmap v693: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 852 KiB/s wr, 58 op/s 2024-09-21T04:13:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:06 smithi060 ceph-mon[33722]: pgmap v693: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 852 KiB/s wr, 58 op/s 2024-09-21T04:13:08.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:08 smithi022 ceph-mon[31015]: pgmap v694: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.5 MiB/s wr, 146 op/s 2024-09-21T04:13:08.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:08 smithi073 ceph-mon[34443]: pgmap v694: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.5 MiB/s wr, 146 op/s 2024-09-21T04:13:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:08 smithi060 ceph-mon[33722]: pgmap v694: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 2.5 MiB/s wr, 146 op/s 2024-09-21T04:13:08.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 525.0 s, 813.7 tps, lat 701.786 ms stddev 3655.847 2024-09-21T04:13:10.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:10 smithi022 ceph-mon[31015]: pgmap v695: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.9 MiB/s wr, 180 op/s 2024-09-21T04:13:10.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:10 smithi073 ceph-mon[34443]: pgmap v695: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.9 MiB/s wr, 180 op/s 2024-09-21T04:13:10.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:10 smithi060 ceph-mon[33722]: pgmap v695: 129 pgs: 129 active+clean; 1.3 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 2.9 MiB/s wr, 180 op/s 2024-09-21T04:13:12.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:12 smithi022 ceph-mon[31015]: pgmap v696: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 422 op/s 2024-09-21T04:13:12.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:12 smithi073 ceph-mon[34443]: pgmap v696: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 422 op/s 2024-09-21T04:13:12.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:12 smithi060 ceph-mon[33722]: pgmap v696: 129 pgs: 129 active+clean; 1.3 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 7.5 MiB/s wr, 422 op/s 2024-09-21T04:13:13.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 530.0 s, 888.2 tps, lat 112.590 ms stddev 119.008 2024-09-21T04:13:14.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:14 smithi022 ceph-mon[31015]: pgmap v697: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 590 op/s 2024-09-21T04:13:14.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:14 smithi073 ceph-mon[34443]: pgmap v697: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 590 op/s 2024-09-21T04:13:14.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:14 smithi060 ceph-mon[33722]: pgmap v697: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 10 MiB/s wr, 590 op/s 2024-09-21T04:13:16.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:16 smithi022 ceph-mon[31015]: pgmap v698: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 708 op/s 2024-09-21T04:13:16.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:16 smithi073 ceph-mon[34443]: pgmap v698: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 708 op/s 2024-09-21T04:13:16.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:16 smithi060 ceph-mon[33722]: pgmap v698: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 12 MiB/s wr, 708 op/s 2024-09-21T04:13:18.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:18 smithi022 ceph-mon[31015]: pgmap v699: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 873 op/s 2024-09-21T04:13:18.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:18 smithi073 ceph-mon[34443]: pgmap v699: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 873 op/s 2024-09-21T04:13:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:18 smithi060 ceph-mon[33722]: pgmap v699: 129 pgs: 129 active+clean; 1.3 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 15 MiB/s wr, 873 op/s 2024-09-21T04:13:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 535.0 s, 888.6 tps, lat 112.503 ms stddev 64.390 2024-09-21T04:13:19.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:13:19.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:19 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:13:19.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:19 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:13:19.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:19.703 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:19 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:20 smithi022 ceph-mon[31015]: pgmap v700: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 819 op/s 2024-09-21T04:13:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:13:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:13:20.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:20 smithi073 ceph-mon[34443]: pgmap v700: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 819 op/s 2024-09-21T04:13:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:13:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:13:20.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:20 smithi060 ceph-mon[33722]: pgmap v700: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 14 MiB/s wr, 819 op/s 2024-09-21T04:13:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:13:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:13:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:13:22.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:22 smithi022 ceph-mon[31015]: pgmap v701: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 17 MiB/s wr, 963 op/s 2024-09-21T04:13:22.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:22 smithi073 ceph-mon[34443]: pgmap v701: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 17 MiB/s wr, 963 op/s 2024-09-21T04:13:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:22 smithi060 ceph-mon[33722]: pgmap v701: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 17 MiB/s wr, 963 op/s 2024-09-21T04:13:23.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 540.0 s, 1017.0 tps, lat 98.545 ms stddev 48.450 2024-09-21T04:13:24.602 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:24 smithi022 ceph-mon[31015]: pgmap v702: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 15 MiB/s wr, 889 op/s 2024-09-21T04:13:24.606 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:24 smithi073 ceph-mon[34443]: pgmap v702: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 15 MiB/s wr, 889 op/s 2024-09-21T04:13:24.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:24 smithi060 ceph-mon[33722]: pgmap v702: 129 pgs: 129 active+clean; 1.3 GiB data, 9.3 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 15 MiB/s wr, 889 op/s 2024-09-21T04:13:26.600 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:26 smithi022 ceph-mon[31015]: pgmap v703: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 15 MiB/s wr, 851 op/s 2024-09-21T04:13:26.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:26 smithi073 ceph-mon[34443]: pgmap v703: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 15 MiB/s wr, 851 op/s 2024-09-21T04:13:26.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:26 smithi060 ceph-mon[33722]: pgmap v703: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 15 MiB/s wr, 851 op/s 2024-09-21T04:13:28.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:28 smithi022 ceph-mon[31015]: pgmap v704: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 16 MiB/s wr, 957 op/s 2024-09-21T04:13:28.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:28 smithi073 ceph-mon[34443]: pgmap v704: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 16 MiB/s wr, 957 op/s 2024-09-21T04:13:28.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:28 smithi060 ceph-mon[33722]: pgmap v704: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 16 MiB/s wr, 957 op/s 2024-09-21T04:13:28.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 545.0 s, 776.0 tps, lat 74.289 ms stddev 41.479 2024-09-21T04:13:30.599 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:30 smithi022 ceph-mon[31015]: pgmap v705: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 821 op/s 2024-09-21T04:13:30.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:30 smithi073 ceph-mon[34443]: pgmap v705: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 821 op/s 2024-09-21T04:13:30.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:30 smithi060 ceph-mon[33722]: pgmap v705: 129 pgs: 129 active+clean; 1.3 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 14 MiB/s wr, 821 op/s 2024-09-21T04:13:32.605 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:32 smithi073 ceph-mon[34443]: pgmap v706: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 16 MiB/s wr, 986 op/s 2024-09-21T04:13:32.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:32 smithi060 ceph-mon[33722]: pgmap v706: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 16 MiB/s wr, 986 op/s 2024-09-21T04:13:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:32 smithi022 ceph-mon[31015]: pgmap v706: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 16 MiB/s wr, 986 op/s 2024-09-21T04:13:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 550.0 s, 804.6 tps, lat 176.595 ms stddev 767.899 2024-09-21T04:13:34.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:34 smithi060 ceph-mon[33722]: pgmap v707: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 15 MiB/s wr, 992 op/s 2024-09-21T04:13:34.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:34 smithi022 ceph-mon[31015]: pgmap v707: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 15 MiB/s wr, 992 op/s 2024-09-21T04:13:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:34 smithi073 ceph-mon[34443]: pgmap v707: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 15 MiB/s wr, 992 op/s 2024-09-21T04:13:36.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:36 smithi060 ceph-mon[33722]: pgmap v708: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 14 MiB/s wr, 973 op/s 2024-09-21T04:13:36.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:36 smithi022 ceph-mon[31015]: pgmap v708: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 14 MiB/s wr, 973 op/s 2024-09-21T04:13:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:36 smithi073 ceph-mon[34443]: pgmap v708: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 14 MiB/s wr, 973 op/s 2024-09-21T04:13:38.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 555.0 s, 849.2 tps, lat 117.632 ms stddev 106.672 2024-09-21T04:13:38.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:38 smithi022 ceph-mon[31015]: pgmap v709: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-21T04:13:38.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:38 smithi073 ceph-mon[34443]: pgmap v709: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-21T04:13:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:38 smithi060 ceph-mon[33722]: pgmap v709: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-21T04:13:40.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:40 smithi022 ceph-mon[31015]: pgmap v710: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 883 op/s 2024-09-21T04:13:40.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:40 smithi073 ceph-mon[34443]: pgmap v710: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 883 op/s 2024-09-21T04:13:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:40 smithi060 ceph-mon[33722]: pgmap v710: 129 pgs: 129 active+clean; 1.3 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 13 MiB/s wr, 883 op/s 2024-09-21T04:13:42.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:42 smithi022 ceph-mon[31015]: pgmap v711: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-09-21T04:13:42.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:42 smithi073 ceph-mon[34443]: pgmap v711: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-09-21T04:13:42.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:42 smithi060 ceph-mon[33722]: pgmap v711: 129 pgs: 129 active+clean; 1.3 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 14 MiB/s wr, 1.00k op/s 2024-09-21T04:13:43.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 560.0 s, 907.0 tps, lat 110.324 ms stddev 43.851 2024-09-21T04:13:44.754 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:44 smithi060 ceph-mon[33722]: pgmap v712: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 14 MiB/s wr, 982 op/s 2024-09-21T04:13:44.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:44 smithi022 ceph-mon[31015]: pgmap v712: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 14 MiB/s wr, 982 op/s 2024-09-21T04:13:44.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:44 smithi073 ceph-mon[34443]: pgmap v712: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 14 MiB/s wr, 982 op/s 2024-09-21T04:13:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:46 smithi022 ceph-mon[31015]: pgmap v713: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 14 MiB/s wr, 939 op/s 2024-09-21T04:13:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:46 smithi073 ceph-mon[34443]: pgmap v713: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 14 MiB/s wr, 939 op/s 2024-09-21T04:13:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:46 smithi060 ceph-mon[33722]: pgmap v713: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 14 MiB/s wr, 939 op/s 2024-09-21T04:13:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 565.0 s, 870.8 tps, lat 113.474 ms stddev 45.953 2024-09-21T04:13:48.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:48 smithi022 ceph-mon[31015]: pgmap v714: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-09-21T04:13:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:48 smithi073 ceph-mon[34443]: pgmap v714: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-09-21T04:13:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:48 smithi060 ceph-mon[33722]: pgmap v714: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 15 MiB/s wr, 1.01k op/s 2024-09-21T04:13:50.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:50 smithi022 ceph-mon[31015]: pgmap v715: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-09-21T04:13:50.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:50 smithi073 ceph-mon[34443]: pgmap v715: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-09-21T04:13:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:50 smithi060 ceph-mon[33722]: pgmap v715: 129 pgs: 129 active+clean; 1.3 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 12 MiB/s wr, 842 op/s 2024-09-21T04:13:52.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:52 smithi022 ceph-mon[31015]: pgmap v716: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 13 MiB/s wr, 982 op/s 2024-09-21T04:13:52.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:52 smithi073 ceph-mon[34443]: pgmap v716: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 13 MiB/s wr, 982 op/s 2024-09-21T04:13:52.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:52 smithi060 ceph-mon[33722]: pgmap v716: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 13 MiB/s wr, 982 op/s 2024-09-21T04:13:53.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 570.0 s, 586.8 tps, lat 172.720 ms stddev 212.211 2024-09-21T04:13:54.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:54 smithi022 ceph-mon[31015]: pgmap v717: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2024-09-21T04:13:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:54 smithi073 ceph-mon[34443]: pgmap v717: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2024-09-21T04:13:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:54 smithi060 ceph-mon[33722]: pgmap v717: 129 pgs: 129 active+clean; 1.3 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 14 MiB/s wr, 1.03k op/s 2024-09-21T04:13:56.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:56 smithi022 ceph-mon[31015]: pgmap v718: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 979 op/s 2024-09-21T04:13:56.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:56 smithi073 ceph-mon[34443]: pgmap v718: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 979 op/s 2024-09-21T04:13:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:56 smithi060 ceph-mon[33722]: pgmap v718: 129 pgs: 129 active+clean; 1.3 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 12 MiB/s wr, 979 op/s 2024-09-21T04:13:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 575.0 s, 570.8 tps, lat 146.984 ms stddev 107.841 2024-09-21T04:13:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:13:58 smithi022 ceph-mon[31015]: pgmap v719: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-21T04:13:58.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:13:58 smithi073 ceph-mon[34443]: pgmap v719: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-21T04:13:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:13:58 smithi060 ceph-mon[33722]: pgmap v719: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-21T04:14:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:00 smithi022 ceph-mon[31015]: pgmap v720: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-09-21T04:14:00.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:00 smithi073 ceph-mon[34443]: pgmap v720: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-09-21T04:14:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:00 smithi060 ceph-mon[33722]: pgmap v720: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 11 MiB/s wr, 865 op/s 2024-09-21T04:14:02.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:02 smithi022 ceph-mon[31015]: pgmap v721: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 985 op/s 2024-09-21T04:14:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:02 smithi073 ceph-mon[34443]: pgmap v721: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 985 op/s 2024-09-21T04:14:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:02 smithi060 ceph-mon[33722]: pgmap v721: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 12 MiB/s wr, 985 op/s 2024-09-21T04:14:03.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 580.0 s, 587.6 tps, lat 197.181 ms stddev 295.940 2024-09-21T04:14:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:04 smithi022 ceph-mon[31015]: pgmap v722: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-09-21T04:14:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:04 smithi073 ceph-mon[34443]: pgmap v722: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-09-21T04:14:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:04 smithi060 ceph-mon[33722]: pgmap v722: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 1.01k op/s 2024-09-21T04:14:06.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:06 smithi022 ceph-mon[31015]: pgmap v723: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 949 op/s 2024-09-21T04:14:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:06 smithi073 ceph-mon[34443]: pgmap v723: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 949 op/s 2024-09-21T04:14:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:06 smithi060 ceph-mon[33722]: pgmap v723: 129 pgs: 129 active+clean; 1.3 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 12 MiB/s wr, 949 op/s 2024-09-21T04:14:08.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 585.0 s, 686.6 tps, lat 145.127 ms stddev 218.492 2024-09-21T04:14:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:08 smithi022 ceph-mon[31015]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-21T04:14:08.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:08 smithi073 ceph-mon[34443]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-21T04:14:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:08 smithi060 ceph-mon[33722]: pgmap v724: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-21T04:14:10.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:10 smithi022 ceph-mon[31015]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-21T04:14:10.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:10 smithi073 ceph-mon[34443]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-21T04:14:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:10 smithi060 ceph-mon[33722]: pgmap v725: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 11 MiB/s wr, 847 op/s 2024-09-21T04:14:12.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:12 smithi022 ceph-mon[31015]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-21T04:14:12.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:12 smithi073 ceph-mon[34443]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-21T04:14:12.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:12 smithi060 ceph-mon[33722]: pgmap v726: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 14 MiB/s wr, 1.01k op/s 2024-09-21T04:14:13.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 590.0 s, 294.5 tps, lat 113.403 ms stddev 70.651 2024-09-21T04:14:14.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:14 smithi022 ceph-mon[31015]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-09-21T04:14:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:14 smithi073 ceph-mon[34443]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-09-21T04:14:14.954 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:14 smithi060 ceph-mon[33722]: pgmap v727: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 14 MiB/s wr, 1.05k op/s 2024-09-21T04:14:16.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:16 smithi022 ceph-mon[31015]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 1.00k op/s 2024-09-21T04:14:16.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:16 smithi073 ceph-mon[34443]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 1.00k op/s 2024-09-21T04:14:16.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:16 smithi060 ceph-mon[33722]: pgmap v728: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 13 MiB/s wr, 1.00k op/s 2024-09-21T04:14:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 595.0 s, 639.7 tps, lat 260.966 ms stddev 730.538 2024-09-21T04:14:18.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:18 smithi022 ceph-mon[31015]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-21T04:14:18.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:18 smithi073 ceph-mon[34443]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-21T04:14:18.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:18 smithi060 ceph-mon[33722]: pgmap v729: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 13 MiB/s wr, 1.04k op/s 2024-09-21T04:14:20.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:20 smithi022 ceph-mon[31015]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 869 op/s 2024-09-21T04:14:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:14:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:14:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:14:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:14:20.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:20 smithi073 ceph-mon[34443]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 869 op/s 2024-09-21T04:14:20.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:14:20.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:14:20.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:14:20.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:14:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:20 smithi060 ceph-mon[33722]: pgmap v730: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 11 MiB/s wr, 869 op/s 2024-09-21T04:14:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:14:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:14:20.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:14:20.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:14:22.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:22 smithi073 ceph-mon[34443]: pgmap v731: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 968 op/s 2024-09-21T04:14:22.857 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:22 smithi022 ceph-mon[31015]: pgmap v731: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 968 op/s 2024-09-21T04:14:22.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:22 smithi060 ceph-mon[33722]: pgmap v731: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 12 MiB/s wr, 968 op/s 2024-09-21T04:14:23.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 600.0 s, 725.6 tps, lat 138.330 ms stddev 71.170 2024-09-21T04:14:24.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:24 smithi022 ceph-mon[31015]: pgmap v732: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 921 op/s 2024-09-21T04:14:24.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:24 smithi073 ceph-mon[34443]: pgmap v732: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 921 op/s 2024-09-21T04:14:24.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:24 smithi060 ceph-mon[33722]: pgmap v732: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 11 MiB/s wr, 921 op/s 2024-09-21T04:14:26.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:26 smithi022 ceph-mon[31015]: pgmap v733: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 10 MiB/s wr, 841 op/s 2024-09-21T04:14:26.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:26 smithi073 ceph-mon[34443]: pgmap v733: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 10 MiB/s wr, 841 op/s 2024-09-21T04:14:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:26 smithi060 ceph-mon[33722]: pgmap v733: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 10 MiB/s wr, 841 op/s 2024-09-21T04:14:28.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 605.0 s, 764.0 tps, lat 130.405 ms stddev 58.529 2024-09-21T04:14:28.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:28 smithi022 ceph-mon[31015]: pgmap v734: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 9.8 MiB/s wr, 844 op/s 2024-09-21T04:14:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:28 smithi073 ceph-mon[34443]: pgmap v734: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 9.8 MiB/s wr, 844 op/s 2024-09-21T04:14:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:28 smithi060 ceph-mon[33722]: pgmap v734: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 9.8 MiB/s wr, 844 op/s 2024-09-21T04:14:30.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:30 smithi022 ceph-mon[31015]: pgmap v735: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.9 MiB/s wr, 703 op/s 2024-09-21T04:14:30.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:30 smithi073 ceph-mon[34443]: pgmap v735: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.9 MiB/s wr, 703 op/s 2024-09-21T04:14:30.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:30 smithi060 ceph-mon[33722]: pgmap v735: 129 pgs: 129 active+clean; 1.4 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 7.9 MiB/s wr, 703 op/s 2024-09-21T04:14:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:32 smithi022 ceph-mon[31015]: pgmap v736: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 885 op/s 2024-09-21T04:14:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:32 smithi073 ceph-mon[34443]: pgmap v736: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 885 op/s 2024-09-21T04:14:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:32 smithi060 ceph-mon[33722]: pgmap v736: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 10 MiB/s wr, 885 op/s 2024-09-21T04:14:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 610.0 s, 763.6 tps, lat 130.608 ms stddev 47.031 2024-09-21T04:14:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:34 smithi073 ceph-mon[34443]: pgmap v737: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.8 MiB/s wr, 891 op/s 2024-09-21T04:14:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:34 smithi060 ceph-mon[33722]: pgmap v737: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.8 MiB/s wr, 891 op/s 2024-09-21T04:14:35.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:34 smithi022 ceph-mon[31015]: pgmap v737: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 9.8 MiB/s wr, 891 op/s 2024-09-21T04:14:35.639 INFO:tasks.quiescer.fs.[cephfs]:Total duration (35.6) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T04:14:35.639 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.8 2024-09-21T04:14:35.640 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:14:36.137 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:14:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:36 smithi060 ceph-mon[33722]: pgmap v738: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.0 MiB/s wr, 853 op/s 2024-09-21T04:14:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:36 smithi022 ceph-mon[31015]: pgmap v738: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.0 MiB/s wr, 853 op/s 2024-09-21T04:14:37.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:36 smithi073 ceph-mon[34443]: pgmap v738: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.0 MiB/s wr, 853 op/s 2024-09-21T04:14:37.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.205+0000 7f820effd640 1 -- 172.21.15.22:0/4015038609 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc031800 con 0x7f821010ac70 2024-09-21T04:14:37.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.205+0000 7f82152b8640 1 -- 172.21.15.22:0/4015038609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f821010ac70 msgr2=0x7f821010fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:37.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.205+0000 7f82152b8640 1 --2- 172.21.15.22:0/4015038609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f821010ac70 0x7f821010fcf0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009900 tx=0x7f81fc02a410 comp rx=0 tx=0).stop 2024-09-21T04:14:37.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.207+0000 7f82152b8640 1 -- 172.21.15.22:0/4015038609 shutdown_connections 2024-09-21T04:14:37.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.207+0000 7f82152b8640 1 --2- 172.21.15.22:0/4015038609 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8210110230 0x7f8210110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:37.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.207+0000 7f82152b8640 1 --2- 172.21.15.22:0/4015038609 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f821010ac70 0x7f821010fcf0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:37.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.207+0000 7f82152b8640 1 --2- 172.21.15.22:0/4015038609 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f821006af90 0x7f821010a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:37.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.207+0000 7f82152b8640 1 -- 172.21.15.22:0/4015038609 >> 172.21.15.22:0/4015038609 conn(0x7f821006ee50 msgr2=0x7f821006f290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.209+0000 7f82152b8640 1 -- 172.21.15.22:0/4015038609 shutdown_connections 2024-09-21T04:14:37.211 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.209+0000 7f82152b8640 1 -- 172.21.15.22:0/4015038609 wait complete. 2024-09-21T04:14:37.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.210+0000 7f82152b8640 1 Processor -- start 2024-09-21T04:14:37.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.210+0000 7f82152b8640 1 -- start start 2024-09-21T04:14:37.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.210+0000 7f82152b8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f821006af90 0x7f82101a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:37.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.210+0000 7f82152b8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821010ac70 0x7f82101a5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:37.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.210+0000 7f82152b8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8210110230 0x7f82101aa510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:37.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.210+0000 7f82152b8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8210117e00 con 0x7f8210110230 2024-09-21T04:14:37.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f82152b8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8210117c80 con 0x7f821006af90 2024-09-21T04:14:37.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f82152b8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8210117f80 con 0x7f821010ac70 2024-09-21T04:14:37.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f820f7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821010ac70 0x7f82101a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:37.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f8214ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8210110230 0x7f82101aa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:37.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f8214ab7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8210110230 0x7f82101aa510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55142/0 (socket says 172.21.15.22:55142) 2024-09-21T04:14:37.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f8214ab7640 1 -- 172.21.15.22:0/3345759698 learned_addr learned my addr 172.21.15.22:0/3345759698 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:37.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f820ffff640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f821006af90 0x7f82101a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:37.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f820f7fe640 1 -- 172.21.15.22:0/3345759698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f821006af90 msgr2=0x7f82101a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:37.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f820f7fe640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f821006af90 0x7f82101a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:37.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f820f7fe640 1 -- 172.21.15.22:0/3345759698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8210110230 msgr2=0x7f82101aa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:37.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.211+0000 7f820f7fe640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8210110230 0x7f82101aa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:37.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.212+0000 7f820f7fe640 1 -- 172.21.15.22:0/3345759698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82101aac40 con 0x7f821010ac70 2024-09-21T04:14:37.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.212+0000 7f820f7fe640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821010ac70 0x7f82101a5270 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009230 tx=0x7f81fc004040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:37.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.212+0000 7f820d7fa640 1 -- 172.21.15.22:0/3345759698 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc03f070 con 0x7f821010ac70 2024-09-21T04:14:37.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.212+0000 7f82152b8640 1 -- 172.21.15.22:0/3345759698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82101aaed0 con 0x7f821010ac70 2024-09-21T04:14:37.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.212+0000 7f82152b8640 1 -- 172.21.15.22:0/3345759698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82101b1690 con 0x7f821010ac70 2024-09-21T04:14:37.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.212+0000 7f820d7fa640 1 -- 172.21.15.22:0/3345759698 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f81fc003a80 con 0x7f821010ac70 2024-09-21T04:14:37.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.212+0000 7f820d7fa640 1 -- 172.21.15.22:0/3345759698 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81fc035070 con 0x7f821010ac70 2024-09-21T04:14:37.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.214+0000 7f82152b8640 1 -- 172.21.15.22:0/3345759698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81f8005290 con 0x7f821010ac70 2024-09-21T04:14:37.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.216+0000 7f820d7fa640 1 -- 172.21.15.22:0/3345759698 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f81fc0035f0 con 0x7f821010ac70 2024-09-21T04:14:37.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.217+0000 7f820d7fa640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f81f40b6590 0x7f81f40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:37.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.218+0000 7f820d7fa640 1 -- 172.21.15.22:0/3345759698 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f81fc1075f0 con 0x7f821010ac70 2024-09-21T04:14:37.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.218+0000 7f820ffff640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f81f40b6590 0x7f81f40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.223+0000 7f820ffff640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f81f40b6590 0x7f81f40b8aa0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8200006fd0 tx=0x7f82000090e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:37.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.223+0000 7f820d7fa640 1 -- 172.21.15.22:0/3345759698 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f81fc0d1ea0 con 0x7f821010ac70 2024-09-21T04:14:37.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.669+0000 7f82152b8640 1 -- 172.21.15.22:0/3345759698 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81f8005580 con 0x7f821010ac70 2024-09-21T04:14:37.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.671+0000 7f820d7fa640 1 -- 172.21.15.22:0/3345759698 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7f81fc0d6de0 con 0x7f821010ac70 2024-09-21T04:14:37.673 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:14:37.673 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:14:37.673 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:14:37.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.675+0000 7f82152b8640 1 -- 172.21.15.22:0/3345759698 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f81f40b6590 msgr2=0x7f81f40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:37.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.675+0000 7f82152b8640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f81f40b6590 0x7f81f40b8aa0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f8200006fd0 tx=0x7f82000090e0 comp rx=0 tx=0).stop 2024-09-21T04:14:37.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.675+0000 7f82152b8640 1 -- 172.21.15.22:0/3345759698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821010ac70 msgr2=0x7f82101a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:37.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.675+0000 7f82152b8640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821010ac70 0x7f82101a5270 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009230 tx=0x7f81fc004040 comp rx=0 tx=0).stop 2024-09-21T04:14:37.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.676+0000 7f82152b8640 1 -- 172.21.15.22:0/3345759698 shutdown_connections 2024-09-21T04:14:37.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.676+0000 7f82152b8640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f81f40b6590 0x7f81f40b8aa0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:37.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.676+0000 7f82152b8640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f821010ac70 0x7f82101a5270 secure :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f81fc009230 tx=0x7f81fc004040 comp rx=0 tx=0).stop 2024-09-21T04:14:37.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.676+0000 7f82152b8640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8210110230 0x7f82101aa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:37.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.676+0000 7f82152b8640 1 --2- 172.21.15.22:0/3345759698 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f821006af90 0x7f82101a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:37.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.676+0000 7f82152b8640 1 -- 172.21.15.22:0/3345759698 >> 172.21.15.22:0/3345759698 conn(0x7f821006ee50 msgr2=0x7f821010cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:37.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.676+0000 7f82152b8640 1 -- 172.21.15.22:0/3345759698 shutdown_connections 2024-09-21T04:14:37.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:37.676+0000 7f82152b8640 1 -- 172.21.15.22:0/3345759698 wait complete. 2024-09-21T04:14:38.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 615.0 s, 724.4 tps, lat 137.163 ms stddev 58.502 2024-09-21T04:14:38.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:38 smithi022 ceph-mon[31015]: pgmap v739: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 899 op/s 2024-09-21T04:14:38.780 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:38 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3345759698' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:14:38.835 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0' 2024-09-21T04:14:38.836 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0 2024-09-21T04:14:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:38 smithi060 ceph-mon[33722]: pgmap v739: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 899 op/s 2024-09-21T04:14:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:38 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3345759698' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:14:39.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:38 smithi073 ceph-mon[34443]: pgmap v739: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 9.5 MiB/s wr, 899 op/s 2024-09-21T04:14:39.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:38 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3345759698' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:14:39.332 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:14:40.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.370+0000 7f2a9950f640 1 -- 172.21.15.22:0/3137148258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a9411d0e0 msgr2=0x7f2a9411f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:40.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.370+0000 7f2a9950f640 1 --2- 172.21.15.22:0/3137148258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a9411d0e0 0x7f2a9411f500 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c009ca0 tx=0x7f2a8c02a8f0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.377+0000 7f2a9950f640 1 -- 172.21.15.22:0/3137148258 shutdown_connections 2024-09-21T04:14:40.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.377+0000 7f2a9950f640 1 --2- 172.21.15.22:0/3137148258 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a9411d0e0 0x7f2a9411f500 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.377+0000 7f2a9950f640 1 --2- 172.21.15.22:0/3137148258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a9410ad10 0x7f2a9411cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.377+0000 7f2a9950f640 1 --2- 172.21.15.22:0/3137148258 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a9410a3c0 0x7f2a9410a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.377+0000 7f2a9950f640 1 -- 172.21.15.22:0/3137148258 >> 172.21.15.22:0/3137148258 conn(0x7f2a94070e80 msgr2=0x7f2a94071290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:40.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.379+0000 7f2a9950f640 1 -- 172.21.15.22:0/3137148258 shutdown_connections 2024-09-21T04:14:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.379+0000 7f2a9950f640 1 -- 172.21.15.22:0/3137148258 wait complete. 2024-09-21T04:14:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.381+0000 7f2a9950f640 1 Processor -- start 2024-09-21T04:14:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.381+0000 7f2a9950f640 1 -- start start 2024-09-21T04:14:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.382+0000 7f2a9950f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a9410a3c0 0x7f2a941a90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.382+0000 7f2a9950f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a9410ad10 0x7f2a941a9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.382+0000 7f2a9950f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a9411d0e0 0x7f2a941ae900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.382+0000 7f2a9950f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a94122850 con 0x7f2a9411d0e0 2024-09-21T04:14:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.382+0000 7f2a9950f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941226d0 con 0x7f2a9410ad10 2024-09-21T04:14:40.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.383+0000 7f2a9950f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941229d0 con 0x7f2a9410a3c0 2024-09-21T04:14:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.383+0000 7f2a937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a9411d0e0 0x7f2a941ae900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.383+0000 7f2a937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a9411d0e0 0x7f2a941ae900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55156/0 (socket says 172.21.15.22:55156) 2024-09-21T04:14:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.383+0000 7f2a937fe640 1 -- 172.21.15.22:0/3658504703 learned_addr learned my addr 172.21.15.22:0/3658504703 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.384+0000 7f2a937fe640 1 -- 172.21.15.22:0/3658504703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a9410a3c0 msgr2=0x7f2a941a90c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T04:14:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.384+0000 7f2a937fe640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a9410a3c0 0x7f2a941a90c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.384+0000 7f2a937fe640 1 -- 172.21.15.22:0/3658504703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a9410ad10 msgr2=0x7f2a941a9660 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T04:14:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.384+0000 7f2a937fe640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a9410ad10 0x7f2a941a9660 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.384+0000 7f2a937fe640 1 -- 172.21.15.22:0/3658504703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a941af030 con 0x7f2a9411d0e0 2024-09-21T04:14:40.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.384+0000 7f2a937fe640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a9411d0e0 0x7f2a941ae900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0098d0 tx=0x7f2a8c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:40.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.386+0000 7f2a8bfff640 1 -- 172.21.15.22:0/3658504703 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c004040 con 0x7f2a9411d0e0 2024-09-21T04:14:40.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.386+0000 7f2a8bfff640 1 -- 172.21.15.22:0/3658504703 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a8c02d070 con 0x7f2a9411d0e0 2024-09-21T04:14:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.387+0000 7f2a8bfff640 1 -- 172.21.15.22:0/3658504703 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c02fbe0 con 0x7f2a9411d0e0 2024-09-21T04:14:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.387+0000 7f2a9950f640 1 -- 172.21.15.22:0/3658504703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a941af2c0 con 0x7f2a9411d0e0 2024-09-21T04:14:40.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.387+0000 7f2a9950f640 1 -- 172.21.15.22:0/3658504703 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a941b5a80 con 0x7f2a9411d0e0 2024-09-21T04:14:40.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.393+0000 7f2a8bfff640 1 -- 172.21.15.22:0/3658504703 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f2a8c02fd80 con 0x7f2a9411d0e0 2024-09-21T04:14:40.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.395+0000 7f2a8bfff640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2a800b6570 0x7f2a800b8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.396+0000 7f2a8bfff640 1 -- 172.21.15.22:0/3658504703 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f2a8c108c30 con 0x7f2a9411d0e0 2024-09-21T04:14:40.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.400+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2a800b6570 0x7f2a800b8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.410+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2a800b6570 0x7f2a800b8a80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2a94075270 tx=0x7f2a7c006bd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:40.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.410+0000 7f2a9fa83740 1 Processor -- start 2024-09-21T04:14:40.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.410+0000 7f2a9fa83740 1 -- start start 2024-09-21T04:14:40.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.410+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 0x55724b675600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b675b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 0x55724b676080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a9fa83740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55724b5ebb90 con 0x55724b2a5980 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a9fa83740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55724b5dafc0 con 0x55724b2ce840 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a9fa83740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55724b5dedd0 con 0x55724b2adb60 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a92ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 0x55724b675600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 0x55724b676080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a92ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 0x55724b675600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:46874/0 (socket says 172.21.15.22:46874) 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a937fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 0x55724b676080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:59856/0 (socket says 172.21.15.22:59856) 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a92ffd640 1 -- 172.21.15.22:0/1716040341 learned_addr learned my addr 172.21.15.22:0/1716040341 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a927fc640 1 --2- 172.21.15.22:0/1716040341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b675b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a92ffd640 1 -- 172.21.15.22:0/1716040341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 msgr2=0x55724b676080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/1716040341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 0x55724b676080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a92ffd640 1 -- 172.21.15.22:0/1716040341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 msgr2=0x55724b675b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:40.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/1716040341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b675b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.411+0000 7f2a92ffd640 1 -- 172.21.15.22:0/1716040341 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724b562060 con 0x55724b2ce840 2024-09-21T04:14:40.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.412+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/1716040341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 0x55724b675600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0138e0 tx=0x7f2a7c00e000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cc97bf144aa7da21 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:40.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.412+0000 7f2a897fa640 1 -- 172.21.15.22:0/1716040341 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c013e60 con 0x55724b2ce840 2024-09-21T04:14:40.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.412+0000 7f2a897fa640 1 -- 172.21.15.22:0/1716040341 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a7c033070 con 0x55724b2ce840 2024-09-21T04:14:40.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.412+0000 7f2a897fa640 1 -- 172.21.15.22:0/1716040341 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c00b380 con 0x55724b2ce840 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.414+0000 7f2a9fa83740 1 -- 172.21.15.22:0/1716040341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 msgr2=0x55724b675600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.414+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/1716040341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 0x55724b675600 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2a7c0138e0 tx=0x7f2a7c00e000 comp rx=0 tx=0).stop 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.414+0000 7f2a9fa83740 1 -- 172.21.15.22:0/1716040341 shutdown_connections 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.414+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/1716040341 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 0x55724b676080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.414+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/1716040341 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b675b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.414+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/1716040341 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 0x55724b675600 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.414+0000 7f2a9fa83740 1 -- 172.21.15.22:0/1716040341 >> 172.21.15.22:0/1716040341 conn(0x55724b2c2990 msgr2=0x55724b6734f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.414+0000 7f2a9fa83740 1 -- 172.21.15.22:0/1716040341 shutdown_connections 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.414+0000 7f2a9fa83740 1 -- 172.21.15.22:0/1716040341 wait complete. 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.415+0000 7f2a9fa83740 1 -- start start 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.415+0000 7f2a9fa83740 1 Processor -- start 2024-09-21T04:14:40.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.415+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b6811f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b681730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2ce840 0x55724b68d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a9fa83740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55724b43c7a0 con 0x55724b2a5980 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a9fa83740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55724b5800a0 con 0x55724b2adb60 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a9fa83740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55724b683de0 con 0x55724b2ce840 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a92ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b6811f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a92ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b6811f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56050/0 (socket says 172.21.15.22:56050) 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a92ffd640 1 -- 172.21.15.22:0/2587559895 learned_addr learned my addr 172.21.15.22:0/2587559895 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a9fa83740 10 client.0 _ll_register_callbacks cb 0x55724b55d3c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a927fc640 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b681730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a937fe640 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2ce840 0x55724b68d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a927fc640 1 -- 172.21.15.22:0/2587559895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2ce840 msgr2=0x55724b68d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a927fc640 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2ce840 0x55724b68d0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a927fc640 1 -- 172.21.15.22:0/2587559895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 msgr2=0x55724b6811f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:40.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a927fc640 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b6811f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.416+0000 7f2a927fc640 1 -- 172.21.15.22:0/2587559895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724b56e880 con 0x55724b2adb60 2024-09-21T04:14:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.417+0000 7f2a927fc640 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b681730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2a9411f730 tx=0x7f2a8400d530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6c7e19c5e3db98a server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.417+0000 7f2a7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:14:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.418+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/2587559895 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a84014430 con 0x55724b2adb60 2024-09-21T04:14:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.418+0000 7f2a9fa83740 1 -- 172.21.15.22:0/2587559895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a7c033070 con 0x55724b2adb60 2024-09-21T04:14:40.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.418+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/2587559895 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f2a840145d0 con 0x55724b2adb60 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.419+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/2587559895 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f2a84022050 con 0x55724b2adb60 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.419+0000 7f2a9fa83740 10 client.25715 fetch_fsmap learned FSMap version 50 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.419+0000 7f2a9fa83740 1 -- 172.21.15.22:0/2587559895 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55724b348b90 con 0x55724b2adb60 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.419+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/2587559895 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a84019070 con 0x55724b2adb60 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.419+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/2587559895 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f2a84013070 con 0x55724b2adb60 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.419+0000 7f2a9fa83740 10 client.25715 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.419+0000 7f2a9fa83740 10 client.25715 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.419+0000 7f2a9fa83740 20 client.25715 populate_metadata read hostname 'smithi022' 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.419+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55724b28d1c0 0x55724b693600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.420+0000 7f2a9fa83740 4 client.25715 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.420+0000 7f2a9fa83740 1 -- 172.21.15.22:0/2587559895 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f2a7c033070 con 0x55724b28d1c0 2024-09-21T04:14:40.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.420+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55724b28d1c0 0x55724b693600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.431+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55724b28d1c0 0x55724b693600 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32aabc2383a14408 server_cookie=e60374f341dbe550 in_seq=0 out_seq=0 2024-09-21T04:14:40.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.431+0000 7f2a7a7fc640 10 client.25715 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:14:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.432+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/2587559895 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f2a7c033070 con 0x55724b28d1c0 2024-09-21T04:14:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.432+0000 7f2a7a7fc640 10 client.25715 handle_command_reply: tid=0 2024-09-21T04:14:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.432+0000 7f2a9fa83740 1 client.25715 shutdown 2024-09-21T04:14:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a9fa83740 1 -- 172.21.15.22:0/2587559895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 msgr2=0x55724b681730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b681730 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f2a9411f730 tx=0x7f2a8400d530 comp rx=0 tx=0).stop 2024-09-21T04:14:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a9fa83740 1 -- 172.21.15.22:0/2587559895 shutdown_connections 2024-09-21T04:14:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55724b28d1c0 0x55724b693600 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2ce840 0x55724b68d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b681730 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/2587559895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b6811f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a9fa83740 1 -- 172.21.15.22:0/2587559895 >> 172.21.15.22:0/2587559895 conn(0x55724b2c2990 msgr2=0x55724b6787e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:40.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a7a7fc640 0 client.25715 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:14:40.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a9fa83740 1 -- 172.21.15.22:0/2587559895 shutdown_connections 2024-09-21T04:14:40.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.433+0000 7f2a9fa83740 1 -- 172.21.15.22:0/2587559895 wait complete. 2024-09-21T04:14:40.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.434+0000 7f2a9fa83740 20 client.25715 trim_cache size 0 max 16384 2024-09-21T04:14:40.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.466+0000 7f2a9fa83740 1 Processor -- start 2024-09-21T04:14:40.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.466+0000 7f2a9fa83740 1 -- start start 2024-09-21T04:14:40.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.467+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b676d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.467+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 0x55724b68cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.467+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 0x55724b68d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.467+0000 7f2a927fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 0x55724b68cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.467+0000 7f2a927fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 0x55724b68cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:59878/0 (socket says 172.21.15.22:59878) 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.467+0000 7f2a927fc640 1 -- 172.21.15.22:0/3397204976 learned_addr learned my addr 172.21.15.22:0/3397204976 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.467+0000 7f2a937fe640 1 --2- 172.21.15.22:0/3397204976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 0x55724b68d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.468+0000 7f2a9fa83740 1 -- 172.21.15.22:0/3397204976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941d9020 con 0x55724b2a5980 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.468+0000 7f2a9fa83740 1 -- 172.21.15.22:0/3397204976 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941dab60 con 0x55724b2ce840 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.468+0000 7f2a9fa83740 1 -- 172.21.15.22:0/3397204976 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941d96f0 con 0x55724b2adb60 2024-09-21T04:14:40.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.468+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/3397204976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b676d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.469+0000 7f2a92ffd640 1 -- 172.21.15.22:0/3397204976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 msgr2=0x55724b68cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:40.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.469+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/3397204976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 0x55724b68cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.469+0000 7f2a92ffd640 1 -- 172.21.15.22:0/3397204976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 msgr2=0x55724b68d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:40.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.469+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/3397204976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 0x55724b68d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.469+0000 7f2a92ffd640 1 -- 172.21.15.22:0/3397204976 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55724b68da50 con 0x55724b2a5980 2024-09-21T04:14:40.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.470+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/3397204976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b676d40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55724b693d70 tx=0x7f2a7c012ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5688d057062a1d82 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:40.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.472+0000 7f2a88ff9640 1 -- 172.21.15.22:0/3397204976 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c013e60 con 0x55724b2a5980 2024-09-21T04:14:40.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.472+0000 7f2a88ff9640 1 -- 172.21.15.22:0/3397204976 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a7c033070 con 0x55724b2a5980 2024-09-21T04:14:40.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.472+0000 7f2a88ff9640 1 -- 172.21.15.22:0/3397204976 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c02e890 con 0x55724b2a5980 2024-09-21T04:14:40.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.473+0000 7f2a9fa83740 1 -- 172.21.15.22:0/3397204976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 msgr2=0x55724b676d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.473+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/3397204976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b676d40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55724b693d70 tx=0x7f2a7c012ed0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.473+0000 7f2a9fa83740 1 -- 172.21.15.22:0/3397204976 shutdown_connections 2024-09-21T04:14:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.473+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/3397204976 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b2adb60 0x55724b68cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.474+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/3397204976 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2ce840 0x55724b68d510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.474+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/3397204976 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2a5980 0x55724b676d40 secure :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0x55724b693d70 tx=0x7f2a7c012ed0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.474+0000 7f2a9fa83740 1 -- 172.21.15.22:0/3397204976 >> 172.21.15.22:0/3397204976 conn(0x55724b2c2990 msgr2=0x55724b676630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:40.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.475+0000 7f2a9fa83740 1 -- 172.21.15.22:0/3397204976 shutdown_connections 2024-09-21T04:14:40.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.475+0000 7f2a9fa83740 1 -- 172.21.15.22:0/3397204976 wait complete. 2024-09-21T04:14:40.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.475+0000 7f2a9fa83740 1 -- start start 2024-09-21T04:14:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.476+0000 7f2a9fa83740 1 Processor -- start 2024-09-21T04:14:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.476+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b6899a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2ce840 0x55724b683ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a9fa83740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b262570 0x55724b6846e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a9fa83740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941da490 con 0x55724b2ce840 2024-09-21T04:14:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a9fa83740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2a941d9dc0 con 0x55724b2adb60 2024-09-21T04:14:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a92ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b6899a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a92ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b6899a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:46906/0 (socket says 172.21.15.22:46906) 2024-09-21T04:14:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a92ffd640 1 -- 172.21.15.22:0/255486764 learned_addr learned my addr 172.21.15.22:0/255486764 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a9fa83740 1 -- 172.21.15.22:0/255486764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2a9410b5e0 con 0x55724b262570 2024-09-21T04:14:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a937fe640 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b262570 0x55724b6846e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a9fa83740 10 client.0 _ll_register_callbacks cb 0x7f2a8400bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:14:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a927fc640 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2ce840 0x55724b683ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a937fe640 1 -- 172.21.15.22:0/255486764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 msgr2=0x55724b6899a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.477+0000 7f2a937fe640 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b6899a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.478+0000 7f2a937fe640 1 -- 172.21.15.22:0/255486764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2ce840 msgr2=0x55724b683ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.478+0000 7f2a937fe640 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2ce840 0x55724b683ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.478+0000 7f2a937fe640 1 -- 172.21.15.22:0/255486764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55724b6fe000 con 0x55724b262570 2024-09-21T04:14:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.478+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b6899a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:14:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.478+0000 7f2a937fe640 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b262570 0x55724b6846e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c106310 tx=0x7f2a8c02a8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=425be2b733947890 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.478+0000 7f2a7a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:14:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.478+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/255486764 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a8c0ce4b0 con 0x55724b262570 2024-09-21T04:14:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.478+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/255486764 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f2a8c0cac10 con 0x55724b262570 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a9fa83740 1 -- 172.21.15.22:0/255486764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a7c033070 con 0x55724b262570 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/255486764 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f2a8c0cf0a0 con 0x55724b262570 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a9fa83740 10 client.25741 fetch_fsmap learned FSMap version 50 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a9fa83740 1 -- 172.21.15.22:0/255486764 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55724b6ff090 con 0x55724b262570 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/255486764 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a7c033070 con 0x55724b262570 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/255486764 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f2a8c0ca2f0 con 0x55724b262570 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a9fa83740 10 client.25741 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a9fa83740 10 client.25741 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a9fa83740 20 client.25741 populate_metadata read hostname 'smithi022' 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55724b6ff860 0x55724b701c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a9fa83740 4 client.25741 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}] 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.479+0000 7f2a9fa83740 1 -- 172.21.15.22:0/255486764 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}) -- 0x55724b5edae0 con 0x55724b6ff860 2024-09-21T04:14:40.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.480+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55724b6ff860 0x55724b701c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:40.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.481+0000 7f2a92ffd640 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55724b6ff860 0x55724b701c80 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d34e22a51053dbee server_cookie=667ab6e7eb13486d in_seq=0 out_seq=0 2024-09-21T04:14:40.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.481+0000 7f2a7a7fc640 10 client.25741 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:14:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.790+0000 7f2a7a7fc640 1 -- 172.21.15.22:0/255486764 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55724b5edae0 con 0x55724b6ff860 2024-09-21T04:14:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.790+0000 7f2a7a7fc640 10 client.25741 handle_command_reply: tid=0 2024-09-21T04:14:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.790+0000 7f2a9fa83740 1 client.25741 shutdown 2024-09-21T04:14:40.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 1 -- 172.21.15.22:0/255486764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b262570 msgr2=0x55724b6846e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b262570 0x55724b6846e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c106310 tx=0x7f2a8c02a8f0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 1 -- 172.21.15.22:0/255486764 shutdown_connections 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55724b6ff860 0x55724b701c80 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55724b262570 0x55724b6846e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55724b2ce840 0x55724b683ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 1 --2- 172.21.15.22:0/255486764 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55724b2adb60 0x55724b6899a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a7a7fc640 0 client.25741 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 1 -- 172.21.15.22:0/255486764 >> 172.21.15.22:0/255486764 conn(0x55724b2c2990 msgr2=0x55724b678700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 1 -- 172.21.15.22:0/255486764 shutdown_connections 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 1 -- 172.21.15.22:0/255486764 wait complete. 2024-09-21T04:14:40.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.791+0000 7f2a9fa83740 20 client.25741 trim_cache size 0 max 16384 2024-09-21T04:14:40.796 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:40 smithi022 ceph-mon[31015]: pgmap v740: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.5 MiB/s wr, 782 op/s 2024-09-21T04:14:40.796 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:14:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:14:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:14:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 46, 2024-09-21T04:14:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:14:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "a21c8e08": { 2024-09-21T04:14:40.796 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 46, 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 137.8, 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:14:40.797 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:14:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:14:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:14:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:14:40.798 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:14:40.798 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:14:40.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 -- 172.21.15.22:0/3658504703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2a800b6570 msgr2=0x7f2a800b8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:40.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2a800b6570 0x7f2a800b8a80 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2a94075270 tx=0x7f2a7c006bd0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 -- 172.21.15.22:0/3658504703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a9411d0e0 msgr2=0x7f2a941ae900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:40.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a9411d0e0 0x7f2a941ae900 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f2a8c0098d0 tx=0x7f2a8c003ba0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 -- 172.21.15.22:0/3658504703 shutdown_connections 2024-09-21T04:14:40.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f2a800b6570 0x7f2a800b8a80 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2a9411d0e0 0x7f2a941ae900 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2a9410ad10 0x7f2a941a9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 --2- 172.21.15.22:0/3658504703 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2a9410a3c0 0x7f2a941a90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:40.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 -- 172.21.15.22:0/3658504703 >> 172.21.15.22:0/3658504703 conn(0x7f2a94070e80 msgr2=0x7f2a94071de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:40.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 -- 172.21.15.22:0/3658504703 shutdown_connections 2024-09-21T04:14:40.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:40.792+0000 7f2a9950f640 1 -- 172.21.15.22:0/3658504703 wait complete. 2024-09-21T04:14:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:40 smithi060 ceph-mon[33722]: pgmap v740: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.5 MiB/s wr, 782 op/s 2024-09-21T04:14:41.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:40 smithi073 ceph-mon[34443]: pgmap v740: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 8.5 MiB/s wr, 782 op/s 2024-09-21T04:14:41.509 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a21c8e08', quiesce took 5.9 seconds. Will release after: 11.9 2024-09-21T04:14:42.908 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:42 smithi073 ceph-mon[34443]: pgmap v741: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.9 MiB/s wr, 864 op/s 2024-09-21T04:14:42.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:42 smithi060 ceph-mon[33722]: pgmap v741: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.9 MiB/s wr, 864 op/s 2024-09-21T04:14:43.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:42 smithi022 ceph-mon[31015]: pgmap v741: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.9 MiB/s wr, 864 op/s 2024-09-21T04:14:43.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 620.0 s, 205.9 tps, lat 172.935 ms stddev 93.662 2024-09-21T04:14:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:44 smithi060 ceph-mon[33722]: pgmap v742: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 764 op/s 2024-09-21T04:14:45.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:44 smithi022 ceph-mon[31015]: pgmap v742: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 764 op/s 2024-09-21T04:14:45.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:44 smithi073 ceph-mon[34443]: pgmap v742: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 7.5 MiB/s wr, 764 op/s 2024-09-21T04:14:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:46 smithi060 ceph-mon[33722]: pgmap v743: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 625 op/s 2024-09-21T04:14:47.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:46 smithi022 ceph-mon[31015]: pgmap v743: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 625 op/s 2024-09-21T04:14:47.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:46 smithi073 ceph-mon[34443]: pgmap v743: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 625 op/s 2024-09-21T04:14:48.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 625.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:14:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:48 smithi060 ceph-mon[33722]: pgmap v744: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.2 MiB/s wr, 515 op/s 2024-09-21T04:14:49.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:48 smithi022 ceph-mon[31015]: pgmap v744: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.2 MiB/s wr, 515 op/s 2024-09-21T04:14:49.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:48 smithi073 ceph-mon[34443]: pgmap v744: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.2 MiB/s wr, 515 op/s 2024-09-21T04:14:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:50 smithi060 ceph-mon[33722]: pgmap v745: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.5 MiB/s wr, 339 op/s 2024-09-21T04:14:51.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:50 smithi022 ceph-mon[31015]: pgmap v745: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.5 MiB/s wr, 339 op/s 2024-09-21T04:14:51.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:50 smithi073 ceph-mon[34443]: pgmap v745: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.5 MiB/s wr, 339 op/s 2024-09-21T04:14:52.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:52 smithi060 ceph-mon[33722]: pgmap v746: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.6 MiB/s wr, 285 op/s 2024-09-21T04:14:53.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:52 smithi022 ceph-mon[31015]: pgmap v746: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.6 MiB/s wr, 285 op/s 2024-09-21T04:14:53.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:52 smithi073 ceph-mon[34443]: pgmap v746: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 2.6 MiB/s wr, 285 op/s 2024-09-21T04:14:53.410 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:14:53.683 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:14:53.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 630.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:14:54.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.224+0000 7f61313ca640 1 -- 172.21.15.22:0/2774763520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c104840 msgr2=0x7f612c104c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:54.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.224+0000 7f61313ca640 1 --2- 172.21.15.22:0/2774763520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c104840 0x7f612c104c50 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f611c009900 tx=0x7f611c02a410 comp rx=0 tx=0).stop 2024-09-21T04:14:54.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.224+0000 7f61313ca640 1 -- 172.21.15.22:0/2774763520 shutdown_connections 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.224+0000 7f61313ca640 1 --2- 172.21.15.22:0/2774763520 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f612c105270 0x7f612c10d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.224+0000 7f61313ca640 1 --2- 172.21.15.22:0/2774763520 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f612c10ddf0 0x7f612c110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.224+0000 7f61313ca640 1 --2- 172.21.15.22:0/2774763520 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c104840 0x7f612c104c50 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.224+0000 7f61313ca640 1 -- 172.21.15.22:0/2774763520 >> 172.21.15.22:0/2774763520 conn(0x7f612c079730 msgr2=0x7f612c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.225+0000 7f61313ca640 1 -- 172.21.15.22:0/2774763520 shutdown_connections 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.225+0000 7f61313ca640 1 -- 172.21.15.22:0/2774763520 wait complete. 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.225+0000 7f61313ca640 1 Processor -- start 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f61313ca640 1 -- start start 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f61313ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c104840 0x7f612c19a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f61313ca640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f612c105270 0x7f612c19a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f61313ca640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f612c10ddf0 0x7f612c19fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:54.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f61313ca640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f612c113940 con 0x7f612c104840 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f61313ca640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f612c1137c0 con 0x7f612c10ddf0 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f61313ca640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f612c113ac0 con 0x7f612c105270 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f612affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c104840 0x7f612c19a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f612affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c104840 0x7f612c19a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42916/0 (socket says 172.21.15.22:42916) 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f612affd640 1 -- 172.21.15.22:0/4270424355 learned_addr learned my addr 172.21.15.22:0/4270424355 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f612a7fc640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f612c105270 0x7f612c19a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.226+0000 7f612b7fe640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f612c10ddf0 0x7f612c19fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f612affd640 1 -- 172.21.15.22:0/4270424355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f612c105270 msgr2=0x7f612c19a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f612affd640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f612c105270 0x7f612c19a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f612affd640 1 -- 172.21.15.22:0/4270424355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f612c10ddf0 msgr2=0x7f612c19fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f612affd640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f612c10ddf0 0x7f612c19fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f612affd640 1 -- 172.21.15.22:0/4270424355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f612c1a0340 con 0x7f612c104840 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f612affd640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c104840 0x7f612c19a3d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f611c005940 tx=0x7f611c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:54.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f6113fff640 1 -- 172.21.15.22:0/4270424355 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c03f030 con 0x7f612c104840 2024-09-21T04:14:54.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f6113fff640 1 -- 172.21.15.22:0/4270424355 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f611c003c90 con 0x7f612c104840 2024-09-21T04:14:54.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f61313ca640 1 -- 172.21.15.22:0/4270424355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f612c1a05d0 con 0x7f612c104840 2024-09-21T04:14:54.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f6113fff640 1 -- 172.21.15.22:0/4270424355 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f611c035070 con 0x7f612c104840 2024-09-21T04:14:54.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.227+0000 7f61313ca640 1 -- 172.21.15.22:0/4270424355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f612c1a6d90 con 0x7f612c104840 2024-09-21T04:14:54.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.228+0000 7f61313ca640 1 -- 172.21.15.22:0/4270424355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f612c104c50 con 0x7f612c104840 2024-09-21T04:14:54.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.231+0000 7f6113fff640 1 -- 172.21.15.22:0/4270424355 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f611c042030 con 0x7f612c104840 2024-09-21T04:14:54.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.231+0000 7f6113fff640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61140b6510 0x7f61140b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:54.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.231+0000 7f612a7fc640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61140b6510 0x7f61140b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:54.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.231+0000 7f6113fff640 1 -- 172.21.15.22:0/4270424355 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f611c107f60 con 0x7f612c104840 2024-09-21T04:14:54.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.232+0000 7f612a7fc640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61140b6510 0x7f61140b8a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f612c102410 tx=0x7f612000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:54.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.235+0000 7f6113fff640 1 -- 172.21.15.22:0/4270424355 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f611c0d27b0 con 0x7f612c104840 2024-09-21T04:14:54.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.478+0000 7f61313ca640 1 -- 172.21.15.22:0/4270424355 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f612c19b500 con 0x7f612c104840 2024-09-21T04:14:54.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.479+0000 7f6113fff640 1 -- 172.21.15.22:0/4270424355 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7f611c0d76f0 con 0x7f612c104840 2024-09-21T04:14:54.482 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:14:54.483 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:14:54.483 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:14:54.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 -- 172.21.15.22:0/4270424355 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61140b6510 msgr2=0x7f61140b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61140b6510 0x7f61140b8a20 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f612c102410 tx=0x7f612000b390 comp rx=0 tx=0).stop 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 -- 172.21.15.22:0/4270424355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c104840 msgr2=0x7f612c19a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c104840 0x7f612c19a3d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f611c005940 tx=0x7f611c0042f0 comp rx=0 tx=0).stop 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 -- 172.21.15.22:0/4270424355 shutdown_connections 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f61140b6510 0x7f61140b8a20 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f612c105270 0x7f612c19a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f612c10ddf0 0x7f612c19fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 --2- 172.21.15.22:0/4270424355 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f612c104840 0x7f612c19a3d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 -- 172.21.15.22:0/4270424355 >> 172.21.15.22:0/4270424355 conn(0x7f612c079730 msgr2=0x7f612c1008b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 -- 172.21.15.22:0/4270424355 shutdown_connections 2024-09-21T04:14:54.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:54.481+0000 7f61313ca640 1 -- 172.21.15.22:0/4270424355 wait complete. 2024-09-21T04:14:54.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:54 smithi022 ceph-mon[31015]: pgmap v747: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-09-21T04:14:54.845 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:54 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/4270424355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:14:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:54 smithi060 ceph-mon[33722]: pgmap v747: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-09-21T04:14:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:54 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/4270424355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:14:55.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:54 smithi073 ceph-mon[34443]: pgmap v747: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.5 MiB/s wr, 153 op/s 2024-09-21T04:14:55.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:54 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/4270424355' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:14:55.229 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id a21c8e08 --release --await' 2024-09-21T04:14:55.229 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id a21c8e08 --release --await 2024-09-21T04:14:55.494 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:14:55.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.989+0000 7f497d897640 1 -- 172.21.15.22:0/1639904015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781094a0 msgr2=0x7f49781098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.989+0000 7f497d897640 1 --2- 172.21.15.22:0/1639904015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781094a0 0x7f49781098b0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f496c009900 tx=0x7f496c02a410 comp rx=0 tx=0).stop 2024-09-21T04:14:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.989+0000 7f497d897640 1 -- 172.21.15.22:0/1639904015 shutdown_connections 2024-09-21T04:14:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.989+0000 7f497d897640 1 --2- 172.21.15.22:0/1639904015 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4978109df0 0x7f4978110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.989+0000 7f497d897640 1 --2- 172.21.15.22:0/1639904015 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781094a0 0x7f49781098b0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.989+0000 7f497d897640 1 --2- 172.21.15.22:0/1639904015 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4978103b60 0x7f4978103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.989+0000 7f497d897640 1 -- 172.21.15.22:0/1639904015 >> 172.21.15.22:0/1639904015 conn(0x7f497807b850 msgr2=0x7f497807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.989+0000 7f497d897640 1 -- 172.21.15.22:0/1639904015 shutdown_connections 2024-09-21T04:14:55.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.989+0000 7f497d897640 1 -- 172.21.15.22:0/1639904015 wait complete. 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.990+0000 7f497d897640 1 Processor -- start 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.990+0000 7f497d897640 1 -- start start 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f497d897640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4978103b60 0x7f497819a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f497d897640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781094a0 0x7f497819aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f497d897640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4978109df0 0x7f497819fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f497d897640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4978113980 con 0x7f49781094a0 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f497d897640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f4978113800 con 0x7f4978103b60 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f497d897640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f4978113b00 con 0x7f4978109df0 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f49767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781094a0 0x7f497819aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f49767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781094a0 0x7f497819aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42932/0 (socket says 172.21.15.22:42932) 2024-09-21T04:14:55.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f49767fc640 1 -- 172.21.15.22:0/2068679277 learned_addr learned my addr 172.21.15.22:0/2068679277 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f49777fe640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4978109df0 0x7f497819fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f4976ffd640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4978103b60 0x7f497819a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f49767fc640 1 -- 172.21.15.22:0/2068679277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4978109df0 msgr2=0x7f497819fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f49767fc640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4978109df0 0x7f497819fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f49767fc640 1 -- 172.21.15.22:0/2068679277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4978103b60 msgr2=0x7f497819a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f49767fc640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4978103b60 0x7f497819a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f49767fc640 1 -- 172.21.15.22:0/2068679277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49781a03e0 con 0x7f49781094a0 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f4976ffd640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4978103b60 0x7f497819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.991+0000 7f49767fc640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781094a0 0x7f497819aa10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f496c005940 tx=0x7f496c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.992+0000 7f497c895640 1 -- 172.21.15.22:0/2068679277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c03f030 con 0x7f49781094a0 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.992+0000 7f497d897640 1 -- 172.21.15.22:0/2068679277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49781a0670 con 0x7f49781094a0 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.992+0000 7f497d897640 1 -- 172.21.15.22:0/2068679277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49781a6e30 con 0x7f49781094a0 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.992+0000 7f497c895640 1 -- 172.21.15.22:0/2068679277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f496c003a80 con 0x7f49781094a0 2024-09-21T04:14:55.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.992+0000 7f497c895640 1 -- 172.21.15.22:0/2068679277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c035070 con 0x7f49781094a0 2024-09-21T04:14:55.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4983e0b740 1 Processor -- start 2024-09-21T04:14:55.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f497c895640 1 -- 172.21.15.22:0/2068679277 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f496c042030 con 0x7f49781094a0 2024-09-21T04:14:55.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4983e0b740 1 -- start start 2024-09-21T04:14:55.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e23510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:55.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e23a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:55.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e23f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:55.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4983e0b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5577b3d0edc0 con 0x5577b3a5c840 2024-09-21T04:14:55.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4983e0b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5577b3d9b1f0 con 0x5577b3a54660 2024-09-21T04:14:55.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4983e0b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5577b3d8a620 con 0x5577b3a7d520 2024-09-21T04:14:55.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f49767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e23f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4976ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e23a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f49777fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e23510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4976ffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e23a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:47388/0 (socket says 172.21.15.22:47388) 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f49767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e23f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42938/0 (socket says 172.21.15.22:42938) 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.995+0000 7f4976ffd640 1 -- 172.21.15.22:0/208845271 learned_addr learned my addr 172.21.15.22:0/208845271 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f49767fc640 1 -- 172.21.15.22:0/208845271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 msgr2=0x5577b3e23510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f49767fc640 1 --2- 172.21.15.22:0/208845271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e23510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f49767fc640 1 -- 172.21.15.22:0/208845271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 msgr2=0x5577b3e23a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f49767fc640 1 --2- 172.21.15.22:0/208845271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e23a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f49767fc640 1 -- 172.21.15.22:0/208845271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577b3d52fd0 con 0x5577b3a5c840 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f4976ffd640 1 --2- 172.21.15.22:0/208845271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e23a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:14:56.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f497c895640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49600b6590 0x7f49600b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f49767fc640 1 --2- 172.21.15.22:0/208845271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e23f90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f496c105280 tx=0x7f496c112e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2068cee300640c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f49777fe640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49600b6590 0x7f49600b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f497c895640 1 -- 172.21.15.22:0/2068679277 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f496c107b70 con 0x7f49781094a0 2024-09-21T04:14:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.996+0000 7f495dffb640 1 -- 172.21.15.22:0/208845271 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c0c97e0 con 0x5577b3a5c840 2024-09-21T04:14:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.997+0000 7f495dffb640 1 -- 172.21.15.22:0/208845271 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f496c0c90a0 con 0x5577b3a5c840 2024-09-21T04:14:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.997+0000 7f495dffb640 1 -- 172.21.15.22:0/208845271 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c0044e0 con 0x5577b3a5c840 2024-09-21T04:14:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.997+0000 7f4983e0b740 1 -- 172.21.15.22:0/208845271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 msgr2=0x5577b3e23f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.997+0000 7f49777fe640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49600b6590 0x7f49600b8aa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f497000a400 tx=0x7f497000d040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.997+0000 7f4983e0b740 1 --2- 172.21.15.22:0/208845271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e23f90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f496c105280 tx=0x7f496c112e80 comp rx=0 tx=0).stop 2024-09-21T04:14:56.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.997+0000 7f4983e0b740 1 -- 172.21.15.22:0/208845271 shutdown_connections 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.997+0000 7f4983e0b740 1 --2- 172.21.15.22:0/208845271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e23f90 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.998+0000 7f4983e0b740 1 --2- 172.21.15.22:0/208845271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e23a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.998+0000 7f4983e0b740 1 --2- 172.21.15.22:0/208845271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e23510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.998+0000 7f4983e0b740 1 -- 172.21.15.22:0/208845271 >> 172.21.15.22:0/208845271 conn(0x5577b3a71910 msgr2=0x5577b3e21400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.998+0000 7f4983e0b740 1 -- 172.21.15.22:0/208845271 shutdown_connections 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.998+0000 7f4983e0b740 1 -- 172.21.15.22:0/208845271 wait complete. 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.998+0000 7f4983e0b740 1 -- start start 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.998+0000 7f4983e0b740 1 Processor -- start 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e2ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e2f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e3ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4983e0b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5577b3d25300 con 0x5577b3a5c840 2024-09-21T04:14:56.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4983e0b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5577b3d8e430 con 0x5577b3a54660 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4983e0b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5577b3bebbb0 con 0x5577b3a7d520 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4983e0b740 10 client.0 _ll_register_callbacks cb 0x5577b3d3f120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e2f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e2f0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42948/0 (socket says 172.21.15.22:42948) 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49767fc640 1 -- 172.21.15.22:0/23247250 learned_addr learned my addr 172.21.15.22:0/23247250 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4976ffd640 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e2ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49777fe640 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e3ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49767fc640 1 -- 172.21.15.22:0/23247250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 msgr2=0x5577b3e3ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49767fc640 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e3ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49767fc640 1 -- 172.21.15.22:0/23247250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 msgr2=0x5577b3e2ebb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49767fc640 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e2ebb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49767fc640 1 -- 172.21.15.22:0/23247250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577b3d14780 con 0x5577b3a5c840 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49777fe640 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e3ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:14:56.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f49767fc640 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e2f0f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f496c0c9f10 tx=0x7f496c02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5802b206d3304f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4956ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4956ffd640 1 -- 172.21.15.22:0/23247250 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c049040 con 0x5577b3a5c840 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:55.999+0000 7f4956ffd640 1 -- 172.21.15.22:0/23247250 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f496c0d70d0 con 0x5577b3a5c840 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4983e0b740 1 -- 172.21.15.22:0/23247250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f496c0c90a0 con 0x5577b3a5c840 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4956ffd640 1 -- 172.21.15.22:0/23247250 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f496c0cd0b0 con 0x5577b3a5c840 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4983e0b740 10 client.16143 fetch_fsmap learned FSMap version 50 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4983e0b740 1 -- 172.21.15.22:0/23247250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5577b3ae8b00 con 0x5577b3a5c840 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4956ffd640 1 -- 172.21.15.22:0/23247250 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f496c0c90a0 con 0x5577b3a5c840 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4956ffd640 1 -- 172.21.15.22:0/23247250 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f496c0ccba0 con 0x5577b3a5c840 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4983e0b740 10 client.16143 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4983e0b740 10 client.16143 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4983e0b740 20 client.16143 populate_metadata read hostname 'smithi022' 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4983e0b740 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5577b3a3bea0 0x5577b3e40ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4983e0b740 4 client.16143 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:14:56.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4983e0b740 1 -- 172.21.15.22:0/23247250 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5577b3d9d140 con 0x5577b3a3bea0 2024-09-21T04:14:56.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.000+0000 7f4976ffd640 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5577b3a3bea0 0x5577b3e40ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.001+0000 7f4956ffd640 10 client.16143 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:14:56.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.001+0000 7f4976ffd640 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5577b3a3bea0 0x5577b3e40ab0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9edb61e9ae877a22 server_cookie=8ffb31c6a917561c in_seq=0 out_seq=0 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4956ffd640 1 -- 172.21.15.22:0/23247250 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5577b3d9d140 con 0x5577b3a3bea0 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4956ffd640 10 client.16143 handle_command_reply: tid=0 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 client.16143 shutdown 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 -- 172.21.15.22:0/23247250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 msgr2=0x5577b3e2f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e2f0f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f496c0c9f10 tx=0x7f496c02a410 comp rx=0 tx=0).stop 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 -- 172.21.15.22:0/23247250 shutdown_connections 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5577b3a3bea0 0x5577b3e40ab0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e3ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e2f0f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 --2- 172.21.15.22:0/23247250 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e2ebb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 -- 172.21.15.22:0/23247250 >> 172.21.15.22:0/23247250 conn(0x5577b3a71910 msgr2=0x5577b3e266a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:56.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4956ffd640 0 client.16143 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:14:56.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 -- 172.21.15.22:0/23247250 shutdown_connections 2024-09-21T04:14:56.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 1 -- 172.21.15.22:0/23247250 wait complete. 2024-09-21T04:14:56.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.002+0000 7f4983e0b740 20 client.16143 trim_cache size 0 max 16384 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f4983e0b740 1 Processor -- start 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f4983e0b740 1 -- start start 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e3aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e30a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e24c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f4983e0b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f49781ae900 con 0x5577b3a5c840 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f4983e0b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f49781b0440 con 0x5577b3a54660 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f4983e0b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f49781aefd0 con 0x5577b3a7d520 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f49767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e30a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f49767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e30a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42954/0 (socket says 172.21.15.22:42954) 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f49767fc640 1 -- 172.21.15.22:0/7579110 learned_addr learned my addr 172.21.15.22:0/7579110 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:56.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f4976ffd640 1 --2- 172.21.15.22:0/7579110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e3aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f49777fe640 1 --2- 172.21.15.22:0/7579110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e24c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f49767fc640 1 -- 172.21.15.22:0/7579110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 msgr2=0x5577b3e24c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f49767fc640 1 --2- 172.21.15.22:0/7579110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e24c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f49767fc640 1 -- 172.21.15.22:0/7579110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 msgr2=0x5577b3e3aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.020+0000 7f49767fc640 1 --2- 172.21.15.22:0/7579110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e3aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.021+0000 7f49767fc640 1 -- 172.21.15.22:0/7579110 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5577b3b5f960 con 0x5577b3a5c840 2024-09-21T04:14:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.021+0000 7f49767fc640 1 --2- 172.21.15.22:0/7579110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e30a90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f496c032a50 tx=0x7f496c112910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70e72ba86e2b9443 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.021+0000 7f495d7fa640 1 -- 172.21.15.22:0/7579110 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c049070 con 0x5577b3a5c840 2024-09-21T04:14:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.021+0000 7f495d7fa640 1 -- 172.21.15.22:0/7579110 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f496c1126e0 con 0x5577b3a5c840 2024-09-21T04:14:56.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.021+0000 7f495d7fa640 1 -- 172.21.15.22:0/7579110 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c0cd290 con 0x5577b3a5c840 2024-09-21T04:14:56.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 -- 172.21.15.22:0/7579110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 msgr2=0x5577b3e30a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:56.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 --2- 172.21.15.22:0/7579110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e30a90 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f496c032a50 tx=0x7f496c112910 comp rx=0 tx=0).stop 2024-09-21T04:14:56.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 -- 172.21.15.22:0/7579110 shutdown_connections 2024-09-21T04:14:56.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 --2- 172.21.15.22:0/7579110 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e24c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 --2- 172.21.15.22:0/7579110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e30a90 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 --2- 172.21.15.22:0/7579110 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e3aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 -- 172.21.15.22:0/7579110 >> 172.21.15.22:0/7579110 conn(0x5577b3a71910 msgr2=0x5577b3e24540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 -- 172.21.15.22:0/7579110 shutdown_connections 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 -- 172.21.15.22:0/7579110 wait complete. 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 -- start start 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.022+0000 7f4983e0b740 1 Processor -- start 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e34cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e35230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f4983e0b740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e35770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f4983e0b740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f49781afd70 con 0x5577b3a5c840 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f4983e0b740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f49781af6a0 con 0x5577b3a54660 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f4983e0b740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f49781ac8e0 con 0x5577b3a7d520 2024-09-21T04:14:56.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f4983e0b740 10 client.0 _ll_register_callbacks cb 0x7f496800b480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f49767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e35230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f49767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e35230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:42968/0 (socket says 172.21.15.22:42968) 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f49767fc640 1 -- 172.21.15.22:0/210230661 learned_addr learned my addr 172.21.15.22:0/210230661 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f49777fe640 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e35770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f4976ffd640 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e34cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f49767fc640 1 -- 172.21.15.22:0/210230661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 msgr2=0x5577b3e35770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f49767fc640 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e35770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f49767fc640 1 -- 172.21.15.22:0/210230661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 msgr2=0x5577b3e34cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f49767fc640 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e34cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f49767fc640 1 -- 172.21.15.22:0/210230661 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5577b3eaa4d0 con 0x5577b3a5c840 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.023+0000 7f4976ffd640 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e34cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f49767fc640 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e35230 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f496c0ce1f0 tx=0x7f496c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=628458f2b3c77ae5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4956ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:14:56.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4956ffd640 1 -- 172.21.15.22:0/210230661 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f496c049070 con 0x5577b3a5c840 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4956ffd640 1 -- 172.21.15.22:0/210230661 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f496c0d70d0 con 0x5577b3a5c840 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4983e0b740 1 -- 172.21.15.22:0/210230661 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f496c1126e0 con 0x5577b3a5c840 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4956ffd640 1 -- 172.21.15.22:0/210230661 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f496c076070 con 0x5577b3a5c840 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4983e0b740 10 client.16149 fetch_fsmap learned FSMap version 50 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4983e0b740 1 -- 172.21.15.22:0/210230661 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5577b3eaa4d0 con 0x5577b3a5c840 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4956ffd640 1 -- 172.21.15.22:0/210230661 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f496c1126e0 con 0x5577b3a5c840 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4956ffd640 1 -- 172.21.15.22:0/210230661 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f496c07b070 con 0x5577b3a5c840 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4983e0b740 10 client.16149 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4983e0b740 10 client.16149 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4983e0b740 20 client.16149 populate_metadata read hostname 'smithi022' 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4983e0b740 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5577b3a11250 0x5577b3eadb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4983e0b740 4 client.16149 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a21c8e08", "release": true, "await": true}] 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.024+0000 7f4983e0b740 1 -- 172.21.15.22:0/210230661 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a21c8e08", "release": true, "await": true}) -- 0x5577b3d98bf0 con 0x5577b3a11250 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.025+0000 7f4976ffd640 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5577b3a11250 0x5577b3eadb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:56.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.025+0000 7f4956ffd640 10 client.16149 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:14:56.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.025+0000 7f4976ffd640 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5577b3a11250 0x5577b3eadb90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=83bef0944a4f9976 server_cookie=1591ed20688684ac in_seq=0 out_seq=0 2024-09-21T04:14:56.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.071+0000 7f4956ffd640 1 -- 172.21.15.22:0/210230661 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5577b3d98bf0 con 0x5577b3a11250 2024-09-21T04:14:56.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.071+0000 7f4956ffd640 10 client.16149 handle_command_reply: tid=0 2024-09-21T04:14:56.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.072+0000 7f4983e0b740 1 client.16149 shutdown 2024-09-21T04:14:56.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.072+0000 7f4983e0b740 1 -- 172.21.15.22:0/210230661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 msgr2=0x5577b3e35230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.072+0000 7f4983e0b740 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e35230 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f496c0ce1f0 tx=0x7f496c009260 comp rx=0 tx=0).stop 2024-09-21T04:14:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.072+0000 7f4983e0b740 1 -- 172.21.15.22:0/210230661 shutdown_connections 2024-09-21T04:14:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.072+0000 7f4983e0b740 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5577b3a11250 0x5577b3eadb90 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.072+0000 7f4983e0b740 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5577b3a7d520 0x5577b3e35770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.072+0000 7f4983e0b740 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5577b3a5c840 0x5577b3e35230 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.072+0000 7f4956ffd640 0 client.16149 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:14:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.072+0000 7f4983e0b740 1 --2- 172.21.15.22:0/210230661 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5577b3a54660 0x5577b3e34cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.072+0000 7f4983e0b740 1 -- 172.21.15.22:0/210230661 >> 172.21.15.22:0/210230661 conn(0x5577b3a71910 msgr2=0x5577b3e24cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:56.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.073+0000 7f4983e0b740 1 -- 172.21.15.22:0/210230661 shutdown_connections 2024-09-21T04:14:56.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.073+0000 7f4983e0b740 1 -- 172.21.15.22:0/210230661 wait complete. 2024-09-21T04:14:56.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.073+0000 7f4983e0b740 20 client.16149 trim_cache size 0 max 16384 2024-09-21T04:14:56.077 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:14:56.077 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:14:56.077 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:14:56.077 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 48, 2024-09-21T04:14:56.077 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:14:56.077 INFO:teuthology.orchestra.run.smithi022.stdout: "a21c8e08": { 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 48, 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 137.8, 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:14:56.078 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:14:56.079 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:14:56.079 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:14:56.079 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:14:56.079 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:14:56.079 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:14:56.079 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:14:56.079 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.074+0000 7f497d897640 1 -- 172.21.15.22:0/2068679277 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49600b6590 msgr2=0x7f49600b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.074+0000 7f497d897640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49600b6590 0x7f49600b8aa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f497000a400 tx=0x7f497000d040 comp rx=0 tx=0).stop 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.074+0000 7f497d897640 1 -- 172.21.15.22:0/2068679277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781094a0 msgr2=0x7f497819aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.074+0000 7f497d897640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781094a0 0x7f497819aa10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f496c005940 tx=0x7f496c0040e0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.074+0000 7f497d897640 1 -- 172.21.15.22:0/2068679277 shutdown_connections 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.074+0000 7f497d897640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49600b6590 0x7f49600b8aa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.074+0000 7f497d897640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4978109df0 0x7f497819fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.074+0000 7f497d897640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f49781094a0 0x7f497819aa10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.074+0000 7f497d897640 1 --2- 172.21.15.22:0/2068679277 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f4978103b60 0x7f497819a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.074+0000 7f497d897640 1 -- 172.21.15.22:0/2068679277 >> 172.21.15.22:0/2068679277 conn(0x7f497807b850 msgr2=0x7f4978107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.075+0000 7f497d897640 1 -- 172.21.15.22:0/2068679277 shutdown_connections 2024-09-21T04:14:56.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:56.075+0000 7f497d897640 1 -- 172.21.15.22:0/2068679277 wait complete. 2024-09-21T04:14:56.825 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:56 smithi022 ceph-mon[31015]: pgmap v748: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 349 KiB/s wr, 53 op/s 2024-09-21T04:14:56.880 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a21c8e08', total seconds elapsed: 21.2 2024-09-21T04:14:56.880 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 17.8 2024-09-21T04:14:56.881 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:14:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:56 smithi060 ceph-mon[33722]: pgmap v748: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 349 KiB/s wr, 53 op/s 2024-09-21T04:14:57.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:56 smithi073 ceph-mon[34443]: pgmap v748: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 9.9 KiB/s rd, 349 KiB/s wr, 53 op/s 2024-09-21T04:14:57.368 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:14:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.996+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/560979323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ac0108b30 msgr2=0x7f7ac010f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.996+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/560979323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ac0108b30 0x7f7ac010f360 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f7ab8009be0 tx=0x7f7ab802a6c0 comp rx=0 tx=0).stop 2024-09-21T04:14:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.997+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/560979323 shutdown_connections 2024-09-21T04:14:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.997+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/560979323 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac01081e0 0x7f7ac01085f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.997+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/560979323 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ac0108b30 0x7f7ac010f360 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.997+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/560979323 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ac01028a0 0x7f7ac0102cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.997+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/560979323 >> 172.21.15.22:0/560979323 conn(0x7f7ac00fe2f0 msgr2=0x7f7ac0100740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.997+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/560979323 shutdown_connections 2024-09-21T04:14:58.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.997+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/560979323 wait complete. 2024-09-21T04:14:58.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.999+0000 7f7ac4bf5640 1 Processor -- start 2024-09-21T04:14:58.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:57.999+0000 7f7ac4bf5640 1 -- start start 2024-09-21T04:14:58.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.000+0000 7f7ac4bf5640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ac01028a0 0x7f7ac0198fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:58.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.000+0000 7f7ac4bf5640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac01081e0 0x7f7ac0199550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:58.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.000+0000 7f7abe59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ac01028a0 0x7f7ac0198fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:58.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.000+0000 7f7abe59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ac01028a0 0x7f7ac0198fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:47416/0 (socket says 172.21.15.22:47416) 2024-09-21T04:14:58.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.000+0000 7f7abe59c640 1 -- 172.21.15.22:0/1168474625 learned_addr learned my addr 172.21.15.22:0/1168474625 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:14:58.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.000+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ac0108b30 0x7f7ac019e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:58.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.000+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0112700 con 0x7f7ac0108b30 2024-09-21T04:14:58.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.000+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0112580 con 0x7f7ac01028a0 2024-09-21T04:14:58.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.000+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ac0112880 con 0x7f7ac01081e0 2024-09-21T04:14:58.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.001+0000 7f7abed9d640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ac0108b30 0x7f7ac019e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:58.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.001+0000 7f7abdd9b640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac01081e0 0x7f7ac0199550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:58.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.001+0000 7f7abe59c640 1 -- 172.21.15.22:0/1168474625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac01081e0 msgr2=0x7f7ac0199550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:58.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.001+0000 7f7abe59c640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac01081e0 0x7f7ac0199550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:58.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.001+0000 7f7abe59c640 1 -- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ac0108b30 msgr2=0x7f7ac019e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:58.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.001+0000 7f7abe59c640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ac0108b30 0x7f7ac019e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:58.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.001+0000 7f7abe59c640 1 -- 172.21.15.22:0/1168474625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac019ef20 con 0x7f7ac01028a0 2024-09-21T04:14:58.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.002+0000 7f7abe59c640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ac01028a0 0x7f7ac0198fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400b4a0 tx=0x7f7ab400b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:58.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.002+0000 7f7aaf7fe640 1 -- 172.21.15.22:0/1168474625 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab400f920 con 0x7f7ac01028a0 2024-09-21T04:14:58.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.002+0000 7f7aaf7fe640 1 -- 172.21.15.22:0/1168474625 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ab400e440 con 0x7f7ac01028a0 2024-09-21T04:14:58.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.002+0000 7f7aaf7fe640 1 -- 172.21.15.22:0/1168474625 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4017680 con 0x7f7ac01028a0 2024-09-21T04:14:58.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.002+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac019f210 con 0x7f7ac01028a0 2024-09-21T04:14:58.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.003+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ac006ae60 con 0x7f7ac01028a0 2024-09-21T04:14:58.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.004+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac019a0e0 con 0x7f7ac01028a0 2024-09-21T04:14:58.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.007+0000 7f7aaf7fe640 1 -- 172.21.15.22:0/1168474625 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7ab400e5f0 con 0x7f7ac01028a0 2024-09-21T04:14:58.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.009+0000 7f7aaf7fe640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7aa80bab30 0x7f7aa80bd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:14:58.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.009+0000 7f7aaf7fe640 1 -- 172.21.15.22:0/1168474625 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7ab40e6b90 con 0x7f7ac01028a0 2024-09-21T04:14:58.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.012+0000 7f7abdd9b640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7aa80bab30 0x7f7aa80bd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:14:58.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.014+0000 7f7aaf7fe640 1 -- 172.21.15.22:0/1168474625 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7ab40b13e0 con 0x7f7ac01028a0 2024-09-21T04:14:58.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.014+0000 7f7abdd9b640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7aa80bab30 0x7f7aa80bd040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0101b40 tx=0x7f7ab0009260 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:14:58.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.460+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7ac010a390 con 0x7f7ac01028a0 2024-09-21T04:14:58.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.461+0000 7f7aaf7fe640 1 -- 172.21.15.22:0/1168474625 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7f7ab40b6320 con 0x7f7ac01028a0 2024-09-21T04:14:58.465 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:14:58.465 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:14:58.465 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:14:58.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.469+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7aa80bab30 msgr2=0x7f7aa80bd040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:58.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.469+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7aa80bab30 0x7f7aa80bd040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7ac0101b40 tx=0x7f7ab0009260 comp rx=0 tx=0).stop 2024-09-21T04:14:58.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.469+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ac01028a0 msgr2=0x7f7ac0198fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:14:58.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.469+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ac01028a0 0x7f7ac0198fb0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7ab400b4a0 tx=0x7f7ab400b960 comp rx=0 tx=0).stop 2024-09-21T04:14:58.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.471+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 shutdown_connections 2024-09-21T04:14:58.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.471+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7aa80bab30 0x7f7aa80bd040 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:58.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.471+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ac01081e0 0x7f7ac0199550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:58.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.471+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ac0108b30 0x7f7ac019e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:58.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.471+0000 7f7ac4bf5640 1 --2- 172.21.15.22:0/1168474625 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ac01028a0 0x7f7ac0198fb0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:14:58.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.471+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 >> 172.21.15.22:0/1168474625 conn(0x7f7ac00fe2f0 msgr2=0x7f7ac0107780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:14:58.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.477+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 shutdown_connections 2024-09-21T04:14:58.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:14:58.478+0000 7f7ac4bf5640 1 -- 172.21.15.22:0/1168474625 wait complete. 2024-09-21T04:14:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 635.0 s, 397.6 tps, lat 919.163 ms stddev 3407.976 2024-09-21T04:14:58.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:58 smithi022 ceph-mon[31015]: pgmap v749: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 377 KiB/s wr, 50 op/s 2024-09-21T04:14:58.827 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:14:58 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1168474625' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:14:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:58 smithi060 ceph-mon[33722]: pgmap v749: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 377 KiB/s wr, 50 op/s 2024-09-21T04:14:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:14:58 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1168474625' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:14:59.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:58 smithi073 ceph-mon[34443]: pgmap v749: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 377 KiB/s wr, 50 op/s 2024-09-21T04:14:59.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:14:58 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1168474625' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:14:59.197 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0' 2024-09-21T04:14:59.197 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 137.8 --await-for 45.0 2024-09-21T04:14:59.694 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:15:00.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.747+0000 7f9632ffd640 1 -- 172.21.15.22:0/1541347209 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96340a03d0 con 0x7f962c09b2b0 2024-09-21T04:15:00.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.748+0000 7f9639754640 1 -- 172.21.15.22:0/1541347209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f962c09b2b0 msgr2=0x7f962c0a1ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:00.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.748+0000 7f9639754640 1 --2- 172.21.15.22:0/1541347209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f962c09b2b0 0x7f962c0a1ae0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f9634066480 tx=0x7f9634098170 comp rx=0 tx=0).stop 2024-09-21T04:15:00.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.748+0000 7f9639754640 1 -- 172.21.15.22:0/1541347209 shutdown_connections 2024-09-21T04:15:00.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.748+0000 7f9639754640 1 --2- 172.21.15.22:0/1541347209 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f962c09a960 0x7f962c09ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.748+0000 7f9639754640 1 --2- 172.21.15.22:0/1541347209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f962c09b2b0 0x7f962c0a1ae0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.748+0000 7f9639754640 1 --2- 172.21.15.22:0/1541347209 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f962c095020 0x7f962c095430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.748+0000 7f9639754640 1 -- 172.21.15.22:0/1541347209 >> 172.21.15.22:0/1541347209 conn(0x7f962c00cd70 msgr2=0x7f962c00d180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:00.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.749+0000 7f9639754640 1 -- 172.21.15.22:0/1541347209 shutdown_connections 2024-09-21T04:15:00.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.749+0000 7f9639754640 1 -- 172.21.15.22:0/1541347209 wait complete. 2024-09-21T04:15:00.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.750+0000 7f9639754640 1 Processor -- start 2024-09-21T04:15:00.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.750+0000 7f9639754640 1 -- start start 2024-09-21T04:15:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.750+0000 7f9639754640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f962c095020 0x7f962c09f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.750+0000 7f9639754640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f962c09a960 0x7f962c09bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.750+0000 7f9639754640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f962c09b2b0 0x7f962c09c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.750+0000 7f9639754640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f962c0a3c90 con 0x7f962c09a960 2024-09-21T04:15:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.750+0000 7f9639754640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f962c0a3b10 con 0x7f962c09b2b0 2024-09-21T04:15:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.750+0000 7f9639754640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f962c0a3e10 con 0x7f962c095020 2024-09-21T04:15:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.751+0000 7f9638f53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f962c09b2b0 0x7f962c09c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.751+0000 7f9638f53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f962c09b2b0 0x7f962c09c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:39410/0 (socket says 172.21.15.22:39410) 2024-09-21T04:15:00.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.751+0000 7f9638f53640 1 -- 172.21.15.22:0/2489366649 learned_addr learned my addr 172.21.15.22:0/2489366649 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:00.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.752+0000 7f96337fe640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f962c09a960 0x7f962c09bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.753+0000 7f96337fe640 1 -- 172.21.15.22:0/2489366649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f962c095020 msgr2=0x7f962c09f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:00.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.753+0000 7f96337fe640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f962c095020 0x7f962c09f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.753+0000 7f96337fe640 1 -- 172.21.15.22:0/2489366649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f962c09b2b0 msgr2=0x7f962c09c1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:00.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.753+0000 7f96337fe640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f962c09b2b0 0x7f962c09c1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.753+0000 7f96337fe640 1 -- 172.21.15.22:0/2489366649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962c13edd0 con 0x7f962c09a960 2024-09-21T04:15:00.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.754+0000 7f96337fe640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f962c09a960 0x7f962c09bab0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f962c008800 tx=0x7f962000db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:00.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.754+0000 7f96317fa640 1 -- 172.21.15.22:0/2489366649 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620017070 con 0x7f962c09a960 2024-09-21T04:15:00.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.754+0000 7f9639754640 1 -- 172.21.15.22:0/2489366649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f962c13efa0 con 0x7f962c09a960 2024-09-21T04:15:00.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.754+0000 7f9639754640 1 -- 172.21.15.22:0/2489366649 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f962c13f450 con 0x7f962c09a960 2024-09-21T04:15:00.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.754+0000 7f96317fa640 1 -- 172.21.15.22:0/2489366649 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9620009820 con 0x7f962c09a960 2024-09-21T04:15:00.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.754+0000 7f96317fa640 1 -- 172.21.15.22:0/2489366649 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620004b20 con 0x7f962c09a960 2024-09-21T04:15:00.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.758+0000 7f9640f2a740 1 Processor -- start 2024-09-21T04:15:00.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.758+0000 7f9640f2a740 1 -- start start 2024-09-21T04:15:00.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.759+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 0x5603dff7c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.759+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff7cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.759+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff7d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.759+0000 7f9640f2a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5603dfef2b90 con 0x5603dfbd5840 2024-09-21T04:15:00.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.759+0000 7f9640f2a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5603dfee1fc0 con 0x5603dfbac980 2024-09-21T04:15:00.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.759+0000 7f9640f2a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5603dfee5dd0 con 0x5603dfbb4b60 2024-09-21T04:15:00.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.759+0000 7f9638f53640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 0x5603dff7c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.759+0000 7f9638f53640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 0x5603dff7c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36432/0 (socket says 172.21.15.22:36432) 2024-09-21T04:15:00.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.759+0000 7f9638f53640 1 -- 172.21.15.22:0/3502051914 learned_addr learned my addr 172.21.15.22:0/3502051914 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:00.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.759+0000 7f9633fff640 1 --2- 172.21.15.22:0/3502051914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff7cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.760+0000 7f9638f53640 1 -- 172.21.15.22:0/3502051914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 msgr2=0x5603dff7d260 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-21T04:15:00.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.760+0000 7f9638f53640 1 --2- 172.21.15.22:0/3502051914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff7d260 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.760+0000 7f9638f53640 1 -- 172.21.15.22:0/3502051914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 msgr2=0x5603dff7cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:00.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.760+0000 7f9638f53640 1 --2- 172.21.15.22:0/3502051914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff7cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.760+0000 7f9638f53640 1 -- 172.21.15.22:0/3502051914 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603dfe69060 con 0x5603dfbd5840 2024-09-21T04:15:00.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.763+0000 7f96317fa640 1 -- 172.21.15.22:0/2489366649 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9620004ce0 con 0x7f962c09a960 2024-09-21T04:15:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.764+0000 7f96317fa640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96240b6600 0x7f96240b8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.764+0000 7f96317fa640 1 -- 172.21.15.22:0/2489366649 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f96200e6d70 con 0x7f962c09a960 2024-09-21T04:15:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.765+0000 7f9638f53640 1 --2- 172.21.15.22:0/3502051914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 0x5603dff7c7e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9634069050 tx=0x7f96340a03d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1c7e0048b70e2f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.765+0000 7f9633fff640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96240b6600 0x7f96240b8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.765+0000 7f961e7fc640 1 -- 172.21.15.22:0/3502051914 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96340b1070 con 0x5603dfbd5840 2024-09-21T04:15:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.765+0000 7f961e7fc640 1 -- 172.21.15.22:0/3502051914 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f963409c040 con 0x5603dfbd5840 2024-09-21T04:15:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.765+0000 7f961e7fc640 1 -- 172.21.15.22:0/3502051914 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9634064050 con 0x5603dfbd5840 2024-09-21T04:15:00.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.767+0000 7f9640f2a740 1 -- 172.21.15.22:0/3502051914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 msgr2=0x5603dff7c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:00.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.767+0000 7f9640f2a740 1 --2- 172.21.15.22:0/3502051914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 0x5603dff7c7e0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f9634069050 tx=0x7f96340a03d0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.767+0000 7f9633fff640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96240b6600 0x7f96240b8b10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x5603dff7b460 tx=0x7f9628009620 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.767+0000 7f9640f2a740 1 -- 172.21.15.22:0/3502051914 shutdown_connections 2024-09-21T04:15:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.767+0000 7f9640f2a740 1 --2- 172.21.15.22:0/3502051914 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff7d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.767+0000 7f9640f2a740 1 --2- 172.21.15.22:0/3502051914 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff7cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.767+0000 7f9640f2a740 1 --2- 172.21.15.22:0/3502051914 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 0x5603dff7c7e0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.767+0000 7f9640f2a740 1 -- 172.21.15.22:0/3502051914 >> 172.21.15.22:0/3502051914 conn(0x5603dfbc9990 msgr2=0x5603dff7a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.768+0000 7f9640f2a740 1 -- 172.21.15.22:0/3502051914 shutdown_connections 2024-09-21T04:15:00.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.768+0000 7f9640f2a740 1 -- 172.21.15.22:0/3502051914 wait complete. 2024-09-21T04:15:00.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.768+0000 7f9640f2a740 1 -- start start 2024-09-21T04:15:00.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.769+0000 7f9640f2a740 1 Processor -- start 2024-09-21T04:15:00.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.769+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff88440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.769+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.769+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 0x5603dff942b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9633fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff88440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9633fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff88440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:39428/0 (socket says 172.21.15.22:39428) 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9640f2a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5603dfd437a0 con 0x5603dfbd5840 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9640f2a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5603dfe870a0 con 0x5603dfbac980 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9640f2a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5603dff8af60 con 0x5603dfbb4b60 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9640f2a740 10 client.0 _ll_register_callbacks cb 0x5603dfe643c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9633fff640 1 -- 172.21.15.22:0/3230397518 learned_addr learned my addr 172.21.15.22:0/3230397518 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9638f53640 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 0x5603dff942b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f96337fe640 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9633fff640 1 -- 172.21.15.22:0/3230397518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 msgr2=0x5603dff889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9633fff640 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff889c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9633fff640 1 -- 172.21.15.22:0/3230397518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 msgr2=0x5603dff942b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9633fff640 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 0x5603dff942b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.770+0000 7f9633fff640 1 -- 172.21.15.22:0/3230397518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603dfe75880 con 0x5603dfbac980 2024-09-21T04:15:00.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.771+0000 7f9633fff640 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff88440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9628004610 tx=0x7f96280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c709ca978b9bcf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:00.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.771+0000 7f96137fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:15:00.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.771+0000 7f96137fe640 1 -- 172.21.15.22:0/3230397518 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9628026430 con 0x5603dfbac980 2024-09-21T04:15:00.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.771+0000 7f9640f2a740 1 -- 172.21.15.22:0/3230397518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f963409c040 con 0x5603dfbac980 2024-09-21T04:15:00.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.771+0000 7f96137fe640 1 -- 172.21.15.22:0/3230397518 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f962801c420 con 0x5603dfbac980 2024-09-21T04:15:00.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.774+0000 7f96137fe640 1 -- 172.21.15.22:0/3230397518 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f962801c620 con 0x5603dfbac980 2024-09-21T04:15:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.776+0000 7f9640f2a740 10 client.25763 fetch_fsmap learned FSMap version 50 2024-09-21T04:15:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.776+0000 7f9640f2a740 1 -- 172.21.15.22:0/3230397518 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5603dfc4fb90 con 0x5603dfbac980 2024-09-21T04:15:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.776+0000 7f96137fe640 1 -- 172.21.15.22:0/3230397518 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f963409c040 con 0x5603dfbac980 2024-09-21T04:15:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.776+0000 7f96137fe640 1 -- 172.21.15.22:0/3230397518 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f9628026ad0 con 0x5603dfbac980 2024-09-21T04:15:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.776+0000 7f9640f2a740 10 client.25763 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:15:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.776+0000 7f9640f2a740 10 client.25763 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:15:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.776+0000 7f9640f2a740 20 client.25763 populate_metadata read hostname 'smithi022' 2024-09-21T04:15:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.776+0000 7f9640f2a740 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5603dfb941c0 0x5603dff9a810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.776+0000 7f9640f2a740 4 client.25763 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:15:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.776+0000 7f9640f2a740 1 -- 172.21.15.22:0/3230397518 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603dfef4ae0 con 0x5603dfb941c0 2024-09-21T04:15:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.777+0000 7f96337fe640 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5603dfb941c0 0x5603dff9a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.778+0000 7f96337fe640 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5603dfb941c0 0x5603dff9a810 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d62a71d7a08c6d2 server_cookie=c6e7928cfef1e046 in_seq=0 out_seq=0 2024-09-21T04:15:00.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.778+0000 7f96137fe640 10 client.25763 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:15:00.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.778+0000 7f96137fe640 1 -- 172.21.15.22:0/3230397518 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5603dfef4ae0 con 0x5603dfb941c0 2024-09-21T04:15:00.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.778+0000 7f96137fe640 10 client.25763 handle_command_reply: tid=0 2024-09-21T04:15:00.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.779+0000 7f9640f2a740 1 client.25763 shutdown 2024-09-21T04:15:00.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.779+0000 7f9640f2a740 1 -- 172.21.15.22:0/3230397518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 msgr2=0x5603dff88440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:00.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.779+0000 7f9640f2a740 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff88440 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9628004610 tx=0x7f96280046c0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.780+0000 7f9640f2a740 1 -- 172.21.15.22:0/3230397518 shutdown_connections 2024-09-21T04:15:00.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.780+0000 7f9640f2a740 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5603dfb941c0 0x5603dff9a810 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.780+0000 7f9640f2a740 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff889c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.780+0000 7f9640f2a740 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbd5840 0x5603dff942b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.780+0000 7f9640f2a740 1 --2- 172.21.15.22:0/3230397518 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff88440 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.781+0000 7f9640f2a740 1 -- 172.21.15.22:0/3230397518 >> 172.21.15.22:0/3230397518 conn(0x5603dfbc9990 msgr2=0x5603dff78d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:00.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.781+0000 7f96137fe640 0 client.25763 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:15:00.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.781+0000 7f9640f2a740 1 -- 172.21.15.22:0/3230397518 shutdown_connections 2024-09-21T04:15:00.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.781+0000 7f9640f2a740 1 -- 172.21.15.22:0/3230397518 wait complete. 2024-09-21T04:15:00.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.781+0000 7f9640f2a740 20 client.25763 trim_cache size 0 max 16384 2024-09-21T04:15:00.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.814+0000 7f9640f2a740 1 Processor -- start 2024-09-21T04:15:00.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.814+0000 7f9640f2a740 1 -- start start 2024-09-21T04:15:00.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.815+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbac980 0x5603dff86ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.815+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff818f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.815+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbd5840 0x5603dff81e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.815+0000 7f9640f2a740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f961800fd20 con 0x5603dfbac980 2024-09-21T04:15:00.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.815+0000 7f9640f2a740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9618011860 con 0x5603dfbd5840 2024-09-21T04:15:00.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.815+0000 7f9640f2a740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f96180103f0 con 0x5603dfbb4b60 2024-09-21T04:15:00.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.815+0000 7f9638f53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbd5840 0x5603dff81e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.815+0000 7f9638f53640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbd5840 0x5603dff81e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:39442/0 (socket says 172.21.15.22:39442) 2024-09-21T04:15:00.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.815+0000 7f9638f53640 1 -- 172.21.15.22:0/4021793895 learned_addr learned my addr 172.21.15.22:0/4021793895 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:00.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.815+0000 7f96337fe640 1 --2- 172.21.15.22:0/4021793895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff818f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.816+0000 7f96337fe640 1 -- 172.21.15.22:0/4021793895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbd5840 msgr2=0x5603dff81e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:00.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.816+0000 7f96337fe640 1 --2- 172.21.15.22:0/4021793895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbd5840 0x5603dff81e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.816+0000 7f96337fe640 1 -- 172.21.15.22:0/4021793895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbac980 msgr2=0x5603dff86ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:00.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.816+0000 7f96337fe640 1 --2- 172.21.15.22:0/4021793895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbac980 0x5603dff86ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.816+0000 7f96337fe640 1 -- 172.21.15.22:0/4021793895 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603dff88b00 con 0x5603dfbb4b60 2024-09-21T04:15:00.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.816+0000 7f96337fe640 1 --2- 172.21.15.22:0/4021793895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff818f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f96200a9d50 tx=0x7f96200e6040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7df81ac35f6b9078 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:00.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.816+0000 7f961dffb640 1 -- 172.21.15.22:0/4021793895 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620020040 con 0x5603dfbb4b60 2024-09-21T04:15:00.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.817+0000 7f961dffb640 1 -- 172.21.15.22:0/4021793895 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96200b1070 con 0x5603dfbb4b60 2024-09-21T04:15:00.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.817+0000 7f961dffb640 1 -- 172.21.15.22:0/4021793895 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9620009c80 con 0x5603dfbb4b60 2024-09-21T04:15:00.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.818+0000 7f9640f2a740 1 -- 172.21.15.22:0/4021793895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 msgr2=0x5603dff818f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:00.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.818+0000 7f9640f2a740 1 --2- 172.21.15.22:0/4021793895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff818f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f96200a9d50 tx=0x7f96200e6040 comp rx=0 tx=0).stop 2024-09-21T04:15:00.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.818+0000 7f9640f2a740 1 -- 172.21.15.22:0/4021793895 shutdown_connections 2024-09-21T04:15:00.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.818+0000 7f9640f2a740 1 --2- 172.21.15.22:0/4021793895 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbb4b60 0x5603dff818f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.818+0000 7f9640f2a740 1 --2- 172.21.15.22:0/4021793895 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbd5840 0x5603dff81e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.818+0000 7f9640f2a740 1 --2- 172.21.15.22:0/4021793895 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbac980 0x5603dff86ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.818+0000 7f9640f2a740 1 -- 172.21.15.22:0/4021793895 >> 172.21.15.22:0/4021793895 conn(0x5603dfbc9990 msgr2=0x5603dff833f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:00.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.818+0000 7f9640f2a740 1 -- 172.21.15.22:0/4021793895 shutdown_connections 2024-09-21T04:15:00.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.819+0000 7f9640f2a740 1 -- 172.21.15.22:0/4021793895 wait complete. 2024-09-21T04:15:00.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.819+0000 7f9640f2a740 1 -- start start 2024-09-21T04:15:00.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.820+0000 7f9640f2a740 1 Processor -- start 2024-09-21T04:15:00.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.820+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff90680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.820+0000 7f9640f2a740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbb4b60 0x5603dff90c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9633fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff90680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9633fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff90680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:39446/0 (socket says 172.21.15.22:39446) 2024-09-21T04:15:00.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9633fff640 1 -- 172.21.15.22:0/764508419 learned_addr learned my addr 172.21.15.22:0/764508419 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:00.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9640f2a740 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbd5840 0x5603dff8b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9618011190 con 0x5603dfbb4b60 2024-09-21T04:15:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9618010ac0 con 0x5603dfbac980 2024-09-21T04:15:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f961800dd00 con 0x5603dfbd5840 2024-09-21T04:15:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9640f2a740 10 client.0 _ll_register_callbacks cb 0x7f9628009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:15:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f96337fe640 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbb4b60 0x5603dff90c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9638f53640 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbd5840 0x5603dff8b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9633fff640 1 -- 172.21.15.22:0/764508419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbd5840 msgr2=0x5603dff8b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9633fff640 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbd5840 0x5603dff8b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.821+0000 7f9633fff640 1 -- 172.21.15.22:0/764508419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbb4b60 msgr2=0x5603dff90c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:00.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.822+0000 7f9633fff640 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbb4b60 0x5603dff90c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:00.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.822+0000 7f9633fff640 1 -- 172.21.15.22:0/764508419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603dff8bb30 con 0x5603dfbac980 2024-09-21T04:15:00.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.822+0000 7f9638f53640 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbd5840 0x5603dff8b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:15:00.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.822+0000 7f9633fff640 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff90680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9628012fd0 tx=0x7f9628004520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=44b731d91b77c0cf server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:00.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.822+0000 7f96137fe640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.822+0000 7f96137fe640 1 -- 172.21.15.22:0/764508419 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962801c420 con 0x5603dfbac980 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.823+0000 7f96137fe640 1 -- 172.21.15.22:0/764508419 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f9628030590 con 0x5603dfbac980 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.823+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96200b1070 con 0x5603dfbac980 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.823+0000 7f96137fe640 1 -- 172.21.15.22:0/764508419 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f9628043050 con 0x5603dfbac980 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.823+0000 7f9640f2a740 10 client.25769 fetch_fsmap learned FSMap version 50 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.823+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5603e0005d70 con 0x5603dfbac980 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.823+0000 7f96137fe640 1 -- 172.21.15.22:0/764508419 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96200b1070 con 0x5603dfbac980 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.823+0000 7f96137fe640 1 -- 172.21.15.22:0/764508419 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f9628005440 con 0x5603dfbac980 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.824+0000 7f9640f2a740 10 client.25769 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.824+0000 7f9640f2a740 10 client.25769 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:15:00.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.824+0000 7f9640f2a740 20 client.25769 populate_metadata read hostname 'smithi022' 2024-09-21T04:15:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.824+0000 7f9640f2a740 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5603dfb69570 0x5603e0008520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.824+0000 7f9640f2a740 4 client.25769 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}] 2024-09-21T04:15:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.824+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 137.8, "await_for": 45.0}) -- 0x5603dfef0590 con 0x5603dfb69570 2024-09-21T04:15:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.824+0000 7f96337fe640 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5603dfb69570 0x5603e0008520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:00.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.825+0000 7f96137fe640 10 client.25769 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:15:00.829 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:00 smithi022 ceph-mon[31015]: pgmap v750: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 422 KiB/s wr, 54 op/s 2024-09-21T04:15:00.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:00.825+0000 7f96337fe640 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5603dfb69570 0x5603e0008520 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54da8b795c8cdb42 server_cookie=4b4913cf2843faa8 in_seq=0 out_seq=0 2024-09-21T04:15:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:00 smithi060 ceph-mon[33722]: pgmap v750: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 422 KiB/s wr, 54 op/s 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f96137fe640 1 -- 172.21.15.22:0/764508419 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5603dfef0590 con 0x5603dfb69570 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f96137fe640 10 client.25769 handle_command_reply: tid=0 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 client.25769 shutdown 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 msgr2=0x5603dff90680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff90680 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9628012fd0 tx=0x7f9628004520 comp rx=0 tx=0).stop 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 shutdown_connections 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5603dfb69570 0x5603e0008520 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5603dfbd5840 0x5603dff8b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5603dfbb4b60 0x5603dff90c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 --2- 172.21.15.22:0/764508419 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5603dfbac980 0x5603dff90680 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:01.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f96137fe640 0 client.25769 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 >> 172.21.15.22:0/764508419 conn(0x5603dfbc9990 msgr2=0x5603dff833f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 shutdown_connections 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 1 -- 172.21.15.22:0/764508419 wait complete. 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.096+0000 7f9640f2a740 20 client.25769 trim_cache size 0 max 16384 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 50, 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stdout: "d40deb2e": { 2024-09-21T04:15:01.101 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 50, 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 137.8, 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:15:01.102 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:15:01.103 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:15:01.103 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:15:01.103 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:15:01.103 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:15:01.103 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:15:01.103 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:15:01.103 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:15:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 -- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96240b6600 msgr2=0x7f96240b8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96240b6600 0x7f96240b8b10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x5603dff7b460 tx=0x7f9628009620 comp rx=0 tx=0).stop 2024-09-21T04:15:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 -- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f962c09a960 msgr2=0x7f962c09bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f962c09a960 0x7f962c09bab0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f962c008800 tx=0x7f962000db30 comp rx=0 tx=0).stop 2024-09-21T04:15:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 -- 172.21.15.22:0/2489366649 shutdown_connections 2024-09-21T04:15:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f96240b6600 0x7f96240b8b10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f962c09b2b0 0x7f962c09c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f962c09a960 0x7f962c09bab0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 --2- 172.21.15.22:0/2489366649 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f962c095020 0x7f962c09f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:01.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 -- 172.21.15.22:0/2489366649 >> 172.21.15.22:0/2489366649 conn(0x7f962c00cd70 msgr2=0x7f962c0966f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 -- 172.21.15.22:0/2489366649 shutdown_connections 2024-09-21T04:15:01.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:01.097+0000 7f9639754640 1 -- 172.21.15.22:0/2489366649 wait complete. 2024-09-21T04:15:01.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:00 smithi073 ceph-mon[34443]: pgmap v750: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 422 KiB/s wr, 54 op/s 2024-09-21T04:15:02.049 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd40deb2e', quiesce took 5.2 seconds. Will release after: 12.600000000000001 2024-09-21T04:15:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:02 smithi060 ceph-mon[33722]: pgmap v751: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.7 MiB/s wr, 174 op/s 2024-09-21T04:15:03.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:02 smithi022 ceph-mon[31015]: pgmap v751: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.7 MiB/s wr, 174 op/s 2024-09-21T04:15:03.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:02 smithi073 ceph-mon[34443]: pgmap v751: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.7 MiB/s wr, 174 op/s 2024-09-21T04:15:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 640.0 s, 312.4 tps, lat 138.620 ms stddev 71.421 2024-09-21T04:15:04.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:04 smithi022 ceph-mon[31015]: pgmap v752: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.0 MiB/s wr, 285 op/s 2024-09-21T04:15:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:04 smithi060 ceph-mon[33722]: pgmap v752: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.0 MiB/s wr, 285 op/s 2024-09-21T04:15:05.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:04 smithi073 ceph-mon[34443]: pgmap v752: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.0 MiB/s wr, 285 op/s 2024-09-21T04:15:06.954 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:06 smithi060 ceph-mon[33722]: pgmap v753: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.2 MiB/s wr, 303 op/s 2024-09-21T04:15:07.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:06 smithi022 ceph-mon[31015]: pgmap v753: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.2 MiB/s wr, 303 op/s 2024-09-21T04:15:07.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:06 smithi073 ceph-mon[34443]: pgmap v753: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.2 MiB/s wr, 303 op/s 2024-09-21T04:15:08.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 645.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:15:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:08 smithi060 ceph-mon[33722]: pgmap v754: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.1 MiB/s wr, 298 op/s 2024-09-21T04:15:09.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:08 smithi022 ceph-mon[31015]: pgmap v754: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.1 MiB/s wr, 298 op/s 2024-09-21T04:15:09.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:08 smithi073 ceph-mon[34443]: pgmap v754: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 3.1 MiB/s wr, 298 op/s 2024-09-21T04:15:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:10 smithi060 ceph-mon[33722]: pgmap v755: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.0 MiB/s wr, 282 op/s 2024-09-21T04:15:11.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:10 smithi022 ceph-mon[31015]: pgmap v755: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.0 MiB/s wr, 282 op/s 2024-09-21T04:15:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:10 smithi073 ceph-mon[34443]: pgmap v755: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 3.0 MiB/s wr, 282 op/s 2024-09-21T04:15:12.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:12 smithi060 ceph-mon[33722]: pgmap v756: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 277 op/s 2024-09-21T04:15:13.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:12 smithi022 ceph-mon[31015]: pgmap v756: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 277 op/s 2024-09-21T04:15:13.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:12 smithi073 ceph-mon[34443]: pgmap v756: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 MiB/s wr, 277 op/s 2024-09-21T04:15:13.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 650.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:15:14.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:15:14.918 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:15:14.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:14 smithi060 ceph-mon[33722]: pgmap v757: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.7 MiB/s wr, 163 op/s 2024-09-21T04:15:15.039 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:14 smithi022 ceph-mon[31015]: pgmap v757: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.7 MiB/s wr, 163 op/s 2024-09-21T04:15:15.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:14 smithi073 ceph-mon[34443]: pgmap v757: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 1.7 MiB/s wr, 163 op/s 2024-09-21T04:15:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.419+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/4156549811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb49c10de60 msgr2=0x7fb49c110330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.419+0000 7fb4a3eaf640 1 --2- 172.21.15.22:0/4156549811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb49c10de60 0x7fb49c110330 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb494009900 tx=0x7fb49402a410 comp rx=0 tx=0).stop 2024-09-21T04:15:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.419+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/4156549811 shutdown_connections 2024-09-21T04:15:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.419+0000 7fb4a3eaf640 1 --2- 172.21.15.22:0/4156549811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c1052e0 0x7fb49c10d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.419+0000 7fb4a3eaf640 1 --2- 172.21.15.22:0/4156549811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb49c10de60 0x7fb49c110330 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:15.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.419+0000 7fb4a3eaf640 1 --2- 172.21.15.22:0/4156549811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb49c1048b0 0x7fb49c104cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.419+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/4156549811 >> 172.21.15.22:0/4156549811 conn(0x7fb49c079750 msgr2=0x7fb49c079b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.419+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/4156549811 shutdown_connections 2024-09-21T04:15:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.419+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/4156549811 wait complete. 2024-09-21T04:15:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a3eaf640 1 Processor -- start 2024-09-21T04:15:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a3eaf640 1 -- start start 2024-09-21T04:15:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a3eaf640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb49c1048b0 0x7fb49c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a3eaf640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c1052e0 0x7fb49c19a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a3eaf640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb49c10de60 0x7fb49c19fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a3eaf640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c113950 con 0x7fb49c10de60 2024-09-21T04:15:15.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a3eaf640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c1137d0 con 0x7fb49c1048b0 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a3eaf640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb49c113ad0 con 0x7fb49c1052e0 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a244c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb49c10de60 0x7fb49c19fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a244c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb49c10de60 0x7fb49c19fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38830/0 (socket says 172.21.15.22:38830) 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a244c640 1 -- 172.21.15.22:0/2388226211 learned_addr learned my addr 172.21.15.22:0/2388226211 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a144a640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c1052e0 0x7fb49c19a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.420+0000 7fb4a1c4b640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb49c1048b0 0x7fb49c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb4a244c640 1 -- 172.21.15.22:0/2388226211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c1052e0 msgr2=0x7fb49c19a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb4a244c640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c1052e0 0x7fb49c19a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb4a244c640 1 -- 172.21.15.22:0/2388226211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb49c1048b0 msgr2=0x7fb49c19a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb4a244c640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb49c1048b0 0x7fb49c19a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:15.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb4a244c640 1 -- 172.21.15.22:0/2388226211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb49c1a0390 con 0x7fb49c10de60 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb4a244c640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb49c10de60 0x7fb49c19fc60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb494005ab0 tx=0x7fb4940040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb49affd640 1 -- 172.21.15.22:0/2388226211 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb49403f030 con 0x7fb49c10de60 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb49affd640 1 -- 172.21.15.22:0/2388226211 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb494003a80 con 0x7fb49c10de60 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/2388226211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb49c1a0620 con 0x7fb49c10de60 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb49affd640 1 -- 172.21.15.22:0/2388226211 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb494035070 con 0x7fb49c10de60 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.421+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/2388226211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb49c1a6de0 con 0x7fb49c10de60 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.422+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/2388226211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb49c06c180 con 0x7fb49c10de60 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.424+0000 7fb49affd640 1 -- 172.21.15.22:0/2388226211 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb494042030 con 0x7fb49c10de60 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.425+0000 7fb49affd640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb4840b6510 0x7fb4840b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.425+0000 7fb4a1c4b640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb4840b6510 0x7fb4840b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:15.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.425+0000 7fb49affd640 1 -- 172.21.15.22:0/2388226211 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fb494107b60 con 0x7fb49c10de60 2024-09-21T04:15:15.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.425+0000 7fb4a1c4b640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb4840b6510 0x7fb4840b8a20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb49c06c880 tx=0x7fb48c009720 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:15.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.429+0000 7fb49affd640 1 -- 172.21.15.22:0/2388226211 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4940d2410 con 0x7fb49c10de60 2024-09-21T04:15:15.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.658+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/2388226211 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb49c108a00 con 0x7fb49c10de60 2024-09-21T04:15:15.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.659+0000 7fb49affd640 1 -- 172.21.15.22:0/2388226211 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7fb4940d7350 con 0x7fb49c10de60 2024-09-21T04:15:15.662 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:15:15.662 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:15:15.663 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/2388226211 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb4840b6510 msgr2=0x7fb4840b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb4840b6510 0x7fb4840b8a20 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb49c06c880 tx=0x7fb48c009720 comp rx=0 tx=0).stop 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/2388226211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb49c10de60 msgr2=0x7fb49c19fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb49c10de60 0x7fb49c19fc60 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb494005ab0 tx=0x7fb4940040e0 comp rx=0 tx=0).stop 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/2388226211 shutdown_connections 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb4840b6510 0x7fb4840b8a20 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb49c1052e0 0x7fb49c19a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb49c10de60 0x7fb49c19fc60 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 --2- 172.21.15.22:0/2388226211 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb49c1048b0 0x7fb49c19a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/2388226211 >> 172.21.15.22:0/2388226211 conn(0x7fb49c079750 msgr2=0x7fb49c0ff7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:15.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.661+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/2388226211 shutdown_connections 2024-09-21T04:15:15.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:15.662+0000 7fb4a3eaf640 1 -- 172.21.15.22:0/2388226211 wait complete. 2024-09-21T04:15:15.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:15 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2388226211' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:15:15.966 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:15 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2388226211' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:15:16.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:15 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2388226211' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:15:16.513 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id d40deb2e --release --await' 2024-09-21T04:15:16.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id d40deb2e --release --await 2024-09-21T04:15:16.787 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:15:16.950 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:16 smithi022 ceph-mon[31015]: pgmap v758: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 374 KiB/s wr, 50 op/s 2024-09-21T04:15:16.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:16 smithi060 ceph-mon[33722]: pgmap v758: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 374 KiB/s wr, 50 op/s 2024-09-21T04:15:17.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:16 smithi073 ceph-mon[34443]: pgmap v758: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.6 KiB/s rd, 374 KiB/s wr, 50 op/s 2024-09-21T04:15:17.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.312+0000 7ff08c65a640 1 -- 172.21.15.22:0/729071806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0841094a0 msgr2=0x7ff0841098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.312+0000 7ff08c65a640 1 --2- 172.21.15.22:0/729071806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0841094a0 0x7ff0841098b0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7ff074009900 tx=0x7ff07402a410 comp rx=0 tx=0).stop 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.312+0000 7ff08c65a640 1 -- 172.21.15.22:0/729071806 shutdown_connections 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.312+0000 7ff08c65a640 1 --2- 172.21.15.22:0/729071806 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff084109df0 0x7ff084110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.312+0000 7ff08c65a640 1 --2- 172.21.15.22:0/729071806 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0841094a0 0x7ff0841098b0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.312+0000 7ff08c65a640 1 --2- 172.21.15.22:0/729071806 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff084103b60 0x7ff084103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.312+0000 7ff08c65a640 1 -- 172.21.15.22:0/729071806 >> 172.21.15.22:0/729071806 conn(0x7ff08407b850 msgr2=0x7ff08407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.312+0000 7ff08c65a640 1 -- 172.21.15.22:0/729071806 shutdown_connections 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.312+0000 7ff08c65a640 1 -- 172.21.15.22:0/729071806 wait complete. 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff08c65a640 1 Processor -- start 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff08c65a640 1 -- start start 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff08c65a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff084103b60 0x7ff084075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff08c65a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0841094a0 0x7ff084075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff08c65a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff084109df0 0x7ff084076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff08c65a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff084113960 con 0x7ff0841094a0 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff08c65a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff0841137e0 con 0x7ff084103b60 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff08c65a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff084113ae0 con 0x7ff084109df0 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff089bf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0841094a0 0x7ff084075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff089bf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0841094a0 0x7ff084075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38844/0 (socket says 172.21.15.22:38844) 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff089bf5640 1 -- 172.21.15.22:0/2405910626 learned_addr learned my addr 172.21.15.22:0/2405910626 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff08abf7640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff084109df0 0x7ff084076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff08a3f6640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff084103b60 0x7ff084075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff089bf5640 1 -- 172.21.15.22:0/2405910626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff084109df0 msgr2=0x7ff084076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff089bf5640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff084109df0 0x7ff084076190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff089bf5640 1 -- 172.21.15.22:0/2405910626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff084103b60 msgr2=0x7ff084075710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:17.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff089bf5640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff084103b60 0x7ff084075710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.313+0000 7ff089bf5640 1 -- 172.21.15.22:0/2405910626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0841a8750 con 0x7ff0841094a0 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.314+0000 7ff089bf5640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0841094a0 0x7ff084075c50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff074005940 tx=0x7ff0740040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.314+0000 7ff07b7fe640 1 -- 172.21.15.22:0/2405910626 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07403f030 con 0x7ff0841094a0 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.314+0000 7ff08c65a640 1 -- 172.21.15.22:0/2405910626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0841a89e0 con 0x7ff0841094a0 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.314+0000 7ff07b7fe640 1 -- 172.21.15.22:0/2405910626 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff074003a80 con 0x7ff0841094a0 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.314+0000 7ff07b7fe640 1 -- 172.21.15.22:0/2405910626 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074035070 con 0x7ff0841094a0 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.314+0000 7ff08c65a640 1 -- 172.21.15.22:0/2405910626 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0841a8ec0 con 0x7ff0841094a0 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.316+0000 7ff092bce740 1 Processor -- start 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff092bce740 1 -- start start 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff092bce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee5374510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff092bce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fa5660 0x555ee5374a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff092bce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5374f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff092bce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555ee525fdc0 con 0x555ee4fad840 2024-09-21T04:15:17.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff092bce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555ee52ec1f0 con 0x555ee4fce520 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff092bce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555ee52db620 con 0x555ee4fa5660 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff07b7fe640 1 -- 172.21.15.22:0/2405910626 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff074042030 con 0x7ff0841094a0 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff089bf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5374f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff08a3f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fa5660 0x555ee5374a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff089bf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5374f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38848/0 (socket says 172.21.15.22:38848) 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff08a3f6640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fa5660 0x555ee5374a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:36092/0 (socket says 172.21.15.22:36092) 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff089bf5640 1 -- 172.21.15.22:0/919923281 learned_addr learned my addr 172.21.15.22:0/919923281 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.317+0000 7ff08abf7640 1 --2- 172.21.15.22:0/919923281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee5374510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff08abf7640 1 -- 172.21.15.22:0/919923281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fa5660 msgr2=0x555ee5374a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff08abf7640 1 --2- 172.21.15.22:0/919923281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fa5660 0x555ee5374a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff08abf7640 1 -- 172.21.15.22:0/919923281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 msgr2=0x555ee5374f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff08abf7640 1 --2- 172.21.15.22:0/919923281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5374f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff08abf7640 1 -- 172.21.15.22:0/919923281 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ee52a3fd0 con 0x555ee4fce520 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff089bf5640 1 --2- 172.21.15.22:0/919923281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5374f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff08abf7640 1 --2- 172.21.15.22:0/919923281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee5374510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009eb0 tx=0x7ff07c0107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee1a431f43f40a54 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff07b7fe640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff0700b6590 0x7ff0700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff078ff9640 1 -- 172.21.15.22:0/919923281 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c003b70 con 0x555ee4fce520 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff078ff9640 1 -- 172.21.15.22:0/919923281 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff07c015070 con 0x555ee4fce520 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff078ff9640 1 -- 172.21.15.22:0/919923281 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07c01a7a0 con 0x555ee4fce520 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff08a3f6640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff0700b6590 0x7ff0700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.318+0000 7ff07b7fe640 1 -- 172.21.15.22:0/2405910626 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff074107bb0 con 0x7ff0841094a0 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.319+0000 7ff092bce740 1 -- 172.21.15.22:0/919923281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 msgr2=0x555ee5374510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.319+0000 7ff08a3f6640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff0700b6590 0x7ff0700b8aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x555ee5373190 tx=0x7ff08000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.319+0000 7ff092bce740 1 --2- 172.21.15.22:0/919923281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee5374510 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff07c009eb0 tx=0x7ff07c0107a0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.319+0000 7ff092bce740 1 -- 172.21.15.22:0/919923281 shutdown_connections 2024-09-21T04:15:17.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.319+0000 7ff092bce740 1 --2- 172.21.15.22:0/919923281 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fa5660 0x555ee5374a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.319+0000 7ff092bce740 1 --2- 172.21.15.22:0/919923281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5374f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.319+0000 7ff092bce740 1 --2- 172.21.15.22:0/919923281 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee5374510 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.319+0000 7ff092bce740 1 -- 172.21.15.22:0/919923281 >> 172.21.15.22:0/919923281 conn(0x555ee4fc2910 msgr2=0x555ee5372400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.319+0000 7ff092bce740 1 -- 172.21.15.22:0/919923281 shutdown_connections 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.319+0000 7ff092bce740 1 -- 172.21.15.22:0/919923281 wait complete. 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff092bce740 1 -- start start 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff092bce740 1 Processor -- start 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff092bce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee537fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff092bce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fad840 0x555ee53800d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff092bce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee538be60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff092bce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555ee5276300 con 0x555ee4fa5660 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff092bce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555ee52df430 con 0x555ee4fce520 2024-09-21T04:15:17.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff092bce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555ee513cbb0 con 0x555ee4fad840 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff092bce740 10 client.0 _ll_register_callbacks cb 0x555ee5290120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff08a3f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee537fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff08a3f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee537fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38858/0 (socket says 172.21.15.22:38858) 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff08a3f6640 1 -- 172.21.15.22:0/2865321274 learned_addr learned my addr 172.21.15.22:0/2865321274 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff089bf5640 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fad840 0x555ee53800d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.320+0000 7ff08abf7640 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee538be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff08a3f6640 1 -- 172.21.15.22:0/2865321274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fad840 msgr2=0x555ee53800d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff08a3f6640 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fad840 0x555ee53800d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff08a3f6640 1 -- 172.21.15.22:0/2865321274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 msgr2=0x555ee538be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff08a3f6640 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee538be60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff08a3f6640 1 -- 172.21.15.22:0/2865321274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ee5265780 con 0x555ee4fa5660 2024-09-21T04:15:17.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff08abf7640 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee538be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff08a3f6640 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee537fb90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff080003d00 tx=0x7ff0800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3f19037c0a37005 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff06dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff06dffb640 1 -- 172.21.15.22:0/2865321274 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08002c060 con 0x555ee4fa5660 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff06dffb640 1 -- 172.21.15.22:0/2865321274 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff080017030 con 0x555ee4fa5660 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff092bce740 1 -- 172.21.15.22:0/2865321274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff07c015070 con 0x555ee4fa5660 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff06dffb640 1 -- 172.21.15.22:0/2865321274 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff080033050 con 0x555ee4fa5660 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff092bce740 10 client.16185 fetch_fsmap learned FSMap version 50 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff092bce740 1 -- 172.21.15.22:0/2865321274 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555ee5039b00 con 0x555ee4fa5660 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.321+0000 7ff06dffb640 1 -- 172.21.15.22:0/2865321274 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff07c015070 con 0x555ee4fa5660 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.322+0000 7ff06dffb640 1 -- 172.21.15.22:0/2865321274 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7ff080011440 con 0x555ee4fa5660 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.322+0000 7ff092bce740 10 client.16185 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.322+0000 7ff092bce740 10 client.16185 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.322+0000 7ff092bce740 20 client.16185 populate_metadata read hostname 'smithi022' 2024-09-21T04:15:17.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.322+0000 7ff092bce740 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555ee4f8cea0 0x555ee5391f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.322+0000 7ff092bce740 4 client.16185 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.322+0000 7ff092bce740 1 -- 172.21.15.22:0/2865321274 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555ee52ee140 con 0x555ee4f8cea0 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.322+0000 7ff089bf5640 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555ee4f8cea0 0x555ee5391f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.323+0000 7ff06dffb640 10 client.16185 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.323+0000 7ff089bf5640 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555ee4f8cea0 0x555ee5391f90 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd32645d99f03e7f server_cookie=6d8c0f26d63f0ee3 in_seq=0 out_seq=0 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.323+0000 7ff06dffb640 1 -- 172.21.15.22:0/2865321274 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555ee52ee140 con 0x555ee4f8cea0 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.323+0000 7ff06dffb640 10 client.16185 handle_command_reply: tid=0 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.323+0000 7ff092bce740 1 client.16185 shutdown 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.323+0000 7ff092bce740 1 -- 172.21.15.22:0/2865321274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 msgr2=0x555ee537fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.323+0000 7ff092bce740 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee537fb90 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7ff080003d00 tx=0x7ff0800046c0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.324+0000 7ff092bce740 1 -- 172.21.15.22:0/2865321274 shutdown_connections 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.324+0000 7ff092bce740 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555ee4f8cea0 0x555ee5391f90 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.324+0000 7ff092bce740 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fad840 0x555ee53800d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.324+0000 7ff092bce740 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee538be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.324+0000 7ff092bce740 1 --2- 172.21.15.22:0/2865321274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee537fb90 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.324+0000 7ff06dffb640 0 client.16185 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.324+0000 7ff092bce740 1 -- 172.21.15.22:0/2865321274 >> 172.21.15.22:0/2865321274 conn(0x555ee4fc2910 msgr2=0x555ee53776f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.324+0000 7ff092bce740 1 -- 172.21.15.22:0/2865321274 shutdown_connections 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.324+0000 7ff092bce740 1 -- 172.21.15.22:0/2865321274 wait complete. 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.324+0000 7ff092bce740 20 client.16185 trim_cache size 0 max 16384 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.341+0000 7ff092bce740 1 Processor -- start 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.341+0000 7ff092bce740 1 -- start start 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.341+0000 7ff092bce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fa5660 0x555ee538bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.341+0000 7ff092bce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5375f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff092bce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fce520 0x555ee53817c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff092bce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0841b2d50 con 0x555ee4fad840 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff092bce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff0841b4890 con 0x555ee4fa5660 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff092bce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff0841b3420 con 0x555ee4fce520 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff089bf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5375f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff089bf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5375f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38870/0 (socket says 172.21.15.22:38870) 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff089bf5640 1 -- 172.21.15.22:0/2408176436 learned_addr learned my addr 172.21.15.22:0/2408176436 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff08a3f6640 1 --2- 172.21.15.22:0/2408176436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fa5660 0x555ee538bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff08abf7640 1 --2- 172.21.15.22:0/2408176436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fce520 0x555ee53817c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff089bf5640 1 -- 172.21.15.22:0/2408176436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fce520 msgr2=0x555ee53817c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff089bf5640 1 --2- 172.21.15.22:0/2408176436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fce520 0x555ee53817c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff089bf5640 1 -- 172.21.15.22:0/2408176436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fa5660 msgr2=0x555ee538bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff089bf5640 1 --2- 172.21.15.22:0/2408176436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fa5660 0x555ee538bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff089bf5640 1 -- 172.21.15.22:0/2408176436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555ee50b0960 con 0x555ee4fad840 2024-09-21T04:15:17.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff08abf7640 1 --2- 172.21.15.22:0/2408176436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fce520 0x555ee53817c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff089bf5640 1 --2- 172.21.15.22:0/2408176436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5375f00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff0740f1150 tx=0x7ff07410b580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6175100b130f38b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.342+0000 7ff06ffff640 1 -- 172.21.15.22:0/2408176436 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074049040 con 0x555ee4fad840 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.343+0000 7ff06ffff640 1 -- 172.21.15.22:0/2408176436 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0740cd4e0 con 0x555ee4fad840 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.343+0000 7ff06ffff640 1 -- 172.21.15.22:0/2408176436 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0740c9140 con 0x555ee4fad840 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.343+0000 7ff092bce740 1 -- 172.21.15.22:0/2408176436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 msgr2=0x555ee5375f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.343+0000 7ff092bce740 1 --2- 172.21.15.22:0/2408176436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5375f00 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7ff0740f1150 tx=0x7ff07410b580 comp rx=0 tx=0).stop 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.343+0000 7ff092bce740 1 -- 172.21.15.22:0/2408176436 shutdown_connections 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.343+0000 7ff092bce740 1 --2- 172.21.15.22:0/2408176436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fce520 0x555ee53817c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.343+0000 7ff092bce740 1 --2- 172.21.15.22:0/2408176436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fad840 0x555ee5375f00 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.343+0000 7ff092bce740 1 --2- 172.21.15.22:0/2408176436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fa5660 0x555ee538bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.343+0000 7ff092bce740 1 -- 172.21.15.22:0/2408176436 >> 172.21.15.22:0/2408176436 conn(0x555ee4fc2910 msgr2=0x555ee53810b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 1 -- 172.21.15.22:0/2408176436 shutdown_connections 2024-09-21T04:15:17.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 1 -- 172.21.15.22:0/2408176436 wait complete. 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 1 -- start start 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 1 Processor -- start 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee5384940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fad840 0x555ee5384f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee53f5a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff0841b41c0 con 0x555ee4fa5660 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff0841b3af0 con 0x555ee4fce520 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff0841b0d30 con 0x555ee4fad840 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff092bce740 10 client.0 _ll_register_callbacks cb 0x7ff080004300 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff08a3f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee5384940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff08a3f6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee5384940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:38872/0 (socket says 172.21.15.22:38872) 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.344+0000 7ff08a3f6640 1 -- 172.21.15.22:0/676577982 learned_addr learned my addr 172.21.15.22:0/676577982 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff08abf7640 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee53f5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff089bf5640 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fad840 0x555ee5384f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff08a3f6640 1 -- 172.21.15.22:0/676577982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fad840 msgr2=0x555ee5384f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:17.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff08a3f6640 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fad840 0x555ee5384f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff08a3f6640 1 -- 172.21.15.22:0/676577982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 msgr2=0x555ee53f5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:15:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff08a3f6640 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee53f5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff08a3f6640 1 -- 172.21.15.22:0/676577982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555ee53f6090 con 0x555ee4fa5660 2024-09-21T04:15:17.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff08abf7640 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee53f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff08a3f6640 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee5384940 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff080011890 tx=0x7ff080011670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233bed2f59b24406 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff06dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff06dffb640 1 -- 172.21.15.22:0/676577982 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff08003b020 con 0x555ee4fa5660 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff06dffb640 1 -- 172.21.15.22:0/676577982 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff080005040 con 0x555ee4fa5660 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff092bce740 1 -- 172.21.15.22:0/676577982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0740cd4e0 con 0x555ee4fa5660 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff06dffb640 1 -- 172.21.15.22:0/676577982 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff080046050 con 0x555ee4fa5660 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff092bce740 10 client.16191 fetch_fsmap learned FSMap version 50 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff092bce740 1 -- 172.21.15.22:0/676577982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555ee53fd460 con 0x555ee4fa5660 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.345+0000 7ff06dffb640 1 -- 172.21.15.22:0/676577982 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0740cd4e0 con 0x555ee4fa5660 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.346+0000 7ff06dffb640 1 -- 172.21.15.22:0/676577982 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7ff080004aa0 con 0x555ee4fa5660 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.346+0000 7ff092bce740 10 client.16191 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.346+0000 7ff092bce740 10 client.16191 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:15:17.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.346+0000 7ff092bce740 20 client.16191 populate_metadata read hostname 'smithi022' 2024-09-21T04:15:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.346+0000 7ff092bce740 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555ee4f62250 0x555ee53ffca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:15:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.346+0000 7ff092bce740 4 client.16191 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d40deb2e", "release": true, "await": true}] 2024-09-21T04:15:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.346+0000 7ff092bce740 1 -- 172.21.15.22:0/676577982 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d40deb2e", "release": true, "await": true}) -- 0x555ee52e9bf0 con 0x555ee4f62250 2024-09-21T04:15:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.346+0000 7ff089bf5640 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555ee4f62250 0x555ee53ffca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:15:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.346+0000 7ff089bf5640 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555ee4f62250 0x555ee53ffca0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=208190283238c834 server_cookie=ef5979b17926c975 in_seq=0 out_seq=0 2024-09-21T04:15:17.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.346+0000 7ff06dffb640 10 client.16191 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:15:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.388+0000 7ff06dffb640 1 -- 172.21.15.22:0/676577982 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555ee52e9bf0 con 0x555ee4f62250 2024-09-21T04:15:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.388+0000 7ff06dffb640 10 client.16191 handle_command_reply: tid=0 2024-09-21T04:15:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 client.16191 shutdown 2024-09-21T04:15:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 -- 172.21.15.22:0/676577982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 msgr2=0x555ee5384940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:17.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee5384940 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff080011890 tx=0x7ff080011670 comp rx=0 tx=0).stop 2024-09-21T04:15:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 -- 172.21.15.22:0/676577982 shutdown_connections 2024-09-21T04:15:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555ee4f62250 0x555ee53ffca0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff06dffb640 0 client.16191 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:15:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555ee4fad840 0x555ee5384f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555ee4fce520 0x555ee53f5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 --2- 172.21.15.22:0/676577982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555ee4fa5660 0x555ee5384940 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 -- 172.21.15.22:0/676577982 >> 172.21.15.22:0/676577982 conn(0x555ee4fc2910 msgr2=0x555ee5375cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:17.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 -- 172.21.15.22:0/676577982 shutdown_connections 2024-09-21T04:15:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.389+0000 7ff092bce740 1 -- 172.21.15.22:0/676577982 wait complete. 2024-09-21T04:15:17.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.390+0000 7ff092bce740 20 client.16191 trim_cache size 0 max 16384 2024-09-21T04:15:17.394 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:15:17.394 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:15:17.394 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:15:17.394 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 52, 2024-09-21T04:15:17.394 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:15:17.394 INFO:teuthology.orchestra.run.smithi022.stdout: "d40deb2e": { 2024-09-21T04:15:17.394 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 52, 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 137.8, 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:15:17.395 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:15:17.396 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:15:17.396 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:15:17.396 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:15:17.396 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:15:17.396 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:15:17.396 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:15:17.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.390+0000 7ff08c65a640 1 -- 172.21.15.22:0/2405910626 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff0700b6590 msgr2=0x7ff0700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.390+0000 7ff08c65a640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff0700b6590 0x7ff0700b8aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x555ee5373190 tx=0x7ff08000b390 comp rx=0 tx=0).stop 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.390+0000 7ff08c65a640 1 -- 172.21.15.22:0/2405910626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0841094a0 msgr2=0x7ff084075c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.390+0000 7ff08c65a640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0841094a0 0x7ff084075c50 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7ff074005940 tx=0x7ff0740040e0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.391+0000 7ff08c65a640 1 -- 172.21.15.22:0/2405910626 shutdown_connections 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.391+0000 7ff08c65a640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff0700b6590 0x7ff0700b8aa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.391+0000 7ff08c65a640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff084109df0 0x7ff084076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.391+0000 7ff08c65a640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff0841094a0 0x7ff084075c50 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.391+0000 7ff08c65a640 1 --2- 172.21.15.22:0/2405910626 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff084103b60 0x7ff084075710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.391+0000 7ff08c65a640 1 -- 172.21.15.22:0/2405910626 >> 172.21.15.22:0/2405910626 conn(0x7ff08407b850 msgr2=0x7ff084105620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.391+0000 7ff08c65a640 1 -- 172.21.15.22:0/2405910626 shutdown_connections 2024-09-21T04:15:17.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:15:17.391+0000 7ff08c65a640 1 -- 172.21.15.22:0/2405910626 wait complete. 2024-09-21T04:15:18.114 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd40deb2e', total seconds elapsed: 21.2 2024-09-21T04:15:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 655.0 s, 253.6 tps, lat 1404.120 ms stddev 4452.664 2024-09-21T04:15:18.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:18 smithi060 ceph-mon[33722]: pgmap v759: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 229 KiB/s wr, 33 op/s 2024-09-21T04:15:19.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:18 smithi022 ceph-mon[31015]: pgmap v759: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 229 KiB/s wr, 33 op/s 2024-09-21T04:15:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:18 smithi073 ceph-mon[34443]: pgmap v759: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 229 KiB/s wr, 33 op/s 2024-09-21T04:15:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:20 smithi060 ceph-mon[33722]: pgmap v760: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 248 KiB/s wr, 35 op/s 2024-09-21T04:15:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:20 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:15:21.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:20 smithi022 ceph-mon[31015]: pgmap v760: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 248 KiB/s wr, 35 op/s 2024-09-21T04:15:21.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:20 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:15:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:20 smithi073 ceph-mon[34443]: pgmap v760: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 248 KiB/s wr, 35 op/s 2024-09-21T04:15:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:20 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:15:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:15:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:15:21.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:21 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:15:22.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:15:22.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:15:22.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:21 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:15:22.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:15:22.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:15:22.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:21 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:15:22.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:22 smithi060 ceph-mon[33722]: pgmap v761: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 947 KiB/s wr, 124 op/s 2024-09-21T04:15:23.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:22 smithi022 ceph-mon[31015]: pgmap v761: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 947 KiB/s wr, 124 op/s 2024-09-21T04:15:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:22 smithi073 ceph-mon[34443]: pgmap v761: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 947 KiB/s wr, 124 op/s 2024-09-21T04:15:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 660.0 s, 802.5 tps, lat 126.088 ms stddev 49.302 2024-09-21T04:15:24.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:24 smithi060 ceph-mon[33722]: pgmap v762: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.8 MiB/s wr, 274 op/s 2024-09-21T04:15:25.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:24 smithi022 ceph-mon[31015]: pgmap v762: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.8 MiB/s wr, 274 op/s 2024-09-21T04:15:25.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:24 smithi073 ceph-mon[34443]: pgmap v762: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 2.8 MiB/s wr, 274 op/s 2024-09-21T04:15:27.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:26 smithi022 ceph-mon[31015]: pgmap v763: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 390 op/s 2024-09-21T04:15:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:26 smithi073 ceph-mon[34443]: pgmap v763: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 390 op/s 2024-09-21T04:15:27.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:26 smithi060 ceph-mon[33722]: pgmap v763: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 4.0 MiB/s wr, 390 op/s 2024-09-21T04:15:28.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 665.0 s, 727.6 tps, lat 135.017 ms stddev 51.830 2024-09-21T04:15:29.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:28 smithi022 ceph-mon[31015]: pgmap v764: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 559 op/s 2024-09-21T04:15:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:28 smithi073 ceph-mon[34443]: pgmap v764: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 559 op/s 2024-09-21T04:15:29.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:28 smithi060 ceph-mon[33722]: pgmap v764: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.7 MiB/s wr, 559 op/s 2024-09-21T04:15:31.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:30 smithi022 ceph-mon[31015]: pgmap v765: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.2 MiB/s wr, 599 op/s 2024-09-21T04:15:31.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:30 smithi073 ceph-mon[34443]: pgmap v765: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.2 MiB/s wr, 599 op/s 2024-09-21T04:15:31.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:30 smithi060 ceph-mon[33722]: pgmap v765: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 6.2 MiB/s wr, 599 op/s 2024-09-21T04:15:33.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:32 smithi022 ceph-mon[31015]: pgmap v766: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.4 MiB/s wr, 753 op/s 2024-09-21T04:15:33.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:32 smithi073 ceph-mon[34443]: pgmap v766: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.4 MiB/s wr, 753 op/s 2024-09-21T04:15:33.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:32 smithi060 ceph-mon[33722]: pgmap v766: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.4 MiB/s wr, 753 op/s 2024-09-21T04:15:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 670.0 s, 708.7 tps, lat 142.278 ms stddev 104.629 2024-09-21T04:15:35.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:34 smithi022 ceph-mon[31015]: pgmap v767: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.5 MiB/s wr, 815 op/s 2024-09-21T04:15:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:34 smithi073 ceph-mon[34443]: pgmap v767: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.5 MiB/s wr, 815 op/s 2024-09-21T04:15:35.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:34 smithi060 ceph-mon[33722]: pgmap v767: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 8.5 MiB/s wr, 815 op/s 2024-09-21T04:15:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:36 smithi022 ceph-mon[31015]: pgmap v768: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 778 op/s 2024-09-21T04:15:37.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:36 smithi073 ceph-mon[34443]: pgmap v768: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 778 op/s 2024-09-21T04:15:37.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:36 smithi060 ceph-mon[33722]: pgmap v768: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.8 MiB/s wr, 778 op/s 2024-09-21T04:15:38.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 675.0 s, 773.2 tps, lat 129.554 ms stddev 79.387 2024-09-21T04:15:39.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:38 smithi022 ceph-mon[31015]: pgmap v769: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.2 MiB/s wr, 825 op/s 2024-09-21T04:15:39.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:38 smithi073 ceph-mon[34443]: pgmap v769: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.2 MiB/s wr, 825 op/s 2024-09-21T04:15:39.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:38 smithi060 ceph-mon[33722]: pgmap v769: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 8.2 MiB/s wr, 825 op/s 2024-09-21T04:15:41.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:40 smithi022 ceph-mon[31015]: pgmap v770: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.8 MiB/s wr, 684 op/s 2024-09-21T04:15:41.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:40 smithi073 ceph-mon[34443]: pgmap v770: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.8 MiB/s wr, 684 op/s 2024-09-21T04:15:41.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:40 smithi060 ceph-mon[33722]: pgmap v770: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.8 MiB/s wr, 684 op/s 2024-09-21T04:15:43.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:42 smithi022 ceph-mon[31015]: pgmap v771: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.5 MiB/s wr, 794 op/s 2024-09-21T04:15:43.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:42 smithi073 ceph-mon[34443]: pgmap v771: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.5 MiB/s wr, 794 op/s 2024-09-21T04:15:43.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:42 smithi060 ceph-mon[33722]: pgmap v771: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.5 MiB/s wr, 794 op/s 2024-09-21T04:15:43.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 680.0 s, 741.2 tps, lat 135.301 ms stddev 76.739 2024-09-21T04:15:45.004 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:44 smithi060 ceph-mon[33722]: pgmap v772: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.8 MiB/s wr, 785 op/s 2024-09-21T04:15:45.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:44 smithi022 ceph-mon[31015]: pgmap v772: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.8 MiB/s wr, 785 op/s 2024-09-21T04:15:45.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:44 smithi073 ceph-mon[34443]: pgmap v772: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 7.8 MiB/s wr, 785 op/s 2024-09-21T04:15:47.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:46 smithi022 ceph-mon[31015]: pgmap v773: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 757 op/s 2024-09-21T04:15:47.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:46 smithi073 ceph-mon[34443]: pgmap v773: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 757 op/s 2024-09-21T04:15:47.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:46 smithi060 ceph-mon[33722]: pgmap v773: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 7.5 MiB/s wr, 757 op/s 2024-09-21T04:15:48.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 685.0 s, 794.6 tps, lat 122.693 ms stddev 59.697 2024-09-21T04:15:49.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:48 smithi022 ceph-mon[31015]: pgmap v774: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 806 op/s 2024-09-21T04:15:49.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:48 smithi073 ceph-mon[34443]: pgmap v774: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 806 op/s 2024-09-21T04:15:49.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:48 smithi060 ceph-mon[33722]: pgmap v774: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.9 MiB/s wr, 806 op/s 2024-09-21T04:15:51.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:50 smithi022 ceph-mon[31015]: pgmap v775: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 673 op/s 2024-09-21T04:15:51.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:50 smithi073 ceph-mon[34443]: pgmap v775: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 673 op/s 2024-09-21T04:15:51.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:50 smithi060 ceph-mon[33722]: pgmap v775: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.4 MiB/s wr, 673 op/s 2024-09-21T04:15:53.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:52 smithi022 ceph-mon[31015]: pgmap v776: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 821 op/s 2024-09-21T04:15:53.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:52 smithi073 ceph-mon[34443]: pgmap v776: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 821 op/s 2024-09-21T04:15:53.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:52 smithi060 ceph-mon[33722]: pgmap v776: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 8.0 MiB/s wr, 821 op/s 2024-09-21T04:15:53.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 690.0 s, 795.4 tps, lat 128.620 ms stddev 98.471 2024-09-21T04:15:55.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:54 smithi022 ceph-mon[31015]: pgmap v777: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 791 op/s 2024-09-21T04:15:55.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:54 smithi073 ceph-mon[34443]: pgmap v777: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 791 op/s 2024-09-21T04:15:55.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:54 smithi060 ceph-mon[33722]: pgmap v777: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.9 MiB/s wr, 791 op/s 2024-09-21T04:15:57.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:56 smithi022 ceph-mon[31015]: pgmap v778: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 794 op/s 2024-09-21T04:15:57.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:56 smithi073 ceph-mon[34443]: pgmap v778: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 794 op/s 2024-09-21T04:15:57.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:56 smithi060 ceph-mon[33722]: pgmap v778: 129 pgs: 129 active+clean; 1.4 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.1 MiB/s wr, 794 op/s 2024-09-21T04:15:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 695.0 s, 774.8 tps, lat 130.078 ms stddev 69.471 2024-09-21T04:15:59.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:15:58 smithi022 ceph-mon[31015]: pgmap v779: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 836 op/s 2024-09-21T04:15:59.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:15:58 smithi073 ceph-mon[34443]: pgmap v779: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 836 op/s 2024-09-21T04:15:59.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:15:58 smithi060 ceph-mon[33722]: pgmap v779: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 8.2 MiB/s wr, 836 op/s 2024-09-21T04:16:01.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:00 smithi022 ceph-mon[31015]: pgmap v780: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 MiB/s wr, 702 op/s 2024-09-21T04:16:01.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:00 smithi073 ceph-mon[34443]: pgmap v780: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 MiB/s wr, 702 op/s 2024-09-21T04:16:01.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:00 smithi060 ceph-mon[33722]: pgmap v780: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 6.8 MiB/s wr, 702 op/s 2024-09-21T04:16:03.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:02 smithi022 ceph-mon[31015]: pgmap v781: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.1 MiB/s wr, 833 op/s 2024-09-21T04:16:03.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:02 smithi073 ceph-mon[34443]: pgmap v781: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.1 MiB/s wr, 833 op/s 2024-09-21T04:16:03.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:02 smithi060 ceph-mon[33722]: pgmap v781: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.1 MiB/s wr, 833 op/s 2024-09-21T04:16:03.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 700.0 s, 775.1 tps, lat 128.165 ms stddev 101.973 2024-09-21T04:16:05.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:04 smithi022 ceph-mon[31015]: pgmap v782: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 786 op/s 2024-09-21T04:16:05.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:04 smithi073 ceph-mon[34443]: pgmap v782: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 786 op/s 2024-09-21T04:16:05.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:04 smithi060 ceph-mon[33722]: pgmap v782: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.6 MiB/s wr, 786 op/s 2024-09-21T04:16:07.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:06 smithi022 ceph-mon[31015]: pgmap v783: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.4 MiB/s wr, 769 op/s 2024-09-21T04:16:07.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:06 smithi073 ceph-mon[34443]: pgmap v783: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.4 MiB/s wr, 769 op/s 2024-09-21T04:16:07.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:06 smithi060 ceph-mon[33722]: pgmap v783: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 7.4 MiB/s wr, 769 op/s 2024-09-21T04:16:08.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 705.0 s, 780.1 tps, lat 128.610 ms stddev 85.912 2024-09-21T04:16:09.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:08 smithi022 ceph-mon[31015]: pgmap v784: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.3 MiB/s wr, 787 op/s 2024-09-21T04:16:09.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:08 smithi073 ceph-mon[34443]: pgmap v784: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.3 MiB/s wr, 787 op/s 2024-09-21T04:16:09.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:08 smithi060 ceph-mon[33722]: pgmap v784: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.3 MiB/s wr, 787 op/s 2024-09-21T04:16:11.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:10 smithi022 ceph-mon[31015]: pgmap v785: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 660 op/s 2024-09-21T04:16:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:10 smithi073 ceph-mon[34443]: pgmap v785: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 660 op/s 2024-09-21T04:16:11.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:10 smithi060 ceph-mon[33722]: pgmap v785: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.3 MiB/s wr, 660 op/s 2024-09-21T04:16:13.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:12 smithi022 ceph-mon[31015]: pgmap v786: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 778 op/s 2024-09-21T04:16:13.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:12 smithi073 ceph-mon[34443]: pgmap v786: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 778 op/s 2024-09-21T04:16:13.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:12 smithi060 ceph-mon[33722]: pgmap v786: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.3 MiB/s wr, 778 op/s 2024-09-21T04:16:13.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 710.0 s, 734.8 tps, lat 135.469 ms stddev 64.504 2024-09-21T04:16:15.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:14 smithi022 ceph-mon[31015]: pgmap v787: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 752 op/s 2024-09-21T04:16:15.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:14 smithi073 ceph-mon[34443]: pgmap v787: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 752 op/s 2024-09-21T04:16:15.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:14 smithi060 ceph-mon[33722]: pgmap v787: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 7.0 MiB/s wr, 752 op/s 2024-09-21T04:16:16.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:15 smithi060 ceph-mon[33722]: pgmap v788: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 744 op/s 2024-09-21T04:16:16.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:15 smithi022 ceph-mon[31015]: pgmap v788: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 744 op/s 2024-09-21T04:16:16.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:15 smithi073 ceph-mon[34443]: pgmap v788: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 7.0 MiB/s wr, 744 op/s 2024-09-21T04:16:18.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:18 smithi060 ceph-mon[33722]: pgmap v789: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.5 MiB/s wr, 791 op/s 2024-09-21T04:16:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 715.0 s, 740.4 tps, lat 135.163 ms stddev 65.801 2024-09-21T04:16:18.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:18 smithi022 ceph-mon[31015]: pgmap v789: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.5 MiB/s wr, 791 op/s 2024-09-21T04:16:18.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:18 smithi073 ceph-mon[34443]: pgmap v789: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 7.5 MiB/s wr, 791 op/s 2024-09-21T04:16:20.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:20 smithi060 ceph-mon[33722]: pgmap v790: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 652 op/s 2024-09-21T04:16:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:20 smithi022 ceph-mon[31015]: pgmap v790: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 652 op/s 2024-09-21T04:16:20.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:20 smithi073 ceph-mon[34443]: pgmap v790: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.0 MiB/s wr, 652 op/s 2024-09-21T04:16:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:22 smithi060 ceph-mon[33722]: pgmap v791: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.8 MiB/s wr, 763 op/s 2024-09-21T04:16:22.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:16:22.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:22 smithi022 ceph-mon[31015]: pgmap v791: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.8 MiB/s wr, 763 op/s 2024-09-21T04:16:22.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:16:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:22 smithi073 ceph-mon[34443]: pgmap v791: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.8 MiB/s wr, 763 op/s 2024-09-21T04:16:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:16:23.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:16:23.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:16:23.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:16:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 720.0 s, 658.4 tps, lat 151.647 ms stddev 76.438 2024-09-21T04:16:23.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:16:23.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:16:23.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:16:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:16:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:16:23.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:16:24.230 INFO:tasks.quiescer.fs.[cephfs]:Total duration (37.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-09-21T04:16:24.230 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.85 2024-09-21T04:16:24.230 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:16:24.646 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:16:24.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:24 smithi022 ceph-mon[31015]: pgmap v792: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 764 op/s 2024-09-21T04:16:24.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:24 smithi073 ceph-mon[34443]: pgmap v792: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 764 op/s 2024-09-21T04:16:24.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:24 smithi060 ceph-mon[33722]: pgmap v792: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 7.3 MiB/s wr, 764 op/s 2024-09-21T04:16:26.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.074+0000 7fe62c9b0640 1 -- 172.21.15.22:0/1427768294 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe620030bb0 con 0x7fe62810a590 2024-09-21T04:16:26.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.075+0000 7fe62fc16640 1 -- 172.21.15.22:0/1427768294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62810a590 msgr2=0x7fe62810a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:26.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.075+0000 7fe62fc16640 1 --2- 172.21.15.22:0/1427768294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62810a590 0x7fe62810a9a0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe620009ca0 tx=0x7fe62002a8b0 comp rx=0 tx=0).stop 2024-09-21T04:16:26.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.075+0000 7fe62fc16640 1 -- 172.21.15.22:0/1427768294 shutdown_connections 2024-09-21T04:16:26.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.075+0000 7fe62fc16640 1 --2- 172.21.15.22:0/1427768294 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe62810aee0 0x7fe628115fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:26.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.075+0000 7fe62fc16640 1 --2- 172.21.15.22:0/1427768294 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe628116640 0x7fe628118b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:26.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.075+0000 7fe62fc16640 1 --2- 172.21.15.22:0/1427768294 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62810a590 0x7fe62810a9a0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:26.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.075+0000 7fe62fc16640 1 -- 172.21.15.22:0/1427768294 >> 172.21.15.22:0/1427768294 conn(0x7fe628070ec0 msgr2=0x7fe6280712d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:26.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.076+0000 7fe62fc16640 1 -- 172.21.15.22:0/1427768294 shutdown_connections 2024-09-21T04:16:26.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.076+0000 7fe62fc16640 1 -- 172.21.15.22:0/1427768294 wait complete. 2024-09-21T04:16:26.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.077+0000 7fe62fc16640 1 Processor -- start 2024-09-21T04:16:26.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.077+0000 7fe62fc16640 1 -- start start 2024-09-21T04:16:26.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.077+0000 7fe62fc16640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62810a590 0x7fe6281a9290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:26.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.077+0000 7fe62fc16640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe62810aee0 0x7fe6281a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:26.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.077+0000 7fe62fc16640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe628116640 0x7fe6281aead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:26.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.077+0000 7fe62fc16640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe6281227f0 con 0x7fe628116640 2024-09-21T04:16:26.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.077+0000 7fe62fc16640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe628122670 con 0x7fe62810a590 2024-09-21T04:16:26.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.077+0000 7fe62fc16640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe628122970 con 0x7fe62810aee0 2024-09-21T04:16:26.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.078+0000 7fe62e1b3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe628116640 0x7fe6281aead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:26.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.078+0000 7fe62d1b1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe62810aee0 0x7fe6281a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:26.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.078+0000 7fe62d1b1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe62810aee0 0x7fe6281a9830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:55946/0 (socket says 172.21.15.22:55946) 2024-09-21T04:16:26.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.078+0000 7fe62d1b1640 1 -- 172.21.15.22:0/1161588852 learned_addr learned my addr 172.21.15.22:0/1161588852 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:26.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.078+0000 7fe62d9b2640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62810a590 0x7fe6281a9290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:26.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.079+0000 7fe62d1b1640 1 -- 172.21.15.22:0/1161588852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62810a590 msgr2=0x7fe6281a9290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:26.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.079+0000 7fe62d1b1640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62810a590 0x7fe6281a9290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:26.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.079+0000 7fe62d1b1640 1 -- 172.21.15.22:0/1161588852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe628116640 msgr2=0x7fe6281aead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:26.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.079+0000 7fe62d1b1640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe628116640 0x7fe6281aead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:26.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.079+0000 7fe62d1b1640 1 -- 172.21.15.22:0/1161588852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6281af200 con 0x7fe62810aee0 2024-09-21T04:16:26.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.079+0000 7fe62e1b3640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe628116640 0x7fe6281aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:16:26.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.080+0000 7fe62d1b1640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe62810aee0 0x7fe6281a9830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe61800c970 tx=0x7fe61800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:26.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.080+0000 7fe61effd640 1 -- 172.21.15.22:0/1161588852 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618007bb0 con 0x7fe62810aee0 2024-09-21T04:16:26.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.080+0000 7fe62fc16640 1 -- 172.21.15.22:0/1161588852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6281af4f0 con 0x7fe62810aee0 2024-09-21T04:16:26.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.080+0000 7fe62fc16640 1 -- 172.21.15.22:0/1161588852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6281b5c50 con 0x7fe62810aee0 2024-09-21T04:16:26.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.081+0000 7fe61effd640 1 -- 172.21.15.22:0/1161588852 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe618007d50 con 0x7fe62810aee0 2024-09-21T04:16:26.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.081+0000 7fe61effd640 1 -- 172.21.15.22:0/1161588852 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe618004da0 con 0x7fe62810aee0 2024-09-21T04:16:26.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.083+0000 7fe62fc16640 1 -- 172.21.15.22:0/1161588852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe60c005290 con 0x7fe62810aee0 2024-09-21T04:16:26.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.087+0000 7fe61effd640 1 -- 172.21.15.22:0/1161588852 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe618005020 con 0x7fe62810aee0 2024-09-21T04:16:26.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.088+0000 7fe61effd640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe6140b66e0 0x7fe6140b8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:26.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.088+0000 7fe62d9b2640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe6140b66e0 0x7fe6140b8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:26.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.089+0000 7fe61effd640 1 -- 172.21.15.22:0/1161588852 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fe6180e71b0 con 0x7fe62810aee0 2024-09-21T04:16:26.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.089+0000 7fe62d9b2640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe6140b66e0 0x7fe6140b8bf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe620006010 tx=0x7fe620009820 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:26.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.092+0000 7fe61effd640 1 -- 172.21.15.22:0/1161588852 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe618014030 con 0x7fe62810aee0 2024-09-21T04:16:26.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.528+0000 7fe62fc16640 1 -- 172.21.15.22:0/1161588852 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe60c005580 con 0x7fe62810aee0 2024-09-21T04:16:26.533 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:16:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.529+0000 7fe61effd640 1 -- 172.21.15.22:0/1161588852 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7fe6180ad620 con 0x7fe62810aee0 2024-09-21T04:16:26.534 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:16:26.534 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:16:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.533+0000 7fe62fc16640 1 -- 172.21.15.22:0/1161588852 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe6140b66e0 msgr2=0x7fe6140b8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.533+0000 7fe62fc16640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe6140b66e0 0x7fe6140b8bf0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe620006010 tx=0x7fe620009820 comp rx=0 tx=0).stop 2024-09-21T04:16:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.533+0000 7fe62fc16640 1 -- 172.21.15.22:0/1161588852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe62810aee0 msgr2=0x7fe6281a9830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.533+0000 7fe62fc16640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe62810aee0 0x7fe6281a9830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe61800c970 tx=0x7fe61800ce30 comp rx=0 tx=0).stop 2024-09-21T04:16:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.534+0000 7fe62fc16640 1 -- 172.21.15.22:0/1161588852 shutdown_connections 2024-09-21T04:16:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.534+0000 7fe62fc16640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fe6140b66e0 0x7fe6140b8bf0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.534+0000 7fe62fc16640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe62810aee0 0x7fe6281a9830 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.534+0000 7fe62fc16640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe628116640 0x7fe6281aead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.534+0000 7fe62fc16640 1 --2- 172.21.15.22:0/1161588852 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe62810a590 0x7fe6281a9290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.534+0000 7fe62fc16640 1 -- 172.21.15.22:0/1161588852 >> 172.21.15.22:0/1161588852 conn(0x7fe628070ec0 msgr2=0x7fe628073260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:26.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.534+0000 7fe62fc16640 1 -- 172.21.15.22:0/1161588852 shutdown_connections 2024-09-21T04:16:26.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:26.534+0000 7fe62fc16640 1 -- 172.21.15.22:0/1161588852 wait complete. 2024-09-21T04:16:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:26 smithi022 ceph-mon[31015]: pgmap v793: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.6 MiB/s wr, 714 op/s 2024-09-21T04:16:26.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:26 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1161588852' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:16:26.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:26 smithi073 ceph-mon[34443]: pgmap v793: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.6 MiB/s wr, 714 op/s 2024-09-21T04:16:26.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:26 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1161588852' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:16:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:26 smithi060 ceph-mon[33722]: pgmap v793: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.6 MiB/s wr, 714 op/s 2024-09-21T04:16:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:26 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1161588852' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:16:27.457 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0' 2024-09-21T04:16:27.457 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0 2024-09-21T04:16:27.939 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:16:28.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.569+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3412391018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d8103bb0 msgr2=0x7f48d8103fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:28.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.569+0000 7f48ddf4a640 1 --2- 172.21.15.22:0/3412391018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d8103bb0 0x7f48d8103fc0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009860 tx=0x7f48c802a340 comp rx=0 tx=0).stop 2024-09-21T04:16:28.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.569+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3412391018 shutdown_connections 2024-09-21T04:16:28.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.569+0000 7f48ddf4a640 1 --2- 172.21.15.22:0/3412391018 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48d8109e40 0x7f48d8110670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.569+0000 7f48ddf4a640 1 --2- 172.21.15.22:0/3412391018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d81094f0 0x7f48d8109900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.569+0000 7f48ddf4a640 1 --2- 172.21.15.22:0/3412391018 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d8103bb0 0x7f48d8103fc0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.569+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3412391018 >> 172.21.15.22:0/3412391018 conn(0x7f48d80ff5e0 msgr2=0x7f48d8101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:28.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.571+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3412391018 shutdown_connections 2024-09-21T04:16:28.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.571+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3412391018 wait complete. 2024-09-21T04:16:28.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.572+0000 7f48ddf4a640 1 Processor -- start 2024-09-21T04:16:28.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.572+0000 7f48ddf4a640 1 -- start start 2024-09-21T04:16:28.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.572+0000 7f48ddf4a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d8103bb0 0x7f48d819a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.572+0000 7f48ddf4a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48d81094f0 0x7f48d819a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.572+0000 7f48ddf4a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d8109e40 0x7f48d819f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d8103bb0 0x7f48d819a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d8103bb0 0x7f48d819a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:36488/0 (socket says 172.21.15.22:36488) 2024-09-21T04:16:28.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48d7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d8109e40 0x7f48d819f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48d7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d8109e40 0x7f48d819f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48838/0 (socket says 172.21.15.22:48838) 2024-09-21T04:16:28.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48ceffd640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48d81094f0 0x7f48d819a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48d77fe640 1 -- 172.21.15.22:0/3595823447 learned_addr learned my addr 172.21.15.22:0/3595823447 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:28.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48d81139b0 con 0x7f48d8109e40 2024-09-21T04:16:28.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f48d8113830 con 0x7f48d8103bb0 2024-09-21T04:16:28.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f48d8113b30 con 0x7f48d81094f0 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48d7fff640 1 -- 172.21.15.22:0/3595823447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48d81094f0 msgr2=0x7f48d819a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48d7fff640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48d81094f0 0x7f48d819a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48d7fff640 1 -- 172.21.15.22:0/3595823447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d8103bb0 msgr2=0x7f48d819a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48d7fff640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d8103bb0 0x7f48d819a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.573+0000 7f48d7fff640 1 -- 172.21.15.22:0/3595823447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d81a0110 con 0x7f48d8109e40 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.574+0000 7f48d7fff640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d8109e40 0x7f48d819f9e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f48d0005fd0 tx=0x7f48d000be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.574+0000 7f48d57fa640 1 -- 172.21.15.22:0/3595823447 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0004b20 con 0x7f48d8109e40 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.574+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d81a0400 con 0x7f48d8109e40 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.574+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d80755f0 con 0x7f48d8109e40 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.574+0000 7f48d57fa640 1 -- 172.21.15.22:0/3595823447 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48d0004cc0 con 0x7f48d8109e40 2024-09-21T04:16:28.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.575+0000 7f48d57fa640 1 -- 172.21.15.22:0/3595823447 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0005990 con 0x7f48d8109e40 2024-09-21T04:16:28.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.579+0000 7f48e44be740 1 Processor -- start 2024-09-21T04:16:28.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.582+0000 7f48e44be740 1 -- start start 2024-09-21T04:16:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.582+0000 7f48e44be740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55576468a850 0x555764a30e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.582+0000 7f48e44be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a313b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.582+0000 7f48e44be740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a318f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.582+0000 7f48e44be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5557649a7bb0 con 0x555764661990 2024-09-21T04:16:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.582+0000 7f48e44be740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555764996fe0 con 0x555764669b70 2024-09-21T04:16:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.582+0000 7f48e44be740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55576499adf0 con 0x55576468a850 2024-09-21T04:16:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.583+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a313b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.583+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a313b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48842/0 (socket says 172.21.15.22:48842) 2024-09-21T04:16:28.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.583+0000 7f48d77fe640 1 -- 172.21.15.22:0/55842871 learned_addr learned my addr 172.21.15.22:0/55842871 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.583+0000 7f48ceffd640 1 --2- 172.21.15.22:0/55842871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55576468a850 0x555764a30e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.583+0000 7f48ceffd640 1 --2- 172.21.15.22:0/55842871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a318f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.583+0000 7f48d77fe640 1 -- 172.21.15.22:0/55842871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55576468a850 msgr2=0x555764a30e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.583+0000 7f48d77fe640 1 --2- 172.21.15.22:0/55842871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55576468a850 0x555764a30e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.583+0000 7f48d77fe640 1 -- 172.21.15.22:0/55842871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 msgr2=0x555764a318f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.583+0000 7f48d77fe640 1 --2- 172.21.15.22:0/55842871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a318f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.583+0000 7f48d77fe640 1 -- 172.21.15.22:0/55842871 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555764704ba0 con 0x555764661990 2024-09-21T04:16:28.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.584+0000 7f48d77fe640 1 --2- 172.21.15.22:0/55842871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a313b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009780 tx=0x7f48c8005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95934ab59bd05ab server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:28.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.587+0000 7f48d57fa640 1 -- 172.21.15.22:0/3595823447 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f48d0024020 con 0x7f48d8109e40 2024-09-21T04:16:28.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.588+0000 7f48cdffb640 1 -- 172.21.15.22:0/55842871 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8041070 con 0x555764661990 2024-09-21T04:16:28.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.588+0000 7f48cdffb640 1 -- 172.21.15.22:0/55842871 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48c80044c0 con 0x555764661990 2024-09-21T04:16:28.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.588+0000 7f48d57fa640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f48c40b6590 0x7f48c40b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.589+0000 7f48cdffb640 1 -- 172.21.15.22:0/55842871 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8037040 con 0x555764661990 2024-09-21T04:16:28.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.589+0000 7f48d57fa640 1 -- 172.21.15.22:0/3595823447 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f48d00ef8f0 con 0x7f48d8109e40 2024-09-21T04:16:28.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.589+0000 7f48e44be740 1 -- 172.21.15.22:0/55842871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 msgr2=0x555764a313b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:28.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.589+0000 7f48e44be740 1 --2- 172.21.15.22:0/55842871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a313b0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f48c8009780 tx=0x7f48c8005c90 comp rx=0 tx=0).stop 2024-09-21T04:16:28.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.589+0000 7f48e44be740 1 -- 172.21.15.22:0/55842871 shutdown_connections 2024-09-21T04:16:28.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.589+0000 7f48e44be740 1 --2- 172.21.15.22:0/55842871 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a318f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.590+0000 7f48e44be740 1 --2- 172.21.15.22:0/55842871 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a313b0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.590+0000 7f48e44be740 1 --2- 172.21.15.22:0/55842871 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55576468a850 0x555764a30e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.590+0000 7f48e44be740 1 -- 172.21.15.22:0/55842871 >> 172.21.15.22:0/55842871 conn(0x55576467ec40 msgr2=0x555764a2ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:28.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.590+0000 7f48ceffd640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f48c40b6590 0x7f48c40b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.590+0000 7f48e44be740 1 -- 172.21.15.22:0/55842871 shutdown_connections 2024-09-21T04:16:28.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.590+0000 7f48e44be740 1 -- 172.21.15.22:0/55842871 wait complete. 2024-09-21T04:16:28.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.590+0000 7f48e44be740 1 -- start start 2024-09-21T04:16:28.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.591+0000 7f48e44be740 1 Processor -- start 2024-09-21T04:16:28.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.591+0000 7f48e44be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a3c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.591+0000 7f48e44be740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a3cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.591+0000 7f48e44be740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55576468a850 0x555764a48a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.591+0000 7f48e44be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5557647f87b0 con 0x555764661990 2024-09-21T04:16:28.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.591+0000 7f48e44be740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555764931e90 con 0x555764669b70 2024-09-21T04:16:28.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.591+0000 7f48e44be740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555764a3f640 con 0x55576468a850 2024-09-21T04:16:28.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.591+0000 7f48e44be740 10 client.0 _ll_register_callbacks cb 0x555764994710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:16:28.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.592+0000 7f48d7fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55576468a850 0x555764a48a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.592+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a3c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.592+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a3c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48856/0 (socket says 172.21.15.22:48856) 2024-09-21T04:16:28.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.592+0000 7f48d77fe640 1 -- 172.21.15.22:0/1328753 learned_addr learned my addr 172.21.15.22:0/1328753 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.593+0000 7f48d77fe640 1 -- 172.21.15.22:0/1328753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55576468a850 msgr2=0x555764a48a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.593+0000 7f48d77fe640 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55576468a850 0x555764a48a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.593+0000 7f48d77fe640 1 -- 172.21.15.22:0/1328753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 msgr2=0x555764a3cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.593+0000 7f48ceffd640 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a3cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.593+0000 7f48d77fe640 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a3cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.593+0000 7f48d77fe640 1 -- 172.21.15.22:0/1328753 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555764a59f60 con 0x555764661990 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.593+0000 7f48ceffd640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f48c40b6590 0x7f48c40b8aa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48d8105c40 tx=0x7f48c0015040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.593+0000 7f48d77fe640 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a3c980 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f48c802a860 tx=0x7f48c8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49c34a4441a7d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.593+0000 7f48b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.594+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1328753 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8041040 con 0x555764661990 2024-09-21T04:16:28.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.594+0000 7f48e44be740 1 -- 172.21.15.22:0/1328753 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5557649a9b00 con 0x555764661990 2024-09-21T04:16:28.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.594+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1328753 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f48c8032440 con 0x555764661990 2024-09-21T04:16:28.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.594+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1328753 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f48c8032680 con 0x555764661990 2024-09-21T04:16:28.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.594+0000 7f48e44be740 10 client.16209 fetch_fsmap learned FSMap version 50 2024-09-21T04:16:28.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.594+0000 7f48e44be740 1 -- 172.21.15.22:0/1328753 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555764a5c820 con 0x555764661990 2024-09-21T04:16:28.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.595+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1328753 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5557649a9b00 con 0x555764661990 2024-09-21T04:16:28.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.595+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1328753 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f48c80467d0 con 0x555764661990 2024-09-21T04:16:28.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.595+0000 7f48e44be740 10 client.16209 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:16:28.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.595+0000 7f48e44be740 10 client.16209 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:16:28.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.595+0000 7f48e44be740 20 client.16209 populate_metadata read hostname 'smithi022' 2024-09-21T04:16:28.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.595+0000 7f48e44be740 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5557646491d0 0x555764a5fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.595+0000 7f48e44be740 4 client.16209 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:16:28.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.595+0000 7f48e44be740 1 -- 172.21.15.22:0/1328753 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5557649a55b0 con 0x5557646491d0 2024-09-21T04:16:28.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.597+0000 7f48ceffd640 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5557646491d0 0x555764a5fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.598+0000 7f48b6ffd640 10 client.16209 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:28.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.598+0000 7f48ceffd640 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5557646491d0 0x555764a5fb80 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d538642bfd92e3eb server_cookie=d74ab084f3ee82c5 in_seq=0 out_seq=0 2024-09-21T04:16:28.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.598+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1328753 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5557649a55b0 con 0x5557646491d0 2024-09-21T04:16:28.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.598+0000 7f48b6ffd640 10 client.16209 handle_command_reply: tid=0 2024-09-21T04:16:28.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 client.16209 shutdown 2024-09-21T04:16:28.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 -- 172.21.15.22:0/1328753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 msgr2=0x555764a3c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a3c980 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f48c802a860 tx=0x7f48c8000bc0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 -- 172.21.15.22:0/1328753 shutdown_connections 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5557646491d0 0x555764a5fb80 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x55576468a850 0x555764a48a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a3cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 --2- 172.21.15.22:0/1328753 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764661990 0x555764a3c980 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 -- 172.21.15.22:0/1328753 >> 172.21.15.22:0/1328753 conn(0x55576467ec40 msgr2=0x555764a34000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48b6ffd640 0 client.16209 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 -- 172.21.15.22:0/1328753 shutdown_connections 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.599+0000 7f48e44be740 1 -- 172.21.15.22:0/1328753 wait complete. 2024-09-21T04:16:28.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.600+0000 7f48e44be740 20 client.16209 trim_cache size 0 max 16384 2024-09-21T04:16:28.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.634+0000 7f48e44be740 1 Processor -- start 2024-09-21T04:16:28.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.634+0000 7f48e44be740 1 -- start start 2024-09-21T04:16:28.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48e44be740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 0x555764a36f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48e44be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764669b70 0x555764a39970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48e44be740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55576468a850 0x555764a39eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48e44be740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48b800fc40 con 0x555764669b70 2024-09-21T04:16:28.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48e44be740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f48b8011780 con 0x55576468a850 2024-09-21T04:16:28.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48e44be740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f48b8010310 con 0x555764661990 2024-09-21T04:16:28.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 0x555764a36f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48d7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55576468a850 0x555764a39eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48d7fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55576468a850 0x555764a39eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:36510/0 (socket says 172.21.15.22:36510) 2024-09-21T04:16:28.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48d7fff640 1 -- 172.21.15.22:0/2754425658 learned_addr learned my addr 172.21.15.22:0/2754425658 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:28.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.635+0000 7f48ceffd640 1 --2- 172.21.15.22:0/2754425658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764669b70 0x555764a39970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.636+0000 7f48d7fff640 1 -- 172.21.15.22:0/2754425658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 msgr2=0x555764a36f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.636+0000 7f48d7fff640 1 --2- 172.21.15.22:0/2754425658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 0x555764a36f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.636+0000 7f48d7fff640 1 -- 172.21.15.22:0/2754425658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764669b70 msgr2=0x555764a39970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.636+0000 7f48d7fff640 1 --2- 172.21.15.22:0/2754425658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764669b70 0x555764a39970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.636+0000 7f48d7fff640 1 -- 172.21.15.22:0/2754425658 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555764a3f6d0 con 0x55576468a850 2024-09-21T04:16:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.636+0000 7f48d7fff640 1 --2- 172.21.15.22:0/2754425658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55576468a850 0x555764a39eb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48d00ecfd0 tx=0x7f48d00b4e90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=69960ef24f07dc80 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:28.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.637+0000 7f48cd7fa640 1 -- 172.21.15.22:0/2754425658 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d00ba140 con 0x55576468a850 2024-09-21T04:16:28.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.637+0000 7f48cd7fa640 1 -- 172.21.15.22:0/2754425658 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48d00bf080 con 0x55576468a850 2024-09-21T04:16:28.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.637+0000 7f48cd7fa640 1 -- 172.21.15.22:0/2754425658 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d00be320 con 0x55576468a850 2024-09-21T04:16:28.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.638+0000 7f48e44be740 1 -- 172.21.15.22:0/2754425658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55576468a850 msgr2=0x555764a39eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:28.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.638+0000 7f48e44be740 1 --2- 172.21.15.22:0/2754425658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55576468a850 0x555764a39eb0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f48d00ecfd0 tx=0x7f48d00b4e90 comp rx=0 tx=0).stop 2024-09-21T04:16:28.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.639+0000 7f48e44be740 1 -- 172.21.15.22:0/2754425658 shutdown_connections 2024-09-21T04:16:28.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.639+0000 7f48e44be740 1 --2- 172.21.15.22:0/2754425658 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x55576468a850 0x555764a39eb0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.639+0000 7f48e44be740 1 --2- 172.21.15.22:0/2754425658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555764669b70 0x555764a39970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.639+0000 7f48e44be740 1 --2- 172.21.15.22:0/2754425658 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 0x555764a36f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.639+0000 7f48e44be740 1 -- 172.21.15.22:0/2754425658 >> 172.21.15.22:0/2754425658 conn(0x55576467ec40 msgr2=0x555764a32860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:28.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.639+0000 7f48e44be740 1 -- 172.21.15.22:0/2754425658 shutdown_connections 2024-09-21T04:16:28.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.639+0000 7f48e44be740 1 -- 172.21.15.22:0/2754425658 wait complete. 2024-09-21T04:16:28.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.640+0000 7f48e44be740 1 -- start start 2024-09-21T04:16:28.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.641+0000 7f48e44be740 1 Processor -- start 2024-09-21T04:16:28.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.641+0000 7f48e44be740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 0x555764a61670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48e44be740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a61c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48e44be740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55576468a850 0x555764ac22c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 0x555764a61670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 0x555764a61670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:55992/0 (socket says 172.21.15.22:55992) 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48ceffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a61c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48ceffd640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a61c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:36526/0 (socket says 172.21.15.22:36526) 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48d77fe640 1 -- 172.21.15.22:0/1043932917 learned_addr learned my addr 172.21.15.22:0/1043932917 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48d7fff640 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55576468a850 0x555764ac22c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48b80110b0 con 0x55576468a850 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f48b80109e0 con 0x555764669b70 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.642+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f48b800dc20 con 0x555764661990 2024-09-21T04:16:28.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.643+0000 7f48e44be740 10 client.0 _ll_register_callbacks cb 0x7f48d0009460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:16:28.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.643+0000 7f48d77fe640 1 -- 172.21.15.22:0/1043932917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 msgr2=0x555764a61c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:28.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.643+0000 7f48d77fe640 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a61c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.643+0000 7f48d77fe640 1 -- 172.21.15.22:0/1043932917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55576468a850 msgr2=0x555764ac22c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:28.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.643+0000 7f48d77fe640 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55576468a850 0x555764ac22c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.643+0000 7f48d77fe640 1 -- 172.21.15.22:0/1043932917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555764ac2930 con 0x555764661990 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.643+0000 7f48d77fe640 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 0x555764a61670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48c8005cd0 tx=0x7f48c80468f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81e3c0e8978f0d7c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.643+0000 7f48b6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.643+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1043932917 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c8063060 con 0x555764661990 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.644+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1043932917 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f48c8030d80 con 0x555764661990 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.644+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48d00bf080 con 0x555764661990 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.644+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1043932917 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f48c8041070 con 0x555764661990 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.644+0000 7f48e44be740 10 client.25819 fetch_fsmap learned FSMap version 50 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.644+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555764acadd0 con 0x555764661990 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.644+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1043932917 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f48d00bf080 con 0x555764661990 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.644+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1043932917 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f48c8032820 con 0x555764661990 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.645+0000 7f48e44be740 10 client.25819 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:16:28.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.645+0000 7f48e44be740 10 client.25819 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:16:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.645+0000 7f48e44be740 20 client.25819 populate_metadata read hostname 'smithi022' 2024-09-21T04:16:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.645+0000 7f48e44be740 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55576461e580 0x555764acd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.645+0000 7f48e44be740 4 client.25819 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}] 2024-09-21T04:16:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.645+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}) -- 0x5557649a29e0 con 0x55576461e580 2024-09-21T04:16:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.645+0000 7f48ceffd640 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55576461e580 0x555764acd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.646+0000 7f48b6ffd640 10 client.25819 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:28.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.646+0000 7f48ceffd640 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55576461e580 0x555764acd420 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=23f3cf53a79250d0 server_cookie=c23f50de0cb251e9 in_seq=0 out_seq=0 2024-09-21T04:16:28.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 725.0 s, 625.2 tps, lat 158.699 ms stddev 102.931 2024-09-21T04:16:28.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:28 smithi022 ceph-mon[31015]: pgmap v794: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.7 MiB/s wr, 717 op/s 2024-09-21T04:16:28.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:28 smithi073 ceph-mon[34443]: pgmap v794: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.7 MiB/s wr, 717 op/s 2024-09-21T04:16:28.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48b6ffd640 1 -- 172.21.15.22:0/1043932917 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5557649a29e0 con 0x55576461e580 2024-09-21T04:16:28.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48b6ffd640 10 client.25819 handle_command_reply: tid=0 2024-09-21T04:16:28.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 client.25819 shutdown 2024-09-21T04:16:28.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 msgr2=0x555764a61670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:28.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 0x555764a61670 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48c8005cd0 tx=0x7f48c80468f0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 shutdown_connections 2024-09-21T04:16:28.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x55576461e580 0x555764acd420 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55576468a850 0x555764ac22c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555764669b70 0x555764a61c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48b6ffd640 0 client.25819 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 --2- 172.21.15.22:0/1043932917 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555764661990 0x555764a61670 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 >> 172.21.15.22:0/1043932917 conn(0x55576467ec40 msgr2=0x555764a3ac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 shutdown_connections 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.943+0000 7f48e44be740 1 -- 172.21.15.22:0/1043932917 wait complete. 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48e44be740 20 client.25819 trim_cache size 0 max 16384 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 54, 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:16:28.948 INFO:teuthology.orchestra.run.smithi022.stdout: "b2317cf8": { 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 54, 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 138.8, 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:16:28.949 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:16:28.950 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:28.950 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:28.950 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:28.950 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:28.950 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:28.950 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:16:28.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f48c40b6590 msgr2=0x7f48c40b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f48c40b6590 0x7f48c40b8aa0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f48d8105c40 tx=0x7f48c0015040 comp rx=0 tx=0).stop 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d8109e40 msgr2=0x7f48d819f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d8109e40 0x7f48d819f9e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f48d0005fd0 tx=0x7f48d000be70 comp rx=0 tx=0).stop 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 shutdown_connections 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f48c40b6590 0x7f48c40b8aa0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f48d81094f0 0x7f48d819a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48d8109e40 0x7f48d819f9e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 --2- 172.21.15.22:0/3595823447 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f48d8103bb0 0x7f48d819a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 >> 172.21.15.22:0/3595823447 conn(0x7f48d80ff5e0 msgr2=0x7f48d8108a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 shutdown_connections 2024-09-21T04:16:28.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:28.944+0000 7f48ddf4a640 1 -- 172.21.15.22:0/3595823447 wait complete. 2024-09-21T04:16:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:28 smithi060 ceph-mon[33722]: pgmap v794: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.7 MiB/s wr, 717 op/s 2024-09-21T04:16:29.677 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b2317cf8', quiesce took 5.4 seconds. Will release after: 13.450000000000001 2024-09-21T04:16:30.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:30 smithi022 ceph-mon[31015]: pgmap v795: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 597 op/s 2024-09-21T04:16:30.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:30 smithi073 ceph-mon[34443]: pgmap v795: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 597 op/s 2024-09-21T04:16:30.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:30 smithi060 ceph-mon[33722]: pgmap v795: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.7 MiB/s wr, 597 op/s 2024-09-21T04:16:32.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:32 smithi022 ceph-mon[31015]: pgmap v796: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.6 MiB/s wr, 676 op/s 2024-09-21T04:16:32.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:32 smithi073 ceph-mon[34443]: pgmap v796: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.6 MiB/s wr, 676 op/s 2024-09-21T04:16:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:32 smithi060 ceph-mon[33722]: pgmap v796: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 6.6 MiB/s wr, 676 op/s 2024-09-21T04:16:33.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 730.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:16:34.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:34 smithi022 ceph-mon[31015]: pgmap v797: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 564 op/s 2024-09-21T04:16:34.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:34 smithi073 ceph-mon[34443]: pgmap v797: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 564 op/s 2024-09-21T04:16:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:34 smithi060 ceph-mon[33722]: pgmap v797: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.7 MiB/s wr, 564 op/s 2024-09-21T04:16:36.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:36 smithi022 ceph-mon[31015]: pgmap v798: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.9 MiB/s wr, 416 op/s 2024-09-21T04:16:36.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:36 smithi073 ceph-mon[34443]: pgmap v798: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.9 MiB/s wr, 416 op/s 2024-09-21T04:16:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:36 smithi060 ceph-mon[33722]: pgmap v798: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 3.9 MiB/s wr, 416 op/s 2024-09-21T04:16:38.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:16:38.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:38 smithi022 ceph-mon[31015]: pgmap v799: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.2 MiB/s wr, 330 op/s 2024-09-21T04:16:38.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:38 smithi073 ceph-mon[34443]: pgmap v799: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.2 MiB/s wr, 330 op/s 2024-09-21T04:16:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:38 smithi060 ceph-mon[33722]: pgmap v799: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 3.2 MiB/s wr, 330 op/s 2024-09-21T04:16:40.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:40 smithi022 ceph-mon[31015]: pgmap v800: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.9 MiB/s wr, 204 op/s 2024-09-21T04:16:40.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:40 smithi073 ceph-mon[34443]: pgmap v800: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.9 MiB/s wr, 204 op/s 2024-09-21T04:16:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:40 smithi060 ceph-mon[33722]: pgmap v800: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 1.9 MiB/s wr, 204 op/s 2024-09-21T04:16:42.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:42 smithi022 ceph-mon[31015]: pgmap v801: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-21T04:16:42.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:42 smithi073 ceph-mon[34443]: pgmap v801: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-21T04:16:42.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:42 smithi060 ceph-mon[33722]: pgmap v801: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 1.5 MiB/s wr, 170 op/s 2024-09-21T04:16:43.128 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:16:43.409 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:16:43.719 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 740.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:16:43.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.891+0000 7f6cf7f31640 1 -- 172.21.15.22:0/2970705403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cf01083d0 msgr2=0x7f6cf01087e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:43.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.891+0000 7f6cf7f31640 1 --2- 172.21.15.22:0/2970705403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cf01083d0 0x7f6cf01087e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6ce4009900 tx=0x7f6ce402a410 comp rx=0 tx=0).stop 2024-09-21T04:16:43.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.891+0000 7f6cf7f31640 1 -- 172.21.15.22:0/2970705403 shutdown_connections 2024-09-21T04:16:43.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.891+0000 7f6cf7f31640 1 --2- 172.21.15.22:0/2970705403 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cf0108d20 0x7f6cf010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:43.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.891+0000 7f6cf7f31640 1 --2- 172.21.15.22:0/2970705403 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cf01083d0 0x7f6cf01087e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:43.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.891+0000 7f6cf7f31640 1 --2- 172.21.15.22:0/2970705403 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf0102ae0 0x7f6cf0102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:43.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.891+0000 7f6cf7f31640 1 -- 172.21.15.22:0/2970705403 >> 172.21.15.22:0/2970705403 conn(0x7f6cf0079760 msgr2=0x7f6cf0079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:43.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.891+0000 7f6cf7f31640 1 -- 172.21.15.22:0/2970705403 shutdown_connections 2024-09-21T04:16:43.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.891+0000 7f6cf7f31640 1 -- 172.21.15.22:0/2970705403 wait complete. 2024-09-21T04:16:43.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.892+0000 7f6cf7f31640 1 Processor -- start 2024-09-21T04:16:43.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.892+0000 7f6cf7f31640 1 -- start start 2024-09-21T04:16:43.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf7f31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cf0102ae0 0x7f6cf0199270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:43.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf7f31640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf01083d0 0x7f6cf0199810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:43.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf7f31640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cf0108d20 0x7f6cf019eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:43.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf7f31640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf0112840 con 0x7f6cf0108d20 2024-09-21T04:16:43.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf7f31640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf01126c0 con 0x7f6cf0102ae0 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf7f31640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf01129c0 con 0x7f6cf01083d0 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf64ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cf0108d20 0x7f6cf019eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf64ce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cf0108d20 0x7f6cf019eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50614/0 (socket says 172.21.15.22:50614) 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf64ce640 1 -- 172.21.15.22:0/3964815735 learned_addr learned my addr 172.21.15.22:0/3964815735 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf5ccd640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cf0102ae0 0x7f6cf0199270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf54cc640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf01083d0 0x7f6cf0199810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf64ce640 1 -- 172.21.15.22:0/3964815735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf01083d0 msgr2=0x7f6cf0199810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf64ce640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf01083d0 0x7f6cf0199810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf64ce640 1 -- 172.21.15.22:0/3964815735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cf0102ae0 msgr2=0x7f6cf0199270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf64ce640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cf0102ae0 0x7f6cf0199270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf64ce640 1 -- 172.21.15.22:0/3964815735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf019f1e0 con 0x7f6cf0108d20 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.893+0000 7f6cf5ccd640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cf0102ae0 0x7f6cf0199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.894+0000 7f6cf64ce640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cf0108d20 0x7f6cf019eab0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800d750 tx=0x7f6ce800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:43.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.894+0000 7f6ceeffd640 1 -- 172.21.15.22:0/3964815735 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8017070 con 0x7f6cf0108d20 2024-09-21T04:16:43.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.894+0000 7f6cf7f31640 1 -- 172.21.15.22:0/3964815735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf019f4d0 con 0x7f6cf0108d20 2024-09-21T04:16:43.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.894+0000 7f6ceeffd640 1 -- 172.21.15.22:0/3964815735 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ce80054b0 con 0x7f6cf0108d20 2024-09-21T04:16:43.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.894+0000 7f6cf7f31640 1 -- 172.21.15.22:0/3964815735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf01a5c30 con 0x7f6cf0108d20 2024-09-21T04:16:43.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.894+0000 7f6ceeffd640 1 -- 172.21.15.22:0/3964815735 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ce8004b90 con 0x7f6cf0108d20 2024-09-21T04:16:43.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.895+0000 7f6cf7f31640 1 -- 172.21.15.22:0/3964815735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf0103d10 con 0x7f6cf0108d20 2024-09-21T04:16:43.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.896+0000 7f6ceeffd640 1 -- 172.21.15.22:0/3964815735 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6ce8004d30 con 0x7f6cf0108d20 2024-09-21T04:16:43.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.897+0000 7f6ceeffd640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6cd80b6510 0x7f6cd80b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:43.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.897+0000 7f6cf5ccd640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6cd80b6510 0x7f6cd80b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:43.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.897+0000 7f6ceeffd640 1 -- 172.21.15.22:0/3964815735 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6ce80e75f0 con 0x7f6cf0108d20 2024-09-21T04:16:43.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.898+0000 7f6cf5ccd640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6cd80b6510 0x7f6cd80b8a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0005fd0 tx=0x7f6ce0009520 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:43.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:43.901+0000 7f6ceeffd640 1 -- 172.21.15.22:0/3964815735 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ce80ada60 con 0x7f6cf0108d20 2024-09-21T04:16:44.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.130+0000 7f6cf7f31640 1 -- 172.21.15.22:0/3964815735 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cf010ab10 con 0x7f6cf0108d20 2024-09-21T04:16:44.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.131+0000 7f6ceeffd640 1 -- 172.21.15.22:0/3964815735 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7f6ce80b1e40 con 0x7f6cf0108d20 2024-09-21T04:16:44.134 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:16:44.134 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:16:44.135 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.133+0000 7f6cf7f31640 1 -- 172.21.15.22:0/3964815735 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6cd80b6510 msgr2=0x7f6cd80b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.133+0000 7f6cf7f31640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6cd80b6510 0x7f6cd80b8a20 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0005fd0 tx=0x7f6ce0009520 comp rx=0 tx=0).stop 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.133+0000 7f6cf7f31640 1 -- 172.21.15.22:0/3964815735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cf0108d20 msgr2=0x7f6cf019eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.133+0000 7f6cf7f31640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cf0108d20 0x7f6cf019eab0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800d750 tx=0x7f6ce800dc10 comp rx=0 tx=0).stop 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.133+0000 7f6cf7f31640 1 -- 172.21.15.22:0/3964815735 shutdown_connections 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.133+0000 7f6cf7f31640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6cd80b6510 0x7f6cd80b8a20 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.133+0000 7f6cf7f31640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6cf01083d0 0x7f6cf0199810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.133+0000 7f6cf7f31640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6cf0108d20 0x7f6cf019eab0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.133+0000 7f6cf7f31640 1 --2- 172.21.15.22:0/3964815735 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6cf0102ae0 0x7f6cf0199270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.133+0000 7f6cf7f31640 1 -- 172.21.15.22:0/3964815735 >> 172.21.15.22:0/3964815735 conn(0x7f6cf0079760 msgr2=0x7f6cf01044f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.134+0000 7f6cf7f31640 1 -- 172.21.15.22:0/3964815735 shutdown_connections 2024-09-21T04:16:44.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:44.134+0000 7f6cf7f31640 1 -- 172.21.15.22:0/3964815735 wait complete. 2024-09-21T04:16:44.804 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id b2317cf8 --release --await' 2024-09-21T04:16:44.805 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id b2317cf8 --release --await 2024-09-21T04:16:44.830 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:44 smithi022 ceph-mon[31015]: pgmap v802: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 466 KiB/s wr, 68 op/s 2024-09-21T04:16:44.830 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:44 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3964815735' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:16:44.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:44 smithi073 ceph-mon[34443]: pgmap v802: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 466 KiB/s wr, 68 op/s 2024-09-21T04:16:44.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:44 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3964815735' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:16:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:44 smithi060 ceph-mon[33722]: pgmap v802: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 466 KiB/s wr, 68 op/s 2024-09-21T04:16:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:44 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3964815735' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:16:45.066 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:16:45.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.575+0000 7f26951b2640 1 -- 172.21.15.22:0/4060796063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269010de10 msgr2=0x7f2690110300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:45.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.575+0000 7f26951b2640 1 --2- 172.21.15.22:0/4060796063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269010de10 0x7f2690110300 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f2688009ca0 tx=0x7f268802a8c0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.575+0000 7f26951b2640 1 -- 172.21.15.22:0/4060796063 shutdown_connections 2024-09-21T04:16:45.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.575+0000 7f26951b2640 1 --2- 172.21.15.22:0/4060796063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f269010de10 0x7f2690110300 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.575+0000 7f26951b2640 1 --2- 172.21.15.22:0/4060796063 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690105300 0x7f269010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.575+0000 7f26951b2640 1 --2- 172.21.15.22:0/4060796063 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26901049b0 0x7f2690104dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.575+0000 7f26951b2640 1 -- 172.21.15.22:0/4060796063 >> 172.21.15.22:0/4060796063 conn(0x7f2690079730 msgr2=0x7f2690079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.576+0000 7f26951b2640 1 -- 172.21.15.22:0/4060796063 shutdown_connections 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.576+0000 7f26951b2640 1 -- 172.21.15.22:0/4060796063 wait complete. 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.576+0000 7f26951b2640 1 Processor -- start 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f26951b2640 1 -- start start 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f26951b2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26901049b0 0x7f269019a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f26951b2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690105300 0x7f269019a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f26951b2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269010de10 0x7f269019fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f26951b2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2690113970 con 0x7f26901049b0 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f26951b2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f26901137f0 con 0x7f2690105300 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f26951b2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2690113af0 con 0x7f269010de10 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f268ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26901049b0 0x7f269019a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f268ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26901049b0 0x7f269019a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50624/0 (socket says 172.21.15.22:50624) 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f268ed9d640 1 -- 172.21.15.22:0/402040117 learned_addr learned my addr 172.21.15.22:0/402040117 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f268e59c640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690105300 0x7f269019a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f268f59e640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269010de10 0x7f269019fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f268ed9d640 1 -- 172.21.15.22:0/402040117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269010de10 msgr2=0x7f269019fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f268ed9d640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269010de10 0x7f269019fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f268ed9d640 1 -- 172.21.15.22:0/402040117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690105300 msgr2=0x7f269019a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f268ed9d640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690105300 0x7f269019a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.577+0000 7f268ed9d640 1 -- 172.21.15.22:0/402040117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26901a02b0 con 0x7f26901049b0 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.578+0000 7f268ed9d640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26901049b0 0x7f269019a340 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f268000e9c0 tx=0x7f268000ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.578+0000 7f2677fff640 1 -- 172.21.15.22:0/402040117 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268000cd80 con 0x7f26901049b0 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.578+0000 7f26951b2640 1 -- 172.21.15.22:0/402040117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26901a05a0 con 0x7f26901049b0 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.578+0000 7f2677fff640 1 -- 172.21.15.22:0/402040117 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26800044b0 con 0x7f26901049b0 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.578+0000 7f2677fff640 1 -- 172.21.15.22:0/402040117 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2680010430 con 0x7f26901049b0 2024-09-21T04:16:45.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.578+0000 7f26951b2640 1 -- 172.21.15.22:0/402040117 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26901a6d00 con 0x7f26901049b0 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f2677fff640 1 -- 172.21.15.22:0/402040117 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f26800105d0 con 0x7f26901049b0 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f269b726740 1 Processor -- start 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f269b726740 1 -- start start 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f269b726740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 0x555d416fa510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f269b726740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d4132b660 0x555d416faa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f269b726740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41333840 0x555d416faf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f269b726740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555d415e5dc0 con 0x555d4132b660 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f269b726740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555d416721f0 con 0x555d41354520 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f269b726740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555d41661620 con 0x555d41333840 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f268ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d4132b660 0x555d416faa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f268ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d4132b660 0x555d416faa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50638/0 (socket says 172.21.15.22:50638) 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.581+0000 7f268ed9d640 1 -- 172.21.15.22:0/2536192367 learned_addr learned my addr 172.21.15.22:0/2536192367 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:45.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268e59c640 1 --2- 172.21.15.22:0/2536192367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41333840 0x555d416faf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268f59e640 1 --2- 172.21.15.22:0/2536192367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 0x555d416fa510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f2677fff640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26780b6510 0x7f26780b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268ed9d640 1 -- 172.21.15.22:0/2536192367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41333840 msgr2=0x555d416faf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268ed9d640 1 --2- 172.21.15.22:0/2536192367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41333840 0x555d416faf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268ed9d640 1 -- 172.21.15.22:0/2536192367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 msgr2=0x555d416fa510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268ed9d640 1 --2- 172.21.15.22:0/2536192367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 0x555d416fa510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268ed9d640 1 -- 172.21.15.22:0/2536192367 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d41629fd0 con 0x555d4132b660 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268f59e640 1 --2- 172.21.15.22:0/2536192367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 0x555d416fa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268f59e640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26780b6510 0x7f26780b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f2677fff640 1 -- 172.21.15.22:0/402040117 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f26800e7af0 con 0x7f26901049b0 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268ed9d640 1 --2- 172.21.15.22:0/2536192367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d4132b660 0x555d416faa50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f26800989d0 tx=0x7f2680072840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b37c02fbd7629624 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f26757fa640 1 -- 172.21.15.22:0/2536192367 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26800ad690 con 0x555d4132b660 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f26757fa640 1 -- 172.21.15.22:0/2536192367 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2680097bd0 con 0x555d4132b660 2024-09-21T04:16:45.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.582+0000 7f268f59e640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26780b6510 0x7f26780b8a20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2688006010 tx=0x7f268803f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.583+0000 7f26757fa640 1 -- 172.21.15.22:0/2536192367 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26800979d0 con 0x555d4132b660 2024-09-21T04:16:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.583+0000 7f269b726740 1 -- 172.21.15.22:0/2536192367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d4132b660 msgr2=0x555d416faa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.583+0000 7f269b726740 1 --2- 172.21.15.22:0/2536192367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d4132b660 0x555d416faa50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f26800989d0 tx=0x7f2680072840 comp rx=0 tx=0).stop 2024-09-21T04:16:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.584+0000 7f269b726740 1 -- 172.21.15.22:0/2536192367 shutdown_connections 2024-09-21T04:16:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.584+0000 7f269b726740 1 --2- 172.21.15.22:0/2536192367 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41333840 0x555d416faf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.584+0000 7f269b726740 1 --2- 172.21.15.22:0/2536192367 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d4132b660 0x555d416faa50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.584+0000 7f269b726740 1 --2- 172.21.15.22:0/2536192367 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 0x555d416fa510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.584+0000 7f269b726740 1 -- 172.21.15.22:0/2536192367 >> 172.21.15.22:0/2536192367 conn(0x555d41348910 msgr2=0x555d416f8400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.584+0000 7f269b726740 1 -- 172.21.15.22:0/2536192367 shutdown_connections 2024-09-21T04:16:45.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.584+0000 7f269b726740 1 -- 172.21.15.22:0/2536192367 wait complete. 2024-09-21T04:16:45.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.584+0000 7f269b726740 1 -- start start 2024-09-21T04:16:45.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f269b726740 1 Processor -- start 2024-09-21T04:16:45.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f269b726740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41705bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f269b726740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 0x555d41706100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f269b726740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41312ea0 0x555d41711e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f269b726740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x555d415fc300 con 0x555d41333840 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f269b726740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x555d41665430 con 0x555d41312ea0 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f269b726740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x555d414c2bb0 con 0x555d41354520 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f269b726740 10 client.0 _ll_register_callbacks cb 0x555d41616120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41705bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41705bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50644/0 (socket says 172.21.15.22:50644) 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268ed9d640 1 -- 172.21.15.22:0/1129434248 learned_addr learned my addr 172.21.15.22:0/1129434248 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268f59e640 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41312ea0 0x555d41711e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268e59c640 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 0x555d41706100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268ed9d640 1 -- 172.21.15.22:0/1129434248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 msgr2=0x555d41706100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268ed9d640 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 0x555d41706100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268ed9d640 1 -- 172.21.15.22:0/1129434248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41312ea0 msgr2=0x555d41711e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268ed9d640 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41312ea0 0x555d41711e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268ed9d640 1 -- 172.21.15.22:0/1129434248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d415eb780 con 0x555d41333840 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.585+0000 7f268e59c640 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 0x555d41706100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f268ed9d640 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41705bc0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f26800e5280 tx=0x7f2680009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59fe75e239e25de2 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f2672ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f2672ff5640 1 -- 172.21.15.22:0/1129434248 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26800ad030 con 0x555d41333840 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f2672ff5640 1 -- 172.21.15.22:0/1129434248 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f26800e52b0 con 0x555d41333840 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f269b726740 1 -- 172.21.15.22:0/1129434248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555d41674140 con 0x555d41333840 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f2672ff5640 1 -- 172.21.15.22:0/1129434248 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f26800ad210 con 0x555d41333840 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f269b726740 10 client.16233 fetch_fsmap learned FSMap version 50 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f269b726740 1 -- 172.21.15.22:0/1129434248 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555d413bfb00 con 0x555d41333840 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f2672ff5640 1 -- 172.21.15.22:0/1129434248 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555d41674140 con 0x555d41333840 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f2672ff5640 1 -- 172.21.15.22:0/1129434248 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f26800a9210 con 0x555d41333840 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f269b726740 10 client.16233 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f269b726740 10 client.16233 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f269b726740 20 client.16233 populate_metadata read hostname 'smithi022' 2024-09-21T04:16:45.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f269b726740 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555d412e8250 0x555d41717d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f269b726740 4 client.16233 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.586+0000 7f269b726740 1 -- 172.21.15.22:0/1129434248 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d4166fbf0 con 0x555d412e8250 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.587+0000 7f268e59c640 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555d412e8250 0x555d41717d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.587+0000 7f268e59c640 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555d412e8250 0x555d41717d30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8462b49146f0b840 server_cookie=b70f4de4bf4b7c29 in_seq=0 out_seq=0 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.587+0000 7f2672ff5640 10 client.16233 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f2672ff5640 1 -- 172.21.15.22:0/1129434248 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555d4166fbf0 con 0x555d412e8250 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f2672ff5640 10 client.16233 handle_command_reply: tid=0 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 client.16233 shutdown 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 -- 172.21.15.22:0/1129434248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 msgr2=0x555d41705bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41705bc0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f26800e5280 tx=0x7f2680009700 comp rx=0 tx=0).stop 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 -- 172.21.15.22:0/1129434248 shutdown_connections 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555d412e8250 0x555d41717d30 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 0x555d41706100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41312ea0 0x555d41711e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 --2- 172.21.15.22:0/1129434248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41705bc0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 -- 172.21.15.22:0/1129434248 >> 172.21.15.22:0/1129434248 conn(0x555d41348910 msgr2=0x555d416fd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:45.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f2672ff5640 0 client.16233 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:45.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 -- 172.21.15.22:0/1129434248 shutdown_connections 2024-09-21T04:16:45.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 1 -- 172.21.15.22:0/1129434248 wait complete. 2024-09-21T04:16:45.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.588+0000 7f269b726740 20 client.16233 trim_cache size 0 max 16384 2024-09-21T04:16:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f269b726740 1 Processor -- start 2024-09-21T04:16:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f269b726740 1 -- start start 2024-09-21T04:16:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f269b726740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41312ea0 0x555d41711da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f269b726740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41707aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f269b726740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 0x555d41704440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f269b726740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f26901b0a80 con 0x555d41333840 2024-09-21T04:16:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f269b726740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f26901b25c0 con 0x555d41312ea0 2024-09-21T04:16:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f269b726740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f26901b1150 con 0x555d41354520 2024-09-21T04:16:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f268e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41707aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f268e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41707aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50656/0 (socket says 172.21.15.22:50656) 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f268e59c640 1 -- 172.21.15.22:0/1173570866 learned_addr learned my addr 172.21.15.22:0/1173570866 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f268ed9d640 1 --2- 172.21.15.22:0/1173570866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41312ea0 0x555d41711da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f268f59e640 1 --2- 172.21.15.22:0/1173570866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 0x555d41704440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f268e59c640 1 -- 172.21.15.22:0/1173570866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 msgr2=0x555d41704440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f268e59c640 1 --2- 172.21.15.22:0/1173570866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 0x555d41704440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f268e59c640 1 -- 172.21.15.22:0/1173570866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41312ea0 msgr2=0x555d41711da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f268e59c640 1 --2- 172.21.15.22:0/1173570866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41312ea0 0x555d41711da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.606+0000 7f268e59c640 1 -- 172.21.15.22:0/1173570866 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d416f8440 con 0x555d41333840 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.607+0000 7f268e59c640 1 --2- 172.21.15.22:0/1173570866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41707aa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f269006aaa0 tx=0x7f2684009c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515b3769b1ba5b0b server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.607+0000 7f2674ff9640 1 -- 172.21.15.22:0/1173570866 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2684004050 con 0x555d41333840 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.607+0000 7f2674ff9640 1 -- 172.21.15.22:0/1173570866 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26840035f0 con 0x555d41333840 2024-09-21T04:16:45.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.607+0000 7f2674ff9640 1 -- 172.21.15.22:0/1173570866 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f268401d670 con 0x555d41333840 2024-09-21T04:16:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 -- 172.21.15.22:0/1173570866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 msgr2=0x555d41707aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 --2- 172.21.15.22:0/1173570866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41707aa0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f269006aaa0 tx=0x7f2684009c80 comp rx=0 tx=0).stop 2024-09-21T04:16:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 -- 172.21.15.22:0/1173570866 shutdown_connections 2024-09-21T04:16:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 --2- 172.21.15.22:0/1173570866 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41354520 0x555d41704440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 --2- 172.21.15.22:0/1173570866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41707aa0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 --2- 172.21.15.22:0/1173570866 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41312ea0 0x555d41711da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 -- 172.21.15.22:0/1173570866 >> 172.21.15.22:0/1173570866 conn(0x555d41348910 msgr2=0x555d416fb540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:45.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 -- 172.21.15.22:0/1173570866 shutdown_connections 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 -- 172.21.15.22:0/1173570866 wait complete. 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 -- start start 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 Processor -- start 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41312ea0 0x555d41776640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41776c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 0x555d4177b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f26901b1ef0 con 0x555d41333840 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f26901b1820 con 0x555d41354520 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.608+0000 7f269b726740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f26901aea60 con 0x555d41312ea0 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f269b726740 10 client.0 _ll_register_callbacks cb 0x7f26840097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41776c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41776c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50672/0 (socket says 172.21.15.22:50672) 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268e59c640 1 -- 172.21.15.22:0/1169535819 learned_addr learned my addr 172.21.15.22:0/1169535819 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:45.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268ed9d640 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41312ea0 0x555d41776640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268f59e640 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 0x555d4177b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268e59c640 1 -- 172.21.15.22:0/1169535819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41312ea0 msgr2=0x555d41776640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268e59c640 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41312ea0 0x555d41776640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268e59c640 1 -- 172.21.15.22:0/1169535819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 msgr2=0x555d4177b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268e59c640 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 0x555d4177b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268e59c640 1 -- 172.21.15.22:0/1169535819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d41704b20 con 0x555d41333840 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f268e59c640 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41776c00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2684005e00 tx=0x7f2684009be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cca266bc41acb97 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f2672ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f2672ff5640 1 -- 172.21.15.22:0/1169535819 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2684004050 con 0x555d41333840 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f2672ff5640 1 -- 172.21.15.22:0/1169535819 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f26840041f0 con 0x555d41333840 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.609+0000 7f269b726740 1 -- 172.21.15.22:0/1169535819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26840035f0 con 0x555d41333840 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f2672ff5640 1 -- 172.21.15.22:0/1169535819 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f268403b050 con 0x555d41333840 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f269b726740 10 client.16239 fetch_fsmap learned FSMap version 50 2024-09-21T04:16:45.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f269b726740 1 -- 172.21.15.22:0/1169535819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555d41436960 con 0x555d41333840 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f2672ff5640 1 -- 172.21.15.22:0/1169535819 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26840035f0 con 0x555d41333840 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f2672ff5640 1 -- 172.21.15.22:0/1169535819 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f26840053a0 con 0x555d41333840 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f269b726740 10 client.16239 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f269b726740 10 client.16239 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f269b726740 20 client.16239 populate_metadata read hostname 'smithi022' 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f269b726740 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555d41783220 0x555d41785640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f269b726740 4 client.16239 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b2317cf8", "release": true, "await": true}] 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f269b726740 1 -- 172.21.15.22:0/1169535819 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b2317cf8", "release": true, "await": true}) -- 0x555d4166d020 con 0x555d41783220 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.610+0000 7f268ed9d640 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555d41783220 0x555d41785640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.611+0000 7f2672ff5640 10 client.16239 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:45.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.611+0000 7f268ed9d640 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555d41783220 0x555d41785640 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed453fca85acd58d server_cookie=5032c002a6ee2115 in_seq=0 out_seq=0 2024-09-21T04:16:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f2672ff5640 1 -- 172.21.15.22:0/1169535819 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x555d4166d020 con 0x555d41783220 2024-09-21T04:16:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f2672ff5640 10 client.16239 handle_command_reply: tid=0 2024-09-21T04:16:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f269b726740 1 client.16239 shutdown 2024-09-21T04:16:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f269b726740 1 -- 172.21.15.22:0/1169535819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 msgr2=0x555d41776c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f269b726740 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41776c00 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2684005e00 tx=0x7f2684009be0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f269b726740 1 -- 172.21.15.22:0/1169535819 shutdown_connections 2024-09-21T04:16:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f269b726740 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x555d41783220 0x555d41785640 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f269b726740 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x555d41354520 0x555d4177b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f269b726740 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x555d41333840 0x555d41776c00 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f269b726740 1 --2- 172.21.15.22:0/1169535819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x555d41312ea0 0x555d41776640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f269b726740 1 -- 172.21.15.22:0/1169535819 >> 172.21.15.22:0/1169535819 conn(0x555d41348910 msgr2=0x555d417078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:45.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.678+0000 7f2672ff5640 0 client.16239 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:45.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.679+0000 7f269b726740 1 -- 172.21.15.22:0/1169535819 shutdown_connections 2024-09-21T04:16:45.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.679+0000 7f269b726740 1 -- 172.21.15.22:0/1169535819 wait complete. 2024-09-21T04:16:45.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.679+0000 7f269b726740 20 client.16239 trim_cache size 0 max 16384 2024-09-21T04:16:45.683 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:16:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:16:45.683 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 56, 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "b2317cf8": { 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 56, 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 138.8, 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:16:45.684 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:16:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:16:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:16:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:45.685 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:45.685 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:16:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 -- 172.21.15.22:0/402040117 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26780b6510 msgr2=0x7f26780b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26780b6510 0x7f26780b8a20 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2688006010 tx=0x7f268803f040 comp rx=0 tx=0).stop 2024-09-21T04:16:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 -- 172.21.15.22:0/402040117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26901049b0 msgr2=0x7f269019a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26901049b0 0x7f269019a340 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f268000e9c0 tx=0x7f268000ee80 comp rx=0 tx=0).stop 2024-09-21T04:16:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 -- 172.21.15.22:0/402040117 shutdown_connections 2024-09-21T04:16:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26780b6510 0x7f26780b8a20 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f269010de10 0x7f269019fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2690105300 0x7f269019a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 --2- 172.21.15.22:0/402040117 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26901049b0 0x7f269019a340 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 -- 172.21.15.22:0/402040117 >> 172.21.15.22:0/402040117 conn(0x7f2690079730 msgr2=0x7f26900ff550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 -- 172.21.15.22:0/402040117 shutdown_connections 2024-09-21T04:16:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:45.680+0000 7f26951b2640 1 -- 172.21.15.22:0/402040117 wait complete. 2024-09-21T04:16:46.429 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b2317cf8', total seconds elapsed: 22.2 2024-09-21T04:16:46.429 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.85 2024-09-21T04:16:46.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:16:46.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:46 smithi022 ceph-mon[31015]: pgmap v803: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 192 KiB/s wr, 35 op/s 2024-09-21T04:16:46.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:46 smithi073 ceph-mon[34443]: pgmap v803: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 192 KiB/s wr, 35 op/s 2024-09-21T04:16:46.918 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:16:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:46 smithi060 ceph-mon[33722]: pgmap v803: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 192 KiB/s wr, 35 op/s 2024-09-21T04:16:47.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.510+0000 7fdb65a9a640 1 -- 172.21.15.22:0/81624312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb60107a50 msgr2=0x7fdb60107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.510+0000 7fdb65a9a640 1 --2- 172.21.15.22:0/81624312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb60107a50 0x7fdb60107f30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009c10 tx=0x7fdb5802a720 comp rx=0 tx=0).stop 2024-09-21T04:16:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.510+0000 7fdb65a9a640 1 -- 172.21.15.22:0/81624312 shutdown_connections 2024-09-21T04:16:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.510+0000 7fdb65a9a640 1 --2- 172.21.15.22:0/81624312 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb60102f60 0x7fdb60107490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.510+0000 7fdb65a9a640 1 --2- 172.21.15.22:0/81624312 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb60107a50 0x7fdb60107f30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.510+0000 7fdb65a9a640 1 --2- 172.21.15.22:0/81624312 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb60102610 0x7fdb60102a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.510+0000 7fdb65a9a640 1 -- 172.21.15.22:0/81624312 >> 172.21.15.22:0/81624312 conn(0x7fdb600fe320 msgr2=0x7fdb60100770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.511+0000 7fdb65a9a640 1 -- 172.21.15.22:0/81624312 shutdown_connections 2024-09-21T04:16:47.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.511+0000 7fdb65a9a640 1 -- 172.21.15.22:0/81624312 wait complete. 2024-09-21T04:16:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.512+0000 7fdb65a9a640 1 Processor -- start 2024-09-21T04:16:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.513+0000 7fdb65a9a640 1 -- start start 2024-09-21T04:16:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.513+0000 7fdb65a9a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb60102610 0x7fdb60116b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.513+0000 7fdb65a9a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb60102f60 0x7fdb60110dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.513+0000 7fdb65a9a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb60107a50 0x7fdb60111320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.513+0000 7fdb65a9a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdb601091c0 con 0x7fdb60102f60 2024-09-21T04:16:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.513+0000 7fdb65a9a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fdb60109040 con 0x7fdb60102610 2024-09-21T04:16:47.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.513+0000 7fdb65a9a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fdb60109340 con 0x7fdb60107a50 2024-09-21T04:16:47.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.514+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb60102610 0x7fdb60116b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:47.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.514+0000 7fdb5f7fe640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb60102610 0x7fdb60116b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:39008/0 (socket says 172.21.15.22:39008) 2024-09-21T04:16:47.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.514+0000 7fdb5f7fe640 1 -- 172.21.15.22:0/1647678350 learned_addr learned my addr 172.21.15.22:0/1647678350 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:47.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.514+0000 7fdb5ffff640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb60107a50 0x7fdb60111320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:47.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.514+0000 7fdb5effd640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb60102f60 0x7fdb60110dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:47.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.515+0000 7fdb5f7fe640 1 -- 172.21.15.22:0/1647678350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb60107a50 msgr2=0x7fdb60111320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:47.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.515+0000 7fdb5f7fe640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb60107a50 0x7fdb60111320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:47.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.515+0000 7fdb5f7fe640 1 -- 172.21.15.22:0/1647678350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb60102f60 msgr2=0x7fdb60110dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:47.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.515+0000 7fdb5f7fe640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb60102f60 0x7fdb60110dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:47.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.515+0000 7fdb5f7fe640 1 -- 172.21.15.22:0/1647678350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb60111b40 con 0x7fdb60102610 2024-09-21T04:16:47.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.518+0000 7fdb5f7fe640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb60102610 0x7fdb60116b00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000d950 tx=0x7fdb5000de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:47.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.522+0000 7fdb5cff9640 1 -- 172.21.15.22:0/1647678350 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb50017070 con 0x7fdb60102610 2024-09-21T04:16:47.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.522+0000 7fdb5cff9640 1 -- 172.21.15.22:0/1647678350 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb50009c30 con 0x7fdb60102610 2024-09-21T04:16:47.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.522+0000 7fdb5cff9640 1 -- 172.21.15.22:0/1647678350 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb5000f3c0 con 0x7fdb60102610 2024-09-21T04:16:47.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.522+0000 7fdb65a9a640 1 -- 172.21.15.22:0/1647678350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb6006ce40 con 0x7fdb60102610 2024-09-21T04:16:47.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.522+0000 7fdb65a9a640 1 -- 172.21.15.22:0/1647678350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb6006d380 con 0x7fdb60102610 2024-09-21T04:16:47.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.524+0000 7fdb65a9a640 1 -- 172.21.15.22:0/1647678350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6006bf20 con 0x7fdb60102610 2024-09-21T04:16:47.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.526+0000 7fdb5cff9640 1 -- 172.21.15.22:0/1647678350 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fdb50010460 con 0x7fdb60102610 2024-09-21T04:16:47.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.527+0000 7fdb5cff9640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdb4c0b6720 0x7fdb4c0b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:47.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.528+0000 7fdb5cff9640 1 -- 172.21.15.22:0/1647678350 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fdb500e71a0 con 0x7fdb60102610 2024-09-21T04:16:47.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.529+0000 7fdb5cff9640 1 -- 172.21.15.22:0/1647678350 <== mon.2 v2:172.21.15.60:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdb500ad710 con 0x7fdb60102610 2024-09-21T04:16:47.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.533+0000 7fdb5effd640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdb4c0b6720 0x7fdb4c0b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:47.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.534+0000 7fdb5effd640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdb4c0b6720 0x7fdb4c0b8c30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdb601081c0 tx=0x7fdb48008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:47.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.942+0000 7fdb65a9a640 1 -- 172.21.15.22:0/1647678350 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb6006d710 con 0x7fdb60102610 2024-09-21T04:16:47.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.943+0000 7fdb5cff9640 1 -- 172.21.15.22:0/1647678350 <== mon.2 v2:172.21.15.60:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7fdb50009de0 con 0x7fdb60102610 2024-09-21T04:16:47.947 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:16:47.947 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:16:47.947 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:16:47.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.947+0000 7fdb65a9a640 1 -- 172.21.15.22:0/1647678350 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdb4c0b6720 msgr2=0x7fdb4c0b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:47.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.947+0000 7fdb65a9a640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdb4c0b6720 0x7fdb4c0b8c30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fdb601081c0 tx=0x7fdb48008040 comp rx=0 tx=0).stop 2024-09-21T04:16:47.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.947+0000 7fdb65a9a640 1 -- 172.21.15.22:0/1647678350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb60102610 msgr2=0x7fdb60116b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:47.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.947+0000 7fdb65a9a640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb60102610 0x7fdb60116b00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb5000d950 tx=0x7fdb5000de10 comp rx=0 tx=0).stop 2024-09-21T04:16:47.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.947+0000 7fdb65a9a640 1 -- 172.21.15.22:0/1647678350 shutdown_connections 2024-09-21T04:16:47.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.947+0000 7fdb65a9a640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdb4c0b6720 0x7fdb4c0b8c30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:47.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.947+0000 7fdb65a9a640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fdb60107a50 0x7fdb60111320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:47.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.947+0000 7fdb65a9a640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdb60102f60 0x7fdb60110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:47.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.947+0000 7fdb65a9a640 1 --2- 172.21.15.22:0/1647678350 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fdb60102610 0x7fdb60116b00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:47.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.947+0000 7fdb65a9a640 1 -- 172.21.15.22:0/1647678350 >> 172.21.15.22:0/1647678350 conn(0x7fdb600fe320 msgr2=0x7fdb60105460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:47.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.948+0000 7fdb65a9a640 1 -- 172.21.15.22:0/1647678350 shutdown_connections 2024-09-21T04:16:47.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:47.948+0000 7fdb65a9a640 1 -- 172.21.15.22:0/1647678350 wait complete. 2024-09-21T04:16:48.666 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0' 2024-09-21T04:16:48.666 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 138.85 --await-for 45.0 2024-09-21T04:16:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 745.0 s, 510.3 tps, lat 785.436 ms stddev 3307.100 2024-09-21T04:16:48.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:48 smithi022 ceph-mon[31015]: pgmap v804: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 447 KiB/s wr, 50 op/s 2024-09-21T04:16:48.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:48 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1647678350' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:16:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:48 smithi073 ceph-mon[34443]: pgmap v804: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 447 KiB/s wr, 50 op/s 2024-09-21T04:16:48.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:48 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1647678350' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:16:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:48 smithi060 ceph-mon[33722]: pgmap v804: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 447 KiB/s wr, 50 op/s 2024-09-21T04:16:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:48 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1647678350' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:16:49.146 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:16:50.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.768+0000 7f564e9d0640 1 -- 172.21.15.22:0/896982176 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5648114450 msgr2=0x7f5648116920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:50.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.768+0000 7f564e9d0640 1 --2- 172.21.15.22:0/896982176 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5648114450 0x7f5648116920 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f5640009ca0 tx=0x7f564002a8f0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.768+0000 7f564e9d0640 1 -- 172.21.15.22:0/896982176 shutdown_connections 2024-09-21T04:16:50.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.768+0000 7f564e9d0640 1 --2- 172.21.15.22:0/896982176 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5648075dd0 0x7f56480761e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.768+0000 7f564e9d0640 1 --2- 172.21.15.22:0/896982176 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5648114450 0x7f5648116920 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.768+0000 7f564e9d0640 1 --2- 172.21.15.22:0/896982176 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648077380 0x7f56480757b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.768+0000 7f564e9d0640 1 -- 172.21.15.22:0/896982176 >> 172.21.15.22:0/896982176 conn(0x7f56480ff5d0 msgr2=0x7f5648101a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.771+0000 7f564e9d0640 1 -- 172.21.15.22:0/896982176 shutdown_connections 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.771+0000 7f564e9d0640 1 -- 172.21.15.22:0/896982176 wait complete. 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.772+0000 7f564e9d0640 1 Processor -- start 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.772+0000 7f564e9d0640 1 -- start start 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f564e9d0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5648075dd0 0x7f56481a0ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f564e9d0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648077380 0x7f56481a1050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f564e9d0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5648114450 0x7f56481a62f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f563ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648077380 0x7f56481a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f5647fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5648075dd0 0x7f56481a0ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f5647fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5648075dd0 0x7f56481a0ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50720/0 (socket says 172.21.15.22:50720) 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f563ffff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648077380 0x7f56481a1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:39024/0 (socket says 172.21.15.22:39024) 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f563ffff640 1 -- 172.21.15.22:0/258924307 learned_addr learned my addr 172.21.15.22:0/258924307 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:50.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f564cf6d640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5648114450 0x7f56481a62f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f564811a040 con 0x7f5648075dd0 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f5648119ec0 con 0x7f5648077380 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.773+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f564811a1c0 con 0x7f5648114450 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.774+0000 7f563ffff640 1 -- 172.21.15.22:0/258924307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5648114450 msgr2=0x7f56481a62f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.774+0000 7f563ffff640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5648114450 0x7f56481a62f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.774+0000 7f563ffff640 1 -- 172.21.15.22:0/258924307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5648075dd0 msgr2=0x7f56481a0ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.774+0000 7f563ffff640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5648075dd0 0x7f56481a0ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.774+0000 7f563ffff640 1 -- 172.21.15.22:0/258924307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56481a6a20 con 0x7f5648077380 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.775+0000 7f563ffff640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648077380 0x7f56481a1050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f563000b470 tx=0x7f563000b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.775+0000 7f5645ffb640 1 -- 172.21.15.22:0/258924307 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630015020 con 0x7f5648077380 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.775+0000 7f5645ffb640 1 -- 172.21.15.22:0/258924307 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5630011d20 con 0x7f5648077380 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.775+0000 7f5645ffb640 1 -- 172.21.15.22:0/258924307 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630010e50 con 0x7f5648077380 2024-09-21T04:16:50.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.776+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56481a6d10 con 0x7f5648077380 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.776+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56481ad470 con 0x7f5648077380 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.780+0000 7f5645ffb640 1 -- 172.21.15.22:0/258924307 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f5630018020 con 0x7f5648077380 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.784+0000 7f5654f44740 1 Processor -- start 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.784+0000 7f5654f44740 1 -- start start 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.785+0000 7f5654f44740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90d22850 0x563b910c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.785+0000 7f5654f44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90cf9990 0x563b910c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.785+0000 7f5654f44740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d01b70 0x563b910c98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.785+0000 7f5645ffb640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f56340b68c0 0x7f56340b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.785+0000 7f5654f44740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563b9103fbb0 con 0x563b90d22850 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.786+0000 7f5654f44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563b9102efe0 con 0x563b90cf9990 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.786+0000 7f5654f44740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563b91032df0 con 0x563b90d01b70 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.786+0000 7f5645ffb640 1 -- 172.21.15.22:0/258924307 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f56300e6f30 con 0x7f5648077380 2024-09-21T04:16:50.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.788+0000 7f5647fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90cf9990 0x563b910c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.788+0000 7f5647fff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90cf9990 0x563b910c93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:39040/0 (socket says 172.21.15.22:39040) 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.788+0000 7f5647fff640 1 -- 172.21.15.22:0/4152490901 learned_addr learned my addr 172.21.15.22:0/4152490901 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.788+0000 7f563ffff640 1 --2- 172.21.15.22:0/4152490901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d01b70 0x563b910c98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.788+0000 7f564cf6d640 1 --2- 172.21.15.22:0/4152490901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90d22850 0x563b910c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.789+0000 7f5647fff640 1 -- 172.21.15.22:0/4152490901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d01b70 msgr2=0x563b910c98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.789+0000 7f5647fff640 1 --2- 172.21.15.22:0/4152490901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d01b70 0x563b910c98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.789+0000 7f5647fff640 1 -- 172.21.15.22:0/4152490901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90d22850 msgr2=0x563b910c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.789+0000 7f5647fff640 1 --2- 172.21.15.22:0/4152490901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90d22850 0x563b910c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.789+0000 7f5647fff640 1 -- 172.21.15.22:0/4152490901 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b90d9cba0 con 0x563b90cf9990 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.789+0000 7f5647fff640 1 --2- 172.21.15.22:0/4152490901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90cf9990 0x563b910c93b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5638009a40 tx=0x7f5638009f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b05161a29c7f2285 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.789+0000 7f564cf6d640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f56340b68c0 0x7f56340b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.790+0000 7f563e7fc640 1 -- 172.21.15.22:0/4152490901 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638017070 con 0x563b90cf9990 2024-09-21T04:16:50.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.790+0000 7f563e7fc640 1 -- 172.21.15.22:0/4152490901 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5638013470 con 0x563b90cf9990 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.790+0000 7f563e7fc640 1 -- 172.21.15.22:0/4152490901 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638012630 con 0x563b90cf9990 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.791+0000 7f5654f44740 1 -- 172.21.15.22:0/4152490901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90cf9990 msgr2=0x563b910c93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.791+0000 7f5654f44740 1 --2- 172.21.15.22:0/4152490901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90cf9990 0x563b910c93b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5638009a40 tx=0x7f5638009f00 comp rx=0 tx=0).stop 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.793+0000 7f5654f44740 1 -- 172.21.15.22:0/4152490901 shutdown_connections 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.793+0000 7f5654f44740 1 --2- 172.21.15.22:0/4152490901 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d01b70 0x563b910c98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.793+0000 7f564cf6d640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f56340b68c0 0x7f56340b8dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f56400098d0 tx=0x7f564003f040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.793+0000 7f5654f44740 1 --2- 172.21.15.22:0/4152490901 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90cf9990 0x563b910c93b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.793+0000 7f5654f44740 1 --2- 172.21.15.22:0/4152490901 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90d22850 0x563b910c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.793+0000 7f5654f44740 1 -- 172.21.15.22:0/4152490901 >> 172.21.15.22:0/4152490901 conn(0x563b90d16c40 msgr2=0x563b910c6d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.795+0000 7f5654f44740 1 -- 172.21.15.22:0/4152490901 shutdown_connections 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.795+0000 7f5654f44740 1 -- 172.21.15.22:0/4152490901 wait complete. 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.796+0000 7f5654f44740 1 -- start start 2024-09-21T04:16:50.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.796+0000 7f5654f44740 1 Processor -- start 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.797+0000 7f5654f44740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90cf9990 0x563b910d4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.797+0000 7f5654f44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910d4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.797+0000 7f5654f44740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90d22850 0x563b910e0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.797+0000 7f5647fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90cf9990 0x563b910d4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.797+0000 7f5647fff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90cf9990 0x563b910d4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:40792/0 (socket says 172.21.15.22:40792) 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.797+0000 7f5647fff640 1 -- 172.21.15.22:0/4069981579 learned_addr learned my addr 172.21.15.22:0/4069981579 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.797+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x563b90e907b0 con 0x563b90d22850 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.798+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x563b90fc9e90 con 0x563b90d01b70 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.798+0000 7f564cf6d640 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90d22850 0x563b910e0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.798+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x563b910d7650 con 0x563b90cf9990 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.798+0000 7f5654f44740 10 client.0 _ll_register_callbacks cb 0x563b9102c710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.798+0000 7f563ffff640 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910d4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.798+0000 7f5647fff640 1 -- 172.21.15.22:0/4069981579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 msgr2=0x563b910d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.798+0000 7f5647fff640 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910d4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.798+0000 7f5647fff640 1 -- 172.21.15.22:0/4069981579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90d22850 msgr2=0x563b910e0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.798+0000 7f5647fff640 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90d22850 0x563b910e0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.798+0000 7f5647fff640 1 -- 172.21.15.22:0/4069981579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b910e0f00 con 0x563b90cf9990 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.799+0000 7f5647fff640 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90cf9990 0x563b910d4a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5638006a00 tx=0x7f5638013850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dd06aaba4d4e7e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.802+0000 7f56277fe640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.802+0000 7f56277fe640 1 -- 172.21.15.22:0/4069981579 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638017050 con 0x563b90cf9990 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.802+0000 7f56277fe640 1 -- 172.21.15.22:0/4069981579 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f563801c650 con 0x563b90cf9990 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.802+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5638013470 con 0x563b90cf9990 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.803+0000 7f56277fe640 1 -- 172.21.15.22:0/4069981579 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f563802f050 con 0x563b90cf9990 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.803+0000 7f5654f44740 10 client.25849 fetch_fsmap learned FSMap version 50 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.803+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563b910e3810 con 0x563b90cf9990 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.803+0000 7f56277fe640 1 -- 172.21.15.22:0/4069981579 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f563801cce0 con 0x563b90cf9990 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.803+0000 7f56277fe640 1 -- 172.21.15.22:0/4069981579 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f5638026b40 con 0x563b90cf9990 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.803+0000 7f5654f44740 10 client.25849 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.803+0000 7f5654f44740 10 client.25849 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:16:50.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.804+0000 7f5654f44740 20 client.25849 populate_metadata read hostname 'smithi022' 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.804+0000 7f5654f44740 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x563b90ce11d0 0x563b910e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.804+0000 7f5654f44740 4 client.25849 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.804+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5638013470 con 0x563b90ce11d0 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.804+0000 7f563ffff640 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x563b90ce11d0 0x563b910e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.805+0000 7f56277fe640 10 client.25849 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.805+0000 7f563ffff640 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x563b90ce11d0 0x563b910e6b70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc0e299ddb6753e2 server_cookie=43d86eacdd338f8d in_seq=0 out_seq=0 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f56277fe640 1 -- 172.21.15.22:0/4069981579 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f5638013470 con 0x563b90ce11d0 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f56277fe640 10 client.25849 handle_command_reply: tid=0 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 client.25849 shutdown 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90cf9990 msgr2=0x563b910d4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90cf9990 0x563b910d4a60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5638006a00 tx=0x7f5638013850 comp rx=0 tx=0).stop 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 shutdown_connections 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x563b90ce11d0 0x563b910e6b70 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90d22850 0x563b910e0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910d4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 --2- 172.21.15.22:0/4069981579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90cf9990 0x563b910d4a60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 >> 172.21.15.22:0/4069981579 conn(0x563b90d16c40 msgr2=0x563b910cc050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f56277fe640 0 client.25849 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 shutdown_connections 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 1 -- 172.21.15.22:0/4069981579 wait complete. 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.806+0000 7f5654f44740 20 client.25849 trim_cache size 0 max 16384 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5654f44740 1 Processor -- start 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5654f44740 1 -- start start 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5654f44740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910e08e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5654f44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910cdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5654f44740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 0x563b910ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5654f44740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f56481b7270 con 0x563b90cf9990 2024-09-21T04:16:50.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5654f44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f56481b8db0 con 0x563b90d01b70 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5654f44740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f56481b7940 con 0x563b90d22850 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5647fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910e08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5647fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910e08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50750/0 (socket says 172.21.15.22:50750) 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f5647fff640 1 -- 172.21.15.22:0/560238149 learned_addr learned my addr 172.21.15.22:0/560238149 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f564cf6d640 1 --2- 172.21.15.22:0/560238149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 0x563b910ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.824+0000 7f563ffff640 1 --2- 172.21.15.22:0/560238149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910cdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.825+0000 7f564cf6d640 1 -- 172.21.15.22:0/560238149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 msgr2=0x563b910cdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.825+0000 7f564cf6d640 1 --2- 172.21.15.22:0/560238149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910cdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.825+0000 7f564cf6d640 1 -- 172.21.15.22:0/560238149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 msgr2=0x563b910e08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.825+0000 7f564cf6d640 1 --2- 172.21.15.22:0/560238149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910e08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.825+0000 7f564cf6d640 1 -- 172.21.15.22:0/560238149 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b910d5120 con 0x563b90d22850 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.825+0000 7f5647fff640 1 --2- 172.21.15.22:0/560238149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910e08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.825+0000 7f564cf6d640 1 --2- 172.21.15.22:0/560238149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 0x563b910ce490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5640006010 tx=0x7f5640041000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bab29bad5d5818f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.825+0000 7f563dffb640 1 -- 172.21.15.22:0/560238149 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5640031870 con 0x563b90d22850 2024-09-21T04:16:50.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.825+0000 7f563dffb640 1 -- 172.21.15.22:0/560238149 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5640036050 con 0x563b90d22850 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.825+0000 7f563dffb640 1 -- 172.21.15.22:0/560238149 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5640004700 con 0x563b90d22850 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.826+0000 7f5654f44740 1 -- 172.21.15.22:0/560238149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 msgr2=0x563b910ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.826+0000 7f5654f44740 1 --2- 172.21.15.22:0/560238149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 0x563b910ce490 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f5640006010 tx=0x7f5640041000 comp rx=0 tx=0).stop 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.826+0000 7f5654f44740 1 -- 172.21.15.22:0/560238149 shutdown_connections 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.826+0000 7f5654f44740 1 --2- 172.21.15.22:0/560238149 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 0x563b910ce490 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.826+0000 7f5654f44740 1 --2- 172.21.15.22:0/560238149 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910cdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.826+0000 7f5654f44740 1 --2- 172.21.15.22:0/560238149 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910e08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.826+0000 7f5654f44740 1 -- 172.21.15.22:0/560238149 >> 172.21.15.22:0/560238149 conn(0x563b90d16c40 msgr2=0x563b910cbf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.826+0000 7f5654f44740 1 -- 172.21.15.22:0/560238149 shutdown_connections 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.826+0000 7f5654f44740 1 -- 172.21.15.22:0/560238149 wait complete. 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.826+0000 7f5654f44740 1 -- start start 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5654f44740 1 Processor -- start 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5654f44740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910ea310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5654f44740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5654f44740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 0x563b910e6d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5654f44740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f56481b86e0 con 0x563b90cf9990 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5654f44740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f56481b8010 con 0x563b90d01b70 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5654f44740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f56481b5250 con 0x563b90d22850 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5647fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910ea310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5654f44740 10 client.0 _ll_register_callbacks cb 0x7f56300092c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5647fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910ea310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50756/0 (socket says 172.21.15.22:50756) 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f5647fff640 1 -- 172.21.15.22:0/602682986 learned_addr learned my addr 172.21.15.22:0/602682986 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.827+0000 7f563ffff640 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f564cf6d640 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 0x563b910e6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f5647fff640 1 -- 172.21.15.22:0/602682986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 msgr2=0x563b910e6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f5647fff640 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 0x563b910e6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f5647fff640 1 -- 172.21.15.22:0/602682986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 msgr2=0x563b910e67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:16:50.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f5647fff640 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910e67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f5647fff640 1 -- 172.21.15.22:0/602682986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b910e7420 con 0x563b90cf9990 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f564cf6d640 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 0x563b910e6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f5647fff640 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910ea310 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5638026f40 tx=0x7f563800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33c7c57231c96303 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f56277fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f56277fe640 1 -- 172.21.15.22:0/602682986 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5638017070 con 0x563b90cf9990 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f56277fe640 1 -- 172.21.15.22:0/602682986 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f5638012df0 con 0x563b90cf9990 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f5654f44740 1 -- 172.21.15.22:0/602682986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5640036050 con 0x563b90cf9990 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f56277fe640 1 -- 172.21.15.22:0/602682986 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f5638013470 con 0x563b90cf9990 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f5654f44740 10 client.16260 fetch_fsmap learned FSMap version 50 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f5654f44740 1 -- 172.21.15.22:0/602682986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x563b91152190 con 0x563b90cf9990 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.828+0000 7f56277fe640 1 -- 172.21.15.22:0/602682986 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5640036050 con 0x563b90cf9990 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.829+0000 7f56277fe640 1 -- 172.21.15.22:0/602682986 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f56380037b0 con 0x563b90cf9990 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.829+0000 7f5654f44740 10 client.16260 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.829+0000 7f5654f44740 10 client.16260 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:16:50.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.829+0000 7f5654f44740 20 client.16260 populate_metadata read hostname 'smithi022' 2024-09-21T04:16:50.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.829+0000 7f5654f44740 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x563b90cb6580 0x563b911548f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:16:50.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.829+0000 7f5654f44740 4 client.16260 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}] 2024-09-21T04:16:50.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.829+0000 7f5654f44740 1 -- 172.21.15.22:0/602682986 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 138.85, "await_for": 45.0}) -- 0x563b91041b00 con 0x563b90cb6580 2024-09-21T04:16:50.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.829+0000 7f563ffff640 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x563b90cb6580 0x563b911548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:16:50.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.829+0000 7f56277fe640 10 client.16260 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:50.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:49.829+0000 7f563ffff640 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x563b90cb6580 0x563b911548f0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bbef7cbde01b524 server_cookie=aed43df4a510c6b2 in_seq=0 out_seq=0 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f56277fe640 1 -- 172.21.15.22:0/602682986 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x563b91041b00 con 0x563b90cb6580 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f56277fe640 10 client.16260 handle_command_reply: tid=0 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 client.16260 shutdown 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 -- 172.21.15.22:0/602682986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 msgr2=0x563b910ea310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910ea310 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5638026f40 tx=0x7f563800ee50 comp rx=0 tx=0).stop 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 -- 172.21.15.22:0/602682986 shutdown_connections 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x563b90cb6580 0x563b911548f0 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x563b90d22850 0x563b910e6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x563b90d01b70 0x563b910e67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 --2- 172.21.15.22:0/602682986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x563b90cf9990 0x563b910ea310 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f56277fe640 0 client.16260 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:16:50.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 -- 172.21.15.22:0/602682986 >> 172.21.15.22:0/602682986 conn(0x563b90d16c40 msgr2=0x563b910d2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 -- 172.21.15.22:0/602682986 shutdown_connections 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 1 -- 172.21.15.22:0/602682986 wait complete. 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.128+0000 7f5654f44740 20 client.16260 trim_cache size 0 max 16384 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 58, 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stdout: "7b89e441": { 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 58, 2024-09-21T04:16:50.143 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 138.8, 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:50.144 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:50.145 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:50.145 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:16:50.145 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:16:50.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f56340b68c0 msgr2=0x7f56340b8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:50.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f56340b68c0 0x7f56340b8dd0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f56400098d0 tx=0x7f564003f040 comp rx=0 tx=0).stop 2024-09-21T04:16:50.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648077380 msgr2=0x7f56481a1050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:16:50.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648077380 0x7f56481a1050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f563000b470 tx=0x7f563000b930 comp rx=0 tx=0).stop 2024-09-21T04:16:50.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 shutdown_connections 2024-09-21T04:16:50.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f56340b68c0 0x7f56340b8dd0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f5648114450 0x7f56481a62f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f5648077380 0x7f56481a1050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 --2- 172.21.15.22:0/258924307 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5648075dd0 0x7f56481a0ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:16:50.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 >> 172.21.15.22:0/258924307 conn(0x7f56480ff5d0 msgr2=0x7f5648110350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:16:50.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 shutdown_connections 2024-09-21T04:16:50.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:16:50.129+0000 7f564e9d0640 1 -- 172.21.15.22:0/258924307 wait complete. 2024-09-21T04:16:50.759 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:50 smithi022 ceph-mon[31015]: pgmap v805: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 494 KiB/s wr, 54 op/s 2024-09-21T04:16:50.788 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7b89e441', quiesce took 4.4 seconds. Will release after: 14.450000000000001 2024-09-21T04:16:50.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:50 smithi073 ceph-mon[34443]: pgmap v805: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 494 KiB/s wr, 54 op/s 2024-09-21T04:16:50.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:50 smithi060 ceph-mon[33722]: pgmap v805: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 494 KiB/s wr, 54 op/s 2024-09-21T04:16:52.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:52 smithi022 ceph-mon[31015]: pgmap v806: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-21T04:16:52.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:52 smithi073 ceph-mon[34443]: pgmap v806: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-21T04:16:52.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:52 smithi060 ceph-mon[33722]: pgmap v806: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.9 KiB/s rd, 1.4 MiB/s wr, 166 op/s 2024-09-21T04:16:53.707 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 750.0 s, 161.3 tps, lat 152.467 ms stddev 133.098 2024-09-21T04:16:54.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:54 smithi022 ceph-mon[31015]: pgmap v807: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.2 MiB/s wr, 242 op/s 2024-09-21T04:16:54.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:54 smithi073 ceph-mon[34443]: pgmap v807: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.2 MiB/s wr, 242 op/s 2024-09-21T04:16:54.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:54 smithi060 ceph-mon[33722]: pgmap v807: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 2.2 MiB/s wr, 242 op/s 2024-09-21T04:16:56.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:56 smithi022 ceph-mon[31015]: pgmap v808: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.2 MiB/s wr, 242 op/s 2024-09-21T04:16:56.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:56 smithi073 ceph-mon[34443]: pgmap v808: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.2 MiB/s wr, 242 op/s 2024-09-21T04:16:56.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:56 smithi060 ceph-mon[33722]: pgmap v808: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 2.2 MiB/s wr, 242 op/s 2024-09-21T04:16:58.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 755.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:16:58.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:16:58 smithi022 ceph-mon[31015]: pgmap v809: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 2.2 MiB/s wr, 244 op/s 2024-09-21T04:16:58.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:16:58 smithi073 ceph-mon[34443]: pgmap v809: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 2.2 MiB/s wr, 244 op/s 2024-09-21T04:16:58.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:16:58 smithi060 ceph-mon[33722]: pgmap v809: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 9.4 KiB/s rd, 2.2 MiB/s wr, 244 op/s 2024-09-21T04:17:00.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:00 smithi022 ceph-mon[31015]: pgmap v810: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 MiB/s wr, 225 op/s 2024-09-21T04:17:00.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:00 smithi073 ceph-mon[34443]: pgmap v810: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 MiB/s wr, 225 op/s 2024-09-21T04:17:00.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:00 smithi060 ceph-mon[33722]: pgmap v810: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 2.0 MiB/s wr, 225 op/s 2024-09-21T04:17:02.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:02 smithi022 ceph-mon[31015]: pgmap v811: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 225 op/s 2024-09-21T04:17:02.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:02 smithi073 ceph-mon[34443]: pgmap v811: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 225 op/s 2024-09-21T04:17:02.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:02 smithi060 ceph-mon[33722]: pgmap v811: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.9 MiB/s wr, 225 op/s 2024-09-21T04:17:03.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 760.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:17:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:04 smithi073 ceph-mon[34443]: pgmap v812: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.0 MiB/s wr, 116 op/s 2024-09-21T04:17:04.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:04 smithi060 ceph-mon[33722]: pgmap v812: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.0 MiB/s wr, 116 op/s 2024-09-21T04:17:05.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:04 smithi022 ceph-mon[31015]: pgmap v812: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.9 KiB/s rd, 1.0 MiB/s wr, 116 op/s 2024-09-21T04:17:05.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:17:05.515 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.010+0000 7f233f643640 1 -- 172.21.15.22:0/2892078441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2338103b80 msgr2=0x7f2338103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.010+0000 7f233f643640 1 --2- 172.21.15.22:0/2892078441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2338103b80 0x7f2338103f90 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2334009900 tx=0x7f233402a410 comp rx=0 tx=0).stop 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.010+0000 7f233f643640 1 -- 172.21.15.22:0/2892078441 shutdown_connections 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.010+0000 7f233f643640 1 --2- 172.21.15.22:0/2892078441 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2338109e10 0x7f2338110640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.010+0000 7f233f643640 1 --2- 172.21.15.22:0/2892078441 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f23381094c0 0x7f23381098d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.010+0000 7f233f643640 1 --2- 172.21.15.22:0/2892078441 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2338103b80 0x7f2338103f90 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.010+0000 7f233f643640 1 -- 172.21.15.22:0/2892078441 >> 172.21.15.22:0/2892078441 conn(0x7f23380ff610 msgr2=0x7f2338101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.010+0000 7f233f643640 1 -- 172.21.15.22:0/2892078441 shutdown_connections 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.010+0000 7f233f643640 1 -- 172.21.15.22:0/2892078441 wait complete. 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233f643640 1 Processor -- start 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233f643640 1 -- start start 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233f643640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2338103b80 0x7f233819a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233f643640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23381094c0 0x7f233819a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:06.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233f643640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2338109e10 0x7f233819fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233f643640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2338113980 con 0x7f23381094c0 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233f643640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f2338113800 con 0x7f2338103b80 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233f643640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f2338113b00 con 0x7f2338109e10 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233cbde640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23381094c0 0x7f233819a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233cbde640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23381094c0 0x7f233819a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57504/0 (socket says 172.21.15.22:57504) 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233cbde640 1 -- 172.21.15.22:0/1533096633 learned_addr learned my addr 172.21.15.22:0/1533096633 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233d3df640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2338103b80 0x7f233819a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233dbe0640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2338109e10 0x7f233819fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233cbde640 1 -- 172.21.15.22:0/1533096633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2338109e10 msgr2=0x7f233819fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233cbde640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2338109e10 0x7f233819fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:06.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233cbde640 1 -- 172.21.15.22:0/1533096633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2338103b80 msgr2=0x7f233819a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.011+0000 7f233cbde640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2338103b80 0x7f233819a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.012+0000 7f233cbde640 1 -- 172.21.15.22:0/1533096633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23381a0340 con 0x7f23381094c0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.012+0000 7f233cbde640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23381094c0 0x7f233819a970 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f232800d740 tx=0x7f232800dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.012+0000 7f232e7fc640 1 -- 172.21.15.22:0/1533096633 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2328017070 con 0x7f23381094c0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.012+0000 7f233f643640 1 -- 172.21.15.22:0/1533096633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23381a0630 con 0x7f23381094c0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.012+0000 7f232e7fc640 1 -- 172.21.15.22:0/1533096633 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f232800de50 con 0x7f23381094c0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.012+0000 7f232e7fc640 1 -- 172.21.15.22:0/1533096633 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f232800f620 con 0x7f23381094c0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.012+0000 7f233f643640 1 -- 172.21.15.22:0/1533096633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23381a6d90 con 0x7f23381094c0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.013+0000 7f233f643640 1 -- 172.21.15.22:0/1533096633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2338103f90 con 0x7f23381094c0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.015+0000 7f232e7fc640 1 -- 172.21.15.22:0/1533096633 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f232801a070 con 0x7f23381094c0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.016+0000 7f232e7fc640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23240b6510 0x7f23240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.016+0000 7f233d3df640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23240b6510 0x7f23240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.016+0000 7f232e7fc640 1 -- 172.21.15.22:0/1533096633 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f23280e7000 con 0x7f23381094c0 2024-09-21T04:17:06.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.016+0000 7f233d3df640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23240b6510 0x7f23240b8a20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f23340057c0 tx=0x7f23340058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:17:06.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.019+0000 7f232e7fc640 1 -- 172.21.15.22:0/1533096633 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23280b18b0 con 0x7f23381094c0 2024-09-21T04:17:06.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.250+0000 7f233f643640 1 -- 172.21.15.22:0/1533096633 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f233819b500 con 0x7f23381094c0 2024-09-21T04:17:06.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.251+0000 7f232e7fc640 1 -- 172.21.15.22:0/1533096633 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7f233819b500 con 0x7f23381094c0 2024-09-21T04:17:06.254 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:17:06.254 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:17:06.254 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:17:06.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 -- 172.21.15.22:0/1533096633 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23240b6510 msgr2=0x7f23240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:06.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23240b6510 0x7f23240b8a20 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f23340057c0 tx=0x7f23340058d0 comp rx=0 tx=0).stop 2024-09-21T04:17:06.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 -- 172.21.15.22:0/1533096633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23381094c0 msgr2=0x7f233819a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:06.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23381094c0 0x7f233819a970 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f232800d740 tx=0x7f232800dc00 comp rx=0 tx=0).stop 2024-09-21T04:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 -- 172.21.15.22:0/1533096633 shutdown_connections 2024-09-21T04:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f23240b6510 0x7f23240b8a20 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f2338109e10 0x7f233819fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f23381094c0 0x7f233819a970 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 --2- 172.21.15.22:0/1533096633 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f2338103b80 0x7f233819a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 -- 172.21.15.22:0/1533096633 >> 172.21.15.22:0/1533096633 conn(0x7f23380ff610 msgr2=0x7f2338101a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 -- 172.21.15.22:0/1533096633 shutdown_connections 2024-09-21T04:17:06.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:06.254+0000 7f233f643640 1 -- 172.21.15.22:0/1533096633 wait complete. 2024-09-21T04:17:06.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:06 smithi022 ceph-mon[31015]: pgmap v813: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 234 KiB/s wr, 39 op/s 2024-09-21T04:17:06.911 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:06 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1533096633' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:17:06.941 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id 7b89e441 --release --await' 2024-09-21T04:17:06.941 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id 7b89e441 --release --await 2024-09-21T04:17:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:06 smithi060 ceph-mon[33722]: pgmap v813: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 234 KiB/s wr, 39 op/s 2024-09-21T04:17:06.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:06 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1533096633' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:17:07.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:06 smithi073 ceph-mon[34443]: pgmap v813: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 234 KiB/s wr, 39 op/s 2024-09-21T04:17:07.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:06 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1533096633' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:17:07.207 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:17:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.731+0000 7fe019ba2640 1 -- 172.21.15.22:0/1432227429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe014102a60 msgr2=0x7fe014102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.731+0000 7fe019ba2640 1 --2- 172.21.15.22:0/1432227429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe014102a60 0x7fe014102e70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe004009ca0 tx=0x7fe00402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.731+0000 7fe019ba2640 1 -- 172.21.15.22:0/1432227429 shutdown_connections 2024-09-21T04:17:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.731+0000 7fe019ba2640 1 --2- 172.21.15.22:0/1432227429 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe014108cf0 0x7fe01410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.731+0000 7fe019ba2640 1 --2- 172.21.15.22:0/1432227429 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0141083a0 0x7fe0141087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.731+0000 7fe019ba2640 1 --2- 172.21.15.22:0/1432227429 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe014102a60 0x7fe014102e70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.731+0000 7fe019ba2640 1 -- 172.21.15.22:0/1432227429 >> 172.21.15.22:0/1432227429 conn(0x7fe014079730 msgr2=0x7fe014079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.731+0000 7fe019ba2640 1 -- 172.21.15.22:0/1432227429 shutdown_connections 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.731+0000 7fe019ba2640 1 -- 172.21.15.22:0/1432227429 wait complete. 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.732+0000 7fe019ba2640 1 Processor -- start 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.732+0000 7fe019ba2640 1 -- start start 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.732+0000 7fe019ba2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe014102a60 0x7fe01419a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.732+0000 7fe019ba2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0141083a0 0x7fe01419a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.732+0000 7fe019ba2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe014108cf0 0x7fe01419fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.732+0000 7fe019ba2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe014112860 con 0x7fe014102a60 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.732+0000 7fe019ba2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe0141126e0 con 0x7fe0141083a0 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.732+0000 7fe019ba2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe0141129e0 con 0x7fe014108cf0 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe0137fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe014102a60 0x7fe01419a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe0137fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe014102a60 0x7fe01419a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57520/0 (socket says 172.21.15.22:57520) 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe0137fe640 1 -- 172.21.15.22:0/933937270 learned_addr learned my addr 172.21.15.22:0/933937270 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:17:07.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe012ffd640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0141083a0 0x7fe01419a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe013fff640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe014108cf0 0x7fe01419fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe0137fe640 1 -- 172.21.15.22:0/933937270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe014108cf0 msgr2=0x7fe01419fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe0137fe640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe014108cf0 0x7fe01419fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe0137fe640 1 -- 172.21.15.22:0/933937270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0141083a0 msgr2=0x7fe01419a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe0137fe640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0141083a0 0x7fe01419a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe0137fe640 1 -- 172.21.15.22:0/933937270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0141a02b0 con 0x7fe014102a60 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe0137fe640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe014102a60 0x7fe01419a340 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe004009dc0 tx=0x7fe004032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe010ff9640 1 -- 172.21.15.22:0/933937270 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004004040 con 0x7fe014102a60 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe010ff9640 1 -- 172.21.15.22:0/933937270 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe004004670 con 0x7fe014102a60 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe019ba2640 1 -- 172.21.15.22:0/933937270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0141a0540 con 0x7fe014102a60 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe010ff9640 1 -- 172.21.15.22:0/933937270 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe004030c80 con 0x7fe014102a60 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.733+0000 7fe019ba2640 1 -- 172.21.15.22:0/933937270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0141a6d00 con 0x7fe014102a60 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe020116740 1 Processor -- start 2024-09-21T04:17:07.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe020116740 1 -- start start 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe010ff9640 1 -- 172.21.15.22:0/933937270 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fe0040041e0 con 0x7fe014102a60 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe020116740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x5627320f6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe020116740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 0x5627320f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe020116740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d2f840 0x5627320f6f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe020116740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562731fe1dc0 con 0x562731d50520 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe020116740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56273206e1f0 con 0x562731d2f840 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe020116740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56273205d620 con 0x562731d27660 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe013fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x5627320f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe0137fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 0x5627320f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe013fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x5627320f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57532/0 (socket says 172.21.15.22:57532) 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.736+0000 7fe013fff640 1 -- 172.21.15.22:0/2159147180 learned_addr learned my addr 172.21.15.22:0/2159147180 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fe012ffd640 1 --2- 172.21.15.22:0/2159147180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d2f840 0x5627320f6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fe013fff640 1 -- 172.21.15.22:0/2159147180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 msgr2=0x5627320f6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:17:07.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fe013fff640 1 --2- 172.21.15.22:0/2159147180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 0x5627320f6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fe013fff640 1 -- 172.21.15.22:0/2159147180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d2f840 msgr2=0x5627320f6f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fe013fff640 1 --2- 172.21.15.22:0/2159147180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d2f840 0x5627320f6f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fe013fff640 1 -- 172.21.15.22:0/2159147180 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562732025fd0 con 0x562731d50520 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fe013fff640 1 --2- 172.21.15.22:0/2159147180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x5627320f6510 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00bc70 tx=0x7fe00c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b160fd69eb1d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fe010ff9640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdffc0b6590 0x7fdffc0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fe0137fe640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdffc0b6590 0x7fdffc0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fdff9ffb640 1 -- 172.21.15.22:0/2159147180 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c015070 con 0x562731d50520 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fdff9ffb640 1 -- 172.21.15.22:0/2159147180 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe00c0118d0 con 0x562731d50520 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fdff9ffb640 1 -- 172.21.15.22:0/2159147180 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c0107f0 con 0x562731d50520 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.737+0000 7fe010ff9640 1 -- 172.21.15.22:0/933937270 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fe004108950 con 0x7fe014102a60 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.738+0000 7fe020116740 1 -- 172.21.15.22:0/2159147180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 msgr2=0x5627320f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.738+0000 7fe020116740 1 --2- 172.21.15.22:0/2159147180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x5627320f6510 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00bc70 tx=0x7fe00c00f730 comp rx=0 tx=0).stop 2024-09-21T04:17:07.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.738+0000 7fe0137fe640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdffc0b6590 0x7fdffc0b8aa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x5627320f5190 tx=0x7fe00410e550 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.738+0000 7fe020116740 1 -- 172.21.15.22:0/2159147180 shutdown_connections 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.738+0000 7fe020116740 1 --2- 172.21.15.22:0/2159147180 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 0x5627320f6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.738+0000 7fe020116740 1 --2- 172.21.15.22:0/2159147180 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d2f840 0x5627320f6f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.738+0000 7fe020116740 1 --2- 172.21.15.22:0/2159147180 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x5627320f6510 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.738+0000 7fe020116740 1 -- 172.21.15.22:0/2159147180 >> 172.21.15.22:0/2159147180 conn(0x562731d44910 msgr2=0x5627320f4400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.738+0000 7fe020116740 1 -- 172.21.15.22:0/2159147180 shutdown_connections 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.739+0000 7fe020116740 1 -- 172.21.15.22:0/2159147180 wait complete. 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.739+0000 7fe020116740 1 -- start start 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.739+0000 7fe020116740 1 Processor -- start 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.739+0000 7fe020116740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d27660 0x562732105f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.739+0000 7fe020116740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732106450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.739+0000 7fe020116740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d50520 0x562732106990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.739+0000 7fe020116740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562731ff8300 con 0x562731d2f840 2024-09-21T04:17:07.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.739+0000 7fe020116740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x562732061430 con 0x562731d27660 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.739+0000 7fe020116740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x562731ebebb0 con 0x562731d50520 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe020116740 10 client.0 _ll_register_callbacks cb 0x562732012120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe012ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732106450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe012ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732106450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57546/0 (socket says 172.21.15.22:57546) 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe012ffd640 1 -- 172.21.15.22:0/68553893 learned_addr learned my addr 172.21.15.22:0/68553893 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe013fff640 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d27660 0x562732105f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe013fff640 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d50520 0x562732106990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe012ffd640 1 -- 172.21.15.22:0/68553893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d50520 msgr2=0x562732106990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe012ffd640 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d50520 0x562732106990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe012ffd640 1 -- 172.21.15.22:0/68553893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d27660 msgr2=0x562732105f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe012ffd640 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d27660 0x562732105f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe012ffd640 1 -- 172.21.15.22:0/68553893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562731fe7780 con 0x562731d2f840 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe013fff640 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d50520 0x562732106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:17:07.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe012ffd640 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732106450 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe00800beb0 tx=0x7fe008012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=708c13e6b6ae6fd1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fdff2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fdff2ffd640 1 -- 172.21.15.22:0/68553893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008004230 con 0x562731d2f840 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fdff2ffd640 1 -- 172.21.15.22:0/68553893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fe0080043d0 con 0x562731d2f840 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.740+0000 7fe020116740 1 -- 172.21.15.22:0/68553893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe00c0118d0 con 0x562731d2f840 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fdff2ffd640 1 -- 172.21.15.22:0/68553893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe0080106a0 con 0x562731d2f840 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fe020116740 10 client.16278 fetch_fsmap learned FSMap version 50 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fe020116740 1 -- 172.21.15.22:0/68553893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x562731dbbb00 con 0x562731d2f840 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fdff2ffd640 1 -- 172.21.15.22:0/68553893 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe00c0118d0 con 0x562731d2f840 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fdff2ffd640 1 -- 172.21.15.22:0/68553893 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7fe008019070 con 0x562731d2f840 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fe020116740 10 client.16278 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fe020116740 10 client.16278 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fe020116740 20 client.16278 populate_metadata read hostname 'smithi022' 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fe020116740 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562731d0eea0 0x562732118310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fe020116740 4 client.16278 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fe020116740 1 -- 172.21.15.22:0/68553893 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562732070140 con 0x562731d0eea0 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.741+0000 7fe013fff640 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562731d0eea0 0x562732118310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.742+0000 7fdff2ffd640 10 client.16278 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.742+0000 7fe013fff640 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562731d0eea0 0x562732118310 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76884e6103840cde server_cookie=4c490ba36e135c9c in_seq=0 out_seq=0 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fdff2ffd640 1 -- 172.21.15.22:0/68553893 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562732070140 con 0x562731d0eea0 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fdff2ffd640 10 client.16278 handle_command_reply: tid=0 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 client.16278 shutdown 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 -- 172.21.15.22:0/68553893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 msgr2=0x562732106450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732106450 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fe00800beb0 tx=0x7fe008012820 comp rx=0 tx=0).stop 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 -- 172.21.15.22:0/68553893 shutdown_connections 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562731d0eea0 0x562732118310 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d50520 0x562732106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732106450 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 --2- 172.21.15.22:0/68553893 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d27660 0x562732105f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 -- 172.21.15.22:0/68553893 >> 172.21.15.22:0/68553893 conn(0x562731d44910 msgr2=0x5627320f2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:17:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fdff2ffd640 0 client.16278 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:17:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 -- 172.21.15.22:0/68553893 shutdown_connections 2024-09-21T04:17:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 1 -- 172.21.15.22:0/68553893 wait complete. 2024-09-21T04:17:07.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.743+0000 7fe020116740 20 client.16278 trim_cache size 0 max 16384 2024-09-21T04:17:07.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.760+0000 7fe020116740 1 Processor -- start 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe020116740 1 -- start start 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe020116740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 0x562732107df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe020116740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732103100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe020116740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d50520 0x562732103640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe020116740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0141ae8b0 con 0x562731d2f840 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe020116740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe0141b03f0 con 0x562731d50520 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe020116740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe0141aef80 con 0x562731d27660 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe012ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732103100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe012ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732103100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57550/0 (socket says 172.21.15.22:57550) 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe012ffd640 1 -- 172.21.15.22:0/1352833571 learned_addr learned my addr 172.21.15.22:0/1352833571 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe013fff640 1 --2- 172.21.15.22:0/1352833571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 0x562732107df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe012ffd640 1 -- 172.21.15.22:0/1352833571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 msgr2=0x562732107df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:17:07.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe012ffd640 1 --2- 172.21.15.22:0/1352833571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 0x562732107df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe012ffd640 1 -- 172.21.15.22:0/1352833571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d50520 msgr2=0x562732103640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe012ffd640 1 --2- 172.21.15.22:0/1352833571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d50520 0x562732103640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe012ffd640 1 -- 172.21.15.22:0/1352833571 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562731e32960 con 0x562731d2f840 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.761+0000 7fe013fff640 1 --2- 172.21.15.22:0/1352833571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 0x562732107df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.762+0000 7fe012ffd640 1 --2- 172.21.15.22:0/1352833571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732103100 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe008001eb0 tx=0x7fe00800bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=398372f263d20fe4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.762+0000 7fdff97fa640 1 -- 172.21.15.22:0/1352833571 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0080037f0 con 0x562731d2f840 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.762+0000 7fdff97fa640 1 -- 172.21.15.22:0/1352833571 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe00802e070 con 0x562731d2f840 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.762+0000 7fdff97fa640 1 -- 172.21.15.22:0/1352833571 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe008010d60 con 0x562731d2f840 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 -- 172.21.15.22:0/1352833571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 msgr2=0x562732103100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 --2- 172.21.15.22:0/1352833571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732103100 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fe008001eb0 tx=0x7fe00800bb50 comp rx=0 tx=0).stop 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 -- 172.21.15.22:0/1352833571 shutdown_connections 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 --2- 172.21.15.22:0/1352833571 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d50520 0x562732103640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 --2- 172.21.15.22:0/1352833571 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d2f840 0x562732103100 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 --2- 172.21.15.22:0/1352833571 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d27660 0x562732107df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 -- 172.21.15.22:0/1352833571 >> 172.21.15.22:0/1352833571 conn(0x562731d44910 msgr2=0x5627321012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 -- 172.21.15.22:0/1352833571 shutdown_connections 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 -- 172.21.15.22:0/1352833571 wait complete. 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 -- start start 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.763+0000 7fe020116740 1 Processor -- start 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe020116740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d27660 0x56273210a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe020116740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d2f840 0x56273210a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe020116740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x562732181cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe020116740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0141afd20 con 0x562731d50520 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe020116740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fe0141af650 con 0x562731d27660 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe020116740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fe0141ac890 con 0x562731d2f840 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe020116740 10 client.0 _ll_register_callbacks cb 0x7fe00800b730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe013fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x562732181cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe013fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x562732181cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:57562/0 (socket says 172.21.15.22:57562) 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe013fff640 1 -- 172.21.15.22:0/3298764758 learned_addr learned my addr 172.21.15.22:0/3298764758 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe013fff640 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d27660 0x56273210a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe012ffd640 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d2f840 0x56273210a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe013fff640 1 -- 172.21.15.22:0/3298764758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d2f840 msgr2=0x56273210a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe013fff640 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d2f840 0x56273210a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe013fff640 1 -- 172.21.15.22:0/3298764758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d27660 msgr2=0x56273210a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe013fff640 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d27660 0x56273210a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe013fff640 1 -- 172.21.15.22:0/3298764758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56273210b1c0 con 0x562731d50520 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe012ffd640 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d2f840 0x56273210a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fe013fff640 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x562732181cd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00bc40 tx=0x7fe00c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8722db03e83102 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.764+0000 7fdff2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:17:07.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fdff2ffd640 1 -- 172.21.15.22:0/3298764758 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe00c035060 con 0x562731d50520 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fdff2ffd640 1 -- 172.21.15.22:0/3298764758 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fe00c0108f0 con 0x562731d50520 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fe020116740 1 -- 172.21.15.22:0/3298764758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe00802e070 con 0x562731d50520 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fdff2ffd640 1 -- 172.21.15.22:0/3298764758 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7fe00c03c050 con 0x562731d50520 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fe020116740 10 client.16284 fetch_fsmap learned FSMap version 50 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fe020116740 1 -- 172.21.15.22:0/3298764758 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x562732183260 con 0x562731d50520 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fdff2ffd640 1 -- 172.21.15.22:0/3298764758 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe00802e070 con 0x562731d50520 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fdff2ffd640 1 -- 172.21.15.22:0/3298764758 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7fe00c0289c0 con 0x562731d50520 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fe020116740 10 client.16284 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fe020116740 10 client.16284 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fe020116740 20 client.16284 populate_metadata read hostname 'smithi022' 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fe020116740 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562731ce4250 0x5627321856f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fe020116740 4 client.16284 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7b89e441", "release": true, "await": true}] 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.765+0000 7fe020116740 1 -- 172.21.15.22:0/3298764758 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7b89e441", "release": true, "await": true}) -- 0x56273206bbf0 con 0x562731ce4250 2024-09-21T04:17:07.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.766+0000 7fe012ffd640 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562731ce4250 0x5627321856f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:17:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.766+0000 7fe012ffd640 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562731ce4250 0x5627321856f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=392da8356446bdea server_cookie=4dbd280d442d9118 in_seq=0 out_seq=0 2024-09-21T04:17:07.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.766+0000 7fdff2ffd640 10 client.16284 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:17:07.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fdff2ffd640 1 -- 172.21.15.22:0/3298764758 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56273206bbf0 con 0x562731ce4250 2024-09-21T04:17:07.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fdff2ffd640 10 client.16284 handle_command_reply: tid=0 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 client.16284 shutdown 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 -- 172.21.15.22:0/3298764758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 msgr2=0x562732181cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x562732181cd0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fe00c00bc40 tx=0x7fe00c00f730 comp rx=0 tx=0).stop 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 -- 172.21.15.22:0/3298764758 shutdown_connections 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x562731ce4250 0x5627321856f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x562731d2f840 0x56273210a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fdff2ffd640 0 client.16284 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562731d50520 0x562732181cd0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 --2- 172.21.15.22:0/3298764758 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x562731d27660 0x56273210a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 -- 172.21.15.22:0/3298764758 >> 172.21.15.22:0/3298764758 conn(0x562731d44910 msgr2=0x562732104790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 -- 172.21.15.22:0/3298764758 shutdown_connections 2024-09-21T04:17:07.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.819+0000 7fe020116740 1 -- 172.21.15.22:0/3298764758 wait complete. 2024-09-21T04:17:07.823 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.820+0000 7fe020116740 20 client.16284 trim_cache size 0 max 16384 2024-09-21T04:17:07.823 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:17:07.823 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:17:07.823 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:17:07.823 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 60, 2024-09-21T04:17:07.823 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:17:07.823 INFO:teuthology.orchestra.run.smithi022.stdout: "7b89e441": { 2024-09-21T04:17:07.823 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 60, 2024-09-21T04:17:07.823 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 138.8, 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:17:07.824 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:17:07.825 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:17:07.825 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:17:07.825 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:17:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.820+0000 7fe019ba2640 1 -- 172.21.15.22:0/933937270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdffc0b6590 msgr2=0x7fdffc0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:07.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.820+0000 7fe019ba2640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdffc0b6590 0x7fdffc0b8aa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x5627320f5190 tx=0x7fe00410e550 comp rx=0 tx=0).stop 2024-09-21T04:17:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.820+0000 7fe019ba2640 1 -- 172.21.15.22:0/933937270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe014102a60 msgr2=0x7fe01419a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:17:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.820+0000 7fe019ba2640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe014102a60 0x7fe01419a340 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe004009dc0 tx=0x7fe004032bc0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.821+0000 7fe019ba2640 1 -- 172.21.15.22:0/933937270 shutdown_connections 2024-09-21T04:17:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.821+0000 7fe019ba2640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fdffc0b6590 0x7fdffc0b8aa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.821+0000 7fe019ba2640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fe014108cf0 0x7fe01419fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.821+0000 7fe019ba2640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fe0141083a0 0x7fe01419a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.821+0000 7fe019ba2640 1 --2- 172.21.15.22:0/933937270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe014102a60 0x7fe01419a340 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:17:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.821+0000 7fe019ba2640 1 -- 172.21.15.22:0/933937270 >> 172.21.15.22:0/933937270 conn(0x7fe014079730 msgr2=0x7fe014101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:17:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.821+0000 7fe019ba2640 1 -- 172.21.15.22:0/933937270 shutdown_connections 2024-09-21T04:17:07.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:17:07.821+0000 7fe019ba2640 1 -- 172.21.15.22:0/933937270 wait complete. 2024-09-21T04:17:08.593 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7b89e441', total seconds elapsed: 22.2 2024-09-21T04:17:08.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 765.0 s, 173.0 tps, lat 2172.704 ms stddev 5745.484 2024-09-21T04:17:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:08 smithi022 ceph-mon[31015]: pgmap v814: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 235 KiB/s wr, 39 op/s 2024-09-21T04:17:08.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:08 smithi060 ceph-mon[33722]: pgmap v814: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 235 KiB/s wr, 39 op/s 2024-09-21T04:17:09.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:08 smithi073 ceph-mon[34443]: pgmap v814: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 235 KiB/s wr, 39 op/s 2024-09-21T04:17:10.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:10 smithi060 ceph-mon[33722]: pgmap v815: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 204 KiB/s wr, 34 op/s 2024-09-21T04:17:11.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:10 smithi022 ceph-mon[31015]: pgmap v815: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 204 KiB/s wr, 34 op/s 2024-09-21T04:17:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:10 smithi073 ceph-mon[34443]: pgmap v815: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 204 KiB/s wr, 34 op/s 2024-09-21T04:17:12.906 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:12 smithi073 ceph-mon[34443]: pgmap v816: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 752 KiB/s wr, 102 op/s 2024-09-21T04:17:12.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:12 smithi060 ceph-mon[33722]: pgmap v816: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 752 KiB/s wr, 102 op/s 2024-09-21T04:17:13.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:12 smithi022 ceph-mon[31015]: pgmap v816: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 752 KiB/s wr, 102 op/s 2024-09-21T04:17:13.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 770.0 s, 841.8 tps, lat 120.708 ms stddev 78.746 2024-09-21T04:17:14.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:14 smithi060 ceph-mon[33722]: pgmap v817: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.0 MiB/s wr, 219 op/s 2024-09-21T04:17:15.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:14 smithi022 ceph-mon[31015]: pgmap v817: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.0 MiB/s wr, 219 op/s 2024-09-21T04:17:15.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:14 smithi073 ceph-mon[34443]: pgmap v817: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 2.0 MiB/s wr, 219 op/s 2024-09-21T04:17:16.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:16 smithi060 ceph-mon[33722]: pgmap v818: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.9 MiB/s wr, 323 op/s 2024-09-21T04:17:17.066 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:16 smithi022 ceph-mon[31015]: pgmap v818: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.9 MiB/s wr, 323 op/s 2024-09-21T04:17:17.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:16 smithi073 ceph-mon[34443]: pgmap v818: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 2.9 MiB/s wr, 323 op/s 2024-09-21T04:17:18.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 775.0 s, 799.6 tps, lat 125.442 ms stddev 45.277 2024-09-21T04:17:18.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:18 smithi060 ceph-mon[33722]: pgmap v819: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 515 op/s 2024-09-21T04:17:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:18 smithi022 ceph-mon[31015]: pgmap v819: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 515 op/s 2024-09-21T04:17:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:18 smithi073 ceph-mon[34443]: pgmap v819: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.7 MiB/s wr, 515 op/s 2024-09-21T04:17:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:20 smithi060 ceph-mon[33722]: pgmap v820: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 541 op/s 2024-09-21T04:17:21.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:20 smithi022 ceph-mon[31015]: pgmap v820: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 541 op/s 2024-09-21T04:17:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:20 smithi073 ceph-mon[34443]: pgmap v820: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.9 MiB/s wr, 541 op/s 2024-09-21T04:17:22.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:22 smithi060 ceph-mon[33722]: pgmap v821: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 690 op/s 2024-09-21T04:17:22.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:22 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:17:23.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:22 smithi022 ceph-mon[31015]: pgmap v821: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 690 op/s 2024-09-21T04:17:23.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:22 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:17:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:22 smithi073 ceph-mon[34443]: pgmap v821: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.1 MiB/s wr, 690 op/s 2024-09-21T04:17:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:22 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:17:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 780.0 s, 720.8 tps, lat 138.074 ms stddev 70.182 2024-09-21T04:17:23.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:17:23.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:17:23.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:17:24.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:17:24.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:17:24.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:17:24.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:17:24.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:17:24.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:17:24.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:24 smithi060 ceph-mon[33722]: pgmap v822: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.2 MiB/s wr, 778 op/s 2024-09-21T04:17:25.000 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:24 smithi022 ceph-mon[31015]: pgmap v822: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.2 MiB/s wr, 778 op/s 2024-09-21T04:17:25.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:24 smithi073 ceph-mon[34443]: pgmap v822: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.2 MiB/s wr, 778 op/s 2024-09-21T04:17:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:26 smithi060 ceph-mon[33722]: pgmap v823: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.7 MiB/s wr, 751 op/s 2024-09-21T04:17:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:26 smithi022 ceph-mon[31015]: pgmap v823: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.7 MiB/s wr, 751 op/s 2024-09-21T04:17:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:26 smithi073 ceph-mon[34443]: pgmap v823: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.7 MiB/s wr, 751 op/s 2024-09-21T04:17:28.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 785.0 s, 757.2 tps, lat 133.081 ms stddev 105.785 2024-09-21T04:17:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:28 smithi060 ceph-mon[33722]: pgmap v824: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.3 MiB/s wr, 810 op/s 2024-09-21T04:17:29.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:28 smithi022 ceph-mon[31015]: pgmap v824: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.3 MiB/s wr, 810 op/s 2024-09-21T04:17:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:28 smithi073 ceph-mon[34443]: pgmap v824: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.3 MiB/s wr, 810 op/s 2024-09-21T04:17:30.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:30 smithi022 ceph-mon[31015]: pgmap v825: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.9 MiB/s wr, 659 op/s 2024-09-21T04:17:30.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:30 smithi060 ceph-mon[33722]: pgmap v825: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.9 MiB/s wr, 659 op/s 2024-09-21T04:17:31.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:30 smithi073 ceph-mon[34443]: pgmap v825: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.9 MiB/s wr, 659 op/s 2024-09-21T04:17:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:32 smithi060 ceph-mon[33722]: pgmap v826: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.8 MiB/s wr, 781 op/s 2024-09-21T04:17:33.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:32 smithi022 ceph-mon[31015]: pgmap v826: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.8 MiB/s wr, 781 op/s 2024-09-21T04:17:33.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:32 smithi073 ceph-mon[34443]: pgmap v826: 129 pgs: 129 active+clean; 1.4 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.8 MiB/s wr, 781 op/s 2024-09-21T04:17:33.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 790.0 s, 764.2 tps, lat 129.912 ms stddev 69.280 2024-09-21T04:17:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:34 smithi060 ceph-mon[33722]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.3 MiB/s wr, 777 op/s 2024-09-21T04:17:35.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:34 smithi022 ceph-mon[31015]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.3 MiB/s wr, 777 op/s 2024-09-21T04:17:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:34 smithi073 ceph-mon[34443]: pgmap v827: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 7.3 MiB/s wr, 777 op/s 2024-09-21T04:17:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:36 smithi060 ceph-mon[33722]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 737 op/s 2024-09-21T04:17:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:36 smithi022 ceph-mon[31015]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 737 op/s 2024-09-21T04:17:37.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:36 smithi073 ceph-mon[34443]: pgmap v828: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 6.6 MiB/s wr, 737 op/s 2024-09-21T04:17:38.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 795.0 s, 756.0 tps, lat 131.846 ms stddev 82.488 2024-09-21T04:17:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:38 smithi060 ceph-mon[33722]: pgmap v829: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.5 MiB/s wr, 814 op/s 2024-09-21T04:17:39.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:38 smithi022 ceph-mon[31015]: pgmap v829: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.5 MiB/s wr, 814 op/s 2024-09-21T04:17:39.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:38 smithi073 ceph-mon[34443]: pgmap v829: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.5 MiB/s wr, 814 op/s 2024-09-21T04:17:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:40 smithi060 ceph-mon[33722]: pgmap v830: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 676 op/s 2024-09-21T04:17:41.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:40 smithi022 ceph-mon[31015]: pgmap v830: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 676 op/s 2024-09-21T04:17:41.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:40 smithi073 ceph-mon[34443]: pgmap v830: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 6.2 MiB/s wr, 676 op/s 2024-09-21T04:17:42.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:42 smithi060 ceph-mon[33722]: pgmap v831: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 774 op/s 2024-09-21T04:17:43.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:42 smithi022 ceph-mon[31015]: pgmap v831: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 774 op/s 2024-09-21T04:17:43.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:42 smithi073 ceph-mon[34443]: pgmap v831: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 6.9 MiB/s wr, 774 op/s 2024-09-21T04:17:43.705 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 800.0 s, 762.1 tps, lat 131.769 ms stddev 67.409 2024-09-21T04:17:44.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:44 smithi060 ceph-mon[33722]: pgmap v832: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.1 MiB/s wr, 759 op/s 2024-09-21T04:17:45.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:44 smithi022 ceph-mon[31015]: pgmap v832: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.1 MiB/s wr, 759 op/s 2024-09-21T04:17:45.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:44 smithi073 ceph-mon[34443]: pgmap v832: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.1 MiB/s wr, 759 op/s 2024-09-21T04:17:46.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:46 smithi060 ceph-mon[33722]: pgmap v833: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.4 MiB/s wr, 733 op/s 2024-09-21T04:17:47.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:46 smithi022 ceph-mon[31015]: pgmap v833: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.4 MiB/s wr, 733 op/s 2024-09-21T04:17:47.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:46 smithi073 ceph-mon[34443]: pgmap v833: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 6.4 MiB/s wr, 733 op/s 2024-09-21T04:17:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 805.0 s, 853.9 tps, lat 117.364 ms stddev 63.716 2024-09-21T04:17:48.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:48 smithi060 ceph-mon[33722]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 781 op/s 2024-09-21T04:17:49.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:48 smithi022 ceph-mon[31015]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 781 op/s 2024-09-21T04:17:49.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:48 smithi073 ceph-mon[34443]: pgmap v834: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 7.0 MiB/s wr, 781 op/s 2024-09-21T04:17:51.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:50 smithi022 ceph-mon[31015]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.6 MiB/s wr, 641 op/s 2024-09-21T04:17:51.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:50 smithi073 ceph-mon[34443]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.6 MiB/s wr, 641 op/s 2024-09-21T04:17:51.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:50 smithi060 ceph-mon[33722]: pgmap v835: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.6 MiB/s wr, 641 op/s 2024-09-21T04:17:53.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:52 smithi022 ceph-mon[31015]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.1 MiB/s wr, 800 op/s 2024-09-21T04:17:53.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:52 smithi073 ceph-mon[34443]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.1 MiB/s wr, 800 op/s 2024-09-21T04:17:53.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:52 smithi060 ceph-mon[33722]: pgmap v836: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 7.1 MiB/s wr, 800 op/s 2024-09-21T04:17:53.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 810.0 s, 913.4 tps, lat 109.738 ms stddev 42.352 2024-09-21T04:17:55.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:54 smithi022 ceph-mon[31015]: pgmap v837: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 824 op/s 2024-09-21T04:17:55.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:54 smithi073 ceph-mon[34443]: pgmap v837: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 824 op/s 2024-09-21T04:17:55.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:54 smithi060 ceph-mon[33722]: pgmap v837: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 7.5 MiB/s wr, 824 op/s 2024-09-21T04:17:57.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:56 smithi022 ceph-mon[31015]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 798 op/s 2024-09-21T04:17:57.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:56 smithi073 ceph-mon[34443]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 798 op/s 2024-09-21T04:17:57.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:56 smithi060 ceph-mon[33722]: pgmap v838: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 7.1 MiB/s wr, 798 op/s 2024-09-21T04:17:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 815.0 s, 815.6 tps, lat 122.164 ms stddev 66.017 2024-09-21T04:17:59.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:17:58 smithi022 ceph-mon[31015]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 843 op/s 2024-09-21T04:17:59.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:17:58 smithi073 ceph-mon[34443]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 843 op/s 2024-09-21T04:17:59.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:17:58 smithi060 ceph-mon[33722]: pgmap v839: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 7.3 MiB/s wr, 843 op/s 2024-09-21T04:18:01.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:00 smithi022 ceph-mon[31015]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 736 op/s 2024-09-21T04:18:01.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:00 smithi073 ceph-mon[34443]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 736 op/s 2024-09-21T04:18:01.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:00 smithi060 ceph-mon[33722]: pgmap v840: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 6.4 MiB/s wr, 736 op/s 2024-09-21T04:18:03.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:02 smithi022 ceph-mon[31015]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.0 MiB/s wr, 903 op/s 2024-09-21T04:18:03.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:02 smithi073 ceph-mon[34443]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.0 MiB/s wr, 903 op/s 2024-09-21T04:18:03.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:02 smithi060 ceph-mon[33722]: pgmap v841: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.0 MiB/s wr, 903 op/s 2024-09-21T04:18:03.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 820.0 s, 836.2 tps, lat 119.328 ms stddev 55.381 2024-09-21T04:18:05.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:04 smithi022 ceph-mon[31015]: pgmap v842: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.3 MiB/s wr, 844 op/s 2024-09-21T04:18:05.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:04 smithi073 ceph-mon[34443]: pgmap v842: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.3 MiB/s wr, 844 op/s 2024-09-21T04:18:05.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:04 smithi060 ceph-mon[33722]: pgmap v842: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 7.3 MiB/s wr, 844 op/s 2024-09-21T04:18:07.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:06 smithi022 ceph-mon[31015]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 824 op/s 2024-09-21T04:18:07.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:06 smithi073 ceph-mon[34443]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 824 op/s 2024-09-21T04:18:07.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:06 smithi060 ceph-mon[33722]: pgmap v843: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 8.1 MiB/s wr, 824 op/s 2024-09-21T04:18:08.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 825.0 s, 780.2 tps, lat 128.583 ms stddev 88.331 2024-09-21T04:18:09.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:08 smithi022 ceph-mon[31015]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 889 op/s 2024-09-21T04:18:09.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:08 smithi073 ceph-mon[34443]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 889 op/s 2024-09-21T04:18:09.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:08 smithi060 ceph-mon[33722]: pgmap v844: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 9.5 MiB/s wr, 889 op/s 2024-09-21T04:18:11.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:10 smithi022 ceph-mon[31015]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.5 MiB/s wr, 763 op/s 2024-09-21T04:18:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:10 smithi073 ceph-mon[34443]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.5 MiB/s wr, 763 op/s 2024-09-21T04:18:11.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:10 smithi060 ceph-mon[33722]: pgmap v845: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.5 MiB/s wr, 763 op/s 2024-09-21T04:18:13.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:12 smithi022 ceph-mon[31015]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 876 op/s 2024-09-21T04:18:13.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:12 smithi073 ceph-mon[34443]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 876 op/s 2024-09-21T04:18:13.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:12 smithi060 ceph-mon[33722]: pgmap v846: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 876 op/s 2024-09-21T04:18:13.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 830.0 s, 802.0 tps, lat 124.061 ms stddev 103.233 2024-09-21T04:18:15.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:14 smithi022 ceph-mon[31015]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 819 op/s 2024-09-21T04:18:15.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:14 smithi073 ceph-mon[34443]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 819 op/s 2024-09-21T04:18:15.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:14 smithi060 ceph-mon[33722]: pgmap v847: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 819 op/s 2024-09-21T04:18:17.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:16 smithi022 ceph-mon[31015]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 815 op/s 2024-09-21T04:18:17.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:16 smithi073 ceph-mon[34443]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 815 op/s 2024-09-21T04:18:17.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:16 smithi060 ceph-mon[33722]: pgmap v848: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 815 op/s 2024-09-21T04:18:18.609 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 23.2 2024-09-21T04:18:18.609 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:18:18.706 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 835.0 s, 930.8 tps, lat 107.459 ms stddev 64.211 2024-09-21T04:18:19.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:18 smithi022 ceph-mon[31015]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 848 op/s 2024-09-21T04:18:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:18 smithi073 ceph-mon[34443]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 848 op/s 2024-09-21T04:18:19.136 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:18:19.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:18 smithi060 ceph-mon[33722]: pgmap v849: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 12 MiB/s wr, 848 op/s 2024-09-21T04:18:19.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.824+0000 7f90af59e640 1 -- 172.21.15.22:0/1124826045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90b010dbf0 msgr2=0x7f90b010e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:19.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.824+0000 7f90af59e640 1 --2- 172.21.15.22:0/1124826045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90b010dbf0 0x7f90b010e000 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009be0 tx=0x7f90a802a6c0 comp rx=0 tx=0).stop 2024-09-21T04:18:19.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.826+0000 7f90af59e640 1 -- 172.21.15.22:0/1124826045 shutdown_connections 2024-09-21T04:18:19.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.826+0000 7f90af59e640 1 --2- 172.21.15.22:0/1124826045 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90b011cba0 0x7f90b011efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:19.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.826+0000 7f90af59e640 1 --2- 172.21.15.22:0/1124826045 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90b010dbf0 0x7f90b010e000 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:19.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.826+0000 7f90af59e640 1 --2- 172.21.15.22:0/1124826045 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b0111cd0 0x7f90b010d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:19.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.826+0000 7f90af59e640 1 -- 172.21.15.22:0/1124826045 >> 172.21.15.22:0/1124826045 conn(0x7f90b006e9f0 msgr2=0x7f90b006ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:19.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.828+0000 7f90af59e640 1 -- 172.21.15.22:0/1124826045 shutdown_connections 2024-09-21T04:18:19.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.828+0000 7f90af59e640 1 -- 172.21.15.22:0/1124826045 wait complete. 2024-09-21T04:18:19.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.829+0000 7f90af59e640 1 Processor -- start 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.829+0000 7f90af59e640 1 -- start start 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.830+0000 7f90af59e640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b010dbf0 0x7f90b01a90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.830+0000 7f90af59e640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90b0111cd0 0x7f90b01a9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.830+0000 7f90af59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90b011cba0 0x7f90b01ae8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.830+0000 7f90af59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f90b0122580 con 0x7f90b011cba0 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.830+0000 7f90af59e640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f90b0122400 con 0x7f90b010dbf0 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.830+0000 7f90af59e640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f90b0122700 con 0x7f90b0111cd0 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.830+0000 7f90ae59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b010dbf0 0x7f90b01a90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.830+0000 7f90ae59c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b010dbf0 0x7f90b01a90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:46626/0 (socket says 172.21.15.22:46626) 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.830+0000 7f90ae59c640 1 -- 172.21.15.22:0/3890188347 learned_addr learned my addr 172.21.15.22:0/3890188347 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:19.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.830+0000 7f90add9b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90b0111cd0 0x7f90b01a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.831+0000 7f90add9b640 1 -- 172.21.15.22:0/3890188347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b010dbf0 msgr2=0x7f90b01a90b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.831+0000 7f90add9b640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b010dbf0 0x7f90b01a90b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.831+0000 7f90add9b640 1 -- 172.21.15.22:0/3890188347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90b011cba0 msgr2=0x7f90b01ae8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.831+0000 7f90add9b640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90b011cba0 0x7f90b01ae8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.831+0000 7f90add9b640 1 -- 172.21.15.22:0/3890188347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b01af020 con 0x7f90b0111cd0 2024-09-21T04:18:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.831+0000 7f90add9b640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90b0111cd0 0x7f90b01a9650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f90a8034040 tx=0x7f90a8030d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.831+0000 7f909f7fe640 1 -- 172.21.15.22:0/3890188347 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8041020 con 0x7f90b0111cd0 2024-09-21T04:18:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.832+0000 7f909f7fe640 1 -- 172.21.15.22:0/3890188347 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f90a8037040 con 0x7f90b0111cd0 2024-09-21T04:18:19.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.832+0000 7f90af59e640 1 -- 172.21.15.22:0/3890188347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b01af2b0 con 0x7f90b0111cd0 2024-09-21T04:18:19.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.832+0000 7f90af59e640 1 -- 172.21.15.22:0/3890188347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b01b5a70 con 0x7f90b0111cd0 2024-09-21T04:18:19.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.832+0000 7f909f7fe640 1 -- 172.21.15.22:0/3890188347 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8036070 con 0x7f90b0111cd0 2024-09-21T04:18:19.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.835+0000 7f909f7fe640 1 -- 172.21.15.22:0/3890188347 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f90a8044020 con 0x7f90b0111cd0 2024-09-21T04:18:19.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.837+0000 7f909d7fa640 1 -- 172.21.15.22:0/3890188347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b010e000 con 0x7f90b0111cd0 2024-09-21T04:18:19.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.837+0000 7f909f7fe640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f90980b6720 0x7f90980b8c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:19.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.837+0000 7f909f7fe640 1 -- 172.21.15.22:0/3890188347 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f90a8108040 con 0x7f90b0111cd0 2024-09-21T04:18:19.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.839+0000 7f90ae59c640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f90980b6720 0x7f90980b8c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:19.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.842+0000 7f90ae59c640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f90980b6720 0x7f90980b8c30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f90a40095f0 tx=0x7f90a4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:19.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:19.845+0000 7f909f7fe640 1 -- 172.21.15.22:0/3890188347 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90a804b020 con 0x7f90b0111cd0 2024-09-21T04:18:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.277+0000 7f909d7fa640 1 -- 172.21.15.22:0/3890188347 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f90b0063fc0 con 0x7f90b0111cd0 2024-09-21T04:18:20.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.278+0000 7f909f7fe640 1 -- 172.21.15.22:0/3890188347 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7f90a80ce4b0 con 0x7f90b0111cd0 2024-09-21T04:18:20.284 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:18:20.285 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:18:20.285 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:18:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.284+0000 7f909d7fa640 1 -- 172.21.15.22:0/3890188347 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f90980b6720 msgr2=0x7f90980b8c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:20.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.284+0000 7f909d7fa640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f90980b6720 0x7f90980b8c30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f90a40095f0 tx=0x7f90a4005f90 comp rx=0 tx=0).stop 2024-09-21T04:18:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.284+0000 7f909d7fa640 1 -- 172.21.15.22:0/3890188347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90b0111cd0 msgr2=0x7f90b01a9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.284+0000 7f909d7fa640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90b0111cd0 0x7f90b01a9650 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f90a8034040 tx=0x7f90a8030d50 comp rx=0 tx=0).stop 2024-09-21T04:18:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.284+0000 7f909d7fa640 1 -- 172.21.15.22:0/3890188347 shutdown_connections 2024-09-21T04:18:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.284+0000 7f909d7fa640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f90980b6720 0x7f90980b8c30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.284+0000 7f909d7fa640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f90b0111cd0 0x7f90b01a9650 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.284+0000 7f909d7fa640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f90b011cba0 0x7f90b01ae8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.284+0000 7f909d7fa640 1 --2- 172.21.15.22:0/3890188347 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f90b010dbf0 0x7f90b01a90b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.284+0000 7f909d7fa640 1 -- 172.21.15.22:0/3890188347 >> 172.21.15.22:0/3890188347 conn(0x7f90b006e9f0 msgr2=0x7f90b01109b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.285+0000 7f909d7fa640 1 -- 172.21.15.22:0/3890188347 shutdown_connections 2024-09-21T04:18:20.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:20.285+0000 7f909d7fa640 1 -- 172.21.15.22:0/3890188347 wait complete. 2024-09-21T04:18:21.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:20 smithi022 ceph-mon[31015]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 714 op/s 2024-09-21T04:18:21.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:20 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3890188347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:18:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:20 smithi073 ceph-mon[34443]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 714 op/s 2024-09-21T04:18:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:20 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3890188347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:18:21.197 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 143.2 --await-for 45.0' 2024-09-21T04:18:21.197 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 143.2 --await-for 45.0 2024-09-21T04:18:21.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:20 smithi060 ceph-mon[33722]: pgmap v850: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 11 MiB/s wr, 714 op/s 2024-09-21T04:18:21.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:20 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3890188347' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:18:21.654 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:18:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.373+0000 7f196c1ff640 1 -- 172.21.15.22:0/601082848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964103b70 msgr2=0x7f1964103f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.373+0000 7f196c1ff640 1 --2- 172.21.15.22:0/601082848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964103b70 0x7f1964103f80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1960009900 tx=0x7f196002a3f0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.373+0000 7f196c1ff640 1 -- 172.21.15.22:0/601082848 shutdown_connections 2024-09-21T04:18:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.373+0000 7f196c1ff640 1 --2- 172.21.15.22:0/601082848 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f19641094b0 0x7f19641098c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.373+0000 7f196c1ff640 1 --2- 172.21.15.22:0/601082848 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1964109e00 0x7f1964110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.373+0000 7f196c1ff640 1 --2- 172.21.15.22:0/601082848 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f1964103b70 0x7f1964103f80 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.377 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.373+0000 7f196c1ff640 1 -- 172.21.15.22:0/601082848 >> 172.21.15.22:0/601082848 conn(0x7f19640ff5a0 msgr2=0x7f19641019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.373+0000 7f196c1ff640 1 -- 172.21.15.22:0/601082848 shutdown_connections 2024-09-21T04:18:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.373+0000 7f196c1ff640 1 -- 172.21.15.22:0/601082848 wait complete. 2024-09-21T04:18:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.375+0000 7f196c1ff640 1 Processor -- start 2024-09-21T04:18:22.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.375+0000 7f196c1ff640 1 -- start start 2024-09-21T04:18:22.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f196c1ff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1964103b70 0x7f196419a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f196c1ff640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19641094b0 0x7f196419a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f196c1ff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1964109e00 0x7f196419fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f196c1ff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19641139c0 con 0x7f1964103b70 2024-09-21T04:18:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f1969f9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1964103b70 0x7f196419a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f1969f9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1964103b70 0x7f196419a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53042/0 (socket says 172.21.15.22:53042) 2024-09-21T04:18:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f1969f9b640 1 -- 172.21.15.22:0/1063683558 learned_addr learned my addr 172.21.15.22:0/1063683558 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f196c1ff640 1 -- 172.21.15.22:0/1063683558 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f1964113840 con 0x7f19641094b0 2024-09-21T04:18:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f196979a640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19641094b0 0x7f196419a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f196c1ff640 1 -- 172.21.15.22:0/1063683558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f1964113b40 con 0x7f1964109e00 2024-09-21T04:18:22.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.376+0000 7f196a79c640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1964109e00 0x7f196419fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.377+0000 7f196a79c640 1 -- 172.21.15.22:0/1063683558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19641094b0 msgr2=0x7f196419a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:22.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.377+0000 7f196a79c640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19641094b0 0x7f196419a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.377+0000 7f196a79c640 1 -- 172.21.15.22:0/1063683558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1964103b70 msgr2=0x7f196419a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:22.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.377+0000 7f196a79c640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1964103b70 0x7f196419a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.377+0000 7f196a79c640 1 -- 172.21.15.22:0/1063683558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19641a03a0 con 0x7f1964109e00 2024-09-21T04:18:22.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.378+0000 7f196a79c640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1964109e00 0x7f196419fc70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f195c009fd0 tx=0x7f195c00dea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:22.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.378+0000 7f195affd640 1 -- 172.21.15.22:0/1063683558 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c00bda0 con 0x7f1964109e00 2024-09-21T04:18:22.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.378+0000 7f195affd640 1 -- 172.21.15.22:0/1063683558 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f195c019850 con 0x7f1964109e00 2024-09-21T04:18:22.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.378+0000 7f195affd640 1 -- 172.21.15.22:0/1063683558 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c0054c0 con 0x7f1964109e00 2024-09-21T04:18:22.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.378+0000 7f196c1ff640 1 -- 172.21.15.22:0/1063683558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19641a0690 con 0x7f1964109e00 2024-09-21T04:18:22.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.378+0000 7f196c1ff640 1 -- 172.21.15.22:0/1063683558 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19640755f0 con 0x7f1964109e00 2024-09-21T04:18:22.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.382+0000 7f1972773740 1 Processor -- start 2024-09-21T04:18:22.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.382+0000 7f195affd640 1 -- 172.21.15.22:0/1063683558 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f195c004a40 con 0x7f1964109e00 2024-09-21T04:18:22.386 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.383+0000 7f1972773740 1 -- start start 2024-09-21T04:18:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.383+0000 7f1972773740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078b9bd600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.383+0000 7f1972773740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9bdb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.383+0000 7f1972773740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 0x56078b9be080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.383+0000 7f1972773740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56078b933b90 con 0x56078b5ed980 2024-09-21T04:18:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.383+0000 7f1972773740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56078b922fc0 con 0x56078b5f5b60 2024-09-21T04:18:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.383+0000 7f1972773740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56078b926dd0 con 0x56078b616840 2024-09-21T04:18:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f1969f9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9bdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f1969f9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9bdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53054/0 (socket says 172.21.15.22:53054) 2024-09-21T04:18:22.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f1969f9b640 1 -- 172.21.15.22:0/2418613060 learned_addr learned my addr 172.21.15.22:0/2418613060 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:22.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f196979a640 1 --2- 172.21.15.22:0/2418613060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 0x56078b9be080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f196979a640 1 --2- 172.21.15.22:0/2418613060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078b9bd600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f1969f9b640 1 -- 172.21.15.22:0/2418613060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 msgr2=0x56078b9bd600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:22.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f1969f9b640 1 --2- 172.21.15.22:0/2418613060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078b9bd600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f1969f9b640 1 -- 172.21.15.22:0/2418613060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 msgr2=0x56078b9be080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:22.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f1969f9b640 1 --2- 172.21.15.22:0/2418613060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 0x56078b9be080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f1969f9b640 1 -- 172.21.15.22:0/2418613060 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078b8aa060 con 0x56078b5ed980 2024-09-21T04:18:22.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f196979a640 1 --2- 172.21.15.22:0/2418613060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078b9bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:18:22.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.384+0000 7f195affd640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f19500b6610 0x7f19500b8b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.385+0000 7f1969f9b640 1 --2- 172.21.15.22:0/2418613060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9bdb40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1960004100 tx=0x7f1960005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f55a88afc02160af server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:22.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.385+0000 7f195affd640 1 -- 172.21.15.22:0/1063683558 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f195c0f0230 con 0x7f1964109e00 2024-09-21T04:18:22.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.385+0000 7f194ffff640 1 -- 172.21.15.22:0/2418613060 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960040070 con 0x56078b5ed980 2024-09-21T04:18:22.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.385+0000 7f196979a640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f19500b6610 0x7f19500b8b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.385+0000 7f194ffff640 1 -- 172.21.15.22:0/2418613060 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f19600054b0 con 0x56078b5ed980 2024-09-21T04:18:22.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.386+0000 7f194ffff640 1 -- 172.21.15.22:0/2418613060 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960035040 con 0x56078b5ed980 2024-09-21T04:18:22.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.387+0000 7f196979a640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f19500b6610 0x7f19500b8b20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1964108ed0 tx=0x7f1954009640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:22.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.387+0000 7f1972773740 1 -- 172.21.15.22:0/2418613060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 msgr2=0x56078b9bdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:22.390 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.387+0000 7f1972773740 1 --2- 172.21.15.22:0/2418613060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9bdb40 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f1960004100 tx=0x7f1960005f30 comp rx=0 tx=0).stop 2024-09-21T04:18:22.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.387+0000 7f1972773740 1 -- 172.21.15.22:0/2418613060 shutdown_connections 2024-09-21T04:18:22.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.388+0000 7f1972773740 1 --2- 172.21.15.22:0/2418613060 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 0x56078b9be080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.388+0000 7f1972773740 1 --2- 172.21.15.22:0/2418613060 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9bdb40 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.388+0000 7f1972773740 1 --2- 172.21.15.22:0/2418613060 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078b9bd600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.391 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.388+0000 7f1972773740 1 -- 172.21.15.22:0/2418613060 >> 172.21.15.22:0/2418613060 conn(0x56078b60a990 msgr2=0x56078b9bb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:22.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.388+0000 7f1972773740 1 -- 172.21.15.22:0/2418613060 shutdown_connections 2024-09-21T04:18:22.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.389+0000 7f1972773740 1 -- 172.21.15.22:0/2418613060 wait complete. 2024-09-21T04:18:22.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.389+0000 7f1972773740 1 -- start start 2024-09-21T04:18:22.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.390+0000 7f1972773740 1 Processor -- start 2024-09-21T04:18:22.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1972773740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1972773740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b5f5b60 0x56078b9c9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1972773740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b616840 0x56078b9d5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1972773740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56078b7847a0 con 0x56078b616840 2024-09-21T04:18:22.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1972773740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x56078b8c80a0 con 0x56078b5ed980 2024-09-21T04:18:22.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1972773740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x56078b9cbe20 con 0x56078b5f5b60 2024-09-21T04:18:22.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1969f9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1969f9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9c9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:50538/0 (socket says 172.21.15.22:50538) 2024-09-21T04:18:22.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1969f9b640 1 -- 172.21.15.22:0/1954987540 learned_addr learned my addr 172.21.15.22:0/1954987540 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:22.395 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f196979a640 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b5f5b60 0x56078b9c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1972773740 10 client.0 _ll_register_callbacks cb 0x56078b8a53c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:18:22.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f196a79c640 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b616840 0x56078b9d5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1969f9b640 1 -- 172.21.15.22:0/1954987540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b5f5b60 msgr2=0x56078b9c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:22.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1969f9b640 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b5f5b60 0x56078b9c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1969f9b640 1 -- 172.21.15.22:0/1954987540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b616840 msgr2=0x56078b9d5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:22.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1969f9b640 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b616840 0x56078b9d5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f1969f9b640 1 -- 172.21.15.22:0/1954987540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56078b8b6880 con 0x56078b5ed980 2024-09-21T04:18:22.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.391+0000 7f196a79c640 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b616840 0x56078b9d5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:18:22.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.392+0000 7f1969f9b640 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9c9250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f19600045d0 tx=0x7f1960005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3174c01a8a0dcd30 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:22.396 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.392+0000 7f194d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.60:3300/0 2024-09-21T04:18:22.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.392+0000 7f194d7fa640 1 -- 172.21.15.22:0/1954987540 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960040070 con 0x56078b5ed980 2024-09-21T04:18:22.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.392+0000 7f194d7fa640 1 -- 172.21.15.22:0/1954987540 <== mon.2 v2:172.21.15.60:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f1960005000 con 0x56078b5ed980 2024-09-21T04:18:22.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.392+0000 7f1972773740 1 -- 172.21.15.22:0/1954987540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f19600054b0 con 0x56078b5ed980 2024-09-21T04:18:22.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.393+0000 7f194d7fa640 1 -- 172.21.15.22:0/1954987540 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f1960035040 con 0x56078b5ed980 2024-09-21T04:18:22.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.393+0000 7f1972773740 10 client.25892 fetch_fsmap learned FSMap version 50 2024-09-21T04:18:22.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.393+0000 7f1972773740 1 -- 172.21.15.22:0/1954987540 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56078b690b90 con 0x56078b5ed980 2024-09-21T04:18:22.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.393+0000 7f194d7fa640 1 -- 172.21.15.22:0/1954987540 <== mon.2 v2:172.21.15.60:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f196004d070 con 0x56078b5ed980 2024-09-21T04:18:22.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.395+0000 7f194d7fa640 1 -- 172.21.15.22:0/1954987540 <== mon.2 v2:172.21.15.60:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f1960052450 con 0x56078b5ed980 2024-09-21T04:18:22.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.395+0000 7f1972773740 10 client.25892 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:18:22.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.395+0000 7f1972773740 10 client.25892 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:18:22.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.395+0000 7f1972773740 20 client.25892 populate_metadata read hostname 'smithi022' 2024-09-21T04:18:22.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.395+0000 7f1972773740 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56078b5d51c0 0x56078b9db030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.395+0000 7f1972773740 4 client.25892 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:18:22.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.395+0000 7f1972773740 1 -- 172.21.15.22:0/1954987540 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f19600054b0 con 0x56078b5d51c0 2024-09-21T04:18:22.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.396+0000 7f196979a640 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56078b5d51c0 0x56078b9db030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.396+0000 7f194d7fa640 10 client.25892 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:18:22.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.396+0000 7f196979a640 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56078b5d51c0 0x56078b9db030 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63d65a000c05b2a7 server_cookie=39b7742a8f7a1249 in_seq=0 out_seq=0 2024-09-21T04:18:22.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.397+0000 7f194d7fa640 1 -- 172.21.15.22:0/1954987540 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f19600054b0 con 0x56078b5d51c0 2024-09-21T04:18:22.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.398+0000 7f194d7fa640 10 client.25892 handle_command_reply: tid=0 2024-09-21T04:18:22.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.398+0000 7f1972773740 1 client.25892 shutdown 2024-09-21T04:18:22.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.398+0000 7f1972773740 1 -- 172.21.15.22:0/1954987540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 msgr2=0x56078b9c9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:22.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.398+0000 7f1972773740 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9c9250 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f19600045d0 tx=0x7f1960005fd0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.399+0000 7f1972773740 1 -- 172.21.15.22:0/1954987540 shutdown_connections 2024-09-21T04:18:22.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.399+0000 7f1972773740 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56078b5d51c0 0x56078b9db030 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.399+0000 7f1972773740 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b5f5b60 0x56078b9c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.399+0000 7f1972773740 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b616840 0x56078b9d5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.399+0000 7f1972773740 1 --2- 172.21.15.22:0/1954987540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9c9250 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.399+0000 7f1972773740 1 -- 172.21.15.22:0/1954987540 >> 172.21.15.22:0/1954987540 conn(0x56078b60a990 msgr2=0x56078b9beff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:22.402 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.399+0000 7f194d7fa640 0 client.25892 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:18:22.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.399+0000 7f1972773740 1 -- 172.21.15.22:0/1954987540 shutdown_connections 2024-09-21T04:18:22.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.399+0000 7f1972773740 1 -- 172.21.15.22:0/1954987540 wait complete. 2024-09-21T04:18:22.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.400+0000 7f1972773740 20 client.25892 trim_cache size 0 max 16384 2024-09-21T04:18:22.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.432+0000 7f1972773740 1 Processor -- start 2024-09-21T04:18:22.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.432+0000 7f1972773740 1 -- start start 2024-09-21T04:18:22.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f1972773740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9d5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f1972773740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5f5b60 0x56078b9d55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f1972773740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078b9c2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f1972773740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19641ae9d0 con 0x56078b5f5b60 2024-09-21T04:18:22.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f1972773740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19641b0510 con 0x56078b5ed980 2024-09-21T04:18:22.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f1972773740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f19641af0a0 con 0x56078b616840 2024-09-21T04:18:22.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f196979a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5f5b60 0x56078b9d55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f1969f9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9d5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f1969f9b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9d5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:50552/0 (socket says 172.21.15.22:50552) 2024-09-21T04:18:22.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f1969f9b640 1 -- 172.21.15.22:0/1010392986 learned_addr learned my addr 172.21.15.22:0/1010392986 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:22.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.433+0000 7f196979a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5f5b60 0x56078b9d55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53070/0 (socket says 172.21.15.22:53070) 2024-09-21T04:18:22.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.434+0000 7f196a79c640 1 --2- 172.21.15.22:0/1010392986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078b9c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.434+0000 7f1969f9b640 1 -- 172.21.15.22:0/1010392986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 msgr2=0x56078b9c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:22.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.434+0000 7f1969f9b640 1 --2- 172.21.15.22:0/1010392986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078b9c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.434+0000 7f1969f9b640 1 -- 172.21.15.22:0/1010392986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5f5b60 msgr2=0x56078b9d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.434+0000 7f1969f9b640 1 --2- 172.21.15.22:0/1010392986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5f5b60 0x56078b9d55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.434+0000 7f1969f9b640 1 -- 172.21.15.22:0/1010392986 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56078b9c4870 con 0x56078b5ed980 2024-09-21T04:18:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.435+0000 7f1969f9b640 1 --2- 172.21.15.22:0/1010392986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9d5080 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f196002a9b0 tx=0x7f1960052700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c46b08258c22be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.435+0000 7f194f7fe640 1 -- 172.21.15.22:0/1010392986 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196005a020 con 0x56078b5ed980 2024-09-21T04:18:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.435+0000 7f194f7fe640 1 -- 172.21.15.22:0/1010392986 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f196004d040 con 0x56078b5ed980 2024-09-21T04:18:22.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.435+0000 7f194f7fe640 1 -- 172.21.15.22:0/1010392986 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1960040040 con 0x56078b5ed980 2024-09-21T04:18:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.436+0000 7f1972773740 1 -- 172.21.15.22:0/1010392986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 msgr2=0x56078b9d5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.436+0000 7f1972773740 1 --2- 172.21.15.22:0/1010392986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9d5080 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f196002a9b0 tx=0x7f1960052700 comp rx=0 tx=0).stop 2024-09-21T04:18:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.436+0000 7f1972773740 1 -- 172.21.15.22:0/1010392986 shutdown_connections 2024-09-21T04:18:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.436+0000 7f1972773740 1 --2- 172.21.15.22:0/1010392986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078b9c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.436+0000 7f1972773740 1 --2- 172.21.15.22:0/1010392986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5f5b60 0x56078b9d55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.436+0000 7f1972773740 1 --2- 172.21.15.22:0/1010392986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5ed980 0x56078b9d5080 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.437+0000 7f1972773740 1 -- 172.21.15.22:0/1010392986 >> 172.21.15.22:0/1010392986 conn(0x56078b60a990 msgr2=0x56078b9c78d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.437+0000 7f1972773740 1 -- 172.21.15.22:0/1010392986 shutdown_connections 2024-09-21T04:18:22.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.437+0000 7f1972773740 1 -- 172.21.15.22:0/1010392986 wait complete. 2024-09-21T04:18:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.437+0000 7f1972773740 1 -- start start 2024-09-21T04:18:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.438+0000 7f1972773740 1 Processor -- start 2024-09-21T04:18:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.438+0000 7f1972773740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9dcb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.438+0000 7f1972773740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 0x56078b9dd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.438+0000 7f1972773740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078ba3d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.438+0000 7f196979a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 0x56078b9dd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.438+0000 7f196979a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 0x56078b9dd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:50558/0 (socket says 172.21.15.22:50558) 2024-09-21T04:18:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f1969f9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9dcb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f196a79c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078ba3d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f1969f9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9dcb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:53086/0 (socket says 172.21.15.22:53086) 2024-09-21T04:18:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f196a79c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078ba3d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:46528/0 (socket says 172.21.15.22:46528) 2024-09-21T04:18:22.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f196979a640 1 -- 172.21.15.22:0/4240263112 learned_addr learned my addr 172.21.15.22:0/4240263112 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f19641afe40 con 0x56078b5ed980 2024-09-21T04:18:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f19641af770 con 0x56078b5f5b60 2024-09-21T04:18:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f19641ac9b0 con 0x56078b616840 2024-09-21T04:18:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f1972773740 10 client.0 _ll_register_callbacks cb 0x7f1954009970 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:18:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f196a79c640 1 -- 172.21.15.22:0/4240263112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 msgr2=0x56078b9dd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f196a79c640 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 0x56078b9dd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f196a79c640 1 -- 172.21.15.22:0/4240263112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 msgr2=0x56078b9dcb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f196a79c640 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9dcb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.439+0000 7f196a79c640 1 -- 172.21.15.22:0/4240263112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56078ba3de50 con 0x56078b616840 2024-09-21T04:18:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.440+0000 7f196a79c640 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078ba3d7e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f195c0ed910 tx=0x7f195c0b5b70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39545fbbbf619e73 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.440+0000 7f194d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.73:3300/0 2024-09-21T04:18:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.441+0000 7f194d7fa640 1 -- 172.21.15.22:0/4240263112 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f195c027040 con 0x56078b616840 2024-09-21T04:18:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.441+0000 7f194d7fa640 1 -- 172.21.15.22:0/4240263112 <== mon.1 v2:172.21.15.73:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f195c019a00 con 0x56078b616840 2024-09-21T04:18:22.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.441+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f196004d040 con 0x56078b616840 2024-09-21T04:18:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.442+0000 7f194d7fa640 1 -- 172.21.15.22:0/4240263112 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f195c0bf9c0 con 0x56078b616840 2024-09-21T04:18:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.442+0000 7f1972773740 10 client.25894 fetch_fsmap learned FSMap version 50 2024-09-21T04:18:22.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.442+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x56078ba46370 con 0x56078b616840 2024-09-21T04:18:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.442+0000 7f194d7fa640 1 -- 172.21.15.22:0/4240263112 <== mon.1 v2:172.21.15.73:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f196004d040 con 0x56078b616840 2024-09-21T04:18:22.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.443+0000 7f194d7fa640 1 -- 172.21.15.22:0/4240263112 <== mon.1 v2:172.21.15.73:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f195c0651a0 con 0x56078b616840 2024-09-21T04:18:22.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.443+0000 7f1972773740 10 client.25894 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:18:22.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.443+0000 7f1972773740 10 client.25894 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:18:22.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.443+0000 7f1972773740 20 client.25894 populate_metadata read hostname 'smithi022' 2024-09-21T04:18:22.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.443+0000 7f1972773740 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56078b5aa570 0x56078ba48b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:22.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.443+0000 7f1972773740 4 client.25894 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.2, "await_for": 45.0}] 2024-09-21T04:18:22.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.444+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 143.2, "await_for": 45.0}) -- 0x56078b935ae0 con 0x56078b5aa570 2024-09-21T04:18:22.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.444+0000 7f1969f9b640 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56078b5aa570 0x56078ba48b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:22.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.446+0000 7f1969f9b640 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56078b5aa570 0x56078ba48b30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc6e9913b08bda server_cookie=35439c377e7c487a in_seq=0 out_seq=0 2024-09-21T04:18:22.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.446+0000 7f194d7fa640 10 client.25894 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:18:22.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f194d7fa640 1 -- 172.21.15.22:0/4240263112 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x56078b935ae0 con 0x56078b5aa570 2024-09-21T04:18:22.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f194d7fa640 10 client.25894 handle_command_reply: tid=0 2024-09-21T04:18:22.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 client.25894 shutdown 2024-09-21T04:18:22.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 msgr2=0x56078ba3d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:22.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078ba3d7e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f195c0ed910 tx=0x7f195c0b5b70 comp rx=0 tx=0).stop 2024-09-21T04:18:22.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 shutdown_connections 2024-09-21T04:18:22.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x56078b5aa570 0x56078ba48b30 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x56078b616840 0x56078ba3d7e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f194d7fa640 0 client.25894 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:18:22.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x56078b5f5b60 0x56078b9dd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 --2- 172.21.15.22:0/4240263112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56078b5ed980 0x56078b9dcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 >> 172.21.15.22:0/4240263112 conn(0x56078b60a990 msgr2=0x56078b9c2710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:22.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 shutdown_connections 2024-09-21T04:18:22.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.739+0000 7f1972773740 1 -- 172.21.15.22:0/4240263112 wait complete. 2024-09-21T04:18:22.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f1972773740 20 client.25894 trim_cache size 0 max 16384 2024-09-21T04:18:22.744 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:18:22.744 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:18:22.744 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 62, 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "f0cc7461": { 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 62, 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 143.2, 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:18:22.745 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:18:22.746 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:18:22.746 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:18:22.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:18:22.746 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:18:22.746 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:18:22.746 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:18:22.746 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:18:22.746 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:18:22.746 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:18:22.746 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f196c1ff640 1 -- 172.21.15.22:0/1063683558 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f19500b6610 msgr2=0x7f19500b8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f196c1ff640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f19500b6610 0x7f19500b8b20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f1964108ed0 tx=0x7f1954009640 comp rx=0 tx=0).stop 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f196c1ff640 1 -- 172.21.15.22:0/1063683558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1964109e00 msgr2=0x7f196419fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f196c1ff640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1964109e00 0x7f196419fc70 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f195c009fd0 tx=0x7f195c00dea0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f196c1ff640 1 -- 172.21.15.22:0/1063683558 shutdown_connections 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f196c1ff640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f19500b6610 0x7f19500b8b20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f196c1ff640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f1964109e00 0x7f196419fc70 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f196c1ff640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f19641094b0 0x7f196419a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f196c1ff640 1 --2- 172.21.15.22:0/1063683558 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1964103b70 0x7f196419a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.740+0000 7f196c1ff640 1 -- 172.21.15.22:0/1063683558 >> 172.21.15.22:0/1063683558 conn(0x7f19640ff5a0 msgr2=0x7f19641019c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.741+0000 7f196c1ff640 1 -- 172.21.15.22:0/1063683558 shutdown_connections 2024-09-21T04:18:22.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:22.741+0000 7f196c1ff640 1 -- 172.21.15.22:0/1063683558 wait complete. 2024-09-21T04:18:23.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:22 smithi022 ceph-mon[31015]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 848 op/s 2024-09-21T04:18:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:22 smithi073 ceph-mon[34443]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 848 op/s 2024-09-21T04:18:23.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:22 smithi060 ceph-mon[33722]: pgmap v851: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 13 MiB/s wr, 848 op/s 2024-09-21T04:18:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 840.0 s, 526.9 tps, lat 144.379 ms stddev 92.360 2024-09-21T04:18:24.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:23 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:18:24.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:23 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:18:24.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:23 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:18:25.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:24 smithi022 ceph-mon[31015]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 805 op/s 2024-09-21T04:18:25.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:24 smithi073 ceph-mon[34443]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 805 op/s 2024-09-21T04:18:25.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:24 smithi060 ceph-mon[33722]: pgmap v852: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 13 MiB/s wr, 805 op/s 2024-09-21T04:18:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:26 smithi022 ceph-mon[31015]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 710 op/s 2024-09-21T04:18:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:18:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:18:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:18:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:26 smithi073 ceph-mon[34443]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 710 op/s 2024-09-21T04:18:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:18:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:18:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:18:27.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:26 smithi060 ceph-mon[33722]: pgmap v853: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 11 MiB/s wr, 710 op/s 2024-09-21T04:18:27.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:18:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:18:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:18:27.857 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'f0cc7461', quiesce took 9.2 seconds. Will release after: 14.0 2024-09-21T04:18:28.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 845.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:18:29.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:28 smithi022 ceph-mon[31015]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.3 MiB/s wr, 605 op/s 2024-09-21T04:18:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:28 smithi073 ceph-mon[34443]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.3 MiB/s wr, 605 op/s 2024-09-21T04:18:29.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:28 smithi060 ceph-mon[33722]: pgmap v854: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.3 MiB/s wr, 605 op/s 2024-09-21T04:18:31.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:30 smithi022 ceph-mon[31015]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.4 MiB/s wr, 427 op/s 2024-09-21T04:18:31.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:30 smithi073 ceph-mon[34443]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.4 MiB/s wr, 427 op/s 2024-09-21T04:18:31.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:30 smithi060 ceph-mon[33722]: pgmap v855: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.4 MiB/s wr, 427 op/s 2024-09-21T04:18:33.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:32 smithi022 ceph-mon[31015]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.3 MiB/s wr, 387 op/s 2024-09-21T04:18:33.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:32 smithi073 ceph-mon[34443]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.3 MiB/s wr, 387 op/s 2024-09-21T04:18:33.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:32 smithi060 ceph-mon[33722]: pgmap v856: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 5.3 MiB/s wr, 387 op/s 2024-09-21T04:18:33.709 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 850.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:18:35.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:34 smithi022 ceph-mon[31015]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.0 MiB/s wr, 220 op/s 2024-09-21T04:18:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:34 smithi073 ceph-mon[34443]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.0 MiB/s wr, 220 op/s 2024-09-21T04:18:35.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:34 smithi060 ceph-mon[33722]: pgmap v857: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 3.0 MiB/s wr, 220 op/s 2024-09-21T04:18:37.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:36 smithi022 ceph-mon[31015]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1016 KiB/s wr, 97 op/s 2024-09-21T04:18:37.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:36 smithi073 ceph-mon[34443]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1016 KiB/s wr, 97 op/s 2024-09-21T04:18:37.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:36 smithi060 ceph-mon[33722]: pgmap v858: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 1016 KiB/s wr, 97 op/s 2024-09-21T04:18:38.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 855.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:18:39.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:38 smithi022 ceph-mon[31015]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 585 KiB/s wr, 52 op/s 2024-09-21T04:18:39.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:38 smithi073 ceph-mon[34443]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 585 KiB/s wr, 52 op/s 2024-09-21T04:18:39.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:38 smithi060 ceph-mon[33722]: pgmap v859: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 585 KiB/s wr, 52 op/s 2024-09-21T04:18:41.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:40 smithi022 ceph-mon[31015]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 169 KiB/s wr, 31 op/s 2024-09-21T04:18:41.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:40 smithi073 ceph-mon[34443]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 169 KiB/s wr, 31 op/s 2024-09-21T04:18:41.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:40 smithi060 ceph-mon[33722]: pgmap v860: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 169 KiB/s wr, 31 op/s 2024-09-21T04:18:41.858 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:18:42.136 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:18:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.632+0000 7f6ded6f8640 1 -- 172.21.15.22:0/2857238612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6de8102a70 msgr2=0x7f6de8102e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.632+0000 7f6ded6f8640 1 --2- 172.21.15.22:0/2857238612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6de8102a70 0x7f6de8102e80 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8009900 tx=0x7f6dd802a410 comp rx=0 tx=0).stop 2024-09-21T04:18:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.632+0000 7f6ded6f8640 1 -- 172.21.15.22:0/2857238612 shutdown_connections 2024-09-21T04:18:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.632+0000 7f6ded6f8640 1 --2- 172.21.15.22:0/2857238612 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de81083b0 0x7f6de81087c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.632+0000 7f6ded6f8640 1 --2- 172.21.15.22:0/2857238612 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6de8108d00 0x7f6de810f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.632+0000 7f6ded6f8640 1 --2- 172.21.15.22:0/2857238612 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6de8102a70 0x7f6de8102e80 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.632+0000 7f6ded6f8640 1 -- 172.21.15.22:0/2857238612 >> 172.21.15.22:0/2857238612 conn(0x7f6de8079710 msgr2=0x7f6de8079b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.632+0000 7f6ded6f8640 1 -- 172.21.15.22:0/2857238612 shutdown_connections 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.632+0000 7f6ded6f8640 1 -- 172.21.15.22:0/2857238612 wait complete. 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.632+0000 7f6ded6f8640 1 Processor -- start 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6ded6f8640 1 -- start start 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6ded6f8640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6de8102a70 0x7f6de819a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6ded6f8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6de81083b0 0x7f6de819aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6ded6f8640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de8108d00 0x7f6de819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6ded6f8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6de8112870 con 0x7f6de81083b0 2024-09-21T04:18:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6ded6f8640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f6de81126f0 con 0x7f6de8102a70 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6ded6f8640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f6de81129f0 con 0x7f6de8108d00 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6de81083b0 0x7f6de819aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de67fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6de81083b0 0x7f6de819aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49698/0 (socket says 172.21.15.22:49698) 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de67fc640 1 -- 172.21.15.22:0/3215081284 learned_addr learned my addr 172.21.15.22:0/3215081284 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de6ffd640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6de8102a70 0x7f6de819a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de77fe640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de8108d00 0x7f6de819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de67fc640 1 -- 172.21.15.22:0/3215081284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de8108d00 msgr2=0x7f6de819fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de67fc640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de8108d00 0x7f6de819fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de67fc640 1 -- 172.21.15.22:0/3215081284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6de8102a70 msgr2=0x7f6de819a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de67fc640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6de8102a70 0x7f6de819a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de67fc640 1 -- 172.21.15.22:0/3215081284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de81a0460 con 0x7f6de81083b0 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.633+0000 7f6de6ffd640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6de8102a70 0x7f6de819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:18:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.634+0000 7f6de67fc640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6de81083b0 0x7f6de819aa90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00ea20 tx=0x7f6ddc00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.634+0000 7f6dcffff640 1 -- 172.21.15.22:0/3215081284 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc00cde0 con 0x7f6de81083b0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.634+0000 7f6dcffff640 1 -- 172.21.15.22:0/3215081284 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ddc005020 con 0x7f6de81083b0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.634+0000 7f6ded6f8640 1 -- 172.21.15.22:0/3215081284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de81a0750 con 0x7f6de81083b0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.634+0000 7f6dcffff640 1 -- 172.21.15.22:0/3215081284 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ddc0116d0 con 0x7f6de81083b0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.634+0000 7f6ded6f8640 1 -- 172.21.15.22:0/3215081284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de81a6eb0 con 0x7f6de81083b0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.635+0000 7f6ded6f8640 1 -- 172.21.15.22:0/3215081284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de8103cf0 con 0x7f6de81083b0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.637+0000 7f6dcffff640 1 -- 172.21.15.22:0/3215081284 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6ddc004a40 con 0x7f6de81083b0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.638+0000 7f6dcffff640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6dd00b6510 0x7f6dd00b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.638+0000 7f6de6ffd640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6dd00b6510 0x7f6dd00b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.638+0000 7f6dcffff640 1 -- 172.21.15.22:0/3215081284 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6ddc0e7df0 con 0x7f6de81083b0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.638+0000 7f6de6ffd640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6dd00b6510 0x7f6dd00b8a20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8000c00 tx=0x7f6dd8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.641+0000 7f6dcffff640 1 -- 172.21.15.22:0/3215081284 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ddc016030 con 0x7f6de81083b0 2024-09-21T04:18:42.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.872+0000 7f6ded6f8640 1 -- 172.21.15.22:0/3215081284 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6de8102e80 con 0x7f6de81083b0 2024-09-21T04:18:42.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.873+0000 7f6dcffff640 1 -- 172.21.15.22:0/3215081284 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7f6de8102e80 con 0x7f6de81083b0 2024-09-21T04:18:42.876 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:18:42.876 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:18:42.877 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:18:42.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 -- 172.21.15.22:0/3215081284 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6dd00b6510 msgr2=0x7f6dd00b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:42.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6dd00b6510 0x7f6dd00b8a20 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8000c00 tx=0x7f6dd8005a20 comp rx=0 tx=0).stop 2024-09-21T04:18:42.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 -- 172.21.15.22:0/3215081284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6de81083b0 msgr2=0x7f6de819aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:42.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6de81083b0 0x7f6de819aa90 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc00ea20 tx=0x7f6ddc00eee0 comp rx=0 tx=0).stop 2024-09-21T04:18:42.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 -- 172.21.15.22:0/3215081284 shutdown_connections 2024-09-21T04:18:42.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f6dd00b6510 0x7f6dd00b8a20 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:42.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6de8108d00 0x7f6de819fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:42.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6de81083b0 0x7f6de819aa90 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:42.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 --2- 172.21.15.22:0/3215081284 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6de8102a70 0x7f6de819a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:42.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 -- 172.21.15.22:0/3215081284 >> 172.21.15.22:0/3215081284 conn(0x7f6de8079710 msgr2=0x7f6de8101c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:42.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 -- 172.21.15.22:0/3215081284 shutdown_connections 2024-09-21T04:18:42.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:42.875+0000 7f6ded6f8640 1 -- 172.21.15.22:0/3215081284 wait complete. 2024-09-21T04:18:43.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:42 smithi022 ceph-mon[31015]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 197 KiB/s wr, 36 op/s 2024-09-21T04:18:43.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:42 smithi073 ceph-mon[34443]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 197 KiB/s wr, 36 op/s 2024-09-21T04:18:43.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:42 smithi060 ceph-mon[33722]: pgmap v861: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 8.8 KiB/s rd, 197 KiB/s wr, 36 op/s 2024-09-21T04:18:43.531 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id f0cc7461 --release --await' 2024-09-21T04:18:43.531 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id f0cc7461 --release --await 2024-09-21T04:18:43.708 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 860.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-09-21T04:18:43.791 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:18:44.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:43 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3215081284' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:18:44.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:43 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3215081284' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:18:44.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:43 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3215081284' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:18:44.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.330+0000 7f57aba46640 1 -- 172.21.15.22:0/3733858454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a41083a0 msgr2=0x7f57a41087b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:44.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.330+0000 7f57aba46640 1 --2- 172.21.15.22:0/3733858454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a41083a0 0x7f57a41087b0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f5794009900 tx=0x7f579402a410 comp rx=0 tx=0).stop 2024-09-21T04:18:44.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.330+0000 7f57aba46640 1 -- 172.21.15.22:0/3733858454 shutdown_connections 2024-09-21T04:18:44.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.330+0000 7f57aba46640 1 --2- 172.21.15.22:0/3733858454 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a4108cf0 0x7f57a410f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.334 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.330+0000 7f57aba46640 1 --2- 172.21.15.22:0/3733858454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a41083a0 0x7f57a41087b0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.330+0000 7f57aba46640 1 --2- 172.21.15.22:0/3733858454 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a4102a60 0x7f57a4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.330+0000 7f57aba46640 1 -- 172.21.15.22:0/3733858454 >> 172.21.15.22:0/3733858454 conn(0x7f57a4079730 msgr2=0x7f57a4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:44.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.331+0000 7f57aba46640 1 -- 172.21.15.22:0/3733858454 shutdown_connections 2024-09-21T04:18:44.335 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.331+0000 7f57aba46640 1 -- 172.21.15.22:0/3733858454 wait complete. 2024-09-21T04:18:44.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.331+0000 7f57aba46640 1 Processor -- start 2024-09-21T04:18:44.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.331+0000 7f57aba46640 1 -- start start 2024-09-21T04:18:44.337 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57aba46640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a4102a60 0x7f57a419a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57aba46640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a41083a0 0x7f57a419aa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57aba46640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a4108cf0 0x7f57a419fd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57aba46640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41138f0 con 0x7f57a4108cf0 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57aba46640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4113770 con 0x7f57a4102a60 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57aba46640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4113a70 con 0x7f57a41083a0 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a9fe3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a4108cf0 0x7f57a419fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a9fe3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a4108cf0 0x7f57a419fd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49716/0 (socket says 172.21.15.22:49716) 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a9fe3640 1 -- 172.21.15.22:0/2406204057 learned_addr learned my addr 172.21.15.22:0/2406204057 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a8fe1640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a41083a0 0x7f57a419aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a97e2640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a4102a60 0x7f57a419a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a9fe3640 1 -- 172.21.15.22:0/2406204057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a41083a0 msgr2=0x7f57a419aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:44.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a41083a0 0x7f57a419aa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a9fe3640 1 -- 172.21.15.22:0/2406204057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a4102a60 msgr2=0x7f57a419a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:44.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a4102a60 0x7f57a419a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a9fe3640 1 -- 172.21.15.22:0/2406204057 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a41a0430 con 0x7f57a4108cf0 2024-09-21T04:18:44.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a97e2640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a4102a60 0x7f57a419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:18:44.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.332+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a4108cf0 0x7f57a419fd00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f579c00eaa0 tx=0x7f579c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:44.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.333+0000 7f579a7fc640 1 -- 172.21.15.22:0/2406204057 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c00cdb0 con 0x7f57a4108cf0 2024-09-21T04:18:44.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.333+0000 7f579a7fc640 1 -- 172.21.15.22:0/2406204057 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f579c005020 con 0x7f57a4108cf0 2024-09-21T04:18:44.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.333+0000 7f57aba46640 1 -- 172.21.15.22:0/2406204057 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a41a0720 con 0x7f57a4108cf0 2024-09-21T04:18:44.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.333+0000 7f579a7fc640 1 -- 172.21.15.22:0/2406204057 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c0116d0 con 0x7f57a4108cf0 2024-09-21T04:18:44.339 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.333+0000 7f57aba46640 1 -- 172.21.15.22:0/2406204057 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a41a6e80 con 0x7f57a4108cf0 2024-09-21T04:18:44.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.336+0000 7f57b1fba740 1 Processor -- start 2024-09-21T04:18:44.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.336+0000 7f579a7fc640 1 -- 172.21.15.22:0/2406204057 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f579c0051d0 con 0x7f57a4108cf0 2024-09-21T04:18:44.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.336+0000 7f57b1fba740 1 -- start start 2024-09-21T04:18:44.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.336+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe4a8520 0x5558fe852920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.336+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe47f660 0x5558fe852e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.336+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe487840 0x5558fe8533a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.336+0000 7f57b1fba740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5558fe739dc0 con 0x5558fe47f660 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.336+0000 7f57b1fba740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5558fe7c61f0 con 0x5558fe4a8520 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.336+0000 7f57b1fba740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5558fe7b5620 con 0x5558fe487840 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a97e2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe47f660 0x5558fe852e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a97e2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe47f660 0x5558fe852e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49724/0 (socket says 172.21.15.22:49724) 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a97e2640 1 -- 172.21.15.22:0/40979835 learned_addr learned my addr 172.21.15.22:0/40979835 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a8fe1640 1 --2- 172.21.15.22:0/40979835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe4a8520 0x5558fe852920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a8fe1640 1 --2- 172.21.15.22:0/40979835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe487840 0x5558fe8533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a97e2640 1 -- 172.21.15.22:0/40979835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe487840 msgr2=0x5558fe8533a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a97e2640 1 --2- 172.21.15.22:0/40979835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe487840 0x5558fe8533a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a97e2640 1 -- 172.21.15.22:0/40979835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe4a8520 msgr2=0x5558fe852920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a97e2640 1 --2- 172.21.15.22:0/40979835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe4a8520 0x5558fe852920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.343 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a97e2640 1 -- 172.21.15.22:0/40979835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fe77dfd0 con 0x5558fe47f660 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a8fe1640 1 --2- 172.21.15.22:0/40979835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe487840 0x5558fe8533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f579a7fc640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f57900b6590 0x7f57900b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a97e2640 1 --2- 172.21.15.22:0/40979835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe47f660 0x5558fe852e60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009c50 tx=0x7f57a000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da92f603e26299d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f57a8fe1640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f57900b6590 0x7f57900b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f579a7fc640 1 -- 172.21.15.22:0/2406204057 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f579c0e78c0 con 0x7f57a4108cf0 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.337+0000 7f578f7fe640 1 -- 172.21.15.22:0/40979835 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0016070 con 0x5558fe47f660 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.338+0000 7f578f7fe640 1 -- 172.21.15.22:0/40979835 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57a0011900 con 0x5558fe47f660 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.338+0000 7f578f7fe640 1 -- 172.21.15.22:0/40979835 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a00106e0 con 0x5558fe47f660 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.338+0000 7f57b1fba740 1 -- 172.21.15.22:0/40979835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe47f660 msgr2=0x5558fe852e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.338+0000 7f57a8fe1640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f57900b6590 0x7f57900b8aa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5794006010 tx=0x7f57940058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.338+0000 7f57b1fba740 1 --2- 172.21.15.22:0/40979835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe47f660 0x5558fe852e60 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009c50 tx=0x7f57a000e6c0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.339+0000 7f57b1fba740 1 -- 172.21.15.22:0/40979835 shutdown_connections 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.339+0000 7f57b1fba740 1 --2- 172.21.15.22:0/40979835 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe487840 0x5558fe8533a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.344 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.339+0000 7f57b1fba740 1 --2- 172.21.15.22:0/40979835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe47f660 0x5558fe852e60 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.339+0000 7f57b1fba740 1 --2- 172.21.15.22:0/40979835 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe4a8520 0x5558fe852920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.339+0000 7f57b1fba740 1 -- 172.21.15.22:0/40979835 >> 172.21.15.22:0/40979835 conn(0x5558fe49c910 msgr2=0x5558fe850810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:44.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.339+0000 7f57b1fba740 1 -- 172.21.15.22:0/40979835 shutdown_connections 2024-09-21T04:18:44.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.339+0000 7f57b1fba740 1 -- 172.21.15.22:0/40979835 wait complete. 2024-09-21T04:18:44.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.339+0000 7f57b1fba740 1 -- start start 2024-09-21T04:18:44.345 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.339+0000 7f57b1fba740 1 Processor -- start 2024-09-21T04:18:44.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe85df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe487840 0x5558fe85e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe4a8520 0x5558fe85ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57b1fba740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5558fe750300 con 0x5558fe4a8520 2024-09-21T04:18:44.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57b1fba740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5558fe7b9430 con 0x5558fe487840 2024-09-21T04:18:44.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57b1fba740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5558fe616bb0 con 0x5558fe47f660 2024-09-21T04:18:44.348 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57b1fba740 10 client.0 _ll_register_callbacks cb 0x5558fe76a120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a9fe3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe4a8520 0x5558fe85ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a97e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe85df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a9fe3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe4a8520 0x5558fe85ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49726/0 (socket says 172.21.15.22:49726) 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a9fe3640 1 -- 172.21.15.22:0/1758188532 learned_addr learned my addr 172.21.15.22:0/1758188532 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a8fe1640 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe487840 0x5558fe85e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a9fe3640 1 -- 172.21.15.22:0/1758188532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 msgr2=0x5558fe85df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe85df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a9fe3640 1 -- 172.21.15.22:0/1758188532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe487840 msgr2=0x5558fe85e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe487840 0x5558fe85e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a9fe3640 1 -- 172.21.15.22:0/1758188532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558fe73f780 con 0x5558fe4a8520 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe4a8520 0x5558fe85ea10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f579c0092f0 tx=0x7f579c005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115c2b09aeaaa0b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.340+0000 7f578cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f578cff9640 1 -- 172.21.15.22:0/1758188532 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c01f030 con 0x5558fe4a8520 2024-09-21T04:18:44.349 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f578cff9640 1 -- 172.21.15.22:0/1758188532 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f579c0a8f80 con 0x5558fe4a8520 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f57b1fba740 1 -- 172.21.15.22:0/1758188532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57a0011900 con 0x5558fe4a8520 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f578cff9640 1 -- 172.21.15.22:0/1758188532 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f579c0b2110 con 0x5558fe4a8520 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f57b1fba740 10 client.16320 fetch_fsmap learned FSMap version 50 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f57b1fba740 1 -- 172.21.15.22:0/1758188532 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5558fe513b00 con 0x5558fe4a8520 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f578cff9640 1 -- 172.21.15.22:0/1758188532 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57a0011900 con 0x5558fe4a8520 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f578cff9640 1 -- 172.21.15.22:0/1758188532 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f579c00f040 con 0x5558fe4a8520 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f57b1fba740 10 client.16320 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f57b1fba740 10 client.16320 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f57b1fba740 20 client.16320 populate_metadata read hostname 'smithi022' 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f57b1fba740 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5558fe466ea0 0x5558fe870230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f57b1fba740 4 client.16320 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.341+0000 7f57b1fba740 1 -- 172.21.15.22:0/1758188532 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558fe7c8140 con 0x5558fe466ea0 2024-09-21T04:18:44.350 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.342+0000 7f57a97e2640 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5558fe466ea0 0x5558fe870230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.342+0000 7f578cff9640 10 client.16320 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.342+0000 7f57a97e2640 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5558fe466ea0 0x5558fe870230 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=631cd913696d2666 server_cookie=97e805a0a3f56ae7 in_seq=0 out_seq=0 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f578cff9640 1 -- 172.21.15.22:0/1758188532 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5558fe7c8140 con 0x5558fe466ea0 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f578cff9640 10 client.16320 handle_command_reply: tid=0 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 client.16320 shutdown 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 -- 172.21.15.22:0/1758188532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe4a8520 msgr2=0x5558fe85ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe4a8520 0x5558fe85ea10 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f579c0092f0 tx=0x7f579c005720 comp rx=0 tx=0).stop 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 -- 172.21.15.22:0/1758188532 shutdown_connections 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5558fe466ea0 0x5558fe870230 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe4a8520 0x5558fe85ea10 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f578cff9640 0 client.16320 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe487840 0x5558fe85e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.351 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 --2- 172.21.15.22:0/1758188532 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe85df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 -- 172.21.15.22:0/1758188532 >> 172.21.15.22:0/1758188532 conn(0x5558fe49c910 msgr2=0x5558fe855b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:44.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 -- 172.21.15.22:0/1758188532 shutdown_connections 2024-09-21T04:18:44.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 1 -- 172.21.15.22:0/1758188532 wait complete. 2024-09-21T04:18:44.352 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.343+0000 7f57b1fba740 20 client.16320 trim_cache size 0 max 16384 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.361+0000 7f57b1fba740 1 Processor -- start 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.361+0000 7f57b1fba740 1 -- start start 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.361+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 0x5558fe84b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.361+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe853950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.361+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe853e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.361+0000 7f57b1fba740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41ae840 con 0x5558fe487840 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.361+0000 7f57b1fba740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41b0380 con 0x5558fe466ea0 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.361+0000 7f57b1fba740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41aef10 con 0x5558fe47f660 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a9fe3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe853e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a9fe3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe853e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49738/0 (socket says 172.21.15.22:49738) 2024-09-21T04:18:44.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a9fe3640 1 -- 172.21.15.22:0/1482326035 learned_addr learned my addr 172.21.15.22:0/1482326035 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:44.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a97e2640 1 --2- 172.21.15.22:0/1482326035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 0x5558fe84b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a8fe1640 1 --2- 172.21.15.22:0/1482326035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe853950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a9fe3640 1 -- 172.21.15.22:0/1482326035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 msgr2=0x5558fe853950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:44.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/1482326035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe853950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a9fe3640 1 -- 172.21.15.22:0/1482326035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 msgr2=0x5558fe84b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/1482326035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 0x5558fe84b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a9fe3640 1 -- 172.21.15.22:0/1482326035 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558fe58a960 con 0x5558fe487840 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/1482326035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe853e90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f579c0a9c00 tx=0x7f579c0aced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab13b330888f205 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.362+0000 7f578effd640 1 -- 172.21.15.22:0/1482326035 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c0c8070 con 0x5558fe487840 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.363+0000 7f578effd640 1 -- 172.21.15.22:0/1482326035 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f579c05c070 con 0x5558fe487840 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.363+0000 7f578effd640 1 -- 172.21.15.22:0/1482326035 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c01f040 con 0x5558fe487840 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.363+0000 7f57b1fba740 1 -- 172.21.15.22:0/1482326035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 msgr2=0x5558fe853e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.363+0000 7f57b1fba740 1 --2- 172.21.15.22:0/1482326035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe853e90 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f579c0a9c00 tx=0x7f579c0aced0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.363+0000 7f57b1fba740 1 -- 172.21.15.22:0/1482326035 shutdown_connections 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.363+0000 7f57b1fba740 1 --2- 172.21.15.22:0/1482326035 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe853950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.363+0000 7f57b1fba740 1 --2- 172.21.15.22:0/1482326035 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe853e90 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.363+0000 7f57b1fba740 1 --2- 172.21.15.22:0/1482326035 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 0x5558fe84b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.363+0000 7f57b1fba740 1 -- 172.21.15.22:0/1482326035 >> 172.21.15.22:0/1482326035 conn(0x5558fe49c910 msgr2=0x5558fe8507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:44.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.364+0000 7f57b1fba740 1 -- 172.21.15.22:0/1482326035 shutdown_connections 2024-09-21T04:18:44.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.364+0000 7f57b1fba740 1 -- 172.21.15.22:0/1482326035 wait complete. 2024-09-21T04:18:44.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.364+0000 7f57b1fba740 1 -- start start 2024-09-21T04:18:44.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.364+0000 7f57b1fba740 1 Processor -- start 2024-09-21T04:18:44.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 0x5558fe8661e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe866720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57b1fba740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe861190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57b1fba740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41afcb0 con 0x5558fe487840 2024-09-21T04:18:44.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57b1fba740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41af5e0 con 0x5558fe466ea0 2024-09-21T04:18:44.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57b1fba740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f57a41ac820 con 0x5558fe47f660 2024-09-21T04:18:44.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57b1fba740 10 client.0 _ll_register_callbacks cb 0x7f579c0057c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:18:44.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a9fe3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe861190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a9fe3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe861190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49752/0 (socket says 172.21.15.22:49752) 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a9fe3640 1 -- 172.21.15.22:0/4166507556 learned_addr learned my addr 172.21.15.22:0/4166507556 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a97e2640 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 0x5558fe8661e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a8fe1640 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe866720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a9fe3640 1 -- 172.21.15.22:0/4166507556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 msgr2=0x5558fe866720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe866720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a9fe3640 1 -- 172.21.15.22:0/4166507556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 msgr2=0x5558fe8661e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 0x5558fe8661e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a9fe3640 1 -- 172.21.15.22:0/4166507556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558fe866e60 con 0x5558fe487840 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a97e2640 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 0x5558fe8661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:18:44.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f57a9fe3640 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe861190 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f579c0aa8a0 tx=0x7f579c0ad500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38d01f4cec6594f server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.365+0000 7f578cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f578cff9640 1 -- 172.21.15.22:0/4166507556 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f579c01f070 con 0x5558fe487840 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f578cff9640 1 -- 172.21.15.22:0/4166507556 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f579c0a9190 con 0x5558fe487840 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f57b1fba740 1 -- 172.21.15.22:0/4166507556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f579c05c070 con 0x5558fe487840 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f578cff9640 1 -- 172.21.15.22:0/4166507556 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f579c0c8050 con 0x5558fe487840 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f57b1fba740 10 client.16326 fetch_fsmap learned FSMap version 50 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f57b1fba740 1 -- 172.21.15.22:0/4166507556 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5558fe8db110 con 0x5558fe487840 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f578cff9640 1 -- 172.21.15.22:0/4166507556 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f579c05c070 con 0x5558fe487840 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f578cff9640 1 -- 172.21.15.22:0/4166507556 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f579c0ac400 con 0x5558fe487840 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f57b1fba740 10 client.16326 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:18:44.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f57b1fba740 10 client.16326 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:18:44.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f57b1fba740 20 client.16326 populate_metadata read hostname 'smithi022' 2024-09-21T04:18:44.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f57b1fba740 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5558fe4a8520 0x5558fe8dd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:18:44.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f57b1fba740 4 client.16326 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "f0cc7461", "release": true, "await": true}] 2024-09-21T04:18:44.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.366+0000 7f57b1fba740 1 -- 172.21.15.22:0/4166507556 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "f0cc7461", "release": true, "await": true}) -- 0x5558fe7c3bf0 con 0x5558fe4a8520 2024-09-21T04:18:44.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.367+0000 7f57a97e2640 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5558fe4a8520 0x5558fe8dd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:18:44.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.367+0000 7f57a97e2640 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5558fe4a8520 0x5558fe8dd5b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86c5600475326496 server_cookie=92d6cd815d430e19 in_seq=0 out_seq=0 2024-09-21T04:18:44.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.367+0000 7f578cff9640 10 client.16326 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:18:44.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.414+0000 7f578cff9640 1 -- 172.21.15.22:0/4166507556 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x5558fe7c3bf0 con 0x5558fe4a8520 2024-09-21T04:18:44.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.414+0000 7f578cff9640 10 client.16326 handle_command_reply: tid=0 2024-09-21T04:18:44.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.414+0000 7f57b1fba740 1 client.16326 shutdown 2024-09-21T04:18:44.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 1 -- 172.21.15.22:0/4166507556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 msgr2=0x5558fe861190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:44.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe861190 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f579c0aa8a0 tx=0x7f579c0ad500 comp rx=0 tx=0).stop 2024-09-21T04:18:44.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 1 -- 172.21.15.22:0/4166507556 shutdown_connections 2024-09-21T04:18:44.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5558fe4a8520 0x5558fe8dd5b0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5558fe47f660 0x5558fe866720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5558fe487840 0x5558fe861190 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 1 --2- 172.21.15.22:0/4166507556 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5558fe466ea0 0x5558fe8661e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f578cff9640 0 client.16326 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:18:44.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 1 -- 172.21.15.22:0/4166507556 >> 172.21.15.22:0/4166507556 conn(0x5558fe49c910 msgr2=0x5558fe8507a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:44.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 1 -- 172.21.15.22:0/4166507556 shutdown_connections 2024-09-21T04:18:44.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 1 -- 172.21.15.22:0/4166507556 wait complete. 2024-09-21T04:18:44.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.415+0000 7f57b1fba740 20 client.16326 trim_cache size 0 max 16384 2024-09-21T04:18:44.420 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:18:44.420 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:18:44.420 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:18:44.420 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 64, 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "f0cc7461": { 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 64, 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 143.2, 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:18:44.421 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:18:44.422 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:18:44.422 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:18:44.422 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-09-21T04:18:44.422 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:18:44.422 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:18:44.422 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:18:44.422 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:18:44.422 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:18:44.422 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:18:44.422 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:18:44.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 -- 172.21.15.22:0/2406204057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f57900b6590 msgr2=0x7f57900b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:44.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f57900b6590 0x7f57900b8aa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5794006010 tx=0x7f57940058d0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 -- 172.21.15.22:0/2406204057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a4108cf0 msgr2=0x7f57a419fd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:18:44.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a4108cf0 0x7f57a419fd00 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f579c00eaa0 tx=0x7f579c00ef60 comp rx=0 tx=0).stop 2024-09-21T04:18:44.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 -- 172.21.15.22:0/2406204057 shutdown_connections 2024-09-21T04:18:44.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f57900b6590 0x7f57900b8aa0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f57a41083a0 0x7f57a419aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f57a4108cf0 0x7f57a419fd00 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 --2- 172.21.15.22:0/2406204057 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f57a4102a60 0x7f57a419a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:18:44.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 -- 172.21.15.22:0/2406204057 >> 172.21.15.22:0/2406204057 conn(0x7f57a4079730 msgr2=0x7f57a4104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:18:44.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 -- 172.21.15.22:0/2406204057 shutdown_connections 2024-09-21T04:18:44.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:18:44.417+0000 7f57aba46640 1 -- 172.21.15.22:0/2406204057 wait complete. 2024-09-21T04:18:45.093 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:44 smithi022 ceph-mon[31015]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 218 KiB/s wr, 37 op/s 2024-09-21T04:18:45.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:44 smithi073 ceph-mon[34443]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 218 KiB/s wr, 37 op/s 2024-09-21T04:18:45.144 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'f0cc7461', total seconds elapsed: 26.5 2024-09-21T04:18:45.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:44 smithi060 ceph-mon[33722]: pgmap v862: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 218 KiB/s wr, 37 op/s 2024-09-21T04:18:47.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:46 smithi022 ceph-mon[31015]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 550 KiB/s wr, 40 op/s 2024-09-21T04:18:47.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:46 smithi073 ceph-mon[34443]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 550 KiB/s wr, 40 op/s 2024-09-21T04:18:47.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:46 smithi060 ceph-mon[33722]: pgmap v863: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 550 KiB/s wr, 40 op/s 2024-09-21T04:18:48.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 865.0 s, 757.8 tps, lat 690.324 ms stddev 3510.060 2024-09-21T04:18:49.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:48 smithi022 ceph-mon[31015]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2024-09-21T04:18:49.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:48 smithi073 ceph-mon[34443]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2024-09-21T04:18:49.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:48 smithi060 ceph-mon[33722]: pgmap v864: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 1.1 MiB/s wr, 101 op/s 2024-09-21T04:18:51.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:50 smithi022 ceph-mon[31015]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-09-21T04:18:51.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:50 smithi073 ceph-mon[34443]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-09-21T04:18:51.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:50 smithi060 ceph-mon[33722]: pgmap v865: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 1.7 MiB/s wr, 126 op/s 2024-09-21T04:18:53.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:52 smithi022 ceph-mon[31015]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 308 op/s 2024-09-21T04:18:53.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:52 smithi073 ceph-mon[34443]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 308 op/s 2024-09-21T04:18:53.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:52 smithi060 ceph-mon[33722]: pgmap v866: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 5.0 MiB/s wr, 308 op/s 2024-09-21T04:18:53.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 870.0 s, 817.0 tps, lat 124.044 ms stddev 89.749 2024-09-21T04:18:55.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:54 smithi022 ceph-mon[31015]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 436 op/s 2024-09-21T04:18:55.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:54 smithi073 ceph-mon[34443]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 436 op/s 2024-09-21T04:18:55.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:54 smithi060 ceph-mon[33722]: pgmap v867: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 6.7 MiB/s wr, 436 op/s 2024-09-21T04:18:57.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:56 smithi073 ceph-mon[34443]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.9 MiB/s wr, 538 op/s 2024-09-21T04:18:57.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:56 smithi060 ceph-mon[33722]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.9 MiB/s wr, 538 op/s 2024-09-21T04:18:57.345 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:56 smithi022 ceph-mon[31015]: pgmap v868: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 7.9 MiB/s wr, 538 op/s 2024-09-21T04:18:58.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 875.0 s, 692.4 tps, lat 141.883 ms stddev 124.619 2024-09-21T04:18:59.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:18:58 smithi060 ceph-mon[33722]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.9 MiB/s wr, 704 op/s 2024-09-21T04:18:59.349 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:18:58 smithi022 ceph-mon[31015]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.9 MiB/s wr, 704 op/s 2024-09-21T04:18:59.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:18:58 smithi073 ceph-mon[34443]: pgmap v869: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 9.9 MiB/s wr, 704 op/s 2024-09-21T04:19:01.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:00 smithi060 ceph-mon[33722]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.6 MiB/s wr, 676 op/s 2024-09-21T04:19:01.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:00 smithi022 ceph-mon[31015]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.6 MiB/s wr, 676 op/s 2024-09-21T04:19:01.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:00 smithi073 ceph-mon[34443]: pgmap v870: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 9.6 MiB/s wr, 676 op/s 2024-09-21T04:19:03.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:02 smithi060 ceph-mon[33722]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 831 op/s 2024-09-21T04:19:03.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:02 smithi022 ceph-mon[31015]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 831 op/s 2024-09-21T04:19:03.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:02 smithi073 ceph-mon[34443]: pgmap v871: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 12 MiB/s wr, 831 op/s 2024-09-21T04:19:03.705 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 880.0 s, 906.0 tps, lat 112.775 ms stddev 65.536 2024-09-21T04:19:04.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:03 smithi060 ceph-mon[33722]: pgmap v872: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 776 op/s 2024-09-21T04:19:04.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:03 smithi022 ceph-mon[31015]: pgmap v872: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 776 op/s 2024-09-21T04:19:04.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:03 smithi073 ceph-mon[34443]: pgmap v872: 129 pgs: 129 active+clean; 1.4 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 10 MiB/s wr, 776 op/s 2024-09-21T04:19:06.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:06 smithi060 ceph-mon[33722]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.5 MiB/s wr, 754 op/s 2024-09-21T04:19:06.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:06 smithi022 ceph-mon[31015]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.5 MiB/s wr, 754 op/s 2024-09-21T04:19:06.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:06 smithi073 ceph-mon[34443]: pgmap v873: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 9.5 MiB/s wr, 754 op/s 2024-09-21T04:19:08.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:08 smithi060 ceph-mon[33722]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 823 op/s 2024-09-21T04:19:08.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 885.0 s, 853.0 tps, lat 116.544 ms stddev 62.843 2024-09-21T04:19:08.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:08 smithi022 ceph-mon[31015]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 823 op/s 2024-09-21T04:19:08.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:08 smithi073 ceph-mon[34443]: pgmap v874: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 11 MiB/s wr, 823 op/s 2024-09-21T04:19:10.702 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:10 smithi060 ceph-mon[33722]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.8 MiB/s wr, 702 op/s 2024-09-21T04:19:10.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:10 smithi022 ceph-mon[31015]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.8 MiB/s wr, 702 op/s 2024-09-21T04:19:10.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:10 smithi073 ceph-mon[34443]: pgmap v875: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 9.8 MiB/s wr, 702 op/s 2024-09-21T04:19:12.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:12 smithi022 ceph-mon[31015]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 830 op/s 2024-09-21T04:19:12.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:12 smithi073 ceph-mon[34443]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 830 op/s 2024-09-21T04:19:12.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:12 smithi060 ceph-mon[33722]: pgmap v876: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 11 MiB/s wr, 830 op/s 2024-09-21T04:19:13.703 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 890.0 s, 793.4 tps, lat 125.930 ms stddev 61.786 2024-09-21T04:19:14.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:14 smithi022 ceph-mon[31015]: pgmap v877: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 10 MiB/s wr, 787 op/s 2024-09-21T04:19:14.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:14 smithi073 ceph-mon[34443]: pgmap v877: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 10 MiB/s wr, 787 op/s 2024-09-21T04:19:14.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:14 smithi060 ceph-mon[33722]: pgmap v877: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 10 MiB/s wr, 787 op/s 2024-09-21T04:19:16.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:16 smithi022 ceph-mon[31015]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.9 MiB/s wr, 786 op/s 2024-09-21T04:19:16.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:16 smithi073 ceph-mon[34443]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.9 MiB/s wr, 786 op/s 2024-09-21T04:19:16.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:16 smithi060 ceph-mon[33722]: pgmap v878: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 9.9 MiB/s wr, 786 op/s 2024-09-21T04:19:18.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 895.0 s, 728.2 tps, lat 137.774 ms stddev 106.604 2024-09-21T04:19:18.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:18 smithi022 ceph-mon[31015]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 853 op/s 2024-09-21T04:19:18.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:18 smithi073 ceph-mon[34443]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 853 op/s 2024-09-21T04:19:18.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:18 smithi060 ceph-mon[33722]: pgmap v879: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 11 MiB/s wr, 853 op/s 2024-09-21T04:19:20.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:20 smithi022 ceph-mon[31015]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 9.1 MiB/s wr, 708 op/s 2024-09-21T04:19:20.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:20 smithi073 ceph-mon[34443]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 9.1 MiB/s wr, 708 op/s 2024-09-21T04:19:20.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:20 smithi060 ceph-mon[33722]: pgmap v880: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 9.1 MiB/s wr, 708 op/s 2024-09-21T04:19:22.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:22 smithi022 ceph-mon[31015]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.2 MiB/s wr, 816 op/s 2024-09-21T04:19:22.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:22 smithi073 ceph-mon[34443]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.2 MiB/s wr, 816 op/s 2024-09-21T04:19:22.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:22 smithi060 ceph-mon[33722]: pgmap v881: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.2 MiB/s wr, 816 op/s 2024-09-21T04:19:23.704 INFO:teuthology.orchestra.run.smithi022.stderr:progress: 900.0 s, 802.9 tps, lat 124.931 ms stddev 79.376 2024-09-21T04:19:23.951 INFO:teuthology.orchestra.run.smithi022.stdout:transaction type: 2024-09-21T04:19:23.952 INFO:teuthology.orchestra.run.smithi022.stdout:scaling factor: 32 2024-09-21T04:19:23.952 INFO:teuthology.orchestra.run.smithi022.stdout:query mode: simple 2024-09-21T04:19:23.952 INFO:teuthology.orchestra.run.smithi022.stdout:number of clients: 100 2024-09-21T04:19:23.952 INFO:teuthology.orchestra.run.smithi022.stdout:number of threads: 4 2024-09-21T04:19:23.952 INFO:teuthology.orchestra.run.smithi022.stdout:duration: 900 s 2024-09-21T04:19:23.952 INFO:teuthology.orchestra.run.smithi022.stdout:number of transactions actually processed: 561747 2024-09-21T04:19:23.952 INFO:teuthology.orchestra.run.smithi022.stdout:latency average = 160.162 ms 2024-09-21T04:19:23.952 INFO:teuthology.orchestra.run.smithi022.stdout:latency stddev = 956.606 ms 2024-09-21T04:19:23.952 INFO:teuthology.orchestra.run.smithi022.stdout:tps = 623.991270 (including connections establishing) 2024-09-21T04:19:23.952 INFO:teuthology.orchestra.run.smithi022.stdout:tps = 624.000703 (excluding connections establishing) 2024-09-21T04:19:23.956 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-09-21T04:19:24.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:24 smithi022 ceph-mon[31015]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.5 MiB/s wr, 787 op/s 2024-09-21T04:19:24.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:24 smithi073 ceph-mon[34443]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.5 MiB/s wr, 787 op/s 2024-09-21T04:19:24.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:24 smithi060 ceph-mon[33722]: pgmap v882: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.5 MiB/s wr, 787 op/s 2024-09-21T04:19:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:26 smithi022 ceph-mon[31015]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.1 MiB/s wr, 772 op/s 2024-09-21T04:19:26.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:19:26.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:26 smithi073 ceph-mon[34443]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.1 MiB/s wr, 772 op/s 2024-09-21T04:19:26.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:19:26.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:26 smithi060 ceph-mon[33722]: pgmap v883: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.1 MiB/s wr, 772 op/s 2024-09-21T04:19:26.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:19:27.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:19:27.851 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:19:27.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:19:27.856 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi073 to 176.0M 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: Unable to set osd_memory_target on smithi073 to 184556646: error parsing value: Value '184556646' is below minimum 939524096 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.954 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.954 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"} : dispatch 2024-09-21T04:19:27.954 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:19:27.954 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:19:27.954 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:19:28.231 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 10 2024-09-21T04:19:28.231 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:19:28.829 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:19:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:28 smithi060 ceph-mon[33722]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-09-21T04:19:28.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:28 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-21T04:19:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:28 smithi060 ceph-mon[33722]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T04:19:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:28 smithi060 ceph-mon[33722]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T04:19:28.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:28 smithi060 ceph-mon[33722]: Unable to set osd_memory_target on smithi060 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T04:19:29.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:28 smithi022 ceph-mon[31015]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-09-21T04:19:29.003 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:28 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-21T04:19:29.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:28 smithi022 ceph-mon[31015]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T04:19:29.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:28 smithi022 ceph-mon[31015]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T04:19:29.004 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:28 smithi022 ceph-mon[31015]: Unable to set osd_memory_target on smithi060 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T04:19:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:28 smithi073 ceph-mon[34443]: pgmap v884: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 8.5 MiB/s wr, 769 op/s 2024-09-21T04:19:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:28 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi022 to 177.0M 2024-09-21T04:19:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:28 smithi073 ceph-mon[34443]: Adjusting osd_memory_target on smithi060 to 177.0M 2024-09-21T04:19:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:28 smithi073 ceph-mon[34443]: Unable to set osd_memory_target on smithi022 to 185687756: error parsing value: Value '185687756' is below minimum 939524096 2024-09-21T04:19:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:28 smithi073 ceph-mon[34443]: Unable to set osd_memory_target on smithi060 to 185689190: error parsing value: Value '185689190' is below minimum 939524096 2024-09-21T04:19:30.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:30 smithi060 ceph-mon[33722]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.6 MiB/s wr, 626 op/s 2024-09-21T04:19:31.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:30 smithi022 ceph-mon[31015]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.6 MiB/s wr, 626 op/s 2024-09-21T04:19:31.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:30 smithi073 ceph-mon[34443]: pgmap v885: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 6.6 MiB/s wr, 626 op/s 2024-09-21T04:19:32.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:32 smithi060 ceph-mon[33722]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.4 MiB/s wr, 825 op/s 2024-09-21T04:19:32.988 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:32 smithi022 ceph-mon[31015]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.4 MiB/s wr, 825 op/s 2024-09-21T04:19:33.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:32 smithi073 ceph-mon[34443]: pgmap v886: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 8.4 MiB/s wr, 825 op/s 2024-09-21T04:19:34.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.361+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/408264830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8b01094b0 msgr2=0x7fa8b01098c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.361+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/408264830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8b01094b0 0x7fa8b01098c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009900 tx=0x7fa8a002a400 comp rx=0 tx=0).stop 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.362+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/408264830 shutdown_connections 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.362+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/408264830 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8b0109e00 0x7fa8b0110630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.362+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/408264830 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8b01094b0 0x7fa8b01098c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.362+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/408264830 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8b0101f70 0x7fa8b0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.362+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/408264830 >> 172.21.15.22:0/408264830 conn(0x7fa8b0077c60 msgr2=0x7fa8b00780a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.362+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/408264830 shutdown_connections 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.362+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/408264830 wait complete. 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.363+0000 7fa8b7dc0640 1 Processor -- start 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.363+0000 7fa8b7dc0640 1 -- start start 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.363+0000 7fa8b7dc0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8b0101f70 0x7fa8b010fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:34.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.363+0000 7fa8b7dc0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8b01094b0 0x7fa8b0110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b5b5c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8b0101f70 0x7fa8b010fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b5b5c640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8b0101f70 0x7fa8b010fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:45134/0 (socket says 172.21.15.22:45134) 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b535b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8b01094b0 0x7fa8b0110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b535b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8b01094b0 0x7fa8b0110280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:47274/0 (socket says 172.21.15.22:47274) 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b5b5c640 1 -- 172.21.15.22:0/1936686283 learned_addr learned my addr 172.21.15.22:0/1936686283 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8b0109e00 0x7fa8b01a2db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b01139c0 con 0x7fa8b0109e00 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b0113840 con 0x7fa8b01094b0 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fa8b0113b40 con 0x7fa8b0101f70 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b5b5c640 1 -- 172.21.15.22:0/1936686283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8b01094b0 msgr2=0x7fa8b0110280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b5b5c640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8b01094b0 0x7fa8b0110280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b635d640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8b0109e00 0x7fa8b01a2db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:34.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b5b5c640 1 -- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8b0109e00 msgr2=0x7fa8b01a2db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b5b5c640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8b0109e00 0x7fa8b01a2db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.364+0000 7fa8b5b5c640 1 -- 172.21.15.22:0/1936686283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8b01a34e0 con 0x7fa8b0101f70 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.365+0000 7fa8b635d640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8b0109e00 0x7fa8b01a2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.365+0000 7fa8b5b5c640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8b0101f70 0x7fa8b010fce0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00e9f0 tx=0x7fa8ac00eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.365+0000 7fa8a6ffd640 1 -- 172.21.15.22:0/1936686283 <== mon.1 v2:172.21.15.73:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00cd80 con 0x7fa8b0101f70 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.365+0000 7fa8a6ffd640 1 -- 172.21.15.22:0/1936686283 <== mon.1 v2:172.21.15.73:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa8ac0108c0 con 0x7fa8b0101f70 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.365+0000 7fa8a6ffd640 1 -- 172.21.15.22:0/1936686283 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0187c0 con 0x7fa8b0101f70 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.366+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8b01a37d0 con 0x7fa8b0101f70 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.366+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8b01ad170 con 0x7fa8b0101f70 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.367+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8b01a1900 con 0x7fa8b0101f70 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.369+0000 7fa8a6ffd640 1 -- 172.21.15.22:0/1936686283 <== mon.1 v2:172.21.15.73:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fa8ac010430 con 0x7fa8b0101f70 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.370+0000 7fa8a6ffd640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa89c0b6590 0x7fa89c0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.371+0000 7fa8a6ffd640 1 -- 172.21.15.22:0/1936686283 <== mon.1 v2:172.21.15.73:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fa8ac0e7d10 con 0x7fa8b0101f70 2024-09-21T04:19:34.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.371+0000 7fa8b535b640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa89c0b6590 0x7fa89c0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:34.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.372+0000 7fa8b535b640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa89c0b6590 0x7fa89c0b8aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009850 tx=0x7fa8a000b040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:34.738 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:34.738 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:19:34.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.375+0000 7fa8a6ffd640 1 -- 172.21.15.22:0/1936686283 <== mon.1 v2:172.21.15.73:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa8ac0ae180 con 0x7fa8b0101f70 2024-09-21T04:19:34.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.663+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8b01ad630 con 0x7fa8b0101f70 2024-09-21T04:19:34.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.664+0000 7fa8a6ffd640 1 -- 172.21.15.22:0/1936686283 <== mon.1 v2:172.21.15.73:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7fa8ac0b2560 con 0x7fa8b0101f70 2024-09-21T04:19:34.738 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.666+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa89c0b6590 msgr2=0x7fa89c0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.666+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa89c0b6590 0x7fa89c0b8aa0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fa8a0009850 tx=0x7fa8a000b040 comp rx=0 tx=0).stop 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.667+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8b0101f70 msgr2=0x7fa8b010fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.667+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8b0101f70 0x7fa8b010fce0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00e9f0 tx=0x7fa8ac00eeb0 comp rx=0 tx=0).stop 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.667+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 shutdown_connections 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.667+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fa89c0b6590 0x7fa89c0b8aa0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.667+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa8b0109e00 0x7fa8b01a2db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.667+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fa8b01094b0 0x7fa8b0110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.667+0000 7fa8b7dc0640 1 --2- 172.21.15.22:0/1936686283 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fa8b0101f70 0x7fa8b010fce0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.667+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 >> 172.21.15.22:0/1936686283 conn(0x7fa8b0077c60 msgr2=0x7fa8b0108160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.667+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 shutdown_connections 2024-09-21T04:19:34.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:34.667+0000 7fa8b7dc0640 1 -- 172.21.15.22:0/1936686283 wait complete. 2024-09-21T04:19:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:34 smithi060 ceph-mon[33722]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.9 MiB/s wr, 892 op/s 2024-09-21T04:19:34.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:34 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1936686283' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:19:35.030 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:34 smithi022 ceph-mon[31015]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.9 MiB/s wr, 892 op/s 2024-09-21T04:19:35.030 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:34 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1936686283' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:19:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:34 smithi073 ceph-mon[34443]: pgmap v887: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.9 MiB/s wr, 892 op/s 2024-09-21T04:19:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:34 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1936686283' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:19:35.387 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db / --timeout 90 --expiration 130 --await-for 45.0' 2024-09-21T04:19:35.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db / --timeout 90 --expiration 130 --await-for 45.0 2024-09-21T04:19:35.674 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:19:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.210+0000 7ff3429e2640 1 -- 172.21.15.22:0/1693674952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff33c101df0 msgr2=0x7ff33c102200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.210+0000 7ff3429e2640 1 --2- 172.21.15.22:0/1693674952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff33c101df0 0x7ff33c102200 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff330009900 tx=0x7ff33002a410 comp rx=0 tx=0).stop 2024-09-21T04:19:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.210+0000 7ff3429e2640 1 -- 172.21.15.22:0/1693674952 shutdown_connections 2024-09-21T04:19:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.210+0000 7ff3429e2640 1 --2- 172.21.15.22:0/1693674952 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c102740 0x7ff33c110570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.210+0000 7ff3429e2640 1 --2- 172.21.15.22:0/1693674952 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff33c101df0 0x7ff33c102200 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.210+0000 7ff3429e2640 1 --2- 172.21.15.22:0/1693674952 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff33c108700 0x7ff33c108b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.210+0000 7ff3429e2640 1 -- 172.21.15.22:0/1693674952 >> 172.21.15.22:0/1693674952 conn(0x7ff33c079f50 msgr2=0x7ff33c07a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.210+0000 7ff3429e2640 1 -- 172.21.15.22:0/1693674952 shutdown_connections 2024-09-21T04:19:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.210+0000 7ff3429e2640 1 -- 172.21.15.22:0/1693674952 wait complete. 2024-09-21T04:19:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.211+0000 7ff3429e2640 1 Processor -- start 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.211+0000 7ff3429e2640 1 -- start start 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff3429e2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff33c101df0 0x7ff33c19a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff3429e2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c102740 0x7ff33c19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff3429e2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff33c108700 0x7ff33c19fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff3429e2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c113960 con 0x7ff33c108700 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff3429e2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c1137e0 con 0x7ff33c102740 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff3429e2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c113ae0 con 0x7ff33c101df0 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff340f7f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff33c108700 0x7ff33c19fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff33bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff33c101df0 0x7ff33c19a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff33bfff640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff33c101df0 0x7ff33c19a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.73:3300/0 says I am v2:172.21.15.22:45144/0 (socket says 172.21.15.22:45144) 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff340f7f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff33c108700 0x7ff33c19fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39492/0 (socket says 172.21.15.22:39492) 2024-09-21T04:19:36.216 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff33bfff640 1 -- 172.21.15.22:0/571199526 learned_addr learned my addr 172.21.15.22:0/571199526 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c102740 0x7ff33c19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff33b7fe640 1 -- 172.21.15.22:0/571199526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff33c101df0 msgr2=0x7ff33c19a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff33c101df0 0x7ff33c19a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff33b7fe640 1 -- 172.21.15.22:0/571199526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff33c108700 msgr2=0x7ff33c19fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff33c108700 0x7ff33c19fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff33b7fe640 1 -- 172.21.15.22:0/571199526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c1a0320 con 0x7ff33c102740 2024-09-21T04:19:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff340f7f640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff33c108700 0x7ff33c19fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:19:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.212+0000 7ff33bfff640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff33c101df0 0x7ff33c19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:19:36.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.213+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c102740 0x7ff33c19a950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff33002a930 tx=0x7ff330004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:36.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.213+0000 7ff3397fa640 1 -- 172.21.15.22:0/571199526 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33003f070 con 0x7ff33c102740 2024-09-21T04:19:36.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.213+0000 7ff3397fa640 1 -- 172.21.15.22:0/571199526 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff330003a80 con 0x7ff33c102740 2024-09-21T04:19:36.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.213+0000 7ff3429e2640 1 -- 172.21.15.22:0/571199526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c1a05b0 con 0x7ff33c102740 2024-09-21T04:19:36.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.213+0000 7ff3397fa640 1 -- 172.21.15.22:0/571199526 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330035070 con 0x7ff33c102740 2024-09-21T04:19:36.218 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.213+0000 7ff3429e2640 1 -- 172.21.15.22:0/571199526 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c1a6d70 con 0x7ff33c102740 2024-09-21T04:19:36.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff348f56740 1 Processor -- start 2024-09-21T04:19:36.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff348f56740 1 -- start start 2024-09-21T04:19:36.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff3397fa640 1 -- 172.21.15.22:0/571199526 <== mon.2 v2:172.21.15.60:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff330043400 con 0x7ff33c102740 2024-09-21T04:19:36.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff348f56740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a179600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff348f56740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a179b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff348f56740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 0x55663a17a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.222 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff348f56740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55663a0efb90 con 0x556639da9980 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff348f56740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55663a0defc0 con 0x556639dd2840 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff348f56740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55663a0e2dd0 con 0x556639db1b60 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff340f7f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a179600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff33bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a179b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff33b7fe640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 0x55663a17a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff340f7f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a179600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.60:3300/0 says I am v2:172.21.15.22:47290/0 (socket says 172.21.15.22:47290) 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff340f7f640 1 -- 172.21.15.22:0/1503425274 learned_addr learned my addr 172.21.15.22:0/1503425274 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.216+0000 7ff33bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a179b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39508/0 (socket says 172.21.15.22:39508) 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff340f7f640 1 -- 172.21.15.22:0/1503425274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 msgr2=0x55663a17a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff340f7f640 1 --2- 172.21.15.22:0/1503425274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 0x55663a17a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff340f7f640 1 -- 172.21.15.22:0/1503425274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 msgr2=0x55663a179b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff340f7f640 1 --2- 172.21.15.22:0/1503425274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a179b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff340f7f640 1 -- 172.21.15.22:0/1503425274 --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55663a066060 con 0x556639dd2840 2024-09-21T04:19:36.223 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff3397fa640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff3240b6510 0x7ff3240b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff340f7f640 1 --2- 172.21.15.22:0/1503425274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a179600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff3340117e0 tx=0x7ff334011be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=875e358b56a3f193 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff33bfff640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff3240b6510 0x7ff3240b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff3397fa640 1 -- 172.21.15.22:0/571199526 <== mon.2 v2:172.21.15.60:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff3301077a0 con 0x7ff33c102740 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/1503425274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 0x55663a17a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff3227fc640 1 -- 172.21.15.22:0/1503425274 <== mon.2 v2:172.21.15.60:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334011310 con 0x556639dd2840 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff3227fc640 1 -- 172.21.15.22:0/1503425274 <== mon.2 v2:172.21.15.60:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff334003e00 con 0x556639dd2840 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.217+0000 7ff3227fc640 1 -- 172.21.15.22:0/1503425274 <== mon.2 v2:172.21.15.60:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3340043d0 con 0x556639dd2840 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff33bfff640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff3240b6510 0x7ff3240b8a20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00bfd0 tx=0x7ff32c00b4a0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff348f56740 1 -- 172.21.15.22:0/1503425274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 msgr2=0x55663a179600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff348f56740 1 --2- 172.21.15.22:0/1503425274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a179600 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff3340117e0 tx=0x7ff334011be0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff348f56740 1 -- 172.21.15.22:0/1503425274 shutdown_connections 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff348f56740 1 --2- 172.21.15.22:0/1503425274 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 0x55663a17a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff348f56740 1 --2- 172.21.15.22:0/1503425274 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a179b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff348f56740 1 --2- 172.21.15.22:0/1503425274 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a179600 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff348f56740 1 -- 172.21.15.22:0/1503425274 >> 172.21.15.22:0/1503425274 conn(0x556639dc6990 msgr2=0x55663a1774f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:36.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff348f56740 1 -- 172.21.15.22:0/1503425274 shutdown_connections 2024-09-21T04:19:36.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff348f56740 1 -- 172.21.15.22:0/1503425274 wait complete. 2024-09-21T04:19:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.219+0000 7ff348f56740 1 -- start start 2024-09-21T04:19:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff348f56740 1 Processor -- start 2024-09-21T04:19:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff348f56740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a185820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff348f56740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 0x55663a185e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff348f56740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a18ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff348f56740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556639f407a0 con 0x556639da9980 2024-09-21T04:19:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff348f56740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x55663a0840a0 con 0x556639dd2840 2024-09-21T04:19:36.226 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff348f56740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x55663a183d40 con 0x556639db1b60 2024-09-21T04:19:36.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff33bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a185820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff33bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a185820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39522/0 (socket says 172.21.15.22:39522) 2024-09-21T04:19:36.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff33bfff640 1 -- 172.21.15.22:0/623006801 learned_addr learned my addr 172.21.15.22:0/623006801 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:36.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 0x55663a185e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff348f56740 10 client.0 _ll_register_callbacks cb 0x55663a0613c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:19:36.228 DEBUG:teuthology.orchestra.run.smithi022:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.220+0000 7ff340f7f640 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a18ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff33bfff640 1 -- 172.21.15.22:0/623006801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 msgr2=0x55663a185e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff33bfff640 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 0x55663a185e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff33bfff640 1 -- 172.21.15.22:0/623006801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 msgr2=0x55663a18ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff33bfff640 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a18ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff33bfff640 1 -- 172.21.15.22:0/623006801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55663a072880 con 0x556639da9980 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff33bfff640 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a185820 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff32c032b40 tx=0x7ff32c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e08fdf748b0439 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff31b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff31b7fe640 1 -- 172.21.15.22:0/623006801 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff32c004260 con 0x556639da9980 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff348f56740 1 -- 172.21.15.22:0/623006801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff334003e00 con 0x556639da9980 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff31b7fe640 1 -- 172.21.15.22:0/623006801 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff32c004400 con 0x556639da9980 2024-09-21T04:19:36.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff31b7fe640 1 -- 172.21.15.22:0/623006801 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff32c041930 con 0x556639da9980 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff348f56740 10 client.16341 fetch_fsmap learned FSMap version 50 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.221+0000 7ff348f56740 1 -- 172.21.15.22:0/623006801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x556639e4cb90 con 0x556639da9980 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.222+0000 7ff31b7fe640 1 -- 172.21.15.22:0/623006801 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff334003e00 con 0x556639da9980 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.222+0000 7ff31b7fe640 1 -- 172.21.15.22:0/623006801 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7ff32c048070 con 0x556639da9980 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.222+0000 7ff348f56740 10 client.16341 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.222+0000 7ff348f56740 10 client.16341 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.222+0000 7ff348f56740 20 client.16341 populate_metadata read hostname 'smithi022' 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.222+0000 7ff348f56740 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556639d911c0 0x55663a197130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.222+0000 7ff348f56740 4 client.16341 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.222+0000 7ff348f56740 1 -- 172.21.15.22:0/623006801 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55663a0f1ae0 con 0x556639d911c0 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.222+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556639d911c0 0x55663a197130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.223+0000 7ff31b7fe640 10 client.16341 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.223+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556639d911c0 0x55663a197130 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32e271d595b5dfb5 server_cookie=43306142adc2703d in_seq=0 out_seq=0 2024-09-21T04:19:36.232 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.223+0000 7ff31b7fe640 1 -- 172.21.15.22:0/623006801 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55663a0f1ae0 con 0x556639d911c0 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.223+0000 7ff31b7fe640 10 client.16341 handle_command_reply: tid=0 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.223+0000 7ff348f56740 1 client.16341 shutdown 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 1 -- 172.21.15.22:0/623006801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 msgr2=0x55663a185820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a185820 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7ff32c032b40 tx=0x7ff32c004730 comp rx=0 tx=0).stop 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 1 -- 172.21.15.22:0/623006801 shutdown_connections 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556639d911c0 0x55663a197130 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639db1b60 0x55663a185e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a18ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 1 --2- 172.21.15.22:0/623006801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639da9980 0x55663a185820 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 1 -- 172.21.15.22:0/623006801 >> 172.21.15.22:0/623006801 conn(0x556639dc6990 msgr2=0x55663a17aff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff31b7fe640 0 client.16341 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 1 -- 172.21.15.22:0/623006801 shutdown_connections 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 1 -- 172.21.15.22:0/623006801 wait complete. 2024-09-21T04:19:36.233 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.224+0000 7ff348f56740 20 client.16341 trim_cache size 0 max 16384 2024-09-21T04:19:36.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.241+0000 7ff348f56740 1 Processor -- start 2024-09-21T04:19:36.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff348f56740 1 -- start start 2024-09-21T04:19:36.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff348f56740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639da9980 0x55663a18b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff348f56740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639db1b60 0x55663a177550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff348f56740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639dd2840 0x55663a19c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff348f56740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c1ae840 con 0x556639dd2840 2024-09-21T04:19:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff348f56740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c1b0380 con 0x556639db1b60 2024-09-21T04:19:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff348f56740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c1aef10 con 0x556639da9980 2024-09-21T04:19:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff340f7f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639dd2840 0x55663a19c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff340f7f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639dd2840 0x55663a19c930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39532/0 (socket says 172.21.15.22:39532) 2024-09-21T04:19:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff340f7f640 1 -- 172.21.15.22:0/92875943 learned_addr learned my addr 172.21.15.22:0/92875943 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/92875943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639db1b60 0x55663a177550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.246 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff33bfff640 1 --2- 172.21.15.22:0/92875943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639da9980 0x55663a18b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff340f7f640 1 -- 172.21.15.22:0/92875943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639da9980 msgr2=0x55663a18b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:36.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff340f7f640 1 --2- 172.21.15.22:0/92875943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639da9980 0x55663a18b4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.242+0000 7ff340f7f640 1 -- 172.21.15.22:0/92875943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639db1b60 msgr2=0x55663a177550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.243+0000 7ff340f7f640 1 --2- 172.21.15.22:0/92875943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639db1b60 0x55663a177550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.243+0000 7ff340f7f640 1 -- 172.21.15.22:0/92875943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55663a186250 con 0x556639dd2840 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.243+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/92875943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639db1b60 0x55663a177550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.243+0000 7ff340f7f640 1 --2- 172.21.15.22:0/92875943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639dd2840 0x55663a19c930 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff3340117b0 tx=0x7ff334011350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c423a04f6d581d83 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.243+0000 7ff321ffb640 1 -- 172.21.15.22:0/92875943 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff33400fba0 con 0x556639dd2840 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.243+0000 7ff321ffb640 1 -- 172.21.15.22:0/92875943 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff334003e00 con 0x556639dd2840 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.243+0000 7ff321ffb640 1 -- 172.21.15.22:0/92875943 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff334005520 con 0x556639dd2840 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.244+0000 7ff348f56740 1 -- 172.21.15.22:0/92875943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639dd2840 msgr2=0x55663a19c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.244+0000 7ff348f56740 1 --2- 172.21.15.22:0/92875943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639dd2840 0x55663a19c930 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff3340117b0 tx=0x7ff334011350 comp rx=0 tx=0).stop 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.244+0000 7ff348f56740 1 -- 172.21.15.22:0/92875943 shutdown_connections 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.244+0000 7ff348f56740 1 --2- 172.21.15.22:0/92875943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639dd2840 0x55663a19c930 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.244+0000 7ff348f56740 1 --2- 172.21.15.22:0/92875943 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639db1b60 0x55663a177550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.244+0000 7ff348f56740 1 --2- 172.21.15.22:0/92875943 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639da9980 0x55663a18b4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.244+0000 7ff348f56740 1 -- 172.21.15.22:0/92875943 >> 172.21.15.22:0/92875943 conn(0x556639dc6990 msgr2=0x55663a18ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:36.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.244+0000 7ff348f56740 1 -- 172.21.15.22:0/92875943 shutdown_connections 2024-09-21T04:19:36.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.244+0000 7ff348f56740 1 -- 172.21.15.22:0/92875943 wait complete. 2024-09-21T04:19:36.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.245+0000 7ff348f56740 1 -- start start 2024-09-21T04:19:36.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.245+0000 7ff348f56740 1 Processor -- start 2024-09-21T04:19:36.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.245+0000 7ff348f56740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639da9980 0x55663a18c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.245+0000 7ff348f56740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639db1b60 0x55663a18c740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.245+0000 7ff348f56740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a18cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.245+0000 7ff348f56740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c1afcb0 con 0x556639db1b60 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.245+0000 7ff348f56740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c1af5e0 con 0x556639dd2840 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.245+0000 7ff348f56740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c1ac820 con 0x556639da9980 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.245+0000 7ff348f56740 10 client.0 _ll_register_callbacks cb 0x7ff32c0329d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff33b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639db1b60 0x55663a18c740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff33b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639db1b60 0x55663a18c740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39546/0 (socket says 172.21.15.22:39546) 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff33b7fe640 1 -- 172.21.15.22:0/2221001986 learned_addr learned my addr 172.21.15.22:0/2221001986 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff33bfff640 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639da9980 0x55663a18c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff340f7f640 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a18cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff33b7fe640 1 -- 172.21.15.22:0/2221001986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639da9980 msgr2=0x55663a18c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639da9980 0x55663a18c200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff33b7fe640 1 -- 172.21.15.22:0/2221001986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 msgr2=0x55663a18cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:36.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a18cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff33b7fe640 1 -- 172.21.15.22:0/2221001986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55663a201b30 con 0x556639db1b60 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff33b7fe640 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639db1b60 0x55663a18c740 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff330104ee0 tx=0x7ff3300cd4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47d9e7e346df685 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff31b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff31b7fe640 1 -- 172.21.15.22:0/2221001986 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330048040 con 0x556639db1b60 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff31b7fe640 1 -- 172.21.15.22:0/2221001986 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff3300c9890 con 0x556639db1b60 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.246+0000 7ff348f56740 1 -- 172.21.15.22:0/2221001986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff334003e00 con 0x556639db1b60 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff31b7fe640 1 -- 172.21.15.22:0/2221001986 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7ff3300cd130 con 0x556639db1b60 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff348f56740 10 client.16347 fetch_fsmap learned FSMap version 50 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff348f56740 1 -- 172.21.15.22:0/2221001986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x55663a202d30 con 0x556639db1b60 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff31b7fe640 1 -- 172.21.15.22:0/2221001986 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff334003e00 con 0x556639db1b60 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff31b7fe640 1 -- 172.21.15.22:0/2221001986 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7ff33004b060 con 0x556639db1b60 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff348f56740 10 client.16347 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff348f56740 10 client.16347 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:19:36.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff348f56740 20 client.16347 populate_metadata read hostname 'smithi022' 2024-09-21T04:19:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff348f56740 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556639d66570 0x55663a205530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff348f56740 4 client.16347 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}] 2024-09-21T04:19:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.247+0000 7ff348f56740 1 -- 172.21.15.22:0/2221001986 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 130.0, "await_for": 45.0}) -- 0x55663a0ed590 con 0x556639d66570 2024-09-21T04:19:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.248+0000 7ff33bfff640 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556639d66570 0x55663a205530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.248+0000 7ff33bfff640 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556639d66570 0x55663a205530 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c89cefdc4c22e59 server_cookie=6018abe7671a9096 in_seq=0 out_seq=0 2024-09-21T04:19:36.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.248+0000 7ff31b7fe640 10 client.16347 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:36.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff31b7fe640 1 -- 172.21.15.22:0/2221001986 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+591 (crc 0 0 0) 0x55663a0ed590 con 0x556639d66570 2024-09-21T04:19:36.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff31b7fe640 10 client.16347 handle_command_reply: tid=0 2024-09-21T04:19:36.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff348f56740 1 client.16347 shutdown 2024-09-21T04:19:36.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff348f56740 1 -- 172.21.15.22:0/2221001986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639db1b60 msgr2=0x55663a18c740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:36.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff348f56740 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639db1b60 0x55663a18c740 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff330104ee0 tx=0x7ff3300cd4b0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff348f56740 1 -- 172.21.15.22:0/2221001986 shutdown_connections 2024-09-21T04:19:36.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff348f56740 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x556639d66570 0x55663a205530 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff348f56740 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x556639dd2840 0x55663a18cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff31b7fe640 0 client.16347 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:36.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff348f56740 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556639db1b60 0x55663a18c740 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff348f56740 1 --2- 172.21.15.22:0/2221001986 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x556639da9980 0x55663a18c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.530+0000 7ff348f56740 1 -- 172.21.15.22:0/2221001986 >> 172.21.15.22:0/2221001986 conn(0x556639dc6990 msgr2=0x55663a17a630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:36.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.531+0000 7ff348f56740 1 -- 172.21.15.22:0/2221001986 shutdown_connections 2024-09-21T04:19:36.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.531+0000 7ff348f56740 1 -- 172.21.15.22:0/2221001986 wait complete. 2024-09-21T04:19:36.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.531+0000 7ff348f56740 20 client.16347 trim_cache size 0 max 16384 2024-09-21T04:19:36.535 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:19:36.535 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 66, 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "dc92612d": { 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 66, 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:19:36.536 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 130.0, 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:36.537 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:19:36.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.531+0000 7ff3429e2640 1 -- 172.21.15.22:0/571199526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff3240b6510 msgr2=0x7ff3240b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:36.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.531+0000 7ff3429e2640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff3240b6510 0x7ff3240b8a20 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff32c00bfd0 tx=0x7ff32c00b4a0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.531+0000 7ff3429e2640 1 -- 172.21.15.22:0/571199526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c102740 msgr2=0x7ff33c19a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:36.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.531+0000 7ff3429e2640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c102740 0x7ff33c19a950 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff33002a930 tx=0x7ff330004040 comp rx=0 tx=0).stop 2024-09-21T04:19:36.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.532+0000 7ff3429e2640 1 -- 172.21.15.22:0/571199526 shutdown_connections 2024-09-21T04:19:36.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.532+0000 7ff3429e2640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff3240b6510 0x7ff3240b8a20 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.532+0000 7ff3429e2640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff33c108700 0x7ff33c19fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.532+0000 7ff3429e2640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff33c102740 0x7ff33c19a950 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.532+0000 7ff3429e2640 1 --2- 172.21.15.22:0/571199526 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff33c101df0 0x7ff33c19a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:36.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.532+0000 7ff3429e2640 1 -- 172.21.15.22:0/571199526 >> 172.21.15.22:0/571199526 conn(0x7ff33c079f50 msgr2=0x7ff33c106570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:36.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.532+0000 7ff3429e2640 1 -- 172.21.15.22:0/571199526 shutdown_connections 2024-09-21T04:19:36.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:36.532+0000 7ff3429e2640 1 -- 172.21.15.22:0/571199526 wait complete. 2024-09-21T04:19:36.818 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/: 2024-09-21T04:19:36.818 INFO:teuthology.orchestra.run.smithi022.stdout:total 2 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1449530303 Sep 21 04:02 . 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1449530303 Sep 21 04:02 .. 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 data 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data: 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:total 46 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 . 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1449530303 Sep 21 04:02 .. 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 576173621 Sep 21 04:04 base 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 Sep 21 04:03 current_logfiles 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 Sep 21 04:03 global 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 847 Sep 21 04:03 log 2024-09-21T04:19:36.819 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_commit_ts 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_dynshmem 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 Sep 21 04:02 pg_hba.conf 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 Sep 21 04:02 pg_ident.conf 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 04:19 pg_logical 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 pg_multixact 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_notify 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_replslot 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_serial 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_snapshots 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 Sep 21 04:19 pg_stat 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 Sep 21 04:19 pg_stat_tmp 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Sep 21 04:19 pg_subtrans 2024-09-21T04:19:36.820 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_tblspc 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 pg_twophase 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 04:02 PG_VERSION 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 872415232 Sep 21 04:19 pg_wal 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 04:02 pg_xact 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 Sep 21 04:02 postgresql.auto.conf 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28074 Sep 21 04:02 postgresql.conf 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 Sep 21 04:03 postmaster.opts 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/base: 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:total 3 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 576173621 Sep 21 04:04 . 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 04:02 1 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 04:02 13493 2024-09-21T04:19:36.821 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 560247343 Sep 21 04:09 13494 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:04 pgsql_tmp 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/base/1: 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:total 7778 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 04:02 . 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 576173621 Sep 21 04:04 .. 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 112 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 113 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:02 1247 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1247_fsm 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1247_vm 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 04:02 1249 2024-09-21T04:19:36.822 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1249_fsm 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1249_vm 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 04:02 1255 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1255_fsm 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1255_vm 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 04:02 1259 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1259_fsm 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1259_vm 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 04:02 13344 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13344_fsm 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13344_vm 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13346 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13348 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13349_fsm 2024-09-21T04:19:36.823 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349_vm 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13351 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13353 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13354_fsm 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354_vm 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13356 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13358 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13359_fsm 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359_vm 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13361 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13363 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1417 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1418 2024-09-21T04:19:36.824 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 174 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 175 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2187 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2224 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2328 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2336 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2337 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2579 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2600 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2600_fsm 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2600_vm 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601 2024-09-21T04:19:36.825 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2601_fsm 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601_vm 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2602 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2602_fsm 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2602_vm 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2603 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2603_fsm 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2603_vm 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2604 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2605 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2605_fsm 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2605_vm 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2606 2024-09-21T04:19:36.826 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2606_fsm 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2606_vm 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2607 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2607_fsm 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2607_vm 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 04:02 2608 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2608_fsm 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2608_vm 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 04:02 2609 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2609_fsm 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2609_vm 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2610 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2610_fsm 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2610_vm 2024-09-21T04:19:36.827 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2611 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2612_fsm 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612_vm 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2613 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2615_fsm 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615_vm 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2616 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2616_fsm 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2616_vm 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 04:02 2617 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2617_fsm 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2617_vm 2024-09-21T04:19:36.828 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 04:02 2618 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2618_fsm 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2618_vm 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 04:02 2619 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2619_fsm 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2619_vm 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2620 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2650 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2651 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2652 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2653 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2654 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2655 2024-09-21T04:19:36.829 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2656 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2657 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 04:02 2658 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:02 2659 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2660 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2661 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2662 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2663 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2664 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2665 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2666 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2667 2024-09-21T04:19:36.830 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2668 2024-09-21T04:19:36.831 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2669 2024-09-21T04:19:36.831 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2670 2024-09-21T04:19:36.831 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 04:02 2673 2024-09-21T04:19:36.831 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 04:02 2674 2024-09-21T04:19:36.831 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 04:02 2675 2024-09-21T04:19:36.831 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2678 2024-09-21T04:19:36.831 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2679 2024-09-21T04:19:36.831 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2680 2024-09-21T04:19:36.831 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2681 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2682 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2683 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2684 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2685 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2686 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2687 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2688 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2689 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 04:02 2690 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 04:02 2691 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2692 2024-09-21T04:19:36.832 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2693 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2696 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2699 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2701 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2702 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2703 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2704 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2753 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2753_fsm 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2753_vm 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2754 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2755 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2756 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2757 2024-09-21T04:19:36.833 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2830 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2831 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2832 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2833 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2834 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2835 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2836 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2837 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 04:02 2838 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2838_fsm 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2838_vm 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2839 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840_fsm 2024-09-21T04:19:36.834 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2840_vm 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2841 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2995 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2996 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3079_fsm 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079_vm 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3080 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3081 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3085 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3118 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3119 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 04:02 3164 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3256 2024-09-21T04:19:36.835 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3257 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3258 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3350 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3351 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3379 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3380 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3381 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3394 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3394_fsm 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3394_vm 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3395 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3429 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3430 2024-09-21T04:19:36.836 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3431 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3433 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3439 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3440 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3455 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 04:02 3456 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3456_fsm 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3456_vm 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3466 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3467 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3468 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3501 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3502 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3503 2024-09-21T04:19:36.837 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3534 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3541_fsm 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541_vm 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3542 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3574 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3575 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3576 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3596 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3597 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3598 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3599 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3600_fsm 2024-09-21T04:19:36.838 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600_vm 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3601_fsm 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601_vm 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3602_fsm 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602_vm 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603_fsm 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3603_vm 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3604 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3605 2024-09-21T04:19:36.839 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3606 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3607 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3608 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 3609 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3712 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3764_fsm 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764_vm 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3766 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3767 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3997 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4143 2024-09-21T04:19:36.840 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4144 2024-09-21T04:19:36.841 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4145 2024-09-21T04:19:36.841 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4146 2024-09-21T04:19:36.841 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4147 2024-09-21T04:19:36.841 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4148 2024-09-21T04:19:36.841 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4149 2024-09-21T04:19:36.841 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4150 2024-09-21T04:19:36.841 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4151 2024-09-21T04:19:36.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:36 smithi022 ceph-mon[31015]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.2 MiB/s wr, 896 op/s 2024-09-21T04:19:36.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:36 smithi060 ceph-mon[33722]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.2 MiB/s wr, 896 op/s 2024-09-21T04:19:37.098 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4152 2024-09-21T04:19:37.098 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4153 2024-09-21T04:19:37.098 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4154 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4155 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4156 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4157 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4158 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4159 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4160 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4161 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4162 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4163 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4164 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4165 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4166 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4167 2024-09-21T04:19:37.099 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4168 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4169 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4170 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4171 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4172 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4173 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4174 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 5002 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 548 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 549 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6102 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6104 2024-09-21T04:19:37.100 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6106 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6110 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6111 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6112 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6113 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6117 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 826 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 827 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 828 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 04:02 pg_filenode.map 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 04:02 PG_VERSION 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-09-21T04:19:37.101 INFO:teuthology.orchestra.run.smithi022.stdout:total 7778 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 Sep 21 04:02 . 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 576173621 Sep 21 04:04 .. 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 112 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 113 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:02 1247 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1247_fsm 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1247_vm 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 04:02 1249 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1249_fsm 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1249_vm 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 04:02 1255 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1255_fsm 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1255_vm 2024-09-21T04:19:37.102 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 04:02 1259 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1259_fsm 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1259_vm 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 04:02 13344 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13344_fsm 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13344_vm 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13346 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13348 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13349_fsm 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349_vm 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13351 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13353 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354 2024-09-21T04:19:37.103 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13354_fsm 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354_vm 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13356 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13358 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13359_fsm 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359_vm 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13361 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13363 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1417 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1418 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 174 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 175 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2187 2024-09-21T04:19:37.104 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2224 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2328 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2336 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2337 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2579 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2600 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2600_fsm 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2600_vm 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2601_fsm 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601_vm 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2602 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2602_fsm 2024-09-21T04:19:37.105 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2602_vm 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2603 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2603_fsm 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2603_vm 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2604 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2605 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2605_fsm 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2605_vm 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2606 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2606_fsm 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2606_vm 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2607 2024-09-21T04:19:37.106 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2607_fsm 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2607_vm 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 04:02 2608 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2608_fsm 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2608_vm 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 04:02 2609 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2609_fsm 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2609_vm 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2610 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2610_fsm 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2610_vm 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2611 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612 2024-09-21T04:19:37.107 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2612_fsm 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612_vm 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2613 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2615_fsm 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615_vm 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2616 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2616_fsm 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2616_vm 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 04:02 2617 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2617_fsm 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2617_vm 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 04:02 2618 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2618_fsm 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2618_vm 2024-09-21T04:19:37.108 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 04:02 2619 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2619_fsm 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2619_vm 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2620 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2650 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2651 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2652 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2653 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2654 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2655 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2656 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2657 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 04:02 2658 2024-09-21T04:19:37.109 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:02 2659 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2660 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2661 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2662 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2663 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2664 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2665 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2666 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2667 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2668 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2669 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2670 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 04:02 2673 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 04:02 2674 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 04:02 2675 2024-09-21T04:19:37.110 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2678 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2679 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2680 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2681 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2682 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2683 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2684 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2685 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2686 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2687 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2688 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2689 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 04:02 2690 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 04:02 2691 2024-09-21T04:19:37.111 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2692 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2693 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2696 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2699 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2701 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2702 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2703 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2704 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2753 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2753_fsm 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2753_vm 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2754 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2755 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2756 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2757 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2830 2024-09-21T04:19:37.112 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2831 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2832 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2833 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2834 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2835 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2836 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2837 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 04:02 2838 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2838_fsm 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2838_vm 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2839 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840_fsm 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2840_vm 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2841 2024-09-21T04:19:37.113 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2995 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2996 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3079_fsm 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079_vm 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3080 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3081 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3085 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3118 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3119 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 04:02 3164 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3256 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3257 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3258 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3350 2024-09-21T04:19:37.114 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3351 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3379 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3380 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3381 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3394 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3394_fsm 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3394_vm 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3395 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3429 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3430 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3431 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3433 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3439 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3440 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3455 2024-09-21T04:19:37.115 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 04:02 3456 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3456_fsm 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3456_vm 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3466 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3467 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3468 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3501 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3502 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3503 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3534 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3541_fsm 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541_vm 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3542 2024-09-21T04:19:37.116 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3574 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3575 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3576 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3596 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3597 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3598 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3599 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3600_fsm 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600_vm 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3601_fsm 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601_vm 2024-09-21T04:19:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3602_fsm 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602_vm 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603_fsm 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3603_vm 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3604 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3605 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3606 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3607 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3608 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 3609 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3712 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764 2024-09-21T04:19:37.118 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3764_fsm 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764_vm 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3766 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3767 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3997 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4143 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4144 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4145 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4146 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4147 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4148 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4149 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4150 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4151 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4152 2024-09-21T04:19:37.119 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4153 2024-09-21T04:19:37.120 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:36 smithi073 ceph-mon[34443]: pgmap v888: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.2 MiB/s wr, 896 op/s 2024-09-21T04:19:37.391 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4154 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4155 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4156 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4157 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4158 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4159 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4160 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4161 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4162 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4163 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4164 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4165 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4166 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4167 2024-09-21T04:19:37.392 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4168 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4169 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4170 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4171 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4172 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4173 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4174 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 5002 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 548 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 549 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6102 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6104 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6106 2024-09-21T04:19:37.393 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6110 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6111 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6112 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6113 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6117 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 826 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 827 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 828 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 04:02 pg_filenode.map 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 04:02 PG_VERSION 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:total 547119 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 560247343 Sep 21 04:09 . 2024-09-21T04:19:37.394 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 576173621 Sep 21 04:04 .. 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 112 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 113 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:04 1247 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1247_fsm 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:04 1247_vm 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 Sep 21 04:04 1249 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:04 1249_fsm 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:04 1249_vm 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 Sep 21 04:02 1255 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1255_fsm 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1255_vm 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 Sep 21 04:19 1259 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1259_fsm 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:04 1259_vm 2024-09-21T04:19:37.395 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 Sep 21 04:02 13344 2024-09-21T04:19:37.396 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13344_fsm 2024-09-21T04:19:37.396 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13344_vm 2024-09-21T04:19:37.396 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13346 2024-09-21T04:19:37.396 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13348 2024-09-21T04:19:37.396 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349 2024-09-21T04:19:37.396 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13349_fsm 2024-09-21T04:19:37.396 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13349_vm 2024-09-21T04:19:37.396 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13351 2024-09-21T04:19:37.397 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13353 2024-09-21T04:19:37.397 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354 2024-09-21T04:19:37.397 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13354_fsm 2024-09-21T04:19:37.397 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13354_vm 2024-09-21T04:19:37.397 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13356 2024-09-21T04:19:37.397 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13358 2024-09-21T04:19:37.397 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359 2024-09-21T04:19:37.397 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 13359_fsm 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13359_vm 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 13361 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 13363 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1417 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 1418 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 441974784 Sep 21 04:19 16396 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 Sep 21 04:16 16396_fsm 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:19 16396_vm 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3645440 Sep 21 04:19 16397 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:19 16397_fsm 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:19 16397_vm 2024-09-21T04:19:37.398 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 2834432 Sep 21 04:19 16399 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:19 16399_fsm 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:19 16399_vm 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:19 16400 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 04:19 16402 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 Sep 21 04:19 16404 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 31416320 Sep 21 04:19 16406 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:19 16406_fsm 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:17 16406_vm 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 174 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 175 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2187 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2224 2024-09-21T04:19:37.399 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2328 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2336 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2337 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:04 2579 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2600 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2600_fsm 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2600_vm 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2601_fsm 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2601_vm 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2602 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2602_fsm 2024-09-21T04:19:37.400 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2602_vm 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2603 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2603_fsm 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2603_vm 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2604 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2605 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2605_fsm 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2605_vm 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:04 2606 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2606_fsm 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:04 2606_vm 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2607 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2607_fsm 2024-09-21T04:19:37.401 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2607_vm 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 Sep 21 04:04 2608 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2608_fsm 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:04 2608_vm 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 Sep 21 04:02 2609 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2609_fsm 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2609_vm 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:04 2610 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2610_fsm 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:04 2610_vm 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2611 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2612_fsm 2024-09-21T04:19:37.402 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2612_vm 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2613 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2615_fsm 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2615_vm 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2616 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2616_fsm 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2616_vm 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 Sep 21 04:02 2617 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2617_fsm 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2617_vm 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 Sep 21 04:02 2618 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2618_fsm 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2618_vm 2024-09-21T04:19:37.403 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 Sep 21 04:19 2619 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:14 2619_fsm 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:04 2619_vm 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2620 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2650 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2651 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2652 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2653 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2654 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2655 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2656 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2657 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 Sep 21 04:04 2658 2024-09-21T04:19:37.404 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 Sep 21 04:04 2659 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2660 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2661 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:04 2662 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:04 2663 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:04 2664 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:04 2665 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:04 2666 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:04 2667 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2668 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2669 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2670 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 Sep 21 04:04 2673 2024-09-21T04:19:37.405 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 Sep 21 04:04 2674 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 Sep 21 04:02 2675 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:04 2678 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:04 2679 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2680 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2681 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2682 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2683 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2684 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2685 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2686 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2687 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 2688 2024-09-21T04:19:37.406 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 Sep 21 04:02 2689 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 Sep 21 04:02 2690 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 Sep 21 04:02 2691 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2692 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2693 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:17 2696 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2699 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2701 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2702 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:04 2703 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:04 2704 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2753 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2753_fsm 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2753_vm 2024-09-21T04:19:37.407 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2754 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2755 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2756 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 2757 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2830 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2831 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2832 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2833 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2834 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2835 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2836 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2837 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 Sep 21 04:02 2838 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2838_fsm 2024-09-21T04:19:37.408 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2838_vm 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2839 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2840_fsm 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2840_vm 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2841 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2995 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2996 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3079_fsm 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3079_vm 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3080 2024-09-21T04:19:37.409 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3081 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:02 3085 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3118 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3119 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 Sep 21 04:02 3164 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3256 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3257 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3258 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3350 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3351 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3379 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3380 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3381 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3394 2024-09-21T04:19:37.410 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3394_fsm 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3394_vm 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3395 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3429 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3430 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3431 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3433 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3439 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3440 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 Sep 21 04:04 3455 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 Sep 21 04:02 3456 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3456_fsm 2024-09-21T04:19:37.411 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3456_vm 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3466 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3467 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3468 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3501 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3502 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3503 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3534 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3541_fsm 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3541_vm 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3542 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3574 2024-09-21T04:19:37.412 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3575 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3576 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3596 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3597 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3598 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3599 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3600_fsm 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3600_vm 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3601_fsm 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3601_vm 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3602_fsm 2024-09-21T04:19:37.413 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3602_vm 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3603_fsm 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3603_vm 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3604 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3605 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3606 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3607 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3608 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 Sep 21 04:02 3609 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3712 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 3764_fsm 2024-09-21T04:19:37.414 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3764_vm 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3766 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 3767 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3997 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4143 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4144 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4145 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4146 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4147 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4148 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4149 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4150 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4151 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4152 2024-09-21T04:19:37.415 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4153 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4154 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4155 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4156 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4157 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4158 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4159 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4160 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4161 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4162 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4163 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4164 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4165 2024-09-21T04:19:37.416 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4166 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4167 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4168 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4169 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4170 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4171 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4172 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4173 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4174 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 5002 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 548 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 549 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6102 2024-09-21T04:19:37.417 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6104 2024-09-21T04:19:37.418 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6106 2024-09-21T04:19:37.418 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6110 2024-09-21T04:19:37.419 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'dc92612d', quiesce took 9.2 seconds. Will release after: 0.8000000000000007 2024-09-21T04:19:37.442 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6111 2024-09-21T04:19:37.442 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6112 2024-09-21T04:19:37.442 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6113 2024-09-21T04:19:37.442 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6117 2024-09-21T04:19:37.442 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 826 2024-09-21T04:19:37.442 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 827 2024-09-21T04:19:37.442 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 828 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 04:02 pg_filenode.map 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 Sep 21 04:03 pg_internal.init 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 Sep 21 04:02 PG_VERSION 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:04 . 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 576173621 Sep 21 04:04 .. 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/global: 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:total 561 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 Sep 21 04:03 . 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1213 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1213_fsm 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1213_vm 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1214 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1214_fsm 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1214_vm 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 1232 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 1233 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1260 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1260_fsm 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1260_vm 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1261 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1261_fsm 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1261_vm 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1262 2024-09-21T04:19:37.444 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 1262_fsm 2024-09-21T04:19:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 1262_vm 2024-09-21T04:19:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2396 2024-09-21T04:19:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 Sep 21 04:02 2396_fsm 2024-09-21T04:19:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2396_vm 2024-09-21T04:19:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2397 2024-09-21T04:19:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2671 2024-09-21T04:19:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2672 2024-09-21T04:19:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2676 2024-09-21T04:19:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2677 2024-09-21T04:19:37.445 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2694 2024-09-21T04:19:37.461 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2695 2024-09-21T04:19:37.461 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2697 2024-09-21T04:19:37.461 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 2698 2024-09-21T04:19:37.461 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2846 2024-09-21T04:19:37.461 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2847 2024-09-21T04:19:37.461 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2964 2024-09-21T04:19:37.461 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2965 2024-09-21T04:19:37.461 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 2966 2024-09-21T04:19:37.461 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 2967 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 3592 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 3593 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4060 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4061 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4175 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4176 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4177 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4178 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4181 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4182 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4183 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4184 2024-09-21T04:19:37.462 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 4185 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 4186 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6000 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6001 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6002 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 6100 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6114 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 6115 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:19 pg_control 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 Sep 21 04:02 pg_filenode.map 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 Sep 21 04:03 pg_internal.init 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/log: 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:total 3 2024-09-21T04:19:37.463 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 847 Sep 21 04:03 . 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1249 Sep 21 04:19 postgresql-Sat.log 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.464 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-09-21T04:19:37.465 INFO:teuthology.orchestra.run.smithi022.stdout:total 3 2024-09-21T04:19:37.510 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 04:19 . 2024-09-21T04:19:37.510 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 mappings 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 04:19 replorigin_checkpoint 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 snapshots 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 04:19 .. 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 Sep 21 04:19 .. 2024-09-21T04:19:37.511 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:total 2 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 . 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 members 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 offsets 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:total 9 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 . 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 .. 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 0000 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.512 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:total 9 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:02 . 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 Sep 21 04:02 .. 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 Sep 21 04:08 0000 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.513 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-09-21T04:19:37.514 INFO:teuthology.orchestra.run.smithi022.stdout:total 16 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 Sep 21 04:19 . 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 Sep 21 04:19 db_0.stat 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 Sep 21 04:19 db_13494.stat 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 Sep 21 04:19 global.stat 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 Sep 21 04:19 . 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:total 153 2024-09-21T04:19:37.515 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Sep 21 04:19 . 2024-09-21T04:19:37.516 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.560 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 155648 Sep 21 04:19 0008 2024-09-21T04:19:37.560 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.560 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-09-21T04:19:37.560 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:total 851970 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 872415232 Sep 21 04:19 . 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:19 00000001000000000000006E 2024-09-21T04:19:37.561 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:09 00000001000000000000006F 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000070 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:15 000000010000000000000071 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000072 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:14 000000010000000000000073 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000074 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:16 000000010000000000000075 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:16 000000010000000000000076 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000077 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000078 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:14 000000010000000000000079 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 00000001000000000000007A 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 00000001000000000000007B 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 00000001000000000000007C 2024-09-21T04:19:37.562 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:15 00000001000000000000007D 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 00000001000000000000007E 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:14 00000001000000000000007F 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:17 000000010000000000000080 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000081 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000082 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000083 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:15 000000010000000000000084 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000085 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:15 000000010000000000000086 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:17 000000010000000000000087 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000088 2024-09-21T04:19:37.563 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000089 2024-09-21T04:19:37.569 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 00000001000000000000008A 2024-09-21T04:19:37.569 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:14 00000001000000000000008B 2024-09-21T04:19:37.569 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 00000001000000000000008C 2024-09-21T04:19:37.569 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:14 00000001000000000000008D 2024-09-21T04:19:37.569 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 00000001000000000000008E 2024-09-21T04:19:37.569 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 00000001000000000000008F 2024-09-21T04:19:37.569 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000090 2024-09-21T04:19:37.569 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:13 000000010000000000000091 2024-09-21T04:19:37.569 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 000000010000000000000092 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 000000010000000000000093 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 000000010000000000000094 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:19 000000010000000000000095 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 000000010000000000000096 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:19 000000010000000000000097 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 000000010000000000000098 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 000000010000000000000099 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 00000001000000000000009A 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:19 00000001000000000000009B 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 00000001000000000000009C 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:19 00000001000000000000009D 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 00000001000000000000009E 2024-09-21T04:19:37.570 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:19 00000001000000000000009F 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 0000000100000000000000A0 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 Sep 21 04:18 0000000100000000000000A1 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 archive_status 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:total 1 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 Sep 21 04:02 . 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 872415232 Sep 21 04:19 .. 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:total 145 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 04:02 . 2024-09-21T04:19:37.571 INFO:teuthology.orchestra.run.smithi022.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1449544278 Sep 21 04:19 .. 2024-09-21T04:19:37.572 INFO:teuthology.orchestra.run.smithi022.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 Sep 21 04:19 0000 2024-09-21T04:19:37.572 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-09-21T04:19:37.582 INFO:tasks.quiescer:joining Quiescers 2024-09-21T04:19:37.582 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-09-21T04:19:37.583 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:19:37.872 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:19:38.220 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:19:38.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.339+0000 7f9f77877640 1 -- 172.21.15.22:0/2722154567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f70102a60 msgr2=0x7f9f70102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:38.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.339+0000 7f9f77877640 1 --2- 172.21.15.22:0/2722154567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f70102a60 0x7f9f70102e70 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c009900 tx=0x7f9f6c02a410 comp rx=0 tx=0).stop 2024-09-21T04:19:38.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.339+0000 7f9f77877640 1 -- 172.21.15.22:0/2722154567 shutdown_connections 2024-09-21T04:19:38.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.339+0000 7f9f77877640 1 --2- 172.21.15.22:0/2722154567 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f701083a0 0x7f9f701087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:38.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.339+0000 7f9f77877640 1 --2- 172.21.15.22:0/2722154567 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f70108cf0 0x7f9f7010f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:38.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.339+0000 7f9f77877640 1 --2- 172.21.15.22:0/2722154567 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f70102a60 0x7f9f70102e70 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.339+0000 7f9f77877640 1 -- 172.21.15.22:0/2722154567 >> 172.21.15.22:0/2722154567 conn(0x7f9f70079730 msgr2=0x7f9f70079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.339+0000 7f9f77877640 1 -- 172.21.15.22:0/2722154567 shutdown_connections 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.339+0000 7f9f77877640 1 -- 172.21.15.22:0/2722154567 wait complete. 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f77877640 1 Processor -- start 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f77877640 1 -- start start 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f77877640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f70102a60 0x7f9f7010ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f77877640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f701083a0 0x7f9f701104f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f77877640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f70108cf0 0x7f9f70110a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f77877640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9f70113930 con 0x7f9f70108cf0 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f77877640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f9f701137b0 con 0x7f9f70102a60 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f77877640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f9f70113ab0 con 0x7f9f701083a0 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f75e14640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f70108cf0 0x7f9f70110a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f75e14640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f70108cf0 0x7f9f70110a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39558/0 (socket says 172.21.15.22:39558) 2024-09-21T04:19:38.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f75e14640 1 -- 172.21.15.22:0/2472839289 learned_addr learned my addr 172.21.15.22:0/2472839289 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f75613640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f70102a60 0x7f9f7010ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f74e12640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f701083a0 0x7f9f701104f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f75e14640 1 -- 172.21.15.22:0/2472839289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f701083a0 msgr2=0x7f9f701104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f75e14640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f701083a0 0x7f9f701104f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f75e14640 1 -- 172.21.15.22:0/2472839289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f70102a60 msgr2=0x7f9f7010ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.340+0000 7f9f75e14640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f70102a60 0x7f9f7010ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.341+0000 7f9f75e14640 1 -- 172.21.15.22:0/2472839289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f701a85d0 con 0x7f9f70108cf0 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.341+0000 7f9f74e12640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f701083a0 0x7f9f701104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.341+0000 7f9f75613640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f70102a60 0x7f9f7010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.341+0000 7f9f75e14640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f70108cf0 0x7f9f70110a30 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800cce0 tx=0x7f9f6800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.341+0000 7f9f667fc640 1 -- 172.21.15.22:0/2472839289 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6800f450 con 0x7f9f70108cf0 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.341+0000 7f9f667fc640 1 -- 172.21.15.22:0/2472839289 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9f6800fa80 con 0x7f9f70108cf0 2024-09-21T04:19:38.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.341+0000 7f9f77877640 1 -- 172.21.15.22:0/2472839289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f701a88c0 con 0x7f9f70108cf0 2024-09-21T04:19:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.341+0000 7f9f667fc640 1 -- 172.21.15.22:0/2472839289 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f68018ad0 con 0x7f9f70108cf0 2024-09-21T04:19:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.341+0000 7f9f77877640 1 -- 172.21.15.22:0/2472839289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f701a8db0 con 0x7f9f70108cf0 2024-09-21T04:19:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.342+0000 7f9f77877640 1 -- 172.21.15.22:0/2472839289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f70102e70 con 0x7f9f70108cf0 2024-09-21T04:19:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.345+0000 7f9f667fc640 1 -- 172.21.15.22:0/2472839289 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9f6800f5f0 con 0x7f9f70108cf0 2024-09-21T04:19:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.346+0000 7f9f667fc640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f5c0b6510 0x7f9f5c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.346+0000 7f9f75613640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f5c0b6510 0x7f9f5c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.346+0000 7f9f667fc640 1 -- 172.21.15.22:0/2472839289 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f9f680e7ff0 con 0x7f9f70108cf0 2024-09-21T04:19:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.346+0000 7f9f75613640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f5c0b6510 0x7f9f5c0b8a20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c006010 tx=0x7f9f6c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:38.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.349+0000 7f9f667fc640 1 -- 172.21.15.22:0/2472839289 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9f68014030 con 0x7f9f70108cf0 2024-09-21T04:19:38.494 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:19:38.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.592+0000 7f9f77877640 1 -- 172.21.15.22:0/2472839289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f701112b0 con 0x7f9f70108cf0 2024-09-21T04:19:38.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.593+0000 7f9f667fc640 1 -- 172.21.15.22:0/2472839289 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7f9f680ae530 con 0x7f9f70108cf0 2024-09-21T04:19:38.596 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:38.596 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:19:38.597 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:19:38.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 -- 172.21.15.22:0/2472839289 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f5c0b6510 msgr2=0x7f9f5c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:38.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f5c0b6510 0x7f9f5c0b8a20 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c006010 tx=0x7f9f6c005a20 comp rx=0 tx=0).stop 2024-09-21T04:19:38.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 -- 172.21.15.22:0/2472839289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f70108cf0 msgr2=0x7f9f70110a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:38.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f70108cf0 0x7f9f70110a30 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f9f6800cce0 tx=0x7f9f6800a620 comp rx=0 tx=0).stop 2024-09-21T04:19:38.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 -- 172.21.15.22:0/2472839289 shutdown_connections 2024-09-21T04:19:38.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f9f5c0b6510 0x7f9f5c0b8a20 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:38.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f9f701083a0 0x7f9f701104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:38.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f70108cf0 0x7f9f70110a30 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:38.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 --2- 172.21.15.22:0/2472839289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9f70102a60 0x7f9f7010ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:38.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 -- 172.21.15.22:0/2472839289 >> 172.21.15.22:0/2472839289 conn(0x7f9f70079730 msgr2=0x7f9f70101610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:38.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 -- 172.21.15.22:0/2472839289 shutdown_connections 2024-09-21T04:19:38.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:38.595+0000 7f9f77877640 1 -- 172.21.15.22:0/2472839289 wait complete. 2024-09-21T04:19:38.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:38 smithi022 ceph-mon[31015]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.7 MiB/s wr, 869 op/s 2024-09-21T04:19:38.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:38 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2472839289' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:19:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:38 smithi060 ceph-mon[33722]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.7 MiB/s wr, 869 op/s 2024-09-21T04:19:38.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:38 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2472839289' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:19:39.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:38 smithi073 ceph-mon[34443]: pgmap v889: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 7.7 MiB/s wr, 869 op/s 2024-09-21T04:19:39.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:38 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2472839289' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:19:39.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.174+0000 7f997df31640 1 -- 172.21.15.22:0/2560836112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9978102a60 msgr2=0x7f9978102e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:39.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.174+0000 7f997df31640 1 --2- 172.21.15.22:0/2560836112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9978102a60 0x7f9978102e70 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f9968009900 tx=0x7f996802a410 comp rx=0 tx=0).stop 2024-09-21T04:19:39.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.174+0000 7f997df31640 1 -- 172.21.15.22:0/2560836112 shutdown_connections 2024-09-21T04:19:39.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.174+0000 7f997df31640 1 --2- 172.21.15.22:0/2560836112 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99781083a0 0x7f99781087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:39.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.174+0000 7f997df31640 1 --2- 172.21.15.22:0/2560836112 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9978108cf0 0x7f997810f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:39.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.174+0000 7f997df31640 1 --2- 172.21.15.22:0/2560836112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9978102a60 0x7f9978102e70 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.174+0000 7f997df31640 1 -- 172.21.15.22:0/2560836112 >> 172.21.15.22:0/2560836112 conn(0x7f9978079730 msgr2=0x7f9978079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.175+0000 7f997df31640 1 -- 172.21.15.22:0/2560836112 shutdown_connections 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.175+0000 7f997df31640 1 -- 172.21.15.22:0/2560836112 wait complete. 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.175+0000 7f997df31640 1 Processor -- start 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f997df31640 1 -- start start 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f997df31640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9978102a60 0x7f997819b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f997df31640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99781083a0 0x7f997819b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f997df31640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9978108cf0 0x7f997819bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f997df31640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9978112860 con 0x7f9978102a60 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f997df31640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f99781126e0 con 0x7f9978108cf0 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f997df31640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f99781129e0 con 0x7f99781083a0 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f99777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9978102a60 0x7f997819b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:39.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f99777fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9978102a60 0x7f997819b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:39580/0 (socket says 172.21.15.22:39580) 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f99777fe640 1 -- 172.21.15.22:0/2019457071 learned_addr learned my addr 172.21.15.22:0/2019457071 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f9977fff640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9978108cf0 0x7f997819bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f9976ffd640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99781083a0 0x7f997819b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f99777fe640 1 -- 172.21.15.22:0/2019457071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99781083a0 msgr2=0x7f997819b6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.176+0000 7f99777fe640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99781083a0 0x7f997819b6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.177+0000 7f99777fe640 1 -- 172.21.15.22:0/2019457071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9978108cf0 msgr2=0x7f997819bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.177+0000 7f99777fe640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9978108cf0 0x7f997819bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.177+0000 7f99777fe640 1 -- 172.21.15.22:0/2019457071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99781a63b0 con 0x7f9978102a60 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.177+0000 7f9976ffd640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99781083a0 0x7f997819b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.177+0000 7f99777fe640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9978102a60 0x7f997819b1b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f996802a930 tx=0x7f9968003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.177+0000 7f9974ff9640 1 -- 172.21.15.22:0/2019457071 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f996803f070 con 0x7f9978102a60 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.177+0000 7f9974ff9640 1 -- 172.21.15.22:0/2019457071 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9968003e40 con 0x7f9978102a60 2024-09-21T04:19:39.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.177+0000 7f997df31640 1 -- 172.21.15.22:0/2019457071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99781a6640 con 0x7f9978102a60 2024-09-21T04:19:39.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.177+0000 7f9974ff9640 1 -- 172.21.15.22:0/2019457071 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9968035030 con 0x7f9978102a60 2024-09-21T04:19:39.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.177+0000 7f997df31640 1 -- 172.21.15.22:0/2019457071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99781a6b20 con 0x7f9978102a60 2024-09-21T04:19:39.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.178+0000 7f997df31640 1 -- 172.21.15.22:0/2019457071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9978102e70 con 0x7f9978102a60 2024-09-21T04:19:39.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.180+0000 7f9974ff9640 1 -- 172.21.15.22:0/2019457071 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f9968042070 con 0x7f9978102a60 2024-09-21T04:19:39.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.181+0000 7f9974ff9640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f99600b6540 0x7f99600b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:39.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.181+0000 7f9976ffd640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f99600b6540 0x7f99600b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:39.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.181+0000 7f9974ff9640 1 -- 172.21.15.22:0/2019457071 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f99681082b0 con 0x7f9978102a60 2024-09-21T04:19:39.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.181+0000 7f9976ffd640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f99600b6540 0x7f99600b8a50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9978100c50 tx=0x7f996c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:39.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.184+0000 7f9974ff9640 1 -- 172.21.15.22:0/2019457071 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f99680ce780 con 0x7f9978102a60 2024-09-21T04:19:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.420+0000 7f997df31640 1 -- 172.21.15.22:0/2019457071 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f997802e640 con 0x7f9978102a60 2024-09-21T04:19:39.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.421+0000 7f9974ff9640 1 -- 172.21.15.22:0/2019457071 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) ==== 94+0+11959 (secure 0 0 0) 0x7f99680d2b60 con 0x7f9978102a60 2024-09-21T04:19:39.424 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:39.424 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":50,"btime":"2024-09-21T04:11:14:572656+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":50,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:11:14.500690+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24647,24634,24617,24616,24610]},"id":1}]} 2024-09-21T04:19:39.424 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 50 2024-09-21T04:19:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 -- 172.21.15.22:0/2019457071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f99600b6540 msgr2=0x7f99600b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f99600b6540 0x7f99600b8a50 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9978100c50 tx=0x7f996c00a5c0 comp rx=0 tx=0).stop 2024-09-21T04:19:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 -- 172.21.15.22:0/2019457071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9978102a60 msgr2=0x7f997819b1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:39.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9978102a60 0x7f997819b1b0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f996802a930 tx=0x7f9968003c20 comp rx=0 tx=0).stop 2024-09-21T04:19:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 -- 172.21.15.22:0/2019457071 shutdown_connections 2024-09-21T04:19:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f99600b6540 0x7f99600b8a50 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f99781083a0 0x7f997819b6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f9978108cf0 0x7f997819bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 --2- 172.21.15.22:0/2019457071 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9978102a60 0x7f997819b1b0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 -- 172.21.15.22:0/2019457071 >> 172.21.15.22:0/2019457071 conn(0x7f9978079730 msgr2=0x7f9978101450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 -- 172.21.15.22:0/2019457071 shutdown_connections 2024-09-21T04:19:39.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:39.423+0000 7f997df31640 1 -- 172.21.15.22:0/2019457071 wait complete. 2024-09-21T04:19:39.913 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --cancel --all' 2024-09-21T04:19:39.914 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --cancel --all 2024-09-21T04:19:39.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:39 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2019457071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:19:39.967 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:39 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2019457071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:19:40.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:39 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2019457071' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:19:40.721 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24647 quiesce db --set-id dc92612d --release --await' 2024-09-21T04:19:40.721 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- timeout 105 ceph tell mds.24647 quiesce db --set-id dc92612d --release --await 2024-09-21T04:19:40.742 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:19:40.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:40 smithi060 ceph-mon[33722]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.7 MiB/s wr, 745 op/s 2024-09-21T04:19:40.999 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:40 smithi022 ceph-mon[31015]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.7 MiB/s wr, 745 op/s 2024-09-21T04:19:41.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:40 smithi073 ceph-mon[34443]: pgmap v890: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 6.7 MiB/s wr, 745 op/s 2024-09-21T04:19:41.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.247+0000 7f46b89da640 1 -- 172.21.15.22:0/2247904344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46b4105270 msgr2=0x7f46b410d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:41.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.247+0000 7f46b89da640 1 --2- 172.21.15.22:0/2247904344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46b4105270 0x7f46b410d990 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f46a8009900 tx=0x7f46a802a410 comp rx=0 tx=0).stop 2024-09-21T04:19:41.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.247+0000 7f46b89da640 1 -- 172.21.15.22:0/2247904344 shutdown_connections 2024-09-21T04:19:41.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.247+0000 7f46b89da640 1 --2- 172.21.15.22:0/2247904344 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46b410ded0 0x7f46b4110330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.247+0000 7f46b89da640 1 --2- 172.21.15.22:0/2247904344 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46b4105270 0x7f46b410d990 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.247+0000 7f46b89da640 1 --2- 172.21.15.22:0/2247904344 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46b4104920 0x7f46b4104d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.247+0000 7f46b89da640 1 -- 172.21.15.22:0/2247904344 >> 172.21.15.22:0/2247904344 conn(0x7f46b4079760 msgr2=0x7f46b4079b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.247+0000 7f46b89da640 1 -- 172.21.15.22:0/2247904344 shutdown_connections 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.247+0000 7f46b89da640 1 -- 172.21.15.22:0/2247904344 wait complete. 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b89da640 1 Processor -- start 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b89da640 1 -- start start 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b89da640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46b4104920 0x7f46b419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b89da640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46b4105270 0x7f46b419a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b89da640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46b410ded0 0x7f46b419fc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b89da640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4113950 con 0x7f46b410ded0 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b89da640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41137d0 con 0x7f46b4104920 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b89da640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f46b4113ad0 con 0x7f46b4105270 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46b410ded0 0x7f46b419fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46b410ded0 0x7f46b419fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35076/0 (socket says 172.21.15.22:35076) 2024-09-21T04:19:41.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b2d9d640 1 -- 172.21.15.22:0/3340800774 learned_addr learned my addr 172.21.15.22:0/3340800774 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.248+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46b4105270 0x7f46b419a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46b259c640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46b4104920 0x7f46b419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46b2d9d640 1 -- 172.21.15.22:0/3340800774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46b4105270 msgr2=0x7f46b419a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46b2d9d640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46b4105270 0x7f46b419a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46b2d9d640 1 -- 172.21.15.22:0/3340800774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46b4104920 msgr2=0x7f46b419a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46b2d9d640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46b4104920 0x7f46b419a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46b2d9d640 1 -- 172.21.15.22:0/3340800774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46b41a0390 con 0x7f46b410ded0 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46b2d9d640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46b410ded0 0x7f46b419fc60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00dac0 tx=0x7f46ac00df80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46a37fe640 1 -- 172.21.15.22:0/3340800774 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac017070 con 0x7f46b410ded0 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46b89da640 1 -- 172.21.15.22:0/3340800774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46b41a0680 con 0x7f46b410ded0 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46a37fe640 1 -- 172.21.15.22:0/3340800774 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46ac00be30 con 0x7f46b410ded0 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46a37fe640 1 -- 172.21.15.22:0/3340800774 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46ac010460 con 0x7f46b410ded0 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.249+0000 7f46b89da640 1 -- 172.21.15.22:0/3340800774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46b41a6de0 con 0x7f46b410ded0 2024-09-21T04:19:41.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.252+0000 7f46bef4e740 1 Processor -- start 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.252+0000 7f46a37fe640 1 -- 172.21.15.22:0/3340800774 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f46ac010600 con 0x7f46b410ded0 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46bef4e740 1 -- start start 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fea0c2d0 0x5597fedb3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 0x5597fedb3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 0x5597fedb3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46bef4e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5597fed29dd0 con 0x5597fea0c2d0 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46bef4e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5597fed19200 con 0x5597fe9eb5f0 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46bef4e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5597fed1d010 con 0x5597fe9e3410 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46b1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fea0c2d0 0x5597fedb3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46b1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fea0c2d0 0x5597fedb3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35078/0 (socket says 172.21.15.22:35078) 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46b1d9b640 1 -- 172.21.15.22:0/1660107896 learned_addr learned my addr 172.21.15.22:0/1660107896 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46b259c640 1 --2- 172.21.15.22:0/1660107896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 0x5597fedb3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/1660107896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 0x5597fedb3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46b1d9b640 1 -- 172.21.15.22:0/1660107896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 msgr2=0x5597fedb3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/1660107896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 0x5597fedb3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46b1d9b640 1 -- 172.21.15.22:0/1660107896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 msgr2=0x5597fedb3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.253+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/1660107896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 0x5597fedb3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.254+0000 7f46b1d9b640 1 -- 172.21.15.22:0/1660107896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597fea778b0 con 0x5597fea0c2d0 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.254+0000 7f46a37fe640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f469c0b6510 0x7f469c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.254+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/1660107896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fea0c2d0 0x5597fedb3310 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f46a80057c0 tx=0x7f46a8005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97826268840e52a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.254+0000 7f46b259c640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f469c0b6510 0x7f469c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.254+0000 7f46a37fe640 1 -- 172.21.15.22:0/3340800774 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f46ac0e7320 con 0x7f46b410ded0 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.254+0000 7f46a0ff9640 1 -- 172.21.15.22:0/1660107896 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8035070 con 0x5597fea0c2d0 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.254+0000 7f46a0ff9640 1 -- 172.21.15.22:0/1660107896 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46a80044c0 con 0x5597fea0c2d0 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.254+0000 7f46a0ff9640 1 -- 172.21.15.22:0/1660107896 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8003bf0 con 0x5597fea0c2d0 2024-09-21T04:19:41.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46bef4e740 1 -- 172.21.15.22:0/1660107896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fea0c2d0 msgr2=0x5597fedb3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46bef4e740 1 --2- 172.21.15.22:0/1660107896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fea0c2d0 0x5597fedb3310 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f46a80057c0 tx=0x7f46a8005fd0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46b259c640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f469c0b6510 0x7f469c0b8a20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x5597fedb1f90 tx=0x7f46a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46bef4e740 1 -- 172.21.15.22:0/1660107896 shutdown_connections 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46bef4e740 1 --2- 172.21.15.22:0/1660107896 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 0x5597fedb3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46bef4e740 1 --2- 172.21.15.22:0/1660107896 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 0x5597fedb3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46bef4e740 1 --2- 172.21.15.22:0/1660107896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fea0c2d0 0x5597fedb3310 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46bef4e740 1 -- 172.21.15.22:0/1660107896 >> 172.21.15.22:0/1660107896 conn(0x5597fea006c0 msgr2=0x5597fedb1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46bef4e740 1 -- 172.21.15.22:0/1660107896 shutdown_connections 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46bef4e740 1 -- 172.21.15.22:0/1660107896 wait complete. 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.255+0000 7f46bef4e740 1 -- start start 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46bef4e740 1 Processor -- start 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 0x5597fedbef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedbf510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fea0c2d0 0x5597fedcadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46bef4e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5597feb7a810 con 0x5597fe9eb5f0 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46bef4e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x5597fecb4080 con 0x5597fea0c2d0 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46bef4e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x5597fedc1a90 con 0x5597fe9e3410 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46bef4e740 10 client.0 _ll_register_callbacks cb 0x5597fecc4960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedbf510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedbf510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35088/0 (socket says 172.21.15.22:35088) 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b1d9b640 1 -- 172.21.15.22:0/2923681540 learned_addr learned my addr 172.21.15.22:0/2923681540 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b259c640 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 0x5597fedbef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b2d9d640 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fea0c2d0 0x5597fedcadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b1d9b640 1 -- 172.21.15.22:0/2923681540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 msgr2=0x5597fedbef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 0x5597fedbef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b1d9b640 1 -- 172.21.15.22:0/2923681540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fea0c2d0 msgr2=0x5597fedcadb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fea0c2d0 0x5597fedcadb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b1d9b640 1 -- 172.21.15.22:0/2923681540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597fecbe460 con 0x5597fe9eb5f0 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b259c640 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 0x5597fedbef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.256+0000 7f46b2d9d640 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fea0c2d0 0x5597fedcadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedbf510 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f46a802a450 tx=0x7f46a8009230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a24a285c5c197240 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f4699ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f4699ffb640 1 -- 172.21.15.22:0/2923681540 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8035040 con 0x5597fe9eb5f0 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f4699ffb640 1 -- 172.21.15.22:0/2923681540 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f46a8003970 con 0x5597fe9eb5f0 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f46bef4e740 1 -- 172.21.15.22:0/2923681540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5597fed2bd20 con 0x5597fe9eb5f0 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f4699ffb640 1 -- 172.21.15.22:0/2923681540 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f46a805a050 con 0x5597fe9eb5f0 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f46bef4e740 10 client.16371 fetch_fsmap learned FSMap version 50 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f46bef4e740 1 -- 172.21.15.22:0/2923681540 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5597fedcdb50 con 0x5597fe9eb5f0 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f4699ffb640 1 -- 172.21.15.22:0/2923681540 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5597fed2bd20 con 0x5597fe9eb5f0 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f4699ffb640 1 -- 172.21.15.22:0/2923681540 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f46a804c5a0 con 0x5597fe9eb5f0 2024-09-21T04:19:41.286 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.257+0000 7f46bef4e740 10 client.16371 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.258+0000 7f46bef4e740 10 client.16371 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.258+0000 7f46bef4e740 20 client.16371 populate_metadata read hostname 'smithi022' 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.258+0000 7f46bef4e740 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5597fe9cac50 0x5597fedd0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.258+0000 7f46bef4e740 4 client.16371 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.258+0000 7f46bef4e740 1 -- 172.21.15.22:0/2923681540 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597fed277d0 con 0x5597fe9cac50 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.258+0000 7f46b259c640 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5597fe9cac50 0x5597fedd0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.258+0000 7f4699ffb640 10 client.16371 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.258+0000 7f46b259c640 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5597fe9cac50 0x5597fedd0eb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2312ada5324247f8 server_cookie=c4f180e082c57ce6 in_seq=0 out_seq=0 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f4699ffb640 1 -- 172.21.15.22:0/2923681540 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5597fed277d0 con 0x5597fe9cac50 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f4699ffb640 10 client.16371 handle_command_reply: tid=0 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f46bef4e740 1 client.16371 shutdown 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f46bef4e740 1 -- 172.21.15.22:0/2923681540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 msgr2=0x5597fedbf510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f46bef4e740 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedbf510 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f46a802a450 tx=0x7f46a8009230 comp rx=0 tx=0).stop 2024-09-21T04:19:41.287 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f46bef4e740 1 -- 172.21.15.22:0/2923681540 shutdown_connections 2024-09-21T04:19:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f46bef4e740 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5597fe9cac50 0x5597fedd0eb0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f46bef4e740 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fea0c2d0 0x5597fedcadb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f46bef4e740 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedbf510 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f4699ffb640 0 client.16371 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f46bef4e740 1 --2- 172.21.15.22:0/2923681540 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fe9e3410 0x5597fedbef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f46bef4e740 1 -- 172.21.15.22:0/2923681540 >> 172.21.15.22:0/2923681540 conn(0x5597fea006c0 msgr2=0x5597fedb64f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.259+0000 7f46bef4e740 1 -- 172.21.15.22:0/2923681540 shutdown_connections 2024-09-21T04:19:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.260+0000 7f46bef4e740 1 -- 172.21.15.22:0/2923681540 wait complete. 2024-09-21T04:19:41.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.260+0000 7f46bef4e740 20 client.16371 trim_cache size 0 max 16384 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46bef4e740 1 Processor -- start 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46bef4e740 1 -- start start 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9e3410 0x5597fedb83f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 0x5597fedb8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 0x5597fedb6410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46bef4e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41b0a40 con 0x5597fe9e3410 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46bef4e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41b2580 con 0x5597fe9eb5f0 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46bef4e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41b1110 con 0x5597fea0c2d0 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46b259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9e3410 0x5597fedb83f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46b259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9e3410 0x5597fedb83f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35102/0 (socket says 172.21.15.22:35102) 2024-09-21T04:19:41.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46b259c640 1 -- 172.21.15.22:0/1536980647 learned_addr learned my addr 172.21.15.22:0/1536980647 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.278+0000 7f46b2d9d640 1 --2- 172.21.15.22:0/1536980647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 0x5597fedb6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/1536980647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 0x5597fedb8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f46b259c640 1 -- 172.21.15.22:0/1536980647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 msgr2=0x5597fedb6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f46b259c640 1 --2- 172.21.15.22:0/1536980647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 0x5597fedb6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f46b259c640 1 -- 172.21.15.22:0/1536980647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 msgr2=0x5597fedb8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f46b259c640 1 --2- 172.21.15.22:0/1536980647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 0x5597fedb8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f46b259c640 1 -- 172.21.15.22:0/1536980647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597fedbd270 con 0x5597fe9e3410 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/1536980647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 0x5597fedb8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f46b259c640 1 --2- 172.21.15.22:0/1536980647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9e3410 0x5597fedb83f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f46a4005fd0 tx=0x7f46a4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5008fc7cbbce0a2e server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f469bfff640 1 -- 172.21.15.22:0/1536980647 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a400be90 con 0x5597fe9e3410 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f469bfff640 1 -- 172.21.15.22:0/1536980647 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46a402a8b0 con 0x5597fe9e3410 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.279+0000 7f469bfff640 1 -- 172.21.15.22:0/1536980647 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a401d800 con 0x5597fe9e3410 2024-09-21T04:19:41.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.280+0000 7f46bef4e740 1 -- 172.21.15.22:0/1536980647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9e3410 msgr2=0x5597fedb83f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.280+0000 7f46bef4e740 1 --2- 172.21.15.22:0/1536980647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9e3410 0x5597fedb83f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f46a4005fd0 tx=0x7f46a4019000 comp rx=0 tx=0).stop 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.280+0000 7f46bef4e740 1 -- 172.21.15.22:0/1536980647 shutdown_connections 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.280+0000 7f46bef4e740 1 --2- 172.21.15.22:0/1536980647 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 0x5597fedb6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.280+0000 7f46bef4e740 1 --2- 172.21.15.22:0/1536980647 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9eb5f0 0x5597fedb8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.280+0000 7f46bef4e740 1 --2- 172.21.15.22:0/1536980647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9e3410 0x5597fedb83f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.280+0000 7f46bef4e740 1 -- 172.21.15.22:0/1536980647 >> 172.21.15.22:0/1536980647 conn(0x5597fea006c0 msgr2=0x5597fedbef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.280+0000 7f46bef4e740 1 -- 172.21.15.22:0/1536980647 shutdown_connections 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.280+0000 7f46bef4e740 1 -- 172.21.15.22:0/1536980647 wait complete. 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46bef4e740 1 -- start start 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46bef4e740 1 Processor -- start 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9e3410 0x5597fedd1f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedd2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46bef4e740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 0x5597fedd2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46bef4e740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41b1eb0 con 0x5597fe9eb5f0 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46bef4e740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41b17e0 con 0x5597fe9e3410 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46bef4e740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f46b41aea20 con 0x5597fea0c2d0 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46b1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedd2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46bef4e740 10 client.0 _ll_register_callbacks cb 0x7f46a8031e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46b1d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedd2450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35110/0 (socket says 172.21.15.22:35110) 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46b259c640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9e3410 0x5597fedd1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.281+0000 7f46b1d9b640 1 -- 172.21.15.22:0/3591252122 learned_addr learned my addr 172.21.15.22:0/3591252122 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46b2d9d640 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 0x5597fedd2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46b1d9b640 1 -- 172.21.15.22:0/3591252122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 msgr2=0x5597fedd2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 0x5597fedd2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46b1d9b640 1 -- 172.21.15.22:0/3591252122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9e3410 msgr2=0x5597fedd1f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9e3410 0x5597fedd1f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46b1d9b640 1 -- 172.21.15.22:0/3591252122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597fee3a630 con 0x5597fe9eb5f0 2024-09-21T04:19:41.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46b259c640 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9e3410 0x5597fedd1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46b2d9d640 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 0x5597fedd2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46b1d9b640 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedd2450 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f46a8000c00 tx=0x7f46a804cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad0ba7b37c321314 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f4699ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f4699ffb640 1 -- 172.21.15.22:0/3591252122 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46a8035040 con 0x5597fe9eb5f0 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46bef4e740 1 -- 172.21.15.22:0/3591252122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f46a402a8b0 con 0x5597fe9eb5f0 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f4699ffb640 1 -- 172.21.15.22:0/3591252122 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f46a8031710 con 0x5597fe9eb5f0 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f4699ffb640 1 -- 172.21.15.22:0/3591252122 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f46a8031910 con 0x5597fe9eb5f0 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46bef4e740 10 client.16377 fetch_fsmap learned FSMap version 50 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.282+0000 7f46bef4e740 1 -- 172.21.15.22:0/3591252122 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5597fee3b7e0 con 0x5597fe9eb5f0 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.283+0000 7f4699ffb640 1 -- 172.21.15.22:0/3591252122 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f46a402a8b0 con 0x5597fe9eb5f0 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.283+0000 7f4699ffb640 1 -- 172.21.15.22:0/3591252122 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f46a804a430 con 0x5597fe9eb5f0 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.283+0000 7f46bef4e740 10 client.16377 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.283+0000 7f46bef4e740 10 client.16377 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:19:41.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.283+0000 7f46bef4e740 20 client.16377 populate_metadata read hostname 'smithi022' 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.283+0000 7f46bef4e740 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5597fe9a0000 0x5597fee3de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.283+0000 7f46bef4e740 4 client.16377 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.283+0000 7f46bef4e740 1 -- 172.21.15.22:0/3591252122 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5597fed24c00 con 0x5597fe9a0000 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.283+0000 7f46b259c640 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5597fe9a0000 0x5597fee3de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.284+0000 7f4699ffb640 10 client.16377 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.284+0000 7f46b259c640 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5597fe9a0000 0x5597fee3de40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c0863c41d7a64567 server_cookie=7c2eb06bc9c80ad8 in_seq=0 out_seq=0 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.284+0000 7f4699ffb640 1 -- 172.21.15.22:0/3591252122 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+80 (crc 0 0 0) 0x5597fed24c00 con 0x5597fe9a0000 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.284+0000 7f4699ffb640 10 client.16377 handle_command_reply: tid=0 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.284+0000 7f46bef4e740 1 client.16377 shutdown 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 1 -- 172.21.15.22:0/3591252122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 msgr2=0x5597fedd2450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedd2450 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f46a8000c00 tx=0x7f46a804cd70 comp rx=0 tx=0).stop 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 1 -- 172.21.15.22:0/3591252122 shutdown_connections 2024-09-21T04:19:41.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5597fe9a0000 0x5597fee3de40 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5597fea0c2d0 0x5597fedd2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5597fe9eb5f0 0x5597fedd2450 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f4699ffb640 0 client.16377 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 1 --2- 172.21.15.22:0/3591252122 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5597fe9e3410 0x5597fedd1f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 1 -- 172.21.15.22:0/3591252122 >> 172.21.15.22:0/3591252122 conn(0x5597fea006c0 msgr2=0x5597fedbd480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 1 -- 172.21.15.22:0/3591252122 shutdown_connections 2024-09-21T04:19:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 1 -- 172.21.15.22:0/3591252122 wait complete. 2024-09-21T04:19:41.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.285+0000 7f46bef4e740 20 client.16377 trim_cache size 0 max 16384 2024-09-21T04:19:41.299 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:19:41.299 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:19:41.300 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:19:41.300 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 67, 2024-09-21T04:19:41.300 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": {} 2024-09-21T04:19:41.300 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:19:41.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 -- 172.21.15.22:0/3340800774 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f469c0b6510 msgr2=0x7f469c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:41.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f469c0b6510 0x7f469c0b8a20 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x5597fedb1f90 tx=0x7f46a400b390 comp rx=0 tx=0).stop 2024-09-21T04:19:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 -- 172.21.15.22:0/3340800774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46b410ded0 msgr2=0x7f46b419fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46b410ded0 0x7f46b419fc60 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f46ac00dac0 tx=0x7f46ac00df80 comp rx=0 tx=0).stop 2024-09-21T04:19:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 -- 172.21.15.22:0/3340800774 shutdown_connections 2024-09-21T04:19:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f469c0b6510 0x7f469c0b8a20 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f46b4105270 0x7f46b419a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f46b410ded0 0x7f46b419fc60 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 --2- 172.21.15.22:0/3340800774 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f46b4104920 0x7f46b419a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 -- 172.21.15.22:0/3340800774 >> 172.21.15.22:0/3340800774 conn(0x7f46b4079760 msgr2=0x7f46b40ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 -- 172.21.15.22:0/3340800774 shutdown_connections 2024-09-21T04:19:41.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:41.286+0000 7f46b89da640 1 -- 172.21.15.22:0/3340800774 wait complete. 2024-09-21T04:19:41.552 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:19:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.634+0000 7f7ef9552640 1 -- 172.21.15.22:0/922644215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef4103b60 msgr2=0x7f7ef4103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.634+0000 7f7ef9552640 1 --2- 172.21.15.22:0/922644215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef4103b60 0x7f7ef4103f70 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009900 tx=0x7f7ee402a410 comp rx=0 tx=0).stop 2024-09-21T04:19:42.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.634+0000 7f7ef9552640 1 -- 172.21.15.22:0/922644215 shutdown_connections 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.634+0000 7f7ef9552640 1 --2- 172.21.15.22:0/922644215 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef4109df0 0x7f7ef4110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.634+0000 7f7ef9552640 1 --2- 172.21.15.22:0/922644215 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef41094a0 0x7f7ef41098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.634+0000 7f7ef9552640 1 --2- 172.21.15.22:0/922644215 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef4103b60 0x7f7ef4103f70 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.634+0000 7f7ef9552640 1 -- 172.21.15.22:0/922644215 >> 172.21.15.22:0/922644215 conn(0x7f7ef407b850 msgr2=0x7f7ef407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.634+0000 7f7ef9552640 1 -- 172.21.15.22:0/922644215 shutdown_connections 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.634+0000 7f7ef9552640 1 -- 172.21.15.22:0/922644215 wait complete. 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.635+0000 7f7ef9552640 1 Processor -- start 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.635+0000 7f7ef9552640 1 -- start start 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.635+0000 7f7ef9552640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef4103b60 0x7f7ef419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.635+0000 7f7ef9552640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41094a0 0x7f7ef419a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.635+0000 7f7ef9552640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef4109df0 0x7f7ef419fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.635+0000 7f7ef9552640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4113960 con 0x7f7ef4109df0 2024-09-21T04:19:42.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef9552640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41137e0 con 0x7f7ef4103b60 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef9552640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef4113ae0 con 0x7f7ef41094a0 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef4109df0 0x7f7ef419fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef4109df0 0x7f7ef419fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35128/0 (socket says 172.21.15.22:35128) 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef37fe640 1 -- 172.21.15.22:0/1649233092 learned_addr learned my addr 172.21.15.22:0/1649233092 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/1649233092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef4103b60 0x7f7ef419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef27fc640 1 --2- 172.21.15.22:0/1649233092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41094a0 0x7f7ef419a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef37fe640 1 -- 172.21.15.22:0/1649233092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41094a0 msgr2=0x7f7ef419a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef37fe640 1 --2- 172.21.15.22:0/1649233092 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7ef41094a0 0x7f7ef419a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef37fe640 1 -- 172.21.15.22:0/1649233092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef4103b60 msgr2=0x7f7ef419a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef37fe640 1 --2- 172.21.15.22:0/1649233092 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7ef4103b60 0x7f7ef419a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef37fe640 1 -- 172.21.15.22:0/1649233092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ef41a0300 con 0x7f7ef4109df0 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef37fe640 1 --2- 172.21.15.22:0/1649233092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7ef4109df0 0x7f7ef419fbd0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f7eec00eaa0 tx=0x7f7eec00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7edbfff640 1 -- 172.21.15.22:0/1649233092 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00cdb0 con 0x7f7ef4109df0 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7ef9552640 1 -- 172.21.15.22:0/1649233092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ef41a05f0 con 0x7f7ef4109df0 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.636+0000 7f7edbfff640 1 -- 172.21.15.22:0/1649233092 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7eec005020 con 0x7f7ef4109df0 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.637+0000 7f7edbfff640 1 -- 172.21.15.22:0/1649233092 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0116d0 con 0x7f7ef4109df0 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.637+0000 7f7ef9552640 1 -- 172.21.15.22:0/1649233092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ef41a6d50 con 0x7f7ef4109df0 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.639+0000 7f7edbfff640 1 -- 172.21.15.22:0/1649233092 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7eec011870 con 0x7f7ef4109df0 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.639+0000 7f7effac6740 1 Processor -- start 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.639+0000 7f7effac6740 1 -- start start 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7effac6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021ca4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7effac6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 0x557021ca4a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7effac6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021ca4f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7effac6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557021b8fdc0 con 0x5570218fe520 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7effac6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557021c1c1f0 con 0x5570218dd840 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7effac6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557021c0b620 con 0x5570218d5660 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021ca4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021ca4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35136/0 (socket says 172.21.15.22:35136) 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef27fc640 1 -- 172.21.15.22:0/3724303938 learned_addr learned my addr 172.21.15.22:0/3724303938 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/3724303938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 0x557021ca4a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef27fc640 1 -- 172.21.15.22:0/3724303938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 msgr2=0x557021ca4a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef27fc640 1 --2- 172.21.15.22:0/3724303938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 0x557021ca4a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef27fc640 1 -- 172.21.15.22:0/3724303938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 msgr2=0x557021ca4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef27fc640 1 --2- 172.21.15.22:0/3724303938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021ca4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7edbfff640 1 --2- 172.21.15.22:0/1649233092 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7edc0b6510 0x7f7edc0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef27fc640 1 -- 172.21.15.22:0/3724303938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557021bd3fd0 con 0x5570218fe520 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/3724303938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 0x557021ca4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/1649233092 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7edc0b6510 0x7f7edc0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7ef27fc640 1 --2- 172.21.15.22:0/3724303938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021ca4510 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800bd00 tx=0x7f7ee80127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d587b7d42c54a88 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.640+0000 7f7edbfff640 1 -- 172.21.15.22:0/1649233092 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7eec0e77d0 con 0x7f7ef4109df0 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.641+0000 7f7ed97fa640 1 -- 172.21.15.22:0/3724303938 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80120d0 con 0x5570218fe520 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.641+0000 7f7ed97fa640 1 -- 172.21.15.22:0/3724303938 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ee8016070 con 0x5570218fe520 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.641+0000 7f7ed97fa640 1 -- 172.21.15.22:0/3724303938 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee80047c0 con 0x5570218fe520 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 -- 172.21.15.22:0/3724303938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 msgr2=0x557021ca4510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/1649233092 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7edc0b6510 0x7f7edc0b8a20 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f7ee40057c0 tx=0x7f7ee40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 --2- 172.21.15.22:0/3724303938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021ca4510 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800bd00 tx=0x7f7ee80127c0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 -- 172.21.15.22:0/3724303938 shutdown_connections 2024-09-21T04:19:42.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 --2- 172.21.15.22:0/3724303938 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 0x557021ca4a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 --2- 172.21.15.22:0/3724303938 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021ca4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 --2- 172.21.15.22:0/3724303938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021ca4510 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 -- 172.21.15.22:0/3724303938 >> 172.21.15.22:0/3724303938 conn(0x5570218f2910 msgr2=0x557021ca2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 -- 172.21.15.22:0/3724303938 shutdown_connections 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 -- 172.21.15.22:0/3724303938 wait complete. 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 -- start start 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 Processor -- start 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 0x557021cb3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021cb44f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.642+0000 7f7effac6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021cc0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7effac6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x557021ba6300 con 0x5570218fe520 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7effac6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x557021c0f430 con 0x5570218dd840 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7effac6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x557021a6cbb0 con 0x5570218d5660 2024-09-21T04:19:42.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7effac6740 10 client.0 _ll_register_callbacks cb 0x557021bc0120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021cc0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021cc0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35146/0 (socket says 172.21.15.22:35146) 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef37fe640 1 -- 172.21.15.22:0/2877658579 learned_addr learned my addr 172.21.15.22:0/2877658579 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef27fc640 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021cb44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 0x557021cb3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef37fe640 1 -- 172.21.15.22:0/2877658579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 msgr2=0x557021cb3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef37fe640 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 0x557021cb3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef37fe640 1 -- 172.21.15.22:0/2877658579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 msgr2=0x557021cb44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef37fe640 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021cb44f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef37fe640 1 -- 172.21.15.22:0/2877658579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557021b95780 con 0x5570218fe520 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ef37fe640 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021cc0200 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0a9c90 tx=0x7f7eec0ace30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40326ef45d5c36fa server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ed6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.643+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/2877658579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7eec01f030 con 0x5570218fe520 2024-09-21T04:19:42.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.644+0000 7f7effac6740 1 -- 172.21.15.22:0/2877658579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ee8016070 con 0x5570218fe520 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.644+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/2877658579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7eec011d60 con 0x5570218fe520 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.644+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/2877658579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7eec0b6fc0 con 0x5570218fe520 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.644+0000 7f7effac6740 10 client.16389 fetch_fsmap learned FSMap version 50 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.644+0000 7f7effac6740 1 -- 172.21.15.22:0/2877658579 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x557021969b00 con 0x5570218fe520 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.644+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/2877658579 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7eec0a9010 con 0x5570218fe520 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.645+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/2877658579 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f7eec00f040 con 0x5570218fe520 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.645+0000 7f7effac6740 10 client.16389 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.645+0000 7f7effac6740 10 client.16389 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.645+0000 7f7effac6740 20 client.16389 populate_metadata read hostname 'smithi022' 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.645+0000 7f7effac6740 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5570218bcea0 0x557021cc62e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.645+0000 7f7effac6740 4 client.16389 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.645+0000 7f7effac6740 1 -- 172.21.15.22:0/2877658579 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7ee8016070 con 0x5570218bcea0 2024-09-21T04:19:42.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.645+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5570218bcea0 0x557021cc62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.646+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5570218bcea0 0x557021cc62e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42108d999142142 server_cookie=cef08268e444d21c in_seq=0 out_seq=0 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.646+0000 7f7ed6ff5640 10 client.16389 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.646+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/2877658579 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x7f7ee8016070 con 0x5570218bcea0 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.646+0000 7f7ed6ff5640 10 client.16389 handle_command_reply: tid=0 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.646+0000 7f7effac6740 1 client.16389 shutdown 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 1 -- 172.21.15.22:0/2877658579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 msgr2=0x557021cc0200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021cc0200 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f7eec0a9c90 tx=0x7f7eec0ace30 comp rx=0 tx=0).stop 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 1 -- 172.21.15.22:0/2877658579 shutdown_connections 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x5570218bcea0 0x557021cc62e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218fe520 0x557021cc0200 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021cb44f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 1 --2- 172.21.15.22:0/2877658579 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218d5660 0x557021cb3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 1 -- 172.21.15.22:0/2877658579 >> 172.21.15.22:0/2877658579 conn(0x5570218f2910 msgr2=0x557021ca7660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:42.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7ed6ff5640 0 client.16389 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:42.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 1 -- 172.21.15.22:0/2877658579 shutdown_connections 2024-09-21T04:19:42.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 1 -- 172.21.15.22:0/2877658579 wait complete. 2024-09-21T04:19:42.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.647+0000 7f7effac6740 20 client.16389 trim_cache size 0 max 16384 2024-09-21T04:19:42.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7effac6740 1 Processor -- start 2024-09-21T04:19:42.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7effac6740 1 -- start start 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7effac6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218d5660 0x557021cc0100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7effac6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021cb5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7effac6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 0x557021caf360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7effac6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41ae970 con 0x5570218d5660 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7effac6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41b04b0 con 0x5570218dd840 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7effac6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41af040 con 0x5570218fe520 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218d5660 0x557021cc0100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef2ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218d5660 0x557021cc0100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35158/0 (socket says 172.21.15.22:35158) 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef2ffd640 1 -- 172.21.15.22:0/2617706436 learned_addr learned my addr 172.21.15.22:0/2617706436 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef27fc640 1 --2- 172.21.15.22:0/2617706436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021cb5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef37fe640 1 --2- 172.21.15.22:0/2617706436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 0x557021caf360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef2ffd640 1 -- 172.21.15.22:0/2617706436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 msgr2=0x557021caf360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:42.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/2617706436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 0x557021caf360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef2ffd640 1 -- 172.21.15.22:0/2617706436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 msgr2=0x557021cb5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:42.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/2617706436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021cb5e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef2ffd640 1 -- 172.21.15.22:0/2617706436 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5570219e0960 con 0x5570218d5660 2024-09-21T04:19:42.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef37fe640 1 --2- 172.21.15.22:0/2617706436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 0x557021caf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:19:42.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/2617706436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218d5660 0x557021cc0100 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009900 tx=0x7f7ee403f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=695c00d78908391c server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:42.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ed8ff9640 1 -- 172.21.15.22:0/2617706436 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4055070 con 0x5570218d5660 2024-09-21T04:19:42.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ed8ff9640 1 -- 172.21.15.22:0/2617706436 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ee4004240 con 0x5570218d5660 2024-09-21T04:19:42.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.665+0000 7f7ed8ff9640 1 -- 172.21.15.22:0/2617706436 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4035070 con 0x5570218d5660 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.666+0000 7f7effac6740 1 -- 172.21.15.22:0/2617706436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218d5660 msgr2=0x557021cc0100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.666+0000 7f7effac6740 1 --2- 172.21.15.22:0/2617706436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218d5660 0x557021cc0100 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f7ee4009900 tx=0x7f7ee403f000 comp rx=0 tx=0).stop 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.666+0000 7f7effac6740 1 -- 172.21.15.22:0/2617706436 shutdown_connections 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.666+0000 7f7effac6740 1 --2- 172.21.15.22:0/2617706436 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 0x557021caf360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.666+0000 7f7effac6740 1 --2- 172.21.15.22:0/2617706436 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218dd840 0x557021cb5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.666+0000 7f7effac6740 1 --2- 172.21.15.22:0/2617706436 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218d5660 0x557021cc0100 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.666+0000 7f7effac6740 1 -- 172.21.15.22:0/2617706436 >> 172.21.15.22:0/2617706436 conn(0x5570218f2910 msgr2=0x557021caec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.666+0000 7f7effac6740 1 -- 172.21.15.22:0/2617706436 shutdown_connections 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.666+0000 7f7effac6740 1 -- 172.21.15.22:0/2617706436 wait complete. 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7effac6740 1 -- start start 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7effac6740 1 Processor -- start 2024-09-21T04:19:42.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7effac6740 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218d5660 0x557021cb8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7effac6740 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218dd840 0x557021cb9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7effac6740 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 0x557021d29ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7effac6740 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41afde0 con 0x5570218dd840 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7effac6740 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41af710 con 0x5570218d5660 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7effac6740 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7ef41ac950 con 0x5570218fe520 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7effac6740 10 client.0 _ll_register_callbacks cb 0x7f7eec00cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7ef27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218dd840 0x557021cb9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7ef27fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218dd840 0x557021cb9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35164/0 (socket says 172.21.15.22:35164) 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7ef27fc640 1 -- 172.21.15.22:0/1447690845 learned_addr learned my addr 172.21.15.22:0/1447690845 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218d5660 0x557021cb8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.667+0000 7f7ef37fe640 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 0x557021d29ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ef27fc640 1 -- 172.21.15.22:0/1447690845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 msgr2=0x557021d29ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ef27fc640 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 0x557021d29ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ef27fc640 1 -- 172.21.15.22:0/1447690845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218d5660 msgr2=0x557021cb8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ef27fc640 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218d5660 0x557021cb8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ef27fc640 1 -- 172.21.15.22:0/1447690845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557021d2a310 con 0x5570218dd840 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218d5660 0x557021cb8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ef27fc640 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218dd840 0x557021cb9060 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800bca0 tx=0x7f7ee8005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d5da7bec9eb551d server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ed6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/1447690845 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ee8025670 con 0x5570218dd840 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/1447690845 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f7ee8025810 con 0x5570218dd840 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7effac6740 1 -- 172.21.15.22:0/1447690845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ee4004240 con 0x5570218dd840 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/1447690845 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f7ee8033050 con 0x5570218dd840 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7effac6740 10 client.16395 fetch_fsmap learned FSMap version 50 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.668+0000 7f7effac6740 1 -- 172.21.15.22:0/1447690845 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x557021d31630 con 0x5570218dd840 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.669+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/1447690845 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ee4004240 con 0x5570218dd840 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.669+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/1447690845 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 50) ==== 8370+0+0 (secure 0 0 0) 0x7f7ee8010a40 con 0x5570218dd840 2024-09-21T04:19:42.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.669+0000 7f7effac6740 10 client.16395 fetch_fsmap finished waiting for FSMap version 50 2024-09-21T04:19:42.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.669+0000 7f7effac6740 10 client.16395 resolve_mds: validated gid 24647 aka daemon mds.b 2024-09-21T04:19:42.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.669+0000 7f7effac6740 20 client.16395 populate_metadata read hostname 'smithi022' 2024-09-21T04:19:42.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.669+0000 7f7effac6740 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557021892250 0x557021d33a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:42.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.669+0000 7f7effac6740 4 client.16395 mds_command: new command op to 24647 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "dc92612d", "release": true, "await": true}] 2024-09-21T04:19:42.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.669+0000 7f7effac6740 1 -- 172.21.15.22:0/1447690845 --> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] -- command(tid 0: {"prefix": "quiesce db", "set_id": "dc92612d", "release": true, "await": true}) -- 0x557021c1e140 con 0x557021892250 2024-09-21T04:19:42.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.669+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557021892250 0x557021d33a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:42.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7ef2ffd640 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557021892250 0x557021d33a80 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5cc812e23380c2be server_cookie=5a7fcc5b8e854860 in_seq=0 out_seq=0 2024-09-21T04:19:42.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7ed6ff5640 10 client.16395 ms_handle_connect on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:42.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7ed6ff5640 1 -- 172.21.15.22:0/1447690845 <== mds.0 v2:172.21.15.60:6838/3182487250 1 ==== command_reply(tid 0: -1 ) ==== 8+0+590 (crc 0 0 0) 0x557021c1e140 con 0x557021892250 2024-09-21T04:19:42.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7ed6ff5640 10 client.16395 handle_command_reply: tid=0 2024-09-21T04:19:42.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7effac6740 1 client.16395 shutdown 2024-09-21T04:19:42.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7effac6740 1 -- 172.21.15.22:0/1447690845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218dd840 msgr2=0x557021cb9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:42.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7effac6740 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218dd840 0x557021cb9060 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f7ee800bca0 tx=0x7f7ee8005700 comp rx=0 tx=0).stop 2024-09-21T04:19:42.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7effac6740 1 -- 172.21.15.22:0/1447690845 shutdown_connections 2024-09-21T04:19:42.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7effac6740 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.60:6838/3182487250,v1:172.21.15.60:6839/3182487250] conn(0x557021892250 0x557021d33a80 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7effac6740 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5570218fe520 0x557021d29ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7effac6740 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5570218dd840 0x557021cb9060 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7effac6740 1 --2- 172.21.15.22:0/1447690845 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x5570218d5660 0x557021cb8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:42.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7effac6740 1 -- 172.21.15.22:0/1447690845 >> 172.21.15.22:0/1447690845 conn(0x5570218f2910 msgr2=0x557021ca5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:42.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7ed6ff5640 0 client.16395 ms_handle_reset on v2:172.21.15.60:6838/3182487250 2024-09-21T04:19:42.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.670+0000 7f7effac6740 1 -- 172.21.15.22:0/1447690845 shutdown_connections 2024-09-21T04:19:42.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.671+0000 7f7effac6740 1 -- 172.21.15.22:0/1447690845 wait complete. 2024-09-21T04:19:42.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:42.671+0000 7f7effac6740 20 client.16395 trim_cache size 0 max 16384 2024-09-21T04:19:42.679 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:19:42.679 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 50, 2024-09-21T04:19:42.679 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 24647, 2024-09-21T04:19:42.679 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 67, 2024-09-21T04:19:42.679 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-09-21T04:19:42.679 INFO:teuthology.orchestra.run.smithi022.stdout: "dc92612d": { 2024-09-21T04:19:42.679 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 67, 2024-09-21T04:19:42.679 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 1.4, 2024-09-21T04:19:42.679 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "CANCELED", 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 130.0, 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": true, 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 4.8 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:42.680 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:42.681 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:42.681 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:42.681 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:42.681 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:19:42.681 INFO:teuthology.orchestra.run.smithi022.stderr:Error EPERM: 2024-09-21T04:19:42.952 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:42 smithi060 ceph-mon[33722]: pgmap v891: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 6.4 MiB/s wr, 718 op/s 2024-09-21T04:19:43.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:42 smithi022 ceph-mon[31015]: pgmap v891: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 6.4 MiB/s wr, 718 op/s 2024-09-21T04:19:43.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:42 smithi073 ceph-mon[34443]: pgmap v891: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 6.4 MiB/s wr, 718 op/s 2024-09-21T04:19:43.541 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:19:43.542 INFO:tasks.quiescer:done joining Quiescers 2024-09-21T04:19:43.542 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-21T04:19:43.552 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-21T04:19:43.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.773+0000 7fabd5a94640 1 -- 172.21.15.22:0/3155878087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabd01025b0 msgr2=0x7fabd0102a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:43.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.773+0000 7fabd5a94640 1 --2- 172.21.15.22:0/3155878087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabd01025b0 0x7fabd0102a20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009900 tx=0x7fabc002a410 comp rx=0 tx=0).stop 2024-09-21T04:19:43.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.773+0000 7fabd5a94640 1 -- 172.21.15.22:0/3155878087 shutdown_connections 2024-09-21T04:19:43.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.773+0000 7fabd5a94640 1 --2- 172.21.15.22:0/3155878087 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd0103630 0x7fabd0103a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:43.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.773+0000 7fabd5a94640 1 --2- 172.21.15.22:0/3155878087 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabd0103fd0 0x7fabd010a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:43.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.773+0000 7fabd5a94640 1 --2- 172.21.15.22:0/3155878087 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabd01025b0 0x7fabd0102a20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:43.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.773+0000 7fabd5a94640 1 -- 172.21.15.22:0/3155878087 >> 172.21.15.22:0/3155878087 conn(0x7fabd00fdf30 msgr2=0x7fabd01003a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:43.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.773+0000 7fabd5a94640 1 -- 172.21.15.22:0/3155878087 shutdown_connections 2024-09-21T04:19:43.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.773+0000 7fabd5a94640 1 -- 172.21.15.22:0/3155878087 wait complete. 2024-09-21T04:19:43.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.775+0000 7fabd5a94640 1 Processor -- start 2024-09-21T04:19:43.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.775+0000 7fabd5a94640 1 -- start start 2024-09-21T04:19:43.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabd5a94640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabd01025b0 0x7fabd0199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:43.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabd5a94640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabd0103630 0x7fabd019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:43.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabd5a94640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd0103fd0 0x7fabd019b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:43.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabd5a94640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010e0b0 con 0x7fabd01025b0 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabd5a94640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010df30 con 0x7fabd0103630 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabd5a94640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010e230 con 0x7fabd0103fd0 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabcf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabd01025b0 0x7fabd0199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabcf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabd01025b0 0x7fabd0199e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35178/0 (socket says 172.21.15.22:35178) 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabcf7fe640 1 -- 172.21.15.22:0/1628766562 learned_addr learned my addr 172.21.15.22:0/1628766562 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabc6ffd640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabd0103630 0x7fabd019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabcffff640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd0103fd0 0x7fabd019b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabcf7fe640 1 -- 172.21.15.22:0/1628766562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd0103fd0 msgr2=0x7fabd019b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabcf7fe640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd0103fd0 0x7fabd019b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabcf7fe640 1 -- 172.21.15.22:0/1628766562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabd0103630 msgr2=0x7fabd019a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabcf7fe640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabd0103630 0x7fabd019a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabcf7fe640 1 -- 172.21.15.22:0/1628766562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd019b8d0 con 0x7fabd01025b0 2024-09-21T04:19:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabc6ffd640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabd0103630 0x7fabd019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:19:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.776+0000 7fabcf7fe640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabd01025b0 0x7fabd0199e90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009230 tx=0x7fabc00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.777+0000 7fabcd7fa640 1 -- 172.21.15.22:0/1628766562 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc003f030 con 0x7fabd01025b0 2024-09-21T04:19:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.777+0000 7fabcd7fa640 1 -- 172.21.15.22:0/1628766562 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabc0032e20 con 0x7fabd01025b0 2024-09-21T04:19:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.777+0000 7fabd5a94640 1 -- 172.21.15.22:0/1628766562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd019bb60 con 0x7fabd01025b0 2024-09-21T04:19:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.777+0000 7fabcd7fa640 1 -- 172.21.15.22:0/1628766562 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0035070 con 0x7fabd01025b0 2024-09-21T04:19:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.777+0000 7fabd5a94640 1 -- 172.21.15.22:0/1628766562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd019be70 con 0x7fabd01025b0 2024-09-21T04:19:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.778+0000 7fabd5a94640 1 -- 172.21.15.22:0/1628766562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd01a2340 con 0x7fabd01025b0 2024-09-21T04:19:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.779+0000 7fabcd7fa640 1 -- 172.21.15.22:0/1628766562 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fabc0042030 con 0x7fabd01025b0 2024-09-21T04:19:43.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.781+0000 7fabcd7fa640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fabbc0b6660 0x7fabbc0b8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:43.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.781+0000 7fabc6ffd640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fabbc0b6660 0x7fabbc0b8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:43.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.781+0000 7fabcd7fa640 1 -- 172.21.15.22:0/1628766562 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fabc0107cc0 con 0x7fabd01025b0 2024-09-21T04:19:43.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.781+0000 7fabc6ffd640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fabbc0b6660 0x7fabbc0b8b70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fabb80058c0 tx=0x7fabb8005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:43.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.785+0000 7fabcd7fa640 1 -- 172.21.15.22:0/1628766562 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fabc010e080 con 0x7fabd01025b0 2024-09-21T04:19:43.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:43 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:19:43.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.977+0000 7fabd5a94640 1 -- 172.21.15.22:0/1628766562 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabd01a2510 con 0x7fabd01025b0 2024-09-21T04:19:43.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.978+0000 7fabcd7fa640 1 -- 172.21.15.22:0/1628766562 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24751 (secure 0 0 0) 0x7fabc00ce130 con 0x7fabd01025b0 2024-09-21T04:19:43.981 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:43.981 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":85,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:01:31.025432+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11},{"from":5,"to":6}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:19:43.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 -- 172.21.15.22:0/1628766562 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fabbc0b6660 msgr2=0x7fabbc0b8b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:43.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fabbc0b6660 0x7fabbc0b8b70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fabb80058c0 tx=0x7fabb8005850 comp rx=0 tx=0).stop 2024-09-21T04:19:43.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 -- 172.21.15.22:0/1628766562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabd01025b0 msgr2=0x7fabd0199e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:43.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabd01025b0 0x7fabd0199e90 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009230 tx=0x7fabc00042f0 comp rx=0 tx=0).stop 2024-09-21T04:19:43.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 -- 172.21.15.22:0/1628766562 shutdown_connections 2024-09-21T04:19:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fabbc0b6660 0x7fabbc0b8b70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fabd0103fd0 0x7fabd019b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fabd0103630 0x7fabd019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 --2- 172.21.15.22:0/1628766562 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fabd01025b0 0x7fabd0199e90 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 -- 172.21.15.22:0/1628766562 >> 172.21.15.22:0/1628766562 conn(0x7fabd00fdf30 msgr2=0x7fabd00ff800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 -- 172.21.15.22:0/1628766562 shutdown_connections 2024-09-21T04:19:43.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:43.981+0000 7fabd5a94640 1 -- 172.21.15.22:0/1628766562 wait complete. 2024-09-21T04:19:43.995 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T03:55:19.289173+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-21T04:00:00.586018+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-21T04:00:02.887576+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '74', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-09-21T04:00:09.042452+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-09-21T04:19:43.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-21T04:19:44.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:43 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:19:44.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 -- 172.21.15.22:0/2462414234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff168104740 msgr2=0x7ff168104b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 --2- 172.21.15.22:0/2462414234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff168104740 0x7ff168104b50 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009900 tx=0x7ff15c02a410 comp rx=0 tx=0).stop 2024-09-21T04:19:44.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 -- 172.21.15.22:0/2462414234 shutdown_connections 2024-09-21T04:19:44.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 --2- 172.21.15.22:0/2462414234 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1681050e0 0x7ff16810ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 --2- 172.21.15.22:0/2462414234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff168104740 0x7ff168104b50 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 --2- 172.21.15.22:0/2462414234 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1681036c0 0x7ff168103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 -- 172.21.15.22:0/2462414234 >> 172.21.15.22:0/2462414234 conn(0x7ff1680ff020 msgr2=0x7ff1681014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:44.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 -- 172.21.15.22:0/2462414234 shutdown_connections 2024-09-21T04:19:44.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 -- 172.21.15.22:0/2462414234 wait complete. 2024-09-21T04:19:44.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 Processor -- start 2024-09-21T04:19:44.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.111+0000 7ff16e284640 1 -- start start 2024-09-21T04:19:44.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff16e284640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1681036c0 0x7ff168199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff16e284640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff168104740 0x7ff16819a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff16e284640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1681050e0 0x7ff16819b090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff16e284640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff16810f1c0 con 0x7ff168104740 2024-09-21T04:19:44.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff16e284640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ff16810f040 con 0x7ff1681036c0 2024-09-21T04:19:44.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff16e284640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ff16810f340 con 0x7ff1681050e0 2024-09-21T04:19:44.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff1677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff168104740 0x7ff16819a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff1677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff168104740 0x7ff16819a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35206/0 (socket says 172.21.15.22:35206) 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff1677fe640 1 -- 172.21.15.22:0/2417151786 learned_addr learned my addr 172.21.15.22:0/2417151786 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff167fff640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1681036c0 0x7ff168199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff16c821640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1681050e0 0x7ff16819b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff1677fe640 1 -- 172.21.15.22:0/2417151786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1681050e0 msgr2=0x7ff16819b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff1677fe640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1681050e0 0x7ff16819b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff1677fe640 1 -- 172.21.15.22:0/2417151786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1681036c0 msgr2=0x7ff168199e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff1677fe640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1681036c0 0x7ff168199e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff1677fe640 1 -- 172.21.15.22:0/2417151786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff16819b8b0 con 0x7ff168104740 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.112+0000 7ff16c821640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1681050e0 0x7ff16819b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.113+0000 7ff1677fe640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff168104740 0x7ff16819a4e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009230 tx=0x7ff15c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.113+0000 7ff1657fa640 1 -- 172.21.15.22:0/2417151786 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c03f030 con 0x7ff168104740 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.113+0000 7ff16e284640 1 -- 172.21.15.22:0/2417151786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff16819bb40 con 0x7ff168104740 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.113+0000 7ff1657fa640 1 -- 172.21.15.22:0/2417151786 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff15c032e20 con 0x7ff168104740 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.113+0000 7ff1657fa640 1 -- 172.21.15.22:0/2417151786 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c035070 con 0x7ff168104740 2024-09-21T04:19:44.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.113+0000 7ff16e284640 1 -- 172.21.15.22:0/2417151786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff16819be50 con 0x7ff168104740 2024-09-21T04:19:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.114+0000 7ff16e284640 1 -- 172.21.15.22:0/2417151786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff16810a890 con 0x7ff168104740 2024-09-21T04:19:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.116+0000 7ff1657fa640 1 -- 172.21.15.22:0/2417151786 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ff15c042030 con 0x7ff168104740 2024-09-21T04:19:44.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.116+0000 7ff1657fa640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff1500b6510 0x7ff1500b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.116+0000 7ff1657fa640 1 -- 172.21.15.22:0/2417151786 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ff15c1080c0 con 0x7ff168104740 2024-09-21T04:19:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.116+0000 7ff167fff640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff1500b6510 0x7ff1500b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.117+0000 7ff167fff640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff1500b6510 0x7ff1500b8a20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff158009bd0 tx=0x7ff158005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:44.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.120+0000 7ff1657fa640 1 -- 172.21.15.22:0/2417151786 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff15c0ce590 con 0x7ff168104740 2024-09-21T04:19:44.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:43 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:19:44.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.310+0000 7ff16e284640 1 -- 172.21.15.22:0/2417151786 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff168063fc0 con 0x7ff168104740 2024-09-21T04:19:44.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.311+0000 7ff1657fa640 1 -- 172.21.15.22:0/2417151786 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) ==== 93+0+10 (secure 0 0 0) 0x7ff15c0d2970 con 0x7ff168104740 2024-09-21T04:19:44.313 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 1 2024-09-21T04:19:44.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 -- 172.21.15.22:0/2417151786 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff1500b6510 msgr2=0x7ff1500b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff1500b6510 0x7ff1500b8a20 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff158009bd0 tx=0x7ff158005f90 comp rx=0 tx=0).stop 2024-09-21T04:19:44.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 -- 172.21.15.22:0/2417151786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff168104740 msgr2=0x7ff16819a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff168104740 0x7ff16819a4e0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009230 tx=0x7ff15c0042f0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 -- 172.21.15.22:0/2417151786 shutdown_connections 2024-09-21T04:19:44.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ff1500b6510 0x7ff1500b8a20 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ff1681050e0 0x7ff16819b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff168104740 0x7ff16819a4e0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 --2- 172.21.15.22:0/2417151786 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ff1681036c0 0x7ff168199e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 -- 172.21.15.22:0/2417151786 >> 172.21.15.22:0/2417151786 conn(0x7ff1680ff020 msgr2=0x7ff168107a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:44.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 -- 172.21.15.22:0/2417151786 shutdown_connections 2024-09-21T04:19:44.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.313+0000 7ff16e284640 1 -- 172.21.15.22:0/2417151786 wait complete. 2024-09-21T04:19:44.327 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-21T04:19:44.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.446+0000 7f49602f2640 1 -- 172.21.15.22:0/3646052413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4958103fc0 msgr2=0x7f495810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.446+0000 7f49602f2640 1 --2- 172.21.15.22:0/3646052413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4958103fc0 0x7f495810a960 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f4950009ca0 tx=0x7f495002a8c0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.447+0000 7f49602f2640 1 -- 172.21.15.22:0/3646052413 shutdown_connections 2024-09-21T04:19:44.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.447+0000 7f49602f2640 1 --2- 172.21.15.22:0/3646052413 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4958103620 0x7f4958103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.447+0000 7f49602f2640 1 --2- 172.21.15.22:0/3646052413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4958103fc0 0x7f495810a960 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.447+0000 7f49602f2640 1 --2- 172.21.15.22:0/3646052413 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49581025a0 0x7f4958102a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.447+0000 7f49602f2640 1 -- 172.21.15.22:0/3646052413 >> 172.21.15.22:0/3646052413 conn(0x7f49580fdee0 msgr2=0x7f4958100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:44.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.447+0000 7f49602f2640 1 -- 172.21.15.22:0/3646052413 shutdown_connections 2024-09-21T04:19:44.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.447+0000 7f49602f2640 1 -- 172.21.15.22:0/3646052413 wait complete. 2024-09-21T04:19:44.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.447+0000 7f49602f2640 1 Processor -- start 2024-09-21T04:19:44.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.447+0000 7f49602f2640 1 -- start start 2024-09-21T04:19:44.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f49602f2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49581025a0 0x7f4958106170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f49602f2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4958103620 0x7f4958104a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f49602f2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4958103fc0 0x7f4958104f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f49602f2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f495810e0f0 con 0x7f4958103620 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f49602f2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f495810df70 con 0x7f49581025a0 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f49602f2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f495810e270 con 0x7f4958103fc0 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495d88d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4958103620 0x7f4958104a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495d88d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4958103620 0x7f4958104a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35228/0 (socket says 172.21.15.22:35228) 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495d88d640 1 -- 172.21.15.22:0/1727892842 learned_addr learned my addr 172.21.15.22:0/1727892842 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495e08e640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49581025a0 0x7f4958106170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495e88f640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4958103fc0 0x7f4958104f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495d88d640 1 -- 172.21.15.22:0/1727892842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4958103fc0 msgr2=0x7f4958104f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495d88d640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4958103fc0 0x7f4958104f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495d88d640 1 -- 172.21.15.22:0/1727892842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49581025a0 msgr2=0x7f4958106170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495d88d640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49581025a0 0x7f4958106170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495d88d640 1 -- 172.21.15.22:0/1727892842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49581056a0 con 0x7f4958103620 2024-09-21T04:19:44.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.448+0000 7f495d88d640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4958103620 0x7f4958104a30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f494c00e9f0 tx=0x7f494c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:44.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.449+0000 7f494b7fe640 1 -- 172.21.15.22:0/1727892842 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c00cd80 con 0x7f4958103620 2024-09-21T04:19:44.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.449+0000 7f494b7fe640 1 -- 172.21.15.22:0/1727892842 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f494c0054b0 con 0x7f4958103620 2024-09-21T04:19:44.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.449+0000 7f49602f2640 1 -- 172.21.15.22:0/1727892842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49581a3e60 con 0x7f4958103620 2024-09-21T04:19:44.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.449+0000 7f494b7fe640 1 -- 172.21.15.22:0/1727892842 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f494c010430 con 0x7f4958103620 2024-09-21T04:19:44.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.449+0000 7f49602f2640 1 -- 172.21.15.22:0/1727892842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49581a4210 con 0x7f4958103620 2024-09-21T04:19:44.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.450+0000 7f49602f2640 1 -- 172.21.15.22:0/1727892842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49581a44d0 con 0x7f4958103620 2024-09-21T04:19:44.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.452+0000 7f494b7fe640 1 -- 172.21.15.22:0/1727892842 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f494c0046c0 con 0x7f4958103620 2024-09-21T04:19:44.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.453+0000 7f494b7fe640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49440b6510 0x7f49440b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.453+0000 7f495e08e640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49440b6510 0x7f49440b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.453+0000 7f494b7fe640 1 -- 172.21.15.22:0/1727892842 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f494c0e7ce0 con 0x7f4958103620 2024-09-21T04:19:44.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.453+0000 7f495e08e640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49440b6510 0x7f49440b8a20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4954009bd0 tx=0x7f4954005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:44.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.456+0000 7f494b7fe640 1 -- 172.21.15.22:0/1727892842 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f494c056710 con 0x7f4958103620 2024-09-21T04:19:44.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.645+0000 7f49602f2640 1 -- 172.21.15.22:0/1727892842 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f49581a46a0 con 0x7f4958103620 2024-09-21T04:19:44.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.646+0000 7f494b7fe640 1 -- 172.21.15.22:0/1727892842 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v85) ==== 104+0+11 (secure 0 0 0) 0x7f494c0a9070 con 0x7f4958103620 2024-09-21T04:19:44.648 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-09-21T04:19:44.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 -- 172.21.15.22:0/1727892842 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49440b6510 msgr2=0x7f49440b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49440b6510 0x7f49440b8a20 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4954009bd0 tx=0x7f4954005f90 comp rx=0 tx=0).stop 2024-09-21T04:19:44.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 -- 172.21.15.22:0/1727892842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4958103620 msgr2=0x7f4958104a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4958103620 0x7f4958104a30 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f494c00e9f0 tx=0x7f494c00edf0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 -- 172.21.15.22:0/1727892842 shutdown_connections 2024-09-21T04:19:44.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f49440b6510 0x7f49440b8a20 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f4958103fc0 0x7f4958104f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4958103620 0x7f4958104a30 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 --2- 172.21.15.22:0/1727892842 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f49581025a0 0x7f4958106170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 -- 172.21.15.22:0/1727892842 >> 172.21.15.22:0/1727892842 conn(0x7f49580fdee0 msgr2=0x7f49580ff780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:44.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 -- 172.21.15.22:0/1727892842 shutdown_connections 2024-09-21T04:19:44.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.648+0000 7f49602f2640 1 -- 172.21.15.22:0/1727892842 wait complete. 2024-09-21T04:19:44.662 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-21T04:19:44.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 -- 172.21.15.22:0/3602033289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62801025a0 msgr2=0x7f6280102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 --2- 172.21.15.22:0/3602033289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62801025a0 0x7f6280102a10 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f6274009900 tx=0x7f627402a410 comp rx=0 tx=0).stop 2024-09-21T04:19:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 -- 172.21.15.22:0/3602033289 shutdown_connections 2024-09-21T04:19:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 --2- 172.21.15.22:0/3602033289 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6280103620 0x7f6280103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 --2- 172.21.15.22:0/3602033289 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6280103fc0 0x7f628010a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 --2- 172.21.15.22:0/3602033289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62801025a0 0x7f6280102a10 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 -- 172.21.15.22:0/3602033289 >> 172.21.15.22:0/3602033289 conn(0x7f62800fdf00 msgr2=0x7f6280100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 -- 172.21.15.22:0/3602033289 shutdown_connections 2024-09-21T04:19:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 -- 172.21.15.22:0/3602033289 wait complete. 2024-09-21T04:19:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 Processor -- start 2024-09-21T04:19:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.777+0000 7f6286d20640 1 -- start start 2024-09-21T04:19:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6286d20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62801025a0 0x7f628006c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6286d20640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6280103620 0x7f628019ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6286d20640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6280103fc0 0x7f62801a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6286d20640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f628010e0a0 con 0x7f62801025a0 2024-09-21T04:19:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6286d20640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f628010df20 con 0x7f6280103fc0 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6286d20640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f628010e220 con 0x7f6280103620 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6284abc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62801025a0 0x7f628006c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6284abc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62801025a0 0x7f628006c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35254/0 (socket says 172.21.15.22:35254) 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6284abc640 1 -- 172.21.15.22:0/1198296741 learned_addr learned my addr 172.21.15.22:0/1198296741 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f627ffff640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6280103620 0x7f628019ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f62852bd640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6280103fc0 0x7f62801a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6284abc640 1 -- 172.21.15.22:0/1198296741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6280103620 msgr2=0x7f628019ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6284abc640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6280103620 0x7f628019ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6284abc640 1 -- 172.21.15.22:0/1198296741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6280103fc0 msgr2=0x7f62801a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6284abc640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6280103fc0 0x7f62801a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6284abc640 1 -- 172.21.15.22:0/1198296741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62801a1920 con 0x7f62801025a0 2024-09-21T04:19:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f62852bd640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6280103fc0 0x7f62801a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:19:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f6284abc640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62801025a0 0x7f628006c260 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6274009230 tx=0x7f6274004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.778+0000 7f627dffb640 1 -- 172.21.15.22:0/1198296741 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627403f030 con 0x7f62801025a0 2024-09-21T04:19:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.779+0000 7f627dffb640 1 -- 172.21.15.22:0/1198296741 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6274004440 con 0x7f62801025a0 2024-09-21T04:19:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.779+0000 7f6286d20640 1 -- 172.21.15.22:0/1198296741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62801a1bb0 con 0x7f62801025a0 2024-09-21T04:19:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.779+0000 7f627dffb640 1 -- 172.21.15.22:0/1198296741 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6274035070 con 0x7f62801025a0 2024-09-21T04:19:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.779+0000 7f6286d20640 1 -- 172.21.15.22:0/1198296741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62801a20f0 con 0x7f62801025a0 2024-09-21T04:19:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.780+0000 7f6286d20640 1 -- 172.21.15.22:0/1198296741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6280109770 con 0x7f62801025a0 2024-09-21T04:19:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.781+0000 7f627dffb640 1 -- 172.21.15.22:0/1198296741 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f6274042030 con 0x7f62801025a0 2024-09-21T04:19:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.782+0000 7f627dffb640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f62700b6590 0x7f62700b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.782+0000 7f627dffb640 1 -- 172.21.15.22:0/1198296741 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f6274107fd0 con 0x7f62801025a0 2024-09-21T04:19:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.782+0000 7f627ffff640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f62700b6590 0x7f62700b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.783+0000 7f627ffff640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f62700b6590 0x7f62700b8aa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f626c009bd0 tx=0x7f626c005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:44.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.785+0000 7f627dffb640 1 -- 172.21.15.22:0/1198296741 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f62740ce440 con 0x7f62801025a0 2024-09-21T04:19:44.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.974+0000 7f6286d20640 1 -- 172.21.15.22:0/1198296741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f628002e7d0 con 0x7f62801025a0 2024-09-21T04:19:44.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.975+0000 7f627dffb640 1 -- 172.21.15.22:0/1198296741 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v85) ==== 100+0+11 (secure 0 0 0) 0x7f62740d2820 con 0x7f62801025a0 2024-09-21T04:19:44.977 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 64 2024-09-21T04:19:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 -- 172.21.15.22:0/1198296741 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f62700b6590 msgr2=0x7f62700b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f62700b6590 0x7f62700b8aa0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f626c009bd0 tx=0x7f626c005f90 comp rx=0 tx=0).stop 2024-09-21T04:19:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 -- 172.21.15.22:0/1198296741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62801025a0 msgr2=0x7f628006c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62801025a0 0x7f628006c260 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f6274009230 tx=0x7f6274004040 comp rx=0 tx=0).stop 2024-09-21T04:19:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 -- 172.21.15.22:0/1198296741 shutdown_connections 2024-09-21T04:19:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f62700b6590 0x7f62700b8aa0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f6280103620 0x7f628019ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f6280103fc0 0x7f62801a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 --2- 172.21.15.22:0/1198296741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f62801025a0 0x7f628006c260 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 -- 172.21.15.22:0/1198296741 >> 172.21.15.22:0/1198296741 conn(0x7f62800fdf00 msgr2=0x7f6280106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 -- 172.21.15.22:0/1198296741 shutdown_connections 2024-09-21T04:19:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:44.977+0000 7f6286d20640 1 -- 172.21.15.22:0/1198296741 wait complete. 2024-09-21T04:19:44.990 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:44 smithi022 ceph-mon[31015]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.4 MiB/s wr, 488 op/s 2024-09-21T04:19:44.990 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:44 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1628766562' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:19:44.990 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:44 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/2417151786' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T04:19:44.990 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:44 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1727892842' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T04:19:44.991 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-09-21T04:19:45.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:44 smithi073 ceph-mon[34443]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.4 MiB/s wr, 488 op/s 2024-09-21T04:19:45.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:44 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1628766562' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:19:45.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:44 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/2417151786' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T04:19:45.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:44 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1727892842' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T04:19:45.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.105+0000 7fb04948b640 1 -- 172.21.15.22:0/1027321081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0441025a0 msgr2=0x7fb044102a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:45.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.105+0000 7fb04948b640 1 --2- 172.21.15.22:0/1027321081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0441025a0 0x7fb044102a10 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fb034009900 tx=0x7fb03402a410 comp rx=0 tx=0).stop 2024-09-21T04:19:45.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 -- 172.21.15.22:0/1027321081 shutdown_connections 2024-09-21T04:19:45.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 --2- 172.21.15.22:0/1027321081 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb044103fc0 0x7fb04410a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 --2- 172.21.15.22:0/1027321081 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb044103620 0x7fb044103a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 --2- 172.21.15.22:0/1027321081 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0441025a0 0x7fb044102a10 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 -- 172.21.15.22:0/1027321081 >> 172.21.15.22:0/1027321081 conn(0x7fb0440fdf00 msgr2=0x7fb044100390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:45.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 -- 172.21.15.22:0/1027321081 shutdown_connections 2024-09-21T04:19:45.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 -- 172.21.15.22:0/1027321081 wait complete. 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 Processor -- start 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 -- start start 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0441025a0 0x7fb044199e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb044103620 0x7fb04419a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb044103fc0 0x7fb04419b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb04410e0a0 con 0x7fb044103fc0 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fb04410df20 con 0x7fb0441025a0 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.106+0000 7fb04948b640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fb04410e220 con 0x7fb044103620 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb0437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb044103fc0 0x7fb04419b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb0437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb044103fc0 0x7fb04419b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35266/0 (socket says 172.21.15.22:35266) 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb0437fe640 1 -- 172.21.15.22:0/4070650142 learned_addr learned my addr 172.21.15.22:0/4070650142 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:45.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb03bfff640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb044103620 0x7fb04419a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb042ffd640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0441025a0 0x7fb044199e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb0437fe640 1 -- 172.21.15.22:0/4070650142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb044103620 msgr2=0x7fb04419a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb0437fe640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb044103620 0x7fb04419a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb0437fe640 1 -- 172.21.15.22:0/4070650142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0441025a0 msgr2=0x7fb044199e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb0437fe640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0441025a0 0x7fb044199e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb0437fe640 1 -- 172.21.15.22:0/4070650142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04419b870 con 0x7fb044103fc0 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb042ffd640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0441025a0 0x7fb044199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb0437fe640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb044103fc0 0x7fb04419b050 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00eb10 tx=0x7fb03c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb040ff9640 1 -- 172.21.15.22:0/4070650142 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c004b20 con 0x7fb044103fc0 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb040ff9640 1 -- 172.21.15.22:0/4070650142 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb03c004cc0 con 0x7fb044103fc0 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb04948b640 1 -- 172.21.15.22:0/4070650142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04419bb60 con 0x7fb044103fc0 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb040ff9640 1 -- 172.21.15.22:0/4070650142 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb03c010690 con 0x7fb044103fc0 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.107+0000 7fb04948b640 1 -- 172.21.15.22:0/4070650142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0441a2250 con 0x7fb044103fc0 2024-09-21T04:19:45.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.109+0000 7fb04948b640 1 -- 172.21.15.22:0/4070650142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0441a2420 con 0x7fb044103fc0 2024-09-21T04:19:45.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.110+0000 7fb040ff9640 1 -- 172.21.15.22:0/4070650142 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fb03c005020 con 0x7fb044103fc0 2024-09-21T04:19:45.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.111+0000 7fb040ff9640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb0300b6510 0x7fb0300b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:45.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.111+0000 7fb042ffd640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb0300b6510 0x7fb0300b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:45.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.111+0000 7fb040ff9640 1 -- 172.21.15.22:0/4070650142 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fb03c0e7ce0 con 0x7fb044103fc0 2024-09-21T04:19:45.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.111+0000 7fb042ffd640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb0300b6510 0x7fb0300b8a20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb034005f70 tx=0x7fb034000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:45.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.115+0000 7fb040ff9640 1 -- 172.21.15.22:0/4070650142 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb03c0ae1b0 con 0x7fb044103fc0 2024-09-21T04:19:45.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:44 smithi060 ceph-mon[33722]: pgmap v892: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.4 MiB/s wr, 488 op/s 2024-09-21T04:19:45.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:44 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1628766562' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:19:45.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:44 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/2417151786' entity='client.admin' cmd={"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} : dispatch 2024-09-21T04:19:45.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:44 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1727892842' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} : dispatch 2024-09-21T04:19:45.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.307+0000 7fb04948b640 1 -- 172.21.15.22:0/4070650142 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fb0441a25f0 con 0x7fb044103fc0 2024-09-21T04:19:45.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.307+0000 7fb040ff9640 1 -- 172.21.15.22:0/4070650142 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v85) ==== 103+0+11 (secure 0 0 0) 0x7fb03c0a9030 con 0x7fb044103fc0 2024-09-21T04:19:45.310 INFO:teuthology.orchestra.run.smithi022.stdout:pg_num: 32 2024-09-21T04:19:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.309+0000 7fb04948b640 1 -- 172.21.15.22:0/4070650142 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb0300b6510 msgr2=0x7fb0300b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.309+0000 7fb04948b640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb0300b6510 0x7fb0300b8a20 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb034005f70 tx=0x7fb034000bc0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.309+0000 7fb04948b640 1 -- 172.21.15.22:0/4070650142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb044103fc0 msgr2=0x7fb04419b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.309+0000 7fb04948b640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb044103fc0 0x7fb04419b050 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fb03c00eb10 tx=0x7fb03c00c2d0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.309+0000 7fb04948b640 1 -- 172.21.15.22:0/4070650142 shutdown_connections 2024-09-21T04:19:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.309+0000 7fb04948b640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fb0300b6510 0x7fb0300b8a20 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.309+0000 7fb04948b640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fb044103620 0x7fb04419a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.309+0000 7fb04948b640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb044103fc0 0x7fb04419b050 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.309+0000 7fb04948b640 1 --2- 172.21.15.22:0/4070650142 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fb0441025a0 0x7fb044199e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.309+0000 7fb04948b640 1 -- 172.21.15.22:0/4070650142 >> 172.21.15.22:0/4070650142 conn(0x7fb0440fdf00 msgr2=0x7fb0440ff7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.310+0000 7fb04948b640 1 -- 172.21.15.22:0/4070650142 shutdown_connections 2024-09-21T04:19:45.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.310+0000 7fb04948b640 1 -- 172.21.15.22:0/4070650142 wait complete. 2024-09-21T04:19:45.324 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-21T04:19:45.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.435+0000 7f87c22a2640 1 -- 172.21.15.22:0/406725897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87bc1050e0 msgr2=0x7f87bc10ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:45.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.435+0000 7f87c22a2640 1 --2- 172.21.15.22:0/406725897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87bc1050e0 0x7f87bc10ba80 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009ca0 tx=0x7f87b402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.435+0000 7f87c22a2640 1 -- 172.21.15.22:0/406725897 shutdown_connections 2024-09-21T04:19:45.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.435+0000 7f87c22a2640 1 --2- 172.21.15.22:0/406725897 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87bc104740 0x7f87bc104b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.435+0000 7f87c22a2640 1 --2- 172.21.15.22:0/406725897 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87bc1050e0 0x7f87bc10ba80 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.435+0000 7f87c22a2640 1 --2- 172.21.15.22:0/406725897 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87bc1036c0 0x7f87bc103b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.435+0000 7f87c22a2640 1 -- 172.21.15.22:0/406725897 >> 172.21.15.22:0/406725897 conn(0x7f87bc0ff000 msgr2=0x7f87bc1014b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.435+0000 7f87c22a2640 1 -- 172.21.15.22:0/406725897 shutdown_connections 2024-09-21T04:19:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.435+0000 7f87c22a2640 1 -- 172.21.15.22:0/406725897 wait complete. 2024-09-21T04:19:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c22a2640 1 Processor -- start 2024-09-21T04:19:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c22a2640 1 -- start start 2024-09-21T04:19:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c22a2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87bc1036c0 0x7f87bc199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c22a2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87bc104740 0x7f87bc19a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c22a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87bc1050e0 0x7f87bc19b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c22a2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc10f170 con 0x7f87bc1050e0 2024-09-21T04:19:45.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c22a2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc10eff0 con 0x7f87bc1036c0 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c22a2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc10f2f0 con 0x7f87bc104740 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c083f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87bc1050e0 0x7f87bc19b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c083f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87bc1050e0 0x7f87bc19b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35284/0 (socket says 172.21.15.22:35284) 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87c083f640 1 -- 172.21.15.22:0/4158684244 learned_addr learned my addr 172.21.15.22:0/4158684244 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87bbfff640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87bc1036c0 0x7f87bc199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.436+0000 7f87bb7fe640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87bc104740 0x7f87bc19a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87c083f640 1 -- 172.21.15.22:0/4158684244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87bc104740 msgr2=0x7f87bc19a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87c083f640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87bc104740 0x7f87bc19a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87c083f640 1 -- 172.21.15.22:0/4158684244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87bc1036c0 msgr2=0x7f87bc199e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87c083f640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87bc1036c0 0x7f87bc199e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87c083f640 1 -- 172.21.15.22:0/4158684244 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87bc19b850 con 0x7f87bc1050e0 2024-09-21T04:19:45.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87bb7fe640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87bc104740 0x7f87bc19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:19:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87c083f640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87bc1050e0 0x7f87bc19b030 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009dc0 tx=0x7f87b4003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87b97fa640 1 -- 172.21.15.22:0/4158684244 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4004240 con 0x7f87bc1050e0 2024-09-21T04:19:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87c22a2640 1 -- 172.21.15.22:0/4158684244 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87bc19bae0 con 0x7f87bc1050e0 2024-09-21T04:19:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87b97fa640 1 -- 172.21.15.22:0/4158684244 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f87b4040030 con 0x7f87bc1050e0 2024-09-21T04:19:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87b97fa640 1 -- 172.21.15.22:0/4158684244 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b403b430 con 0x7f87bc1050e0 2024-09-21T04:19:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.437+0000 7f87c22a2640 1 -- 172.21.15.22:0/4158684244 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87bc1a2230 con 0x7f87bc1050e0 2024-09-21T04:19:45.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.438+0000 7f87c22a2640 1 -- 172.21.15.22:0/4158684244 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87bc103b30 con 0x7f87bc1050e0 2024-09-21T04:19:45.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.440+0000 7f87b97fa640 1 -- 172.21.15.22:0/4158684244 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f87b4030650 con 0x7f87bc1050e0 2024-09-21T04:19:45.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.440+0000 7f87b97fa640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87a40b6510 0x7f87a40b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:19:45.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.440+0000 7f87bbfff640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87a40b6510 0x7f87a40b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:19:45.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.440+0000 7f87b97fa640 1 -- 172.21.15.22:0/4158684244 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f87b4108780 con 0x7f87bc1050e0 2024-09-21T04:19:45.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.441+0000 7f87bbfff640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87a40b6510 0x7f87a40b8a20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f87ac005fd0 tx=0x7f87ac005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:19:45.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.443+0000 7f87b97fa640 1 -- 172.21.15.22:0/4158684244 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f87b40cebf0 con 0x7f87bc1050e0 2024-09-21T04:19:45.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.685+0000 7f87c22a2640 1 -- 172.21.15.22:0/4158684244 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f87bc10a870 con 0x7f87bc1050e0 2024-09-21T04:19:45.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.694+0000 7f87b97fa640 1 -- 172.21.15.22:0/4158684244 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+833522 (secure 0 0 0) 0x7f87bc10a870 con 0x7f87bc1050e0 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 18, 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "active_gid": 14150, 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "active_name": "x", 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "active_addrs": { 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6800", 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3402236759 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.709 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:6801", 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 3402236759 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "active_addr": "172.21.15.22:6801/3402236759", 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "active_change": "2024-09-21T03:52:28.809690+0000", 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "active_mgr_features": 4540719139924082687, 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "available": true, 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "standbys": [ 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.710 INFO:teuthology.orchestra.run.smithi022.stdout: "gid": 24116, 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "y", 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_features": 4540719139924082687, 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.711 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:45.712 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.713 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.714 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.716 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.717 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.718 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.719 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.720 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.721 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-21T04:19:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-21T04:19:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-21T04:19:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.722 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-21T04:19:45.723 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-21T04:19:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-21T04:19:45.724 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-21T04:19:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-21T04:19:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.725 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.726 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:45.727 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.728 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.729 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-21T04:19:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T04:19:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:19:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.731 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.732 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.733 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.734 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-21T04:19:45.735 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:19:45.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.737 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.738 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.739 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.740 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.741 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.742 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.743 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.744 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.745 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-21T04:19:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-21T04:19:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.746 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T04:19:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-21T04:19:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-21T04:19:45.747 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-21T04:19:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-21T04:19:45.748 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-21T04:19:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-21T04:19:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-21T04:19:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-21T04:19:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-21T04:19:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.749 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-21T04:19:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-21T04:19:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.750 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T04:19:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:45.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:45.752 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.753 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.754 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.756 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.757 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.758 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.760 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T04:19:45.761 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.762 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-21T04:19:45.763 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-21T04:19:45.764 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.766 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.767 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.768 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.769 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.770 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.772 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-21T04:19:45.774 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-21T04:19:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-21T04:19:45.811 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-21T04:19:45.812 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nginx": { 2024-09-21T04:19:45.813 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nginx", 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nginx container image", 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.814 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.815 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_oauth2_proxy": { 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "oauth2-proxy container image", 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.817 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.818 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-21T04:19:45.819 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.820 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba_metrics": { 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba_metrics", 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.821 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T04:19:45.822 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.823 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.824 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.826 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.827 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-21T04:19:45.828 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.829 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.830 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-21T04:19:45.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.833 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.836 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.837 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.838 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.839 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.841 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.842 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.843 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-21T04:19:45.845 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.846 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.848 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.849 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.850 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.851 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.852 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.853 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:45.854 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-21T04:19:45.855 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.856 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_keepalive_count_max": { 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_keepalive_interval": { 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_keepalive_interval", 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T04:19:45.859 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.861 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.862 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.863 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.864 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.866 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.867 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.868 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-21T04:19:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-21T04:19:45.869 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:45.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-21T04:19:45.871 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.872 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.873 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T04:19:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T04:19:45.874 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T04:19:45.875 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-21T04:19:45.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.878 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.879 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.880 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.881 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.882 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.883 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.884 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.885 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.886 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.887 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.888 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-21T04:19:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.889 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.891 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.892 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.893 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.894 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.895 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.896 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "[]", 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.897 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.898 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "{}", 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.899 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T04:19:45.900 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.901 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.902 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T04:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T04:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.903 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.904 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T04:19:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T04:19:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.905 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.906 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T04:19:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T04:19:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.908 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.909 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.910 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.911 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.912 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.913 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T04:19:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T04:19:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T04:19:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.914 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:45.915 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.916 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T04:19:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T04:19:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.917 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-21T04:19:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.918 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T04:19:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T04:19:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.919 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-21T04:19:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.922 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.923 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.924 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.925 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.926 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.927 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.928 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.929 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.931 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.933 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.934 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.935 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.936 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.937 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.938 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.939 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.941 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:45.942 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.943 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.944 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "sso_oauth2": { 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sso_oauth2", 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.945 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-21T04:19:45.946 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-21T04:19:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-21T04:19:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.947 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-21T04:19:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-21T04:19:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-21T04:19:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.948 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-21T04:19:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-21T04:19:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-21T04:19:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.949 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-21T04:19:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-21T04:19:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.950 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-21T04:19:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-21T04:19:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-21T04:19:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.952 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-21T04:19:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.953 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.954 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.955 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.956 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.958 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.959 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-21T04:19:45.960 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-21T04:19:45.961 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-21T04:19:45.962 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.963 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.964 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.965 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:45.966 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-21T04:19:45.967 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.968 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-21T04:19:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.969 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.970 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.972 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.973 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-21T04:19:45.974 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.975 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.976 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:45.977 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-21T04:19:45.978 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.979 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-21T04:19:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-21T04:19:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-21T04:19:45.980 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.981 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:45.982 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.983 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.984 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.985 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.986 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:45.987 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.988 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.989 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:45.990 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.991 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-21T04:19:45.992 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-21T04:19:45.993 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-21T04:19:45.994 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:45.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.996 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:45.997 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:45.998 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:45.999 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.000 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.001 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.002 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-21T04:19:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.003 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.004 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.005 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.006 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.007 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.008 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.009 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.010 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.011 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.012 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.013 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.014 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.015 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.016 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.017 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.018 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-21T04:19:46.019 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.020 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.021 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.022 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.023 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.024 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.025 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.026 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-21T04:19:46.027 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.028 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.029 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.030 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.031 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.032 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.033 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.034 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.035 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.036 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.037 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.038 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.039 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.040 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.041 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.042 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.043 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.045 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.046 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.048 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.049 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.050 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.051 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.052 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.053 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.054 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.055 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.056 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.057 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.058 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-21T04:19:46.059 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.060 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.061 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.062 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.063 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.064 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.065 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.066 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.067 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.068 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.069 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.070 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.071 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.072 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.073 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.074 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.075 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.076 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.077 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.078 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.079 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.080 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:46.081 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.082 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-21T04:19:46.083 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-21T04:19:46.084 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-21T04:19:46.085 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.086 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.087 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.088 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.089 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.090 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.091 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-21T04:19:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-21T04:19:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-21T04:19:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-21T04:19:46.092 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.093 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.094 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.095 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-21T04:19:46.096 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.097 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.098 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.099 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.100 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.101 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.102 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.103 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.104 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.105 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.106 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.107 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.108 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-21T04:19:46.109 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-21T04:19:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-21T04:19:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.110 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.111 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-21T04:19:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-21T04:19:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-21T04:19:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.112 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-21T04:19:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-21T04:19:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.113 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-21T04:19:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-21T04:19:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.114 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-21T04:19:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-21T04:19:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-21T04:19:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.115 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.116 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-21T04:19:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.117 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.118 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.119 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.120 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.121 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.123 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.124 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.125 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.127 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.128 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.129 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.130 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.131 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.132 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.133 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.134 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.135 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.136 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.137 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "max_requests": { 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_requests", 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.138 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.139 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.140 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.141 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.142 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.143 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.144 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.145 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.146 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T04:19:46.147 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.148 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.149 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.150 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.151 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.152 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.153 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.154 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.156 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.157 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.158 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.159 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.160 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.161 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.162 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.163 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.164 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.165 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.166 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-21T04:19:46.167 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-21T04:19:46.168 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.169 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.170 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.171 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-21T04:19:46.172 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.175 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smb", 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "internal_store_backend": { 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "internal_store_backend", 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.176 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.177 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.178 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.179 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.180 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.181 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.182 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "update_orchestration": { 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "update_orchestration", 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.183 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-21T04:19:46.184 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.185 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.186 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.187 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.188 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.189 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.190 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.191 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.192 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.193 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.194 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.195 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.196 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.197 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.198 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.199 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.200 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.201 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.202 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.203 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.204 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.205 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.206 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.207 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.208 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.209 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.210 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.211 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.212 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-21T04:19:46.213 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T04:19:46.214 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.215 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.216 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.217 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.218 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T04:19:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-21T04:19:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-21T04:19:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.219 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-21T04:19:46.220 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-21T04:19:46.221 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-21T04:19:46.222 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:46.223 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-21T04:19:46.224 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-21T04:19:46.225 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.226 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.227 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.228 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.229 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.231 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.232 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.233 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.234 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.235 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.236 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.237 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.238 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.239 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.240 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.241 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.242 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.243 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.244 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.245 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.246 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.247 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.248 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.249 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.250 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.251 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.252 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.253 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.254 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:46.255 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.256 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.257 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.258 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.259 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.260 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.261 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.262 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.263 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.264 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-21T04:19:46.265 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.267 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.268 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-21T04:19:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "gid": 24118, 2024-09-21T04:19:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "z", 2024-09-21T04:19:46.269 INFO:teuthology.orchestra.run.smithi022.stdout: "mgr_features": 4540719139924082687, 2024-09-21T04:19:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-21T04:19:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-21T04:19:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.270 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:46.271 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T04:19:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.272 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.273 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.274 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.275 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.276 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.277 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.278 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.279 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.280 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.281 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.282 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.283 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.284 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.285 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T04:19:46.286 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-21T04:19:46.287 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.288 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.289 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.290 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.291 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-21T04:19:46.292 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.293 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-21T04:19:46.294 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.295 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T04:19:46.296 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.297 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.298 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.299 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.300 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.301 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.302 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-21T04:19:46.303 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.304 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.305 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.306 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.307 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.308 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-21T04:19:46.309 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-21T04:19:46.310 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-21T04:19:46.311 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.312 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.313 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.314 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.315 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T04:19:46.316 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T04:19:46.317 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.318 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T04:19:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.319 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-21T04:19:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-21T04:19:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T04:19:46.320 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:46.321 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.322 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.323 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.324 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.325 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-21T04:19:46.326 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-21T04:19:46.327 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.328 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.329 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.330 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nginx": { 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nginx", 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.331 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nginx container image", 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T04:19:46.332 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.333 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T04:19:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-21T04:19:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.334 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_oauth2_proxy": { 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "oauth2-proxy container image", 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.335 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.336 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.337 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.338 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba_metrics": { 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba_metrics", 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.339 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.340 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.341 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:46.342 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.343 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-21T04:19:46.344 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.345 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-21T04:19:46.346 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-21T04:19:46.347 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-21T04:19:46.348 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-21T04:19:46.349 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-21T04:19:46.350 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.351 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.352 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.353 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.354 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.355 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.356 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.357 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.358 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.359 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T04:19:46.360 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.361 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.362 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.363 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.364 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.365 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.366 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.367 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.368 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.369 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.370 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.371 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T04:19:46.372 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-21T04:19:46.373 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.374 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.375 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.376 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_keepalive_count_max": { 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.377 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_keepalive_interval": { 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_keepalive_interval", 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T04:19:46.378 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.379 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.380 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.381 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.382 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.383 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.384 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.385 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.386 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.387 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.388 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.389 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.390 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.391 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-21T04:19:46.392 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.393 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.394 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.395 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.396 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.397 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.398 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.399 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.400 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.401 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.402 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.403 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.404 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.405 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.406 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.407 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.408 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.409 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-21T04:19:46.410 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.411 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.412 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.413 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.414 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "[]", 2024-09-21T04:19:46.415 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.416 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "{}", 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.417 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.418 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.419 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.420 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T04:19:46.421 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T04:19:46.422 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.423 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.424 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.425 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T04:19:46.426 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T04:19:46.427 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T04:19:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.428 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.429 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.430 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.431 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.432 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.433 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.434 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.435 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.436 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.437 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.438 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.439 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-21T04:19:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-21T04:19:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.440 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.441 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.442 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.443 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.444 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.445 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.446 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.447 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.448 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.449 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-21T04:19:46.450 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T04:19:46.451 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.452 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.453 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.454 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.455 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.456 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.457 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "sso_oauth2": { 2024-09-21T04:19:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sso_oauth2", 2024-09-21T04:19:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.458 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.459 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-21T04:19:46.460 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.461 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.462 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.463 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.464 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.465 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.466 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.467 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.468 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T04:19:46.469 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.470 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.471 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.472 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.473 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.474 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.475 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.476 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.477 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.478 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.479 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.480 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.481 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.482 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.483 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.484 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.485 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.486 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.487 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-21T04:19:46.488 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.489 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-21T04:19:46.490 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.491 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.492 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.493 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.494 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.495 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-21T04:19:46.496 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.497 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.498 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.499 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:46.500 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.501 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-21T04:19:46.502 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.503 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.504 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.505 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.506 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.507 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.508 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.509 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.510 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.511 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.512 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.513 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.514 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.515 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.516 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-21T04:19:46.517 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.518 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.519 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.520 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.521 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.522 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.523 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.524 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.525 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-21T04:19:46.526 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T04:19:46.527 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.528 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.529 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.530 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.531 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.532 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.533 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.534 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.535 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.536 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-21T04:19:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.537 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.538 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.539 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.540 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.541 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.542 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.543 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.544 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.545 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.546 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.547 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.548 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.549 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.550 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.551 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.552 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.553 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.554 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.555 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.556 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.557 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.558 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.559 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.560 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.561 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-21T04:19:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.562 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-21T04:19:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-21T04:19:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.563 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T04:19:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.564 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.565 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.566 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.567 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.568 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.569 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.570 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.571 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.572 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.573 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.574 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.575 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.576 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.577 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.578 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.579 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.580 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.581 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.582 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.583 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.584 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.585 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.586 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.587 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.588 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.589 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.590 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:46.591 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.592 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.593 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.594 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.595 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.596 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.597 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.598 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.599 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.600 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.601 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.602 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.603 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.604 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.605 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.606 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.607 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.608 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.609 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.610 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.611 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.612 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.613 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.614 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.615 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.616 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-21T04:19:46.617 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.618 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.619 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.620 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.621 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.622 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.623 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.624 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.625 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.626 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.627 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.628 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.629 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.630 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-21T04:19:46.631 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.632 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.633 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.634 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.635 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.636 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.637 INFO:teuthology.orchestra.run.smithi022.stdout: "max_requests": { 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_requests", 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.638 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.639 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.640 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.641 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.642 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.643 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.644 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.645 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.646 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.647 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.648 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.649 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.650 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.651 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.652 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.653 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.654 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.655 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.656 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.657 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.658 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.659 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.660 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.661 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.662 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.663 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.664 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-21T04:19:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-21T04:19:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.665 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.666 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-21T04:19:46.667 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.668 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.669 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-21T04:19:46.670 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-21T04:19:46.671 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.672 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-21T04:19:46.673 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.674 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-21T04:19:46.675 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.676 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.677 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smb", 2024-09-21T04:19:46.678 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "internal_store_backend": { 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "internal_store_backend", 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T04:19:46.679 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.680 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.681 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.682 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.683 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.684 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.685 INFO:teuthology.orchestra.run.smithi022.stdout: "update_orchestration": { 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "update_orchestration", 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.686 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.687 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.688 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.689 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.690 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.691 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.692 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.693 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.694 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.695 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.696 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.697 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.698 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.699 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.700 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.701 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.702 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.703 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.704 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.705 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.706 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.707 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.708 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.709 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.710 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.711 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.712 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.713 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.714 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.715 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.716 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.717 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.718 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.719 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.720 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.721 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.722 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T04:19:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.723 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-21T04:19:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-21T04:19:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.724 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.725 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.726 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.727 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.728 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.729 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-21T04:19:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-21T04:19:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.730 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:46.731 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-21T04:19:46.732 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.733 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.734 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.735 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.736 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.737 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.738 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.739 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.740 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.741 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.742 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.743 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.744 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.745 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.746 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.747 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.748 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.749 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.750 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.751 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.752 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.753 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.754 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.755 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.756 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.757 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.758 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-21T04:19:46.759 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.760 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.761 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.762 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.763 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-21T04:19:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-21T04:19:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-21T04:19:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.764 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-21T04:19:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.765 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-21T04:19:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-21T04:19:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.766 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.767 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.768 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.769 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.770 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.771 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.772 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.773 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.774 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.775 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.776 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-21T04:19:46.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.779 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "modules": [ 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "dashboard", 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "iostat", 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "nfs", 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "restful" 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "available_modules": [ 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "alerts", 2024-09-21T04:19:46.780 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How frequently to reexamine health status", 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.781 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.782 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.783 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.784 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.785 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.786 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_destination": { 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_destination", 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.787 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_from_name": { 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_from_name", 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "Ceph", 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.788 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Email From: name", 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_host": { 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_host", 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.789 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP server", 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_password": { 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_password", 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.790 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Password to authenticate with", 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_port": { 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_port", 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "465", 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.791 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP port", 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_sender": { 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_sender", 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.792 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SMTP envelope sender", 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_ssl": { 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_ssl", 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.793 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "smtp_user": { 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smtp_user", 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "User to authenticate as", 2024-09-21T04:19:46.794 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.795 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "balancer", 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "active": { 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "active", 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.796 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically balance PGs across cluster", 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_time": { 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_time", 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0000", 2024-09-21T04:19:46.797 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "beginning time of day to automatically balance", 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "begin_weekday": { 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "begin_weekday", 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.798 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_max_iterations": { 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_max_iterations", 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:46.799 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "25", 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "250", 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_metrics": { 2024-09-21T04:19:46.800 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_metrics", 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "pgs,objects,bytes", 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.801 INFO:teuthology.orchestra.run.smithi022.stdout: "crush_compat_step": { 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crush_compat_step", 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.5", 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0.001", 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "0.999", 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "aggressiveness of optimization", 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.802 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "end_time": { 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_time", 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2359", 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ending time of day to automatically balance", 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.803 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "end_weekday": { 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "end_weekday", 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "0", 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "6", 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.804 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.805 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.806 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.807 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.808 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "min_score": { 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_score", 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.809 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.810 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "upmap", 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "crush-compat", 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "none", 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "read", 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap", 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap-read" 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Balancer mode", 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.811 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_ids": { 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_ids", 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.812 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.813 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.814 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_deviation": { 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_deviation", 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.815 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "upmap_max_optimizations": { 2024-09-21T04:19:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "upmap_max_optimizations", 2024-09-21T04:19:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.816 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-21T04:19:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.817 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.818 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm", 2024-09-21T04:19:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_down_multiplier": { 2024-09-21T04:19:46.819 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_down_multiplier", 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.820 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_refresh_rate": { 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_refresh_rate", 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "20", 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.821 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "agent_starting_port": { 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "agent_starting_port", 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4721", 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.822 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_ptrace": { 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_ptrace", 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.823 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_interval": { 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_interval", 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.824 INFO:teuthology.orchestra.run.smithi022.stdout: "autotune_memory_target_ratio": { 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "autotune_memory_target_ratio", 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0.7", 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm_log_destination": { 2024-09-21T04:19:46.825 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cephadm_log_destination", 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "file", 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "file,syslog", 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "syslog" 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.826 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "cgroups_split": { 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cgroups_split", 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.827 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "config_checks_enabled": { 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_checks_enabled", 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.828 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "config_dashboard": { 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_dashboard", 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.829 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_alertmanager": { 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_alertmanager", 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.830 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_base": { 2024-09-21T04:19:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_base", 2024-09-21T04:19:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-21T04:19:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.831 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Container image name, without the tag", 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_elasticsearch": { 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_elasticsearch", 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.832 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "elasticsearch container image", 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_grafana": { 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_grafana", 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/grafana:10.4.8", 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.833 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_haproxy": { 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_haproxy", 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.834 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "HAproxy container image", 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_agent": { 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_agent", 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.835 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger agent container image", 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_collector": { 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_collector", 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger collector container image", 2024-09-21T04:19:46.836 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_jaeger_query": { 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_jaeger_query", 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Jaeger query container image", 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.837 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_keepalived": { 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_keepalived", 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.838 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Keepalived container image", 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_loki": { 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_loki", 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Loki container image", 2024-09-21T04:19:46.839 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nginx": { 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nginx", 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nginx container image", 2024-09-21T04:19:46.840 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_node_exporter": { 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_node_exporter", 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:46.841 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_nvmeof": { 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_nvmeof", 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.842 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Nvme-of container image", 2024-09-21T04:19:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_oauth2_proxy": { 2024-09-21T04:19:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_oauth2_proxy", 2024-09-21T04:19:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.843 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "oauth2-proxy container image", 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_prometheus": { 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_prometheus", 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.844 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-21T04:19:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Prometheus container image", 2024-09-21T04:19:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_promtail": { 2024-09-21T04:19:46.845 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_promtail", 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Promtail container image", 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.846 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba": { 2024-09-21T04:19:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba", 2024-09-21T04:19:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-21T04:19:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.847 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB container image", 2024-09-21T04:19:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_samba_metrics": { 2024-09-21T04:19:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_samba_metrics", 2024-09-21T04:19:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.848 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "container_image_snmp_gateway": { 2024-09-21T04:19:46.849 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_image_snmp_gateway", 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "SNMP Gateway container image", 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.850 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "container_init": { 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "container_init", 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Run podman/docker with `--init`", 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.851 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "daemon_cache_timeout": { 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "daemon_cache_timeout", 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.852 INFO:teuthology.orchestra.run.smithi022.stdout: "default_cephadm_command_timeout": { 2024-09-21T04:19:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_cephadm_command_timeout", 2024-09-21T04:19:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "900", 2024-09-21T04:19:46.853 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-21T04:19:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.854 INFO:teuthology.orchestra.run.smithi022.stdout: "default_registry": { 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "default_registry", 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "docker.io", 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.855 INFO:teuthology.orchestra.run.smithi022.stdout: "device_cache_timeout": { 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_cache_timeout", 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1800", 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache device inventory", 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "device_enhanced_scan": { 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_enhanced_scan", 2024-09-21T04:19:46.856 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "facts_cache_timeout": { 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "facts_cache_timeout", 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.857 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "seconds to cache host facts data", 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "grafana_dashboards_path": { 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "grafana_dashboards_path", 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.858 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "host_check_interval": { 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "host_check_interval", 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.859 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to perform a host check", 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "hw_monitoring": { 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hw_monitoring", 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.860 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "inventory_list_all": { 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "inventory_list_all", 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.861 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.862 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.863 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "log_refresh_metadata": { 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_refresh_metadata", 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.864 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.865 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.866 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.867 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.868 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.869 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "*", 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.870 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "max_count_per_host": { 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_count_per_host", 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.871 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of daemons per service per host", 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "max_osd_draining_count": { 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_osd_draining_count", 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-21T04:19:46.872 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "migration_current": { 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "migration_current", 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "internal - do not modify", 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.873 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "mode": { 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mode", 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "root", 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm-package", 2024-09-21T04:19:46.874 INFO:teuthology.orchestra.run.smithi022.stdout: "root" 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "mode for remote execution of cephadm", 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "oob_default_addr": { 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "oob_default_addr", 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "169.254.1.1", 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.875 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "prometheus_alerts_path": { 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus_alerts_path", 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.876 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_insecure": { 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_insecure", 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-21T04:19:46.877 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_password": { 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_password", 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.878 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_url": { 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_url", 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.879 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "registry_username": { 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "registry_username", 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.880 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "secure_monitoring_stack": { 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secure_monitoring_stack", 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.881 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "service_discovery_port": { 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "service_discovery_port", 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8765", 2024-09-21T04:19:46.882 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "cephadm service discovery port", 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.883 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_config_file": { 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_config_file", 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.884 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-21T04:19:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.885 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_keepalive_count_max": { 2024-09-21T04:19:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_keepalive_count_max", 2024-09-21T04:19:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-21T04:19:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.886 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-21T04:19:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "ssh_keepalive_interval": { 2024-09-21T04:19:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssh_keepalive_interval", 2024-09-21T04:19:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.887 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-21T04:19:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-21T04:19:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.888 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "use_agent": { 2024-09-21T04:19:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_agent", 2024-09-21T04:19:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.889 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-21T04:19:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "use_repo_digest": { 2024-09-21T04:19:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "use_repo_digest", 2024-09-21T04:19:46.890 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-21T04:19:46.891 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_failed_host_check": { 2024-09-21T04:19:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_failed_host_check", 2024-09-21T04:19:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.892 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if the host check fails", 2024-09-21T04:19:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_daemons": { 2024-09-21T04:19:46.893 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_daemons", 2024-09-21T04:19:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.894 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-21T04:19:46.895 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.895 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.895 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.895 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.895 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_on_stray_hosts": { 2024-09-21T04:19:46.895 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_on_stray_hosts", 2024-09-21T04:19:46.895 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.895 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.895 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-21T04:19:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.896 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crash", 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.897 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.898 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.899 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.900 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.901 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.902 INFO:teuthology.orchestra.run.smithi022.stdout: "retain_interval": { 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retain_interval", 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "31536000", 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.903 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_recent_interval": { 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_recent_interval", 2024-09-21T04:19:46.904 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1209600", 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.905 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dashboard", 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.906 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_HOST": { 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.907 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.908 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_ENABLED": { 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_ENABLED", 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.909 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.910 INFO:teuthology.orchestra.run.smithi022.stdout: "ENABLE_BROWSABLE_API": { 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.911 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-21T04:19:46.912 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-21T04:19:46.913 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-21T04:19:46.914 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-21T04:19:46.915 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.916 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.917 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.918 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_PASSWORD": { 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.919 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.920 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_URL": { 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_URL", 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.921 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_API_USERNAME": { 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.922 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.923 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.924 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.925 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-21T04:19:46.926 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-21T04:19:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.927 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.928 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.929 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "[]", 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.930 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "MULTICLUSTER_CONFIG": { 2024-09-21T04:19:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-21T04:19:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.931 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "{}", 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_HOST": { 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.932 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-21T04:19:46.933 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-21T04:19:46.934 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-21T04:19:46.935 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-21T04:19:46.936 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-21T04:19:46.937 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.938 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.939 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.940 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.941 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_ENABLED": { 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.942 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.943 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.944 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8", 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-21T04:19:46.945 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "45", 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ACCESS_KEY": { 2024-09-21T04:19:46.946 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-21T04:19:46.947 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "admin", 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SECRET_KEY": { 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-21T04:19:46.948 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "RGW_API_SSL_VERIFY": { 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.949 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "UNSAFE_TLS_v1_2": { 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.950 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.951 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.952 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.953 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "cross_origin_url": { 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cross_origin_url", 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.954 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "crt_file": { 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "crt_file", 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.955 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "debug": { 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "debug", 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.956 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Enable/disable debug options", 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "jwt_token_ttl": { 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "jwt_token_ttl", 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "28800", 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.957 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.958 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.959 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.960 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.961 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.962 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.963 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "motd": { 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "motd", 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.964 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "The message of the day", 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect_resolve_ip_addr": { 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "redirect_resolve_ip_addr", 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.965 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.966 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8080", 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.967 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.968 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.969 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl_server_port": { 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl_server_port", 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8443", 2024-09-21T04:19:46.970 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "sso_oauth2": { 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sso_oauth2", 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.971 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.972 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "redirect", 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "redirect" 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-21T04:19:46.973 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "url_prefix": { 2024-09-21T04:19:46.974 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url_prefix", 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.975 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_monitoring": { 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_monitoring", 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.976 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "monitor device health metrics", 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.977 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.978 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.979 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.980 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.981 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "mark_out_threshold": { 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mark_out_threshold", 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "2419200", 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.982 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "pool_name": { 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pool_name", 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "device_health_metrics", 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.983 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "retention_period": { 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "retention_period", 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15552000", 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.984 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long to retain device health metrics", 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_frequency": { 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_frequency", 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.985 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "self_heal": { 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "self_heal", 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.986 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.987 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how frequently to wake up and check device health", 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.988 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "warn_threshold": { 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "warn_threshold", 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7257600", 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.989 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "diskprediction_local", 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:46.990 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.991 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.992 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.993 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:46.994 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.995 INFO:teuthology.orchestra.run.smithi022.stdout: "predict_interval": { 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predict_interval", 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "86400", 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.996 INFO:teuthology.orchestra.run.smithi022.stdout: "predictor_model": { 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "predictor_model", 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "prophetstor", 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.997 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "600", 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.998 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:46.999 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "influx", 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": false, 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "influxdb python module not found", 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: "batch_size": { 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "batch_size", 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.000 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5000", 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "database": { 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "database", 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.001 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "ceph", 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": { 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "hostname", 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.002 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server hostname", 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.003 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "30", 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "5", 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.004 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.005 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.006 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.007 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.008 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "password": { 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "password", 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.009 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "password of InfluxDB server user", 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "port": { 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "port", 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.010 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "8086", 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "InfluxDB server port", 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.011 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "ssl": { 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ssl", 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.012 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "false", 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "threads": { 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threads", 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.013 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "32", 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "username": { 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "username", 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.014 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "username of InfluxDB server user", 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "verify_ssl": { 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "verify_ssl", 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.015 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "true", 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "insights", 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.016 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.017 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.018 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.019 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.020 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.021 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.022 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "iostat", 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.023 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.024 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.025 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.026 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.027 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.028 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "k8sevents", 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_event_retention_days": { 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "ceph_event_retention_days", 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.029 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "7", 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "config_check_secs": { 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "config_check_secs", 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.030 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "10", 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.031 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.032 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.033 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.034 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.035 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.036 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "localpool", 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "failure_domain": { 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "failure_domain", 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.037 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "host", 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "failure domain for any created local pool", 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.038 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.039 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.040 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.041 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.042 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "min_size": { 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "min_size", 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.043 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default min_size for any created local pool", 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "num_rep": { 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "num_rep", 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.044 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3", 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default replica count for any created local pool", 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_num": { 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_num", 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.045 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "128", 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "default pg_num for any created local pool", 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "prefix": { 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prefix", 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.046 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "name prefix for any created local pool", 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.047 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "subtree": { 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "subtree", 2024-09-21T04:19:47.048 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "rack", 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.049 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mds_autoscaler", 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.050 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.051 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.052 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.053 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.054 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.055 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirroring", 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.056 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.057 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.058 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.059 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.060 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.061 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "nfs", 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.062 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.063 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.064 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.065 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.066 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.067 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-21T04:19:47.068 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "fail_fs": { 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "fail_fs", 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.069 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.070 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.071 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.072 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.073 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator": { 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "orchestrator", 2024-09-21T04:19:47.074 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "cephadm", 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "rook", 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "test_orchestrator" 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Orchestrator backend", 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.075 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.076 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_perf_query", 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.077 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.078 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.079 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.080 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.081 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.082 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "osd_support", 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.083 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.084 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.085 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.086 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.087 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.088 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.089 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "pg_autoscaler", 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.090 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.091 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.092 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.093 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.094 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.095 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.096 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "threshold": { 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "threshold", 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "3.0", 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1.0", 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "scaling threshold", 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.097 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "progress", 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_pg_recovery_event": { 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_pg_recovery_event", 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.098 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.099 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.100 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.101 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.102 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.103 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.104 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "max_completed_events": { 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_completed_events", 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "50", 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.105 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "number of past completed events to remember", 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "sleep_interval": { 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sleep_interval", 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.106 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "how long the module is going to sleep", 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.107 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "prometheus", 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: "cache": { 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "cache", 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.108 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "exclude_perf_counters": { 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "exclude_perf_counters", 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.109 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.110 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.111 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.112 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.113 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.114 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools": { 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools", 2024-09-21T04:19:47.115 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-21T04:19:47.116 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "300", 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "scrape_interval": { 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "scrape_interval", 2024-09-21T04:19:47.117 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15.0", 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-21T04:19:47.118 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "::", 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-21T04:19:47.119 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "9283", 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.120 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "stale_cache_strategy": { 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stale_cache_strategy", 2024-09-21T04:19:47.121 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "log", 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_behaviour": { 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_behaviour", 2024-09-21T04:19:47.122 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "default", 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "default", 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "error" 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.123 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "standby_error_status_code": { 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "standby_error_status_code", 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "400", 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "599", 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.124 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.125 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.127 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.128 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.129 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_snap_create": { 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_snap_create", 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10", 2024-09-21T04:19:47.130 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "mirror_snapshot_schedule": { 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "mirror_snapshot_schedule", 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.131 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.132 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "trash_purge_schedule": { 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "trash_purge_schedule", 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.133 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "restful", 2024-09-21T04:19:47.134 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "enable_auth": { 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enable_auth", 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.135 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "key_file": { 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "key_file", 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.136 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.137 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.138 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.139 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.140 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.141 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "max_requests": { 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_requests", 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "500", 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-21T04:19:47.142 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "server_addr": { 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_addr", 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.143 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "server_port": { 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "server_port", 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.144 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.145 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rgw", 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.146 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.147 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.148 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.149 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.150 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "secondary_zone_period_retry_limit": { 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-21T04:19:47.151 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "5", 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.152 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.153 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rook", 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.154 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.155 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.156 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.157 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.158 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.159 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "storage_class": { 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "storage_class", 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "local", 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.160 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "selftest", 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.161 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.162 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.163 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.164 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.165 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "roption1": { 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption1", 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.166 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "roption2": { 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "roption2", 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "xyz", 2024-09-21T04:19:47.167 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption1": { 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption1", 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.168 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption2": { 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption2", 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.169 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption3": { 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption3", 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "float", 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.170 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption4": { 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption4", 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.171 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption5": { 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption5", 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.172 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption6": { 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption6", 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:47.173 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "rwoption7": { 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rwoption7", 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.174 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "1", 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "42", 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.175 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "testkey": { 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testkey", 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.176 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "testlkey": { 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testlkey", 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.177 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "testnewline": { 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "testnewline", 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.178 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "smb", 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.179 INFO:teuthology.orchestra.run.smithi022.stdout: "internal_store_backend": { 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "internal_store_backend", 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.180 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.181 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.182 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.183 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.184 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.185 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "update_orchestration": { 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "update_orchestration", 2024-09-21T04:19:47.186 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.187 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snap_schedule", 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "allow_m_granularity": { 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "allow_m_granularity", 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "allow minute scheduled snapshots", 2024-09-21T04:19:47.188 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "dump_on_update": { 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "dump_on_update", 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "dump database to debug log on update", 2024-09-21T04:19:47.189 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.190 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.191 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.192 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.193 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.194 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.195 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "stats", 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.196 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.197 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.198 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.199 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.200 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.201 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "status", 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.202 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.203 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.204 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.205 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.206 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.207 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telegraf", 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "address": { 2024-09-21T04:19:47.208 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "address", 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:47.209 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "15", 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.210 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.211 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.212 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.213 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.214 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.215 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "telemetry", 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.216 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_basic": { 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_basic", 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.217 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_crash": { 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_crash", 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.218 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_device": { 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_device", 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.219 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_ident": { 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_ident", 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "channel_perf": { 2024-09-21T04:19:47.220 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "channel_perf", 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "contact": { 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "contact", 2024-09-21T04:19:47.221 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "description": { 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "description", 2024-09-21T04:19:47.222 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "device_url": { 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "device_url", 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.223 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "enabled": { 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "enabled", 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.224 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.225 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "24", 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "8", 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "last_opt_revision": { 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "last_opt_revision", 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.226 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "1", 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard": { 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard", 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.227 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "leaderboard_description": { 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "leaderboard_description", 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.228 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.229 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.230 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.231 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.232 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.233 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "organization": { 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "organization", 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.234 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "proxy": { 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "proxy", 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.235 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.236 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "url": { 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "url", 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-21T04:19:47.237 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "test_orchestrator", 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.238 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.239 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.240 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.241 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.242 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.243 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.245 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.247 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.248 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.249 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "max_concurrent_clones": { 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "max_concurrent_clones", 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "4", 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.250 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "periodic_async_work": { 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "periodic_async_work", 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Periodically check for async work", 2024-09-21T04:19:47.251 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_delay": { 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_delay", 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.252 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "snapshot_clone_no_wait": { 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "snapshot_clone_no_wait", 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "True", 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.254 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix", 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "can_run": true, 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "error_string": "", 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "module_options": { 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "discovery_interval": { 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "discovery_interval", 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "uint", 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "100", 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.255 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "identifier": { 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "identifier", 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.256 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "interval": { 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "interval", 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "secs", 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "60", 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.257 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "log_level": { 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_level", 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.258 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster": { 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster", 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.259 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_cluster_level": { 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_cluster_level", 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.260 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "info", 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [ 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "", 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "critical", 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "debug", 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "error", 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "info", 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "warning" 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.261 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "log_to_file": { 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "log_to_file", 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "bool", 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "False", 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.262 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "sqlite3_killpoint": { 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "sqlite3_killpoint", 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "dev", 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 1, 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "0", 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.263 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_host": { 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_host", 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "", 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.264 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_port": { 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_port", 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "int", 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "10051", 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "zabbix_sender": { 2024-09-21T04:19:47.265 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "zabbix_sender", 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "str", 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "level": "advanced", 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "flags": 0, 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "min": "", 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "max": "", 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "enum_allowed": [], 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "desc": "", 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "long_desc": "", 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "tags": [], 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: "see_also": [] 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.266 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "services": { 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "dashboard": "https://172.21.15.22:8443/" 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "always_on_modules": { 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "octopus": [ 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-21T04:19:47.267 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "pacific": [ 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.268 INFO:teuthology.orchestra.run.smithi022.stdout: "quincy": [ 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "reef": [ 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-21T04:19:47.269 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: ], 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "squid": [ 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "balancer", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "crash", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "devicehealth", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "orchestrator", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "pg_autoscaler", 2024-09-21T04:19:47.270 INFO:teuthology.orchestra.run.smithi022.stdout: "progress", 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: "rbd_support", 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: "status", 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: "telemetry", 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: "volumes" 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: "last_failure_osd_epoch": 3, 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: "active_clients": [ 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "devicehealth", 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-21T04:19:47.271 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 2582871604 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "libcephsqlite", 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1961608017 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-21T04:19:47.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "rbd_support", 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 1374607005 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "volumes", 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: "addrvec": [ 2024-09-21T04:19:47.273 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-09-21T04:19:47.274 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v2", 2024-09-21T04:19:47.274 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "172.21.15.22:0", 2024-09-21T04:19:47.274 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 110177566 2024-09-21T04:19:47.274 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.274 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-21T04:19:47.274 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:47.274 INFO:teuthology.orchestra.run.smithi022.stdout: ] 2024-09-21T04:19:47.274 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:19:47.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:45 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1198296741' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T04:19:47.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:45 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/4070650142' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T04:19:47.275 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:45 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/4158684244' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T04:19:47.276 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:46 smithi060 ceph-mon[33722]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 2.2 MiB/s wr, 259 op/s 2024-09-21T04:19:47.276 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:45 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1198296741' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T04:19:47.276 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:45 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/4070650142' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T04:19:47.276 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:45 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/4158684244' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T04:19:47.276 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:46 smithi073 ceph-mon[34443]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 2.2 MiB/s wr, 259 op/s 2024-09-21T04:19:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 -- 172.21.15.22:0/4158684244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87a40b6510 msgr2=0x7f87a40b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87a40b6510 0x7f87a40b8a20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f87ac005fd0 tx=0x7f87ac005850 comp rx=0 tx=0).stop 2024-09-21T04:19:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 -- 172.21.15.22:0/4158684244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87bc1050e0 msgr2=0x7f87bc19b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:19:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87bc1050e0 0x7f87bc19b030 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f87b4009dc0 tx=0x7f87b4003ba0 comp rx=0 tx=0).stop 2024-09-21T04:19:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 -- 172.21.15.22:0/4158684244 shutdown_connections 2024-09-21T04:19:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f87a40b6510 0x7f87a40b8a20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f87bc104740 0x7f87bc19a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87bc1050e0 0x7f87bc19b030 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 --2- 172.21.15.22:0/4158684244 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87bc1036c0 0x7f87bc199e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:19:47.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 -- 172.21.15.22:0/4158684244 >> 172.21.15.22:0/4158684244 conn(0x7f87bc0ff000 msgr2=0x7f87bc107a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:19:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 -- 172.21.15.22:0/4158684244 shutdown_connections 2024-09-21T04:19:47.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:19:45.700+0000 7f87c22a2640 1 -- 172.21.15.22:0/4158684244 wait complete. 2024-09-21T04:19:47.317 DEBUG:tasks.check_counter:Getting stats from a 2024-09-21T04:19:47.317 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.a perf dump 2024-09-21T04:19:47.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:45 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1198296741' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} : dispatch 2024-09-21T04:19:47.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:45 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/4070650142' entity='client.admin' cmd={"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} : dispatch 2024-09-21T04:19:47.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:45 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/4158684244' entity='client.admin' cmd={"prefix": "mgr dump", "format": "json-pretty"} : dispatch 2024-09-21T04:19:47.318 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:46 smithi022 ceph-mon[31015]: pgmap v893: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 2.2 MiB/s wr, 259 op/s 2024-09-21T04:19:47.593 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:19:48.232 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 2469, 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2471, 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 2249871, 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 785143, 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 6, 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.366875725, 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.126986833, 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.071690713, 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.146004037, 2024-09-21T04:19:48.233 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2469, 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.166574773, 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000067466 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:19:48.234 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1393, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 1367, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 987160, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 529488, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 5, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.188013938, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.077999996, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.059539461, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.045837451, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1366, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.076390021, 2024-09-21T04:19:48.235 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000055922 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 730176, 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 198064 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 7, 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 247, 2024-09-21T04:19:48.236 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 3532, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 601118, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 6, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.028707222, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.022115845, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.004595157, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000018660, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 246, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.019775238, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000080387 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:48.237 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 600800 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 1, 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.238 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-MDSRank": { 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 5784, 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.205335410, 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000035500 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-PurgeQueue": { 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.239 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "request": 0, 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "reply": 0, 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "reply_latency": { 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_reply": 0, 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "forward": 0, 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_complete": 0, 2024-09-21T04:19:48.240 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_keys": 0, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_commit": 0, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_split": 0, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_merge": 0, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes": 275, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_top": 0, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_bottom": 275, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pin_tail": 0, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pinned": 275, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_expired": 0, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_with_caps": 0, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": 0, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "subtrees": 9, 2024-09-21T04:19:48.241 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_hit": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_forward": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_discover": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_remote_ino": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_lock": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "load_cent": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "q": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "exported": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "exported_inodes": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "imported": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "imported_inodes": 0, 2024-09-21T04:19:48.242 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_dir_fetch": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_peer_discover": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rfiles": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rbytes": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rsnaps": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_set_tag": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:19:48.243 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_file_inodes": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_grant": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps_dirty": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_cap_release": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "process_request_cap_release": 0 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache": { 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update": 0, 2024-09-21T04:19:48.244 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update_receipt": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_try_discover": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_send_discover": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_handle_discover": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_delayed": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_created": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_enqueued": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_reintegrated": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_migrated": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_processing": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:19:48.245 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_started": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_completed": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_path": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_inode": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_exportdir": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_flush": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragstats": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_inodestats": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "uninline_started": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "uninline_succeeded": 0, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "uninline_write_failed": 0 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.246 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log": { 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "evlrg": 0, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "evadd": 0, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "evex": 0, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "evtrm": 0, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "ev": 1273, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "evexg": 0, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "evexd": 0, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "segadd": 0, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "segex": 0, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "segtrm": 0, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "seg": 3, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "segmjr": 2, 2024-09-21T04:19:48.247 INFO:teuthology.orchestra.run.smithi022.stdout: "segexg": 0, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "segexd": 0, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "expos": 4194304, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "wrpos": 5715820, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "rdpos": 5714760, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "jlat": { 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "replayed": 1273 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mem": { 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "ino": 273, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "ino+": 275, 2024-09-21T04:19:48.248 INFO:teuthology.orchestra.run.smithi022.stdout: "ino-": 2, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "dir": 17, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "dir+": 17, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "dir-": 0, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "dn": 275, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "dn+": 275, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "dn-": 0, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "cap": 0, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "cap+": 0, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "cap-": 0, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "rss": 119428, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "heap": 317464576 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_server": { 2024-09-21T04:19:48.249 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_client_request": 0, 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_server_request": 0, 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_request": 0, 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_session": 0, 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_peer_request": 0, 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "req_create_latency": { 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getattr_latency": { 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.250 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getfilelock_latency": { 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "req_link_latency": { 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookup_latency": { 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.251 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookuphash_latency": { 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupino_latency": { 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupname_latency": { 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.252 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupparent_latency": { 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupsnap_latency": { 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lssnap_latency": { 2024-09-21T04:19:48.253 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.254 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.254 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.254 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.254 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mkdir_latency": { 2024-09-21T04:19:48.254 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.254 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.254 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mknod_latency": { 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mksnap_latency": { 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "req_open_latency": { 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.255 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: "req_readdir_latency": { 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rename_latency": { 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.256 INFO:teuthology.orchestra.run.smithi022.stdout: "req_renamesnap_latency": { 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "req_snapdiff_latency": { 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmdir_latency": { 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.257 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmsnap_latency": { 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmxattr_latency": { 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setattr_latency": { 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.258 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setdirlayout_latency": { 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setfilelock_latency": { 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setlayout_latency": { 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.259 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setxattr_latency": { 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "req_symlink_latency": { 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "req_unlink_latency": { 2024-09-21T04:19:48.260 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getvxattr_latency": { 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessions": { 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "session_count": 1, 2024-09-21T04:19:48.261 INFO:teuthology.orchestra.run.smithi022.stdout: "session_add": 1, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "session_remove": 0, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_open": 1, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_stale": 0, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "total_load": 0, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "average_load": 0, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "avg_session_uptime": 2137, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "mdthresh_evicted": 0 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:19:48.262 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:19:48.263 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-21T04:19:48.264 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 190207, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 53, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-21T04:19:48.265 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 8960, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 169, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 799152, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2611, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.266 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter": { 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "op_active": 0, 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "op_laggy": 0, 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send": 3512, 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send_bytes": 21, 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "op_resend": 3, 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "op_reply": 3512, 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "op_latency": { 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3512, 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 2.906962729, 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000827722 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "op_inflight": 0, 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "oplen_avg": { 2024-09-21T04:19:48.267 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3512, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 3513 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "op": 3512, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "op_r": 3512, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "op_w": 0, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "op_rmw": 0, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "op_pg": 0, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_stat": 2180, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_create": 0, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_read": 1330, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_write": 0, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writefull": 0, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writesame": 0, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_append": 0, 2024-09-21T04:19:48.268 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_zero": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_truncate": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_delete": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_mapext": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_sparse_read": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_clonerange": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_getxattr": 1, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_setxattr": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_rmxattr": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_call": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_watch": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_notify": 0, 2024-09-21T04:19:48.269 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_other": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_active": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_send": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_resend": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_ping": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_active": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_send": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_resend": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_active": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_send": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_resend": 0, 2024-09-21T04:19:48.270 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_active": 0, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_send": 0, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_resend": 0, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "command_active": 0, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "command_send": 0, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "command_resend": 0, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "map_epoch": 85, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "map_full": 0, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "map_inc": 2, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_sessions": 5, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_open": 7, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_close": 2, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_laggy": 0, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_wr": 0, 2024-09-21T04:19:48.271 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_rd": 2, 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_del": 0 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "oft": { 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_objs": 0, 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_updates": 0, 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_removes": 0 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "purge_queue": { 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops": 0, 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing": 0, 2024-09-21T04:19:48.272 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_high_water": 0, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed_ops": 0, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed": 0, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_item_in_journal": 0 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 3865, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 2871773, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 3865, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-21T04:19:48.273 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 3865, 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 2871773, 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_bytes": { 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:48.274 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 3512, 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 1521521, 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 3512, 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 1521521, 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:48.275 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_ops": { 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 1024, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 3512, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 3512, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 3512, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 3512, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.276 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-21T04:19:48.277 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle-0x557426099380": { 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:48.278 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: "trackedop": { 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_ops_count": 0 2024-09-21T04:19:48.279 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:48.280 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:19:48.897 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:48 smithi022 ceph-mon[31015]: pgmap v894: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1023 KiB/s wr, 121 op/s 2024-09-21T04:19:48.927 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-09-21T04:19:48.927 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-09-21T04:19:48.927 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-09-21T04:19:48.927 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-09-21T04:19:48.927 DEBUG:tasks.check_counter:Getting stats from d 2024-09-21T04:19:48.927 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.d perf dump 2024-09-21T04:19:49.005 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:48 smithi060 ceph-mon[33722]: pgmap v894: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1023 KiB/s wr, 121 op/s 2024-09-21T04:19:49.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:48 smithi073 ceph-mon[34443]: pgmap v894: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 1023 KiB/s wr, 121 op/s 2024-09-21T04:19:49.186 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:19:49.669 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:19:49.670 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:19:49.670 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 331, 2024-09-21T04:19:49.670 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 326, 2024-09-21T04:19:49.670 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 561952, 2024-09-21T04:19:49.670 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 200688, 2024-09-21T04:19:49.670 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-21T04:19:49.670 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-21T04:19:49.670 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.069275956, 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.029668742, 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.047238457, 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 326, 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.024513292, 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000075194 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:49.671 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 561952, 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 200688 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 2, 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 248, 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 320, 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 204384, 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-21T04:19:49.672 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.028687091, 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.021233943, 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.002684326, 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 246, 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.015714961, 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000063881 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:49.673 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 204384 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 0, 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2, 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 0, 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 0, 2024-09-21T04:19:49.674 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.000400388, 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000000000, 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.000319169, 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.675 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.676 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:19:49.677 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:19:49.678 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:19:49.679 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148744, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 30, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:19:49.680 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 968, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-21T04:19:49.681 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 329, 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 512799, 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 329, 2024-09-21T04:19:49.682 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-21T04:19:49.683 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-21T04:19:49.683 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 329, 2024-09-21T04:19:49.683 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 512799, 2024-09-21T04:19:49.683 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:49.683 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:49.683 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:49.683 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:49.683 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:49.683 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:49.683 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:19:50.365 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-21T04:19:50.365 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-21T04:19:50.365 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-21T04:19:50.365 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-21T04:19:50.365 DEBUG:tasks.check_counter:Getting stats from g 2024-09-21T04:19:50.365 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.g perf dump 2024-09-21T04:19:50.625 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:19:50.995 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:50 smithi022 ceph-mon[31015]: pgmap v895: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-21T04:19:51.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:50 smithi073 ceph-mon[34443]: pgmap v895: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-21T04:19:51.120 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:19:51.120 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:19:51.120 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 1142, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 1144, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 383657, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 363157, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 6, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.187676353, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.082865052, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.034535276, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.057143338, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 1142, 2024-09-21T04:19:51.121 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.077618822, 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000067967 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 2811, 2024-09-21T04:19:51.122 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 2783, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 4119275, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 979883, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 3, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.327462406, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.119631760, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.092557328, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.105099195, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 2783, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.188182955, 2024-09-21T04:19:51.123 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000067618 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 733392, 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 199136 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 5, 2024-09-21T04:19:51.124 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 248, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 1668, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 601509, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 8, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 4, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.027631396, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.022393868, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.002957342, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000064393, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 246, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.014880632, 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000060490 2024-09-21T04:19:51.125 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 600544 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 1, 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.126 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-MDSRank": { 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 5915, 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.190661695, 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000032233 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "finisher-PurgeQueue": { 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "queue_len": 0, 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "complete_latency": { 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.127 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "mds": { 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "request": 0, 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "reply": 0, 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "reply_latency": { 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_reply": 0, 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "forward": 0, 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_complete": 0, 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_fetch_keys": 0, 2024-09-21T04:19:51.128 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_commit": 0, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_split": 0, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_merge": 0, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes": 658, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_top": 5, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_bottom": 653, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pin_tail": 0, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_pinned": 651, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_expired": 0, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "inodes_with_caps": 0, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "caps": 0, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "subtrees": 10, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse": 0, 2024-09-21T04:19:51.129 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_hit": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_forward": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_discover": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_remote_ino": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "traverse_lock": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "load_cent": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "q": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "exported": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "exported_inodes": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "imported": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "imported_inodes": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_dir_fetch": 0, 2024-09-21T04:19:51.130 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "openino_peer_discover": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rfiles": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rbytes": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "root_rsnaps": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_set_tag": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "scrub_file_inodes": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:19:51.131 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_grant": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_caps_dirty": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_cap_release": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "process_request_cap_release": 0 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_cache": { 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_update_receipt": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_try_discover": 0, 2024-09-21T04:19:51.132 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_send_discover": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "dir_handle_discover": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_delayed": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_created": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_enqueued": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_reintegrated": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "strays_migrated": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_processing": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_started": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "recovery_completed": 0, 2024-09-21T04:19:51.133 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_path": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_quiesce_inode": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_exportdir": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_flush": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_fragstats": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "ireq_inodestats": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "uninline_started": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "uninline_succeeded": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "uninline_write_failed": 0 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_log": { 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "evlrg": 0, 2024-09-21T04:19:51.134 INFO:teuthology.orchestra.run.smithi022.stdout: "evadd": 0, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "evex": 0, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "evtrm": 0, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "ev": 1404, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "evexg": 0, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "evexd": 0, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "segadd": 0, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "segex": 0, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "segtrm": 0, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "seg": 3, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "segmjr": 2, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "segexg": 0, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "segexd": 0, 2024-09-21T04:19:51.135 INFO:teuthology.orchestra.run.smithi022.stdout: "expos": 4194304, 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "wrpos": 6957937, 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "rdpos": 6955184, 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "jlat": { 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "replayed": 1404 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_mem": { 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "ino": 638, 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "ino+": 647, 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "ino-": 9, 2024-09-21T04:19:51.136 INFO:teuthology.orchestra.run.smithi022.stdout: "dir": 35, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "dir+": 37, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "dir-": 2, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "dn": 658, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "dn+": 662, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "dn-": 4, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "cap": 0, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "cap+": 0, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "cap-": 0, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "rss": 121076, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "heap": 320622592 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_server": { 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_client_request": 0, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "dispatch_server_request": 0, 2024-09-21T04:19:51.137 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_request": 0, 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_client_session": 0, 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "handle_peer_request": 0, 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "req_create_latency": { 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getattr_latency": { 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getfilelock_latency": { 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.138 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: "req_link_latency": { 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookup_latency": { 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.139 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookuphash_latency": { 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupino_latency": { 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupname_latency": { 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.140 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupparent_latency": { 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lookupsnap_latency": { 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: "req_lssnap_latency": { 2024-09-21T04:19:51.141 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.142 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.142 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.142 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mkdir_latency": { 2024-09-21T04:19:51.142 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.142 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.142 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.142 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.142 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mknod_latency": { 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "req_mksnap_latency": { 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "req_open_latency": { 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.143 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: "req_readdir_latency": { 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rename_latency": { 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: "req_renamesnap_latency": { 2024-09-21T04:19:51.144 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: "req_snapdiff_latency": { 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmdir_latency": { 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.145 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmsnap_latency": { 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "req_rmxattr_latency": { 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setattr_latency": { 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.146 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setdirlayout_latency": { 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setfilelock_latency": { 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.147 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setlayout_latency": { 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "req_setxattr_latency": { 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "req_symlink_latency": { 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.148 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: "req_unlink_latency": { 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: "req_getvxattr_latency": { 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:51.149 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_sessions": { 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "session_count": 1, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "session_add": 2, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "session_remove": 1, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_open": 1, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "sessions_stale": 0, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "total_load": 0, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "average_load": 0, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "avg_session_uptime": 2139, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "mdthresh_evicted": 0 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:19:51.150 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:19:51.151 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-21T04:19:51.152 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 198287, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 57, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:19:51.153 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 8960, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 169, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 1870520, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 6145, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-21T04:19:51.154 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "objecter": { 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "op_active": 0, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "op_laggy": 0, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send": 3600, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "op_send_bytes": 21, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "op_resend": 3, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "op_reply": 3600, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "op_latency": { 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3600, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 5.340931885, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001483592 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "op_inflight": 0, 2024-09-21T04:19:51.155 INFO:teuthology.orchestra.run.smithi022.stdout: "oplen_avg": { 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3600, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 3601 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "op": 3600, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "op_r": 3600, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "op_w": 0, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "op_rmw": 0, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "op_pg": 0, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_stat": 2208, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_create": 0, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_read": 1390, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_write": 0, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writefull": 0, 2024-09-21T04:19:51.156 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_writesame": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_append": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_zero": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_truncate": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_delete": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_mapext": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_sparse_read": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_clonerange": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_getxattr": 1, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_setxattr": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_rmxattr": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:19:51.157 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_call": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_watch": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_notify": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "osdop_other": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_active": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_send": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_resend": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "linger_ping": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_active": 0, 2024-09-21T04:19:51.158 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_send": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "poolop_resend": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_active": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_send": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "poolstat_resend": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_active": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_send": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "statfs_resend": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "command_active": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "command_send": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "command_resend": 0, 2024-09-21T04:19:51.159 INFO:teuthology.orchestra.run.smithi022.stdout: "map_epoch": 85, 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "map_full": 0, 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "map_inc": 2, 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_sessions": 6, 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_open": 8, 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_session_close": 2, 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_laggy": 0, 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_wr": 0, 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_rd": 2, 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_del": 0 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "oft": { 2024-09-21T04:19:51.160 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_objs": 0, 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_updates": 0, 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "omap_total_removes": 0 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "purge_queue": { 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops": 0, 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing": 0, 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executing_high_water": 0, 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed_ops": 0, 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_executed": 0, 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: "pq_item_in_journal": 0 2024-09-21T04:19:51.161 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 3954, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 4127748, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 3954, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 3954, 2024-09-21T04:19:51.162 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 4127748, 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_bytes": { 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:51.163 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 3600, 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 2763638, 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 3600, 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 2763638, 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-objecter_ops": { 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:51.164 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 1024, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 3600, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 3600, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 3600, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 3600, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.165 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-21T04:19:51.166 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-write_buf_throttle-0x56453ccf52b0": { 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 3758096384, 2024-09-21T04:19:51.167 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 0, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 0, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 0, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 0, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:51.168 INFO:teuthology.orchestra.run.smithi022.stdout: "trackedop": { 2024-09-21T04:19:51.169 INFO:teuthology.orchestra.run.smithi022.stdout: "slow_ops_count": 0 2024-09-21T04:19:51.169 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:51.169 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:19:51.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:50 smithi060 ceph-mon[33722]: pgmap v895: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-09-21T04:19:51.973 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-09-21T04:19:51.973 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-09-21T04:19:51.973 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-09-21T04:19:51.974 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-09-21T04:19:51.974 DEBUG:tasks.check_counter:Getting stats from j 2024-09-21T04:19:51.974 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.j perf dump 2024-09-21T04:19:52.231 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:19:52.767 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 4, 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 4, 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 2944, 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 448, 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 0, 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.003238573, 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.000041166, 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.002135814, 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:52.768 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 3, 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.003937947, 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.001312649 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 2, 2024-09-21T04:19:52.769 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 249, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 320, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 204560, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 4, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 2, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.027560046, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.021898193, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.002672730, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 247, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.016067565, 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000065050 2024-09-21T04:19:52.770 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 204560 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_messages": 329, 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages": 326, 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_bytes": 559552, 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_bytes": 201520, 2024-09-21T04:19:52.771 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_created_connections": 2, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_active_connections": 1, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_total_time": 0.064753648, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_send_time": 0.030879966, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_recv_time": 0.038447390, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 325, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.023838564, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000073349 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:52.772 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_recv_encrypted_bytes": 559552, 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: "msgr_send_encrypted_bytes": 201520 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: "cct": { 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: "total_workers": 0, 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: "unhealthy_workers": 0 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: "mempool": { 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: "bloom_filter_items": 0, 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:19:52.773 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_extent_items": 0, 2024-09-21T04:19:52.774 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_blob_items": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_txc_items": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:19:52.775 INFO:teuthology.orchestra.run.smithi022.stdout: "bluestore_writing_items": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_bytes": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_items": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_bytes": 148744, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_anon_items": 30, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "buffer_meta_items": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_bytes": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_items": 0, 2024-09-21T04:19:52.776 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_mapbl_items": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_pglog_items": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_bytes": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_items": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_bytes": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "pgmap_items": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_bytes": 968, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_co_items": 2, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_bytes": 0, 2024-09-21T04:19:52.777 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_1_items": 0, 2024-09-21T04:19:52.778 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_bytes": 0, 2024-09-21T04:19:52.778 INFO:teuthology.orchestra.run.smithi022.stdout: "unittest_2_items": 0 2024-09-21T04:19:52.778 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-09-21T04:19:52.778 INFO:teuthology.orchestra.run.smithi022.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:19:52.778 INFO:teuthology.orchestra.run.smithi022.stdout: "val": 0, 2024-09-21T04:19:52.778 INFO:teuthology.orchestra.run.smithi022.stdout: "max": 104857600, 2024-09-21T04:19:52.778 INFO:teuthology.orchestra.run.smithi022.stdout: "get_started": 0, 2024-09-21T04:19:52.778 INFO:teuthology.orchestra.run.smithi022.stdout: "get": 331, 2024-09-21T04:19:52.778 INFO:teuthology.orchestra.run.smithi022.stdout: "get_sum": 513059, 2024-09-21T04:19:52.778 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: "get_or_fail_success": 331, 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: "take": 0, 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: "take_sum": 0, 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: "put": 331, 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: "put_sum": 513059, 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: "wait": { 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: "avgcount": 0, 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: "sum": 0.000000000, 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: "avgtime": 0.000000000 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-09-21T04:19:52.779 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-09-21T04:19:53.079 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:52 smithi022 ceph-mon[31015]: pgmap v896: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-21T04:19:53.079 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:52 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:19:53.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:52 smithi073 ceph-mon[34443]: pgmap v896: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-21T04:19:53.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:52 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:19:53.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:52 smithi060 ceph-mon[33722]: pgmap v896: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 21 KiB/s wr, 21 op/s 2024-09-21T04:19:53.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:52 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:19:53.452 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-21T04:19:53.452 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-21T04:19:53.452 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-21T04:19:53.452 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-21T04:19:53.452 DEBUG:tasks.check_counter:Getting stats from b 2024-09-21T04:19:53.453 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.b perf dump 2024-09-21T04:19:53.766 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:19:54.502 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T04:19:54.502 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:19:54.502 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 19165, 2024-09-21T04:19:54.502 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 21762, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 5825177, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 16590755, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 14, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 5, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 1.613016266, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.745149264, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.924386111, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.090916807, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 21761, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.670355904, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000030805 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.503 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 38034, 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.007536125, 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000198 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 54224, 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 32768 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 6552, 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 9674, 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 1893319, 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 7922478, 2024-09-21T04:19:54.504 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 13, 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 7, 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.706008541, 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.342684882, 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.326587208, 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.049072761, 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 9672, 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1.443377765, 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000149232 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 12676, 2024-09-21T04:19:54.505 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.002739937, 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000216 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 528816 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 10804, 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 16366, 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 3505474, 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 6902125, 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 83, 2024-09-21T04:19:54.506 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 7, 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 1.139327679, 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.590505161, 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.629875432, 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.013966498, 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 16365, 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.667783839, 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000040805 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 25128, 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.004946878, 2024-09-21T04:19:54.507 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000196 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 779088, 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 206592 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 4446, 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 2.961594429, 2024-09-21T04:19:54.508 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000666125 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 104, 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.004807489, 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000046225 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 5776, 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 4048, 2024-09-21T04:19:54.509 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 4048, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 26.861722075, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.006635800 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 1728, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 39, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 3, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 143, 2024-09-21T04:19:54.510 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 2, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 121, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 20, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 140, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 961, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 98, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 98, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 12, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 7645, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 5808, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 1699, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 10, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2024-09-21T04:19:54.511 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 6576, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 25, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 958, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 5, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 74, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 1013, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 1449530832, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2024-09-21T04:19:54.512 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 2409, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 1318, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 5261, 2024-09-21T04:19:54.513 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 1151, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 9, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 1085 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 149, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 27, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 16, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 30, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 695, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:19:54.514 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 19, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 18, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 1, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_path": 17, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_inode": 2314, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 27, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2024-09-21T04:19:54.515 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 3, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_started": 0, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_succeeded": 0, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_write_failed": 0 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 5568, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 5568, 2024-09-21T04:19:54.516 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 9, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 9, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 2, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 17323862, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 0, 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2024-09-21T04:19:54.517 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2320, 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 19.887798286, 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.008572326 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 0 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 123, 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 1092, 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 969, 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 62, 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 90, 2024-09-21T04:19:54.518 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 28, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 143, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 1124, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 981, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 98, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 1078, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 980, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 137432, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 350109696 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 6938, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 994, 2024-09-21T04:19:54.519 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 5776, 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 49, 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 1999, 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 972, 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 8.941444799, 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.009199017 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 404, 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.096929276, 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000239923 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2024-09-21T04:19:54.520 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1, 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.001736545, 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001736545 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1695, 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 16.875635141, 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.009956126 2024-09-21T04:19:54.521 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.522 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2024-09-21T04:19:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2024-09-21T04:19:54.523 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 34, 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.042686311, 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001255479 2024-09-21T04:19:54.524 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2024-09-21T04:19:54.525 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 846, 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.634162120, 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000749600 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 53, 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.095658273, 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001804873 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 15, 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.104183339, 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.006945555 2024-09-21T04:19:54.526 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.527 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2, 2024-09-21T04:19:54.528 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.001787757, 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000893878 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2024-09-21T04:19:54.529 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 10, 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.025675598, 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.002567559 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.530 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 16, 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.041822916, 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.002613932 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.531 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 1, 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 3, 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 2, 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 1, 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 376, 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 376, 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 1046, 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.532 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:19:54.533 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:19:54.534 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 294455, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 101, 2024-09-21T04:19:54.535 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 8960, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 169, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-21T04:19:54.536 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 500564, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 3569, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 3169, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 13535767, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 37, 2024-09-21T04:19:54.537 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 3169, 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3169, 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 36.375643044, 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.011478587 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3169, 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 3355 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.538 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 3169, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 13, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 3156, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 0, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 11, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 13, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 2334, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 86, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2024-09-21T04:19:54.539 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 3, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 551, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 0, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 22, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:19:54.540 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2024-09-21T04:19:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2024-09-21T04:19:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2024-09-21T04:19:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:19:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2024-09-21T04:19:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:19:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2024-09-21T04:19:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2024-09-21T04:19:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2024-09-21T04:19:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2024-09-21T04:19:54.541 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2024-09-21T04:19:54.542 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 85, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 11, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 12, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 12, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 0, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 272, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 0, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 63 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 1, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:19:54.543 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 6, 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 3, 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed_ops": 36, 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 18, 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:54.544 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 36517, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 7908100, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 36517, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 36517, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 7908100, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.545 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3169, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 13537729, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3169, 2024-09-21T04:19:54.546 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 13537729, 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:54.547 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3169, 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 3169, 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3169, 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 3169, 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:19:54.548 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 18, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 1962, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 18, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 14, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 1962, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.549 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x558135583450": { 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 5568, 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 13129558, 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 5568, 2024-09-21T04:19:54.550 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 2320, 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 13129558, 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "trackedop": { 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 2114 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:54.551 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T04:19:54.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:54 smithi060 ceph-mon[33722]: pgmap v897: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-21T04:19:55.042 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:54 smithi022 ceph-mon[31015]: pgmap v897: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-21T04:19:55.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:54 smithi073 ceph-mon[34443]: pgmap v897: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-21T04:19:55.957 INFO:tasks.check_counter:Daemon mds.b mds.exported=25 2024-09-21T04:19:55.958 INFO:tasks.check_counter:Daemon mds.b mds.imported=5 2024-09-21T04:19:55.958 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=149 2024-09-21T04:19:55.958 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=27 2024-09-21T04:19:55.958 DEBUG:tasks.check_counter:Getting stats from e 2024-09-21T04:19:55.958 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.e perf dump 2024-09-21T04:19:56.235 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:19:56.852 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:56 smithi060 ceph-mon[33722]: pgmap v898: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1355, 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1355, 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 4635813, 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 430076, 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 6, 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 2, 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.172335150, 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.080054803, 2024-09-21T04:19:56.863 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.038912103, 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.040155594, 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1354, 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.059754530, 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000044131 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T04:19:56.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 2266, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 2513, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 5314028, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 1232864, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 5, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 4, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.205917242, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.083252431, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.048687594, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.059247401, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2511, 2024-09-21T04:19:56.865 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.092709738, 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000036921 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 512528 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:19:56.866 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 624, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 596, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 5006129, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 285859, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 3, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 2, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.084220748, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.038053300, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.044607781, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.007964488, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 595, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.023746430, 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000039909 2024-09-21T04:19:56.867 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 745824, 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 202224 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.868 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 6542, 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.163873775, 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000025049 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:56.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 0, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 0, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 0, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 0, 2024-09-21T04:19:56.870 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 150, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 0, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 150, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 0, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 150, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 0, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 0, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 0, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 6, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 0, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 0, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 0, 2024-09-21T04:19:56.871 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 1013, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 1449530832, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2024-09-21T04:19:56.872 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:19:56.873 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 0, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 0, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 0, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 0 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 0, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 0, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2024-09-21T04:19:56.874 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_path": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_inode": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2024-09-21T04:19:56.875 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_started": 0, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_succeeded": 0, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_write_failed": 0 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 0, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2024-09-21T04:19:56.876 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 5568, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 0, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 9, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 2, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 17323862, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 17316981, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.877 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 5568 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 111, 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 1079, 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 968, 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 34, 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 66, 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 32, 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 150, 2024-09-21T04:19:56.878 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 1108, 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 958, 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 0, 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 0, 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 0, 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 119384, 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 322719744 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 0, 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 0, 2024-09-21T04:19:56.879 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 0, 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 0, 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.880 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2024-09-21T04:19:56.881 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.882 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.883 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2024-09-21T04:19:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2024-09-21T04:19:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.884 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.885 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2024-09-21T04:19:56.886 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.887 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.888 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.889 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2024-09-21T04:19:56.890 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 1, 2024-09-21T04:19:56.891 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 3, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 2, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 1, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 0, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 0, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 2148, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:19:56.892 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:19:56.893 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:19:56.894 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 189423, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 51, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 8960, 2024-09-21T04:19:56.895 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 169, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 389524, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 1586, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2024-09-21T04:19:56.896 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 3879, 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 26, 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 4, 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 3879, 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3879, 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 4.988952128, 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001286143 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3879, 2024-09-21T04:19:56.897 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 3880 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 3879, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 3879, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 0, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 2294, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 0, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 1582, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 0, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 0, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2024-09-21T04:19:56.898 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 2, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2024-09-21T04:19:56.899 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2024-09-21T04:19:56.900 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 85, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 2, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 5, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 5, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 0, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2024-09-21T04:19:56.901 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 0, 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 2, 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 0 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 0, 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T04:19:56.902 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 0, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed_ops": 0, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 0, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 4241, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 14552871, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 4241, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:19:56.903 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 4241, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 14552871, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:19:56.904 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3879, 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 13129568, 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3879, 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 13129568, 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2024-09-21T04:19:56.905 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3879, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 3879, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3879, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 3879, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.906 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:19:56.907 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x5600e408d450": { 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:56.908 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "trackedop": { 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:56.909 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T04:19:57.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:56 smithi022 ceph-mon[31015]: pgmap v898: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-21T04:19:57.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:56 smithi073 ceph-mon[34443]: pgmap v898: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 14 KiB/s wr, 13 op/s 2024-09-21T04:19:57.875 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-21T04:19:57.875 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-21T04:19:57.875 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-21T04:19:57.875 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-21T04:19:57.875 DEBUG:tasks.check_counter:Getting stats from h 2024-09-21T04:19:57.876 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.h perf dump 2024-09-21T04:19:58.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:57 smithi022 ceph-mon[31015]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:19:58.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:57 smithi073 ceph-mon[34443]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:19:58.146 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:19:58.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:57 smithi060 ceph-mon[33722]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-09-21T04:19:58.779 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:19:58 smithi060 ceph-mon[33722]: pgmap v899: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T04:19:58.821 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 10045, 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 7418, 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 4057472, 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 5073615, 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 10, 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 4, 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.857417531, 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.409025034, 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.497672173, 2024-09-21T04:19:58.822 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.049176908, 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 7419, 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.264576857, 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000035662 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 14432, 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.003084540, 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000213 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 769440, 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 207920 2024-09-21T04:19:58.823 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 847, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1065, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 376991, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 1086550, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 13, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 9, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.098902930, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.046999189, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.038964830, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.012135113, 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:58.824 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1064, 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.069489478, 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000065309 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 834, 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000192332, 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000230 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 606448 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:19:58.825 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 7532, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 5553, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 2585901, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 2797967, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 14, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 7, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.558387209, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.259016777, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.377747516, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.011973539, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 5549, 2024-09-21T04:19:58.826 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.237554029, 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000042810 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 11403, 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.002322304, 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000203 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-21T04:19:58.827 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1900, 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.681289584, 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000358573 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 840, 2024-09-21T04:19:58.828 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.041467494, 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000049366 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 2315, 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 1990, 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1990, 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 29.624730833, 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.014886799 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 325, 2024-09-21T04:19:58.829 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 11, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 176, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 1, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 152, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 23, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 175, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 222, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 157, 2024-09-21T04:19:58.830 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 157, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 15, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 6238, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 4222, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 325, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 40, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 6, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 653, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 6, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 205, 2024-09-21T04:19:58.831 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 11, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 340, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 1016, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 1446810793, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:19:58.832 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 524, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 826, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 4547, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 306, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 56, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 1127 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2024-09-21T04:19:58.833 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 107, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 325, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 177, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 289, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 163, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 225, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 225, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:19:58.834 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_path": 17, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_inode": 1064, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 6, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_started": 0, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_succeeded": 0, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_write_failed": 0 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.835 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 2125, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 2125, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 4, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 4, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 2, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2024-09-21T04:19:58.836 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 6873220, 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 0, 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 860, 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 2.461588969, 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.002862312 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 0 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 179, 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 612, 2024-09-21T04:19:58.837 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 433, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 45, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 180, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 135, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 179, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 626, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 447, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 157, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 573, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 416, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 124776, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 331096064 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 3754, 2024-09-21T04:19:58.838 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 2315, 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 18, 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 465, 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 227, 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 27.801664960, 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.122474294 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 62, 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.175438538, 2024-09-21T04:19:58.839 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.002829653 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2024-09-21T04:19:58.840 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1375, 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.589878471, 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000429002 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.841 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.842 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.843 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 93, 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.046224133, 2024-09-21T04:19:58.844 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000497033 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 6, 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.002697681, 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000449613 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 224, 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1.002116686, 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.004473735 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2024-09-21T04:19:58.845 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.846 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.847 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.848 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.849 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3, 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.006710364, 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.002236788 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.850 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 1, 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 1, 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 0, 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 1, 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 175, 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 175, 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 1049, 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.851 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:19:58.852 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:19:58.853 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 280119, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 101, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-21T04:19:58.854 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 8960, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 169, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 628485, 2024-09-21T04:19:58.855 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 3121, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 1799, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 2747988, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 33, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 1799, 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2024-09-21T04:19:58.856 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1799, 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 9.151911591, 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.005087221 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1799, 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 1961 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 1799, 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 104, 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 1695, 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2024-09-21T04:19:58.857 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 0, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 10, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 104, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 964, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 115, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 462, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2024-09-21T04:19:58.858 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 20, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2024-09-21T04:19:58.859 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2024-09-21T04:19:58.860 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 85, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 2, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 12, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 12, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 0, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 224, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 0, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 62 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2024-09-21T04:19:58.861 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 1, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 10, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 5, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed_ops": 450, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 225, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.862 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 18420, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 5339556, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 18420, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 18420, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 5339556, 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:58.863 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 1799, 2024-09-21T04:19:58.864 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 2772513, 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 1799, 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 2772513, 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:58.865 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 1799, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 1799, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 1799, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 1799, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.866 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 225, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 24525, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 225, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 104, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 24525, 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:58.867 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x5653416e35f0": { 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 2125, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 2678916, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 2125, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:19:58.868 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 860, 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 2678916, 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "trackedop": { 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 1030 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:19:58.869 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T04:19:59.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:19:58 smithi022 ceph-mon[31015]: pgmap v899: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T04:19:59.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:19:58 smithi073 ceph-mon[34443]: pgmap v899: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 15 KiB/s wr, 14 op/s 2024-09-21T04:19:59.676 INFO:tasks.check_counter:Daemon mds.h mds.exported=6 2024-09-21T04:19:59.676 INFO:tasks.check_counter:Daemon mds.h mds.imported=11 2024-09-21T04:19:59.676 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=107 2024-09-21T04:19:59.676 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=325 2024-09-21T04:19:59.676 DEBUG:tasks.check_counter:Getting stats from k 2024-09-21T04:19:59.677 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.k perf dump 2024-09-21T04:19:59.939 INFO:teuthology.orchestra.run.smithi060.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.b/config 2024-09-21T04:20:00.576 INFO:teuthology.orchestra.run.smithi060.stdout:{ 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 369, 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 339, 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 750530, 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 205396, 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 6, 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 1, 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.055382574, 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.026027981, 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.036678717, 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.000018736, 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:00.577 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 339, 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.020491518, 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000060446 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 749696, 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 205072 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.578 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 1051, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 1301, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 258482, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 848609, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 5, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 4, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.128230728, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.057793506, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.022720512, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.035832860, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 1299, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.052749235, 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000040607 2024-09-21T04:20:00.579 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 514704 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_messages": 2457, 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages": 2459, 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_bytes": 3405337, 2024-09-21T04:20:00.580 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_bytes": 781384, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_created_connections": 4, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_active_connections": 3, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_total_time": 0.279297410, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_send_time": 0.121479630, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_recv_time": 0.062291069, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_running_fast_dispatch_time": 0.075536736, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 2457, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.096274797, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000039183 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.581 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: "cct": { 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: "total_workers": 1, 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: "unhealthy_workers": 0 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-MDSRank": { 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-21T04:20:00.582 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 5895, 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.169901110, 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000028821 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: "finisher-PurgeQueue": { 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: "queue_len": 0, 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: "complete_latency": { 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:20:00.583 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "mds": { 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "request": 0, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "reply": 0, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "reply_latency": { 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_reply": 0, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "forward": 0, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_complete": 0, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_fetch_keys": 0, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_commit": 0, 2024-09-21T04:20:00.584 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_split": 0, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_merge": 0, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes": 388, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_top": 0, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_bottom": 388, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pin_tail": 0, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_pinned": 388, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_expired": 0, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "inodes_with_caps": 0, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "caps": 0, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "subtrees": 7, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse": 0, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_hit": 0, 2024-09-21T04:20:00.585 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_forward": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_discover": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_remote_ino": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "traverse_lock": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "load_cent": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "q": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "exported": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "exported_inodes": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "imported": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "imported_inodes": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_dir_fetch": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:20:00.586 INFO:teuthology.orchestra.run.smithi060.stdout: "openino_peer_discover": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rfiles": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rbytes": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "root_rsnaps": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_set_tag": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "scrub_file_inodes": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T04:20:00.587 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_grant": 0, 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps": 0, 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_caps_dirty": 0, 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_cap_release": 0, 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: "process_request_cap_release": 0 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_cache": { 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update": 0, 2024-09-21T04:20:00.588 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_update_receipt": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_try_discover": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_send_discover": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "dir_handle_discover": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_delayed": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_created": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_enqueued": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_reintegrated": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "strays_migrated": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_processing": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:20:00.589 INFO:teuthology.orchestra.run.smithi060.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_started": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "recovery_completed": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_path": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_quiesce_inode": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_exportdir": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_flush": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_fragstats": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "ireq_inodestats": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_started": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_succeeded": 0, 2024-09-21T04:20:00.590 INFO:teuthology.orchestra.run.smithi060.stdout: "uninline_write_failed": 0 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_log": { 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "evlrg": 0, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "evadd": 0, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "evex": 0, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "evtrm": 0, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "ev": 2125, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "evexg": 0, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "evexd": 0, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "segadd": 0, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "segex": 0, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "segtrm": 0, 2024-09-21T04:20:00.591 INFO:teuthology.orchestra.run.smithi060.stdout: "seg": 4, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "segmjr": 2, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "segexg": 0, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "segexd": 0, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "expos": 4194304, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "wrpos": 6873220, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "rdpos": 6873159, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "jlat": { 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "replayed": 2125 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.592 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_mem": { 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "ino": 164, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "ino+": 585, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "ino-": 421, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "dir": 19, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "dir+": 26, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "dir-": 7, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "dn": 388, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "dn+": 591, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "dn-": 203, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "cap": 0, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "cap+": 0, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "cap-": 0, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "rss": 121668, 2024-09-21T04:20:00.593 INFO:teuthology.orchestra.run.smithi060.stdout: "heap": 318521344 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_server": { 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_client_request": 0, 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "dispatch_server_request": 0, 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_request": 0, 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_client_session": 0, 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "handle_peer_request": 0, 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "req_create_latency": { 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.594 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getattr_latency": { 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getfilelock_latency": { 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "req_link_latency": { 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.595 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookup_latency": { 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookuphash_latency": { 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupino_latency": { 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.596 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupname_latency": { 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupparent_latency": { 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.597 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lookupsnap_latency": { 2024-09-21T04:20:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "req_lssnap_latency": { 2024-09-21T04:20:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.598 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mkdir_latency": { 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mknod_latency": { 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.599 INFO:teuthology.orchestra.run.smithi060.stdout: "req_mksnap_latency": { 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "req_open_latency": { 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "req_readdir_latency": { 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.600 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rename_latency": { 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "req_renamesnap_latency": { 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "req_snapdiff_latency": { 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.601 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmdir_latency": { 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmsnap_latency": { 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "req_rmxattr_latency": { 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.602 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setattr_latency": { 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setdirlayout_latency": { 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setfilelock_latency": { 2024-09-21T04:20:00.603 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setlayout_latency": { 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "req_setxattr_latency": { 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "req_symlink_latency": { 2024-09-21T04:20:00.604 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "req_unlink_latency": { 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "req_getvxattr_latency": { 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.605 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_sessions": { 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "session_count": 1, 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "session_add": 1, 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "session_remove": 0, 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_open": 1, 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "sessions_stale": 0, 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "total_load": 0, 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "average_load": 0, 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "avg_session_uptime": 2153, 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "mdthresh_evicted": 0 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.606 INFO:teuthology.orchestra.run.smithi060.stdout: "mempool": { 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bloom_filter_items": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:20:00.607 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_extent_items": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_blob_items": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_txc_items": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:20:00.608 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "bluestore_writing_items": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_bytes": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_items": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_bytes": 190951, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_anon_items": 54, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "buffer_meta_items": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_bytes": 0, 2024-09-21T04:20:00.609 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_items": 0, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_mapbl_items": 0, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_pglog_items": 0, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_bytes": 8960, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_items": 169, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_bytes": 0, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "pgmap_items": 0, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_bytes": 644077, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "mds_co_items": 2583, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_bytes": 0, 2024-09-21T04:20:00.610 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_1_items": 0, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_bytes": 0, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "unittest_2_items": 0 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "objecter": { 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "op_active": 0, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "op_laggy": 0, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send": 3508, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "op_send_bytes": 21, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "op_resend": 3, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "op_reply": 3508, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "op_latency": { 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3508, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 5.338948896, 2024-09-21T04:20:00.611 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.001521935 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "op_inflight": 0, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "oplen_avg": { 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 3508, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 3509 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "op": 3508, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "op_r": 3508, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "op_w": 0, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "op_rmw": 0, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "op_pg": 0, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_stat": 2198, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_create": 0, 2024-09-21T04:20:00.612 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_read": 1308, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_write": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writefull": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_writesame": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_append": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_zero": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_truncate": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_delete": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_mapext": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_sparse_read": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_clonerange": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_getxattr": 1, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_setxattr": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:20:00.613 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_rmxattr": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_call": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_watch": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_notify": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "osdop_other": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_active": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_send": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_resend": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "linger_ping": 0, 2024-09-21T04:20:00.614 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_active": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_send": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "poolop_resend": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_active": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_send": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "poolstat_resend": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_active": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_send": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "statfs_resend": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "command_active": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "command_send": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "command_resend": 0, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "map_epoch": 85, 2024-09-21T04:20:00.615 INFO:teuthology.orchestra.run.smithi060.stdout: "map_full": 0, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "map_inc": 2, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_sessions": 5, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_open": 6, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_session_close": 1, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "osd_laggy": 0, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_wr": 0, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_rd": 2, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_del": 0 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "oft": { 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_objs": 0, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_updates": 0, 2024-09-21T04:20:00.616 INFO:teuthology.orchestra.run.smithi060.stdout: "omap_total_removes": 0 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "purge_queue": { 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops": 0, 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing": 0, 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executing_high_water": 0, 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed_ops": 0, 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_executed": 0, 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "pq_item_in_journal": 0 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T04:20:00.617 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 3873, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 4044208, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 3873, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3873, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 4044208, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.618 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_bytes": { 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 104857600, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3508, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 2678921, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3508, 2024-09-21T04:20:00.619 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 2678921, 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-objecter_ops": { 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 1024, 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:00.620 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 3508, 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 3508, 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 3508, 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 3508, 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:20:00.621 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.622 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "throttle-write_buf_throttle-0x5631eb561380": { 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "val": 0, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "max": 3758096384, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "get_started": 0, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "get": 0, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "get_sum": 0, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "take": 0, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "take_sum": 0, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "put": 0, 2024-09-21T04:20:00.623 INFO:teuthology.orchestra.run.smithi060.stdout: "put_sum": 0, 2024-09-21T04:20:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "wait": { 2024-09-21T04:20:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "avgcount": 0, 2024-09-21T04:20:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "sum": 0.000000000, 2024-09-21T04:20:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "avgtime": 0.000000000 2024-09-21T04:20:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:20:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: }, 2024-09-21T04:20:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "trackedop": { 2024-09-21T04:20:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: "slow_ops_count": 0 2024-09-21T04:20:00.624 INFO:teuthology.orchestra.run.smithi060.stdout: } 2024-09-21T04:20:00.624 INFO:teuthology.orchestra.run.smithi060.stdout:} 2024-09-21T04:20:01.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:00 smithi022 ceph-mon[31015]: pgmap v900: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T04:20:01.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:00 smithi022 ceph-mon[31015]: overall HEALTH_OK 2024-09-21T04:20:01.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:00 smithi073 ceph-mon[34443]: pgmap v900: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T04:20:01.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:00 smithi073 ceph-mon[34443]: overall HEALTH_OK 2024-09-21T04:20:01.123 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:00 smithi060 ceph-mon[33722]: pgmap v900: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T04:20:01.123 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:00 smithi060 ceph-mon[33722]: overall HEALTH_OK 2024-09-21T04:20:01.432 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-09-21T04:20:01.432 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-09-21T04:20:01.432 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-09-21T04:20:01.432 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-09-21T04:20:01.432 DEBUG:tasks.check_counter:Getting stats from c 2024-09-21T04:20:01.433 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.c perf dump 2024-09-21T04:20:01.738 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T04:20:02.607 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-21T04:20:02.607 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:20:02.608 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 3929, 2024-09-21T04:20:02.608 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 4328, 2024-09-21T04:20:02.608 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1339027, 2024-09-21T04:20:02.608 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 3530546, 2024-09-21T04:20:02.608 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 16, 2024-09-21T04:20:02.608 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 4, 2024-09-21T04:20:02.608 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.331855356, 2024-09-21T04:20:02.608 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.154943535, 2024-09-21T04:20:02.608 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.187051635, 2024-09-21T04:20:02.608 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.018524406, 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 4327, 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.180473645, 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000041708 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 6808, 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.001314983, 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000193 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T04:20:02.609 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1174, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 865, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1283285, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 520496, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 10, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 8, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.110317496, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.054051481, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.071986465, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000591680, 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:02.610 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 864, 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.049581998, 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000057386 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1210, 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000215289, 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000177 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 764496, 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 207344 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:20:02.611 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 7905, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 4881, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 2626885, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 1855413, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 8, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 5, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.509366628, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.230412354, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.346420256, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.006481726, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 4879, 2024-09-21T04:20:02.612 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.142355363, 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000029177 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 12327, 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.002260895, 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000183 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 160, 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 515808 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2024-09-21T04:20:02.613 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 866, 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.621410064, 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000717563 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 23, 2024-09-21T04:20:02.614 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000706813, 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000030731 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 1225, 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 770, 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 770, 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 2.555437737, 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.003318750 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 455, 2024-09-21T04:20:02.615 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 11, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 297, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 0, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 297, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 0, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 284, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 4, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 265, 2024-09-21T04:20:02.616 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 265, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 13, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 2078, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 1376, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 455, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 43, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 0, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 6058, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 0, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 0, 2024-09-21T04:20:02.617 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 0, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 7, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 259, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 1016, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 1446810793, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 0, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:20:02.618 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 643, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 777, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 1978, 2024-09-21T04:20:02.619 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 680, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 2, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 8 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 29, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 373, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 198, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 368, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 35, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:20:02.620 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 2, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 2, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 0, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_path": 17, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_inode": 4645, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 0, 2024-09-21T04:20:02.621 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0, 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_started": 0, 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_succeeded": 0, 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_write_failed": 0 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "evlrg": 0, 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 1276, 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2024-09-21T04:20:02.622 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 1276, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 3, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 3, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "segmjr": 2, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 4194304, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 5717542, 2024-09-21T04:20:02.623 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 0, 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 358, 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1.566095435, 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.004374568 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 0 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 298, 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 302, 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 4, 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 53, 2024-09-21T04:20:02.624 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 212, 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 159, 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 297, 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 311, 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 14, 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 265, 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 267, 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 2, 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 126080, 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 332279808 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.625 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 1462, 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 0, 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 1225, 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 13, 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 9, 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 4, 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.010229570, 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.002557392 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 168, 2024-09-21T04:20:02.626 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 2.200669309, 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.013099222 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.627 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 416, 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.245727768, 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000590691 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.628 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.629 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.630 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2024-09-21T04:20:02.630 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.630 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.630 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.631 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2024-09-21T04:20:02.632 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 168, 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.082677773, 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000492129 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 12, 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.010488251, 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000874020 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.633 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.634 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2024-09-21T04:20:02.635 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2024-09-21T04:20:02.636 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.637 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2, 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.005645066, 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.002822533 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2024-09-21T04:20:02.638 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 1, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 1, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 0, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 1, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 38, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 38, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 1052, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "mdthresh_evicted": 0 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:20:02.639 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:20:02.640 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:20:02.641 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 288055, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 100, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 8960, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 169, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:20:02.642 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 1025416, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 6270, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 543, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 1554416, 2024-09-21T04:20:02.643 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 33, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 543, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 543, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 3.320924173, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.006115882 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 543, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 639 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 543, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 2, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 541, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2024-09-21T04:20:02.644 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 0, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 10, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 2, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 360, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 68, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 16, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 0, 2024-09-21T04:20:02.645 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 20, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2024-09-21T04:20:02.646 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 85, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2024-09-21T04:20:02.647 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 2, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 9, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 10, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 1, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 129, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 0, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 34 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 1, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.648 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 2, 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 1, 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed_ops": 4, 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 2, 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:02.649 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 13004, 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 4055916, 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 13004, 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 13004, 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 4055916, 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.650 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 543, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 1554634, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 543, 2024-09-21T04:20:02.651 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 1554634, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:02.652 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 543, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 543, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 543, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 543, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 2, 2024-09-21T04:20:02.653 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 218, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 2, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 2, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 218, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x5578f4917520": { 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:02.654 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 1276, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 1523238, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 1276, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 358, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 1523238, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:02.655 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:02.656 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:02.656 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:02.656 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:02.656 INFO:teuthology.orchestra.run.smithi073.stdout: "trackedop": { 2024-09-21T04:20:02.656 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 4092 2024-09-21T04:20:02.656 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:02.656 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-21T04:20:03.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:02 smithi022 ceph-mon[31015]: pgmap v901: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T04:20:03.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:02 smithi073 ceph-mon[34443]: pgmap v901: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T04:20:03.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:02 smithi060 ceph-mon[33722]: pgmap v901: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 12 KiB/s wr, 12 op/s 2024-09-21T04:20:03.577 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-21T04:20:03.577 INFO:tasks.check_counter:Daemon mds.c mds.imported=7 2024-09-21T04:20:03.577 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=29 2024-09-21T04:20:03.577 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=373 2024-09-21T04:20:03.577 DEBUG:tasks.check_counter:Getting stats from f 2024-09-21T04:20:03.578 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.f perf dump 2024-09-21T04:20:03.831 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T04:20:04.444 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-21T04:20:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:20:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 9306, 2024-09-21T04:20:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 6696, 2024-09-21T04:20:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 3202984, 2024-09-21T04:20:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 5077818, 2024-09-21T04:20:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 11, 2024-09-21T04:20:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 5, 2024-09-21T04:20:04.444 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.642733421, 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.287541223, 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.390202893, 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.038885395, 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 6695, 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.241865930, 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000036126 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 14070, 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.002777920, 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000197 2024-09-21T04:20:04.445 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 448 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 4285, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 5877, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 2367750, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 3287701, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 12, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 7, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.394852915, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.203829366, 2024-09-21T04:20:04.446 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.233770015, 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.001238497, 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 5878, 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.225216136, 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000038315 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 8686, 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.001860703, 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000214 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 759920, 2024-09-21T04:20:04.447 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 209776 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 152, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 402, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 42295, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 733413, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 15, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 9, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.038519314, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.021245649, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.008629971, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.005281133, 2024-09-21T04:20:04.448 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:04.449 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 398, 2024-09-21T04:20:04.449 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.038516111, 2024-09-21T04:20:04.449 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000096774 2024-09-21T04:20:04.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.449 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:04.449 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 4, 2024-09-21T04:20:04.449 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000605, 2024-09-21T04:20:04.449 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000151 2024-09-21T04:20:04.449 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 606368 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1586, 2024-09-21T04:20:04.450 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.517842626, 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000326508 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 66, 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.002213218, 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000033533 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-09-21T04:20:04.451 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 1411, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 769, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 769, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.519609787, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000675695 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 642, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 11, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2024-09-21T04:20:04.452 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 518, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 5, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 503, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 10, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 510, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 145, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 488, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 488, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 13, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 2070, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 1302, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 634, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 47, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:20:04.453 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 0, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 2302, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 1, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 3, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 144, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 10, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 633, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 1016, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 1446810793, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 0, 2024-09-21T04:20:04.454 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 592, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 825, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:20:04.455 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 1485, 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 356, 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 2, 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 30 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 47, 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 351, 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 185, 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 376, 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 100, 2024-09-21T04:20:04.456 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 9, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 9, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 0, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_path": 17, 2024-09-21T04:20:04.457 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_inode": 9749, 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 3, 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0, 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_started": 0, 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_succeeded": 0, 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_write_failed": 0 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2024-09-21T04:20:04.458 INFO:teuthology.orchestra.run.smithi073.stdout: "evlrg": 0, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 1408, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 1408, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 3, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 3, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "segmjr": 2, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2024-09-21T04:20:04.459 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 4194304, 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 6980876, 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 0, 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 744, 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 4.214065487, 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.005664066 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 0 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2024-09-21T04:20:04.460 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 515, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 668, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 153, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 51, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 216, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 165, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 518, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 693, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 175, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 488, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 641, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 153, 2024-09-21T04:20:04.461 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 128824, 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 335355904 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 1473, 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 36, 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 1411, 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 20, 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 73, 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 9, 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.015165134, 2024-09-21T04:20:04.462 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.001685014 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 9, 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.002552885, 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000283653 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2024-09-21T04:20:04.463 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 387, 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.184205769, 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000475983 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.464 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.465 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.466 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3, 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.004076113, 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.001358704 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2024-09-21T04:20:04.467 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 326, 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.212237774, 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000651036 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 26, 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.082375433, 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.003168285 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.468 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.469 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2, 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.006675739, 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.003337869 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.470 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.471 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.472 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 7, 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.012320940, 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.001760134 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.473 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 1, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 2, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 1, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 1, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 76, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 76, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 1054, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mdthresh_evicted": 0 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-21T04:20:04.474 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:20:04.475 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:20:04.476 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 304537, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 111, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-21T04:20:04.477 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 8960, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 169, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 1726767, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 10362, 2024-09-21T04:20:04.478 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 1005, 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 2826393, 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 33, 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 1005, 2024-09-21T04:20:04.479 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1005, 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 5.470874134, 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.005443655 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1005, 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1135 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 1005, 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 3, 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 1002, 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2024-09-21T04:20:04.480 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 0, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 10, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 3, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 747, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 68, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 58, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2024-09-21T04:20:04.481 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 20, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2024-09-21T04:20:04.482 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2024-09-21T04:20:04.483 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 85, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 2, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 12, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 12, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 0, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 189, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 0, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 40 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2024-09-21T04:20:04.484 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 1, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 23, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 5, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed_ops": 46, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 9, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.485 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 13739, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 4353328, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 13739, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 13739, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 4353328, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.486 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 1005, 2024-09-21T04:20:04.487 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 2827358, 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 1005, 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 2827358, 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:04.488 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 1005, 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 1005, 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 1005, 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 1005, 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:20:04.489 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 9, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 965, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 9, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 3, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 965, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.490 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x55fc11811520": { 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 1408, 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 2786572, 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 1408, 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:04.491 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 744, 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 2786572, 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: "trackedop": { 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 8520 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:04.492 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-21T04:20:04.855 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:04 smithi073 ceph-mon[34443]: pgmap v902: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T04:20:05.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:04 smithi022 ceph-mon[31015]: pgmap v902: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T04:20:05.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:04 smithi060 ceph-mon[33722]: pgmap v902: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 12 KiB/s wr, 11 op/s 2024-09-21T04:20:05.434 INFO:tasks.check_counter:Daemon mds.f mds.exported=3 2024-09-21T04:20:05.434 INFO:tasks.check_counter:Daemon mds.f mds.imported=10 2024-09-21T04:20:05.434 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=47 2024-09-21T04:20:05.434 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=351 2024-09-21T04:20:05.434 DEBUG:tasks.check_counter:Getting stats from i 2024-09-21T04:20:05.435 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.i perf dump 2024-09-21T04:20:05.691 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T04:20:06.273 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-21T04:20:06.273 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 10410, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 8119, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 3420911, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 15223681, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 10, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 3, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.760172288, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.350014579, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.433468537, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.050156294, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 8119, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.266154295, 2024-09-21T04:20:06.274 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000032781 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 15643, 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.002882242, 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000184 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 14956, 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 15446, 2024-09-21T04:20:06.275 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 5694492, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 7226213, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 15, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 6, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 1.151987784, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.541171039, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.808488879, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.000343056, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 15446, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1.510305368, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000097779 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.276 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 26262, 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.005311481, 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000202 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 776640, 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 209520 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 549, 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 798, 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 147609, 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 1744762, 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 13, 2024-09-21T04:20:06.277 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 8, 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.076483258, 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.037699152, 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.017326207, 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.015651876, 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 794, 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.037020901, 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000046625 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:06.278 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2, 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000151, 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000075 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 607840 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-09-21T04:20:06.279 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3172, 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1.955224509, 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000616401 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2, 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000171422, 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000085711 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.280 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 4019, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 3702, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3702, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 4.169476491, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.001126276 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 317, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 11, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2024-09-21T04:20:06.281 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 373, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 0, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 325, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 48, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 365, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 135, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 62, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 62, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 9, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 9910, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 7401, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 317, 2024-09-21T04:20:06.282 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 46, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 12, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 4893, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 2, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 5, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 124, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 6, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 125, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2024-09-21T04:20:06.283 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 1016, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 1446810793, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 0, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 761, 2024-09-21T04:20:06.284 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 818, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 10157, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 8489, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 0, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 485 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 281, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 250, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 137, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 238, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 308, 2024-09-21T04:20:06.285 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 160, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 0, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 160, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_path": 17, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_inode": 1307, 2024-09-21T04:20:06.286 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 5, 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0, 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_started": 0, 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_succeeded": 0, 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_write_failed": 0 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "evlrg": 0, 2024-09-21T04:20:06.287 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 10610, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 10610, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 14, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 14, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "segmjr": 2, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 4194304, 2024-09-21T04:20:06.288 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 17684790, 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 0, 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1476, 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 6.238023029, 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.004226302 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 0 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 88, 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 214, 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 126, 2024-09-21T04:20:06.289 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 47, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 154, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 107, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 373, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 509, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 136, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 62, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 179, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 117, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 125344, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 332279808 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2024-09-21T04:20:06.290 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 6402, 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 0, 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 4019, 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 18, 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 544, 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 53, 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.133379623, 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.002516596 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 25, 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.087773798, 2024-09-21T04:20:06.291 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.003510951 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 160, 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.476366986, 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.002977293 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2670, 2024-09-21T04:20:06.292 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1.381903033, 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000517566 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.293 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2024-09-21T04:20:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2024-09-21T04:20:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.294 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2024-09-21T04:20:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.295 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.296 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 458, 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.305198146, 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000666371 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 15, 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.011378948, 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000758596 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 161, 2024-09-21T04:20:06.297 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 1.371186802, 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.008516688 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2024-09-21T04:20:06.298 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.299 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.300 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.301 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 160, 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.402289155, 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.002514307 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.302 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 1, 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 1, 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 0, 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 1, 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 1595, 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 1595, 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 1057, 2024-09-21T04:20:06.303 INFO:teuthology.orchestra.run.smithi073.stdout: "mdthresh_evicted": 0 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:20:06.304 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:20:06.305 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 271191, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 93, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:20:06.306 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 8960, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 169, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 559978, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 13955, 2024-09-21T04:20:06.307 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 1811, 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 13536328, 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 33, 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 1811, 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2024-09-21T04:20:06.308 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1811, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 8.743800115, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.004828161 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1811, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 2112 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 1811, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 0, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 1811, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 0, 2024-09-21T04:20:06.309 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 10, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 0, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 1476, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 64, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 9, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 0, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 20, 2024-09-21T04:20:06.310 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2024-09-21T04:20:06.311 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 85, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 2, 2024-09-21T04:20:06.312 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 9, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 13, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 4, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 413, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 0, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 120 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 1, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2024-09-21T04:20:06.313 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 0, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed_ops": 0, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 0, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 25911, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 6907872, 2024-09-21T04:20:06.314 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 25911, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 25911, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 6907872, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-21T04:20:06.315 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 1811, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 13536328, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 1811, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 13536328, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.316 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 1811, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 1811, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 1811, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 1811, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.317 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2024-09-21T04:20:06.318 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x55c5188f32b0": { 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 10610, 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 13490486, 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 10610, 2024-09-21T04:20:06.319 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 1476, 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 13490486, 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "trackedop": { 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 1144 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:06.320 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-21T04:20:07.018 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:06 smithi073 ceph-mon[34443]: pgmap v903: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T04:20:07.047 INFO:tasks.check_counter:Daemon mds.i mds.exported=5 2024-09-21T04:20:07.048 INFO:tasks.check_counter:Daemon mds.i mds.imported=6 2024-09-21T04:20:07.048 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=281 2024-09-21T04:20:07.048 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=250 2024-09-21T04:20:07.048 DEBUG:tasks.check_counter:Getting stats from l 2024-09-21T04:20:07.048 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph daemon mds.l perf dump 2024-09-21T04:20:07.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:06 smithi022 ceph-mon[31015]: pgmap v903: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T04:20:07.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:06 smithi060 ceph-mon[33722]: pgmap v903: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 2.9 KiB/s wr, 11 op/s 2024-09-21T04:20:07.296 INFO:teuthology.orchestra.run.smithi073.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.c/config 2024-09-21T04:20:07.894 INFO:teuthology.orchestra.run.smithi073.stdout:{ 2024-09-21T04:20:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-0": { 2024-09-21T04:20:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 1526, 2024-09-21T04:20:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 1498, 2024-09-21T04:20:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1137056, 2024-09-21T04:20:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 574626, 2024-09-21T04:20:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 5, 2024-09-21T04:20:07.894 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 1, 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.201476308, 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.089764455, 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.067204505, 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.040997629, 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 1497, 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.069005811, 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000046096 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.895 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 747632, 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 206064 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-1": { 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 388, 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 638, 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 1005712, 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 640640, 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 5, 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 4, 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.056031971, 2024-09-21T04:20:07.896 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.028035065, 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.011104411, 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.011882383, 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 637, 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.035162132, 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000055199 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-09-21T04:20:07.897 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 518784 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "AsyncMessenger::Worker-2": { 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_messages": 2136, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages": 2138, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_bytes": 13132094, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_bytes": 679255, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_created_connections": 5, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_active_connections": 3, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_total_time": 0.180746931, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_send_time": 0.075420881, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_recv_time": 0.043679617, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_running_fast_dispatch_time": 0.051035246, 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_messages_queue_lat": { 2024-09-21T04:20:07.898 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 2136, 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.075506721, 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000035349 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_handle_ack_lat": { 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "msgr_send_encrypted_bytes": 0 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "cct": { 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "total_workers": 1, 2024-09-21T04:20:07.899 INFO:teuthology.orchestra.run.smithi073.stdout: "unhealthy_workers": 0 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-MDSRank": { 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 6253, 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.165061543, 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000026397 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "finisher-PurgeQueue": { 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "queue_len": 0, 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "complete_latency": { 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.900 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "mds": { 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "request": 0, 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "reply": 0, 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "reply_latency": { 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_reply": 0, 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "forward": 0, 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_complete": 0, 2024-09-21T04:20:07.901 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_fetch_keys": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_commit": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_split": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_merge": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes": 355, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_top": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_bottom": 355, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pin_tail": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_pinned": 355, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_expired": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "inodes_with_caps": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "caps": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "subtrees": 3, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_hit": 0, 2024-09-21T04:20:07.902 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_forward": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_discover": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_dir_fetch": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_remote_ino": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "traverse_lock": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "load_cent": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "q": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "exported": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "exported_inodes": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "imported": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "imported_inodes": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_dir_fetch": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_backtrace_fetch": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "openino_peer_discover": 0, 2024-09-21T04:20:07.903 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rfiles": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rbytes": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "root_rsnaps": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_fetch": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_set_tag": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_backtrace_repaired": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_inotable_repaired": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_inodes": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dir_base_inodes": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_dirfrag_rstats": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "scrub_file_inodes": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_inode_file_caps": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_revoke": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_grant": 0, 2024-09-21T04:20:07.904 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_trunc": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_caps_dirty": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_cap_release": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "process_request_cap_release": 0 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_cache": { 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_update_receipt": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_try_discover": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_send_discover": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "dir_handle_discover": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays": 0, 2024-09-21T04:20:07.905 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_delayed": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "num_strays_enqueuing": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_created": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_enqueued": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_reintegrated": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "strays_migrated": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_processing": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_enqueued": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "num_recovering_prioritized": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_started": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "recovery_completed": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_path": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_quiesce_inode": 0, 2024-09-21T04:20:07.906 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_enqueue_scrub": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_exportdir": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_flush": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragmentdir": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_fragstats": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "ireq_inodestats": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_started": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_succeeded": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "uninline_write_failed": 0 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_log": { 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "evlrg": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "evadd": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "evex": 0, 2024-09-21T04:20:07.907 INFO:teuthology.orchestra.run.smithi073.stdout: "evtrm": 0, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "ev": 10610, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "evexg": 0, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "evexd": 0, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "segadd": 0, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "segex": 0, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "segtrm": 0, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "seg": 14, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "segmjr": 2, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "segexg": 0, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "segexd": 0, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "expos": 4194304, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "wrpos": 17684790, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "rdpos": 17683652, 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "jlat": { 2024-09-21T04:20:07.908 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "replayed": 10610 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_mem": { 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "ino": 69, 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "ino+": 192, 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "ino-": 123, 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "dir": 16, 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "dir+": 24, 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "dir-": 8, 2024-09-21T04:20:07.909 INFO:teuthology.orchestra.run.smithi073.stdout: "dn": 355, 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "dn+": 485, 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "dn-": 130, 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "cap": 0, 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "cap+": 0, 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "cap-": 0, 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "rss": 117652, 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "heap": 318517248 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_server": { 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_client_request": 0, 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "dispatch_server_request": 0, 2024-09-21T04:20:07.910 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_request": 0, 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_client_session": 0, 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "handle_peer_request": 0, 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "req_create_latency": { 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getattr_latency": { 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.911 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getfilelock_latency": { 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "req_link_latency": { 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookup_latency": { 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.912 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookuphash_latency": { 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupino_latency": { 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupname_latency": { 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.913 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupparent_latency": { 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lookupsnap_latency": { 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.914 INFO:teuthology.orchestra.run.smithi073.stdout: "req_lssnap_latency": { 2024-09-21T04:20:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.915 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mkdir_latency": { 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mknod_latency": { 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "req_mksnap_latency": { 2024-09-21T04:20:07.916 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "req_open_latency": { 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "req_readdir_latency": { 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.917 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rename_latency": { 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "req_renamesnap_latency": { 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "req_snapdiff_latency": { 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.918 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmdir_latency": { 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmsnap_latency": { 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "req_rmxattr_latency": { 2024-09-21T04:20:07.919 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setattr_latency": { 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setdirlayout_latency": { 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.920 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setfilelock_latency": { 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setlayout_latency": { 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "req_setxattr_latency": { 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.921 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "req_symlink_latency": { 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "req_unlink_latency": { 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.922 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_revoke_eviction": 0, 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "cap_acquisition_throttle": 0, 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "req_getvxattr_latency": { 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_sessions": { 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "session_count": 1, 2024-09-21T04:20:07.923 INFO:teuthology.orchestra.run.smithi073.stdout: "session_add": 1, 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "session_remove": 0, 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_open": 1, 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "sessions_stale": 0, 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "total_load": 0, 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "average_load": 0, 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "avg_session_uptime": 2151, 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "mdthresh_evicted": 0 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "mempool": { 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_bytes": 0, 2024-09-21T04:20:07.924 INFO:teuthology.orchestra.run.smithi073.stdout: "bloom_filter_items": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_bytes": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_alloc_items": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_bytes": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_data_items": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_onode_items": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_meta_items": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_bytes": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_other_items": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_cache_buffer_items": 0, 2024-09-21T04:20:07.925 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_bytes": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_extent_items": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_bytes": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_blob_items": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_shared_blob_items": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_inline_bl_items": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_bytes": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_fsck_items": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_bytes": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_txc_items": 0, 2024-09-21T04:20:07.926 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_deferred_items": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_bytes": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "bluestore_writing_items": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_bytes": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_items": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_bytes": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_reader_items": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_bytes": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "bluefs_file_writer_items": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_bytes": 190929, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_anon_items": 54, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_bytes": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "buffer_meta_items": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_bytes": 0, 2024-09-21T04:20:07.927 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_items": 0, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_bytes": 0, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_mapbl_items": 0, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_bytes": 0, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_pglog_items": 0, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_bytes": 8960, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_items": 169, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_bytes": 0, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "osdmap_mapping_items": 0, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_bytes": 0, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "pgmap_items": 0, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_bytes": 422154, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "mds_co_items": 11102, 2024-09-21T04:20:07.928 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_bytes": 0, 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_1_items": 0, 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_bytes": 0, 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "unittest_2_items": 0 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "objecter": { 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "op_active": 0, 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "op_laggy": 0, 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send": 3678, 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "op_send_bytes": 21, 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "op_resend": 3, 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "op_reply": 3678, 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "op_latency": { 2024-09-21T04:20:07.929 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3678, 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 4.037908048, 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.001097854 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "op_inflight": 0, 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "oplen_avg": { 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 3678, 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 3679 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "op": 3678, 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "op_r": 3678, 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "op_w": 0, 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "op_rmw": 0, 2024-09-21T04:20:07.930 INFO:teuthology.orchestra.run.smithi073.stdout: "op_pg": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_stat": 2216, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_create": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_read": 1460, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_write": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writefull": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_writesame": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_append": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_zero": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_truncate": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_delete": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_mapext": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_sparse_read": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_clonerange": 0, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_getxattr": 1, 2024-09-21T04:20:07.931 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_setxattr": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_cmpxattr": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_rmxattr": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_resetxattrs": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_call": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_watch": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_notify": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_src_cmpxattr": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_pgls_filter": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "osdop_other": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_active": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_send": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_resend": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "linger_ping": 0, 2024-09-21T04:20:07.932 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_active": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_send": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "poolop_resend": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_active": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_send": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "poolstat_resend": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_active": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_send": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "statfs_resend": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "command_active": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "command_send": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "command_resend": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "map_epoch": 85, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "map_full": 0, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "map_inc": 2, 2024-09-21T04:20:07.933 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_sessions": 5, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_open": 6, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_session_close": 1, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "osd_laggy": 0, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_wr": 0, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_rd": 2, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_del": 0 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "oft": { 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_objs": 0, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_kv_pairs": 0, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_updates": 0, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "omap_total_removes": 0 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "purge_queue": { 2024-09-21T04:20:07.934 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops": 0, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_ops_high_water": 0, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing": 0, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executing_high_water": 0, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed_ops": 0, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_executed": 0, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "pq_item_in_journal": 0 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 4046, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 14888995, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:07.935 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 4046, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 4046, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 14888995, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_bytes": { 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 104857600, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:07.936 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 3678, 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 13495476, 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 3678, 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 13495476, 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:07.937 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-objecter_ops": { 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 1024, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 3678, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 3678, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 3678, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 3678, 2024-09-21T04:20:07.938 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle": { 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:07.939 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "throttle-write_buf_throttle-0x5591a15f5380": { 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "val": 0, 2024-09-21T04:20:07.940 INFO:teuthology.orchestra.run.smithi073.stdout: "max": 3758096384, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "get_started": 0, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "get": 0, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "get_sum": 0, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_fail": 0, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "get_or_fail_success": 0, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "take": 0, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "take_sum": 0, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "put": 0, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "put_sum": 0, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "wait": { 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "avgcount": 0, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "sum": 0.000000000, 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: "avgtime": 0.000000000 2024-09-21T04:20:07.941 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: }, 2024-09-21T04:20:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "trackedop": { 2024-09-21T04:20:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: "slow_ops_count": 0 2024-09-21T04:20:07.942 INFO:teuthology.orchestra.run.smithi073.stdout: } 2024-09-21T04:20:07.942 INFO:teuthology.orchestra.run.smithi073.stdout:} 2024-09-21T04:20:08.699 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-09-21T04:20:08.699 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-09-21T04:20:08.699 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-09-21T04:20:08.699 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-09-21T04:20:08.700 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T04:20:08.710 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T04:20:08.710 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T04:20:08.710 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T04:20:08.740 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T04:20:08.740 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T04:20:08.800 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T04:20:09.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:08 smithi022 ceph-mon[31015]: pgmap v904: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T04:20:09.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:08 smithi073 ceph-mon[34443]: pgmap v904: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T04:20:09.113 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:20:09.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:08 smithi060 ceph-mon[33722]: pgmap v904: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 597 B/s wr, 10 op/s 2024-09-21T04:20:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.612+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/4107073570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa64110200 msgr2=0x7ffa64112620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.612+0000 7ffa6b5ae640 1 --2- 172.21.15.22:0/4107073570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa64110200 0x7ffa64112620 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ffa5c009900 tx=0x7ffa5c02a480 comp rx=0 tx=0).stop 2024-09-21T04:20:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.612+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/4107073570 shutdown_connections 2024-09-21T04:20:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.612+0000 7ffa6b5ae640 1 --2- 172.21.15.22:0/4107073570 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa64110200 0x7ffa64112620 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.612+0000 7ffa6b5ae640 1 --2- 172.21.15.22:0/4107073570 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa64102fa0 0x7ffa6410fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.612+0000 7ffa6b5ae640 1 --2- 172.21.15.22:0/4107073570 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa64102650 0x7ffa64102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.612+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/4107073570 >> 172.21.15.22:0/4107073570 conn(0x7ffa64079730 msgr2=0x7ffa64079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.613+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/4107073570 shutdown_connections 2024-09-21T04:20:09.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.613+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/4107073570 wait complete. 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.613+0000 7ffa6b5ae640 1 Processor -- start 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.613+0000 7ffa6b5ae640 1 -- start start 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6b5ae640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa64102650 0x7ffa6419c590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6b5ae640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa64102fa0 0x7ffa6419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6b5ae640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa64110200 0x7ffa641a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6b5ae640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64115b20 con 0x7ffa64102650 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6b5ae640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7ffa641159a0 con 0x7ffa64110200 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6b5ae640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7ffa64115ca0 con 0x7ffa64102fa0 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6934a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa64102650 0x7ffa6419c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6934a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa64102650 0x7ffa6419c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:56592/0 (socket says 172.21.15.22:56592) 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6934a640 1 -- 172.21.15.22:0/249396008 learned_addr learned my addr 172.21.15.22:0/249396008 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:20:09.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa68b49640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa64102fa0 0x7ffa6419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa69b4b640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa64110200 0x7ffa641a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6934a640 1 -- 172.21.15.22:0/249396008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa64102fa0 msgr2=0x7ffa6419cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6934a640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa64102fa0 0x7ffa6419cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6934a640 1 -- 172.21.15.22:0/249396008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa64110200 msgr2=0x7ffa641a1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6934a640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa64110200 0x7ffa641a1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6934a640 1 -- 172.21.15.22:0/249396008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa641a2440 con 0x7ffa64102650 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.614+0000 7ffa6934a640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa64102650 0x7ffa6419c590 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c970 tx=0x7ffa5400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.615+0000 7ffa627fc640 1 -- 172.21.15.22:0/249396008 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54007bb0 con 0x7ffa64102650 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.615+0000 7ffa627fc640 1 -- 172.21.15.22:0/249396008 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa54007d50 con 0x7ffa64102650 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.615+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/249396008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa641a2730 con 0x7ffa64102650 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.615+0000 7ffa627fc640 1 -- 172.21.15.22:0/249396008 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa54004e40 con 0x7ffa64102650 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.615+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/249396008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa641a8f50 con 0x7ffa64102650 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.616+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/249396008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa64102a60 con 0x7ffa64102650 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.618+0000 7ffa627fc640 1 -- 172.21.15.22:0/249396008 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7ffa54005000 con 0x7ffa64102650 2024-09-21T04:20:09.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.619+0000 7ffa627fc640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ffa4c0b6540 0x7ffa4c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:09.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.619+0000 7ffa68b49640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ffa4c0b6540 0x7ffa4c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:09.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.619+0000 7ffa627fc640 1 -- 172.21.15.22:0/249396008 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7ffa540e7860 con 0x7ffa64102650 2024-09-21T04:20:09.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.619+0000 7ffa68b49640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ffa4c0b6540 0x7ffa4c0b8a50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffa64103fa0 tx=0x7ffa58007730 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:09.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.622+0000 7ffa627fc640 1 -- 172.21.15.22:0/249396008 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ffa54014030 con 0x7ffa64102650 2024-09-21T04:20:09.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.824+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/249396008 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffa641a9180 con 0x7ffa64102650 2024-09-21T04:20:09.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.825+0000 7ffa627fc640 1 -- 172.21.15.22:0/249396008 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+588 (secure 0 0 0) 0x7ffa540add30 con 0x7ffa64102650 2024-09-21T04:20:09.828 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/2250622126 2024-09-22T03:52:28.809522+0000 2024-09-21T04:20:09.828 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1700605044 2024-09-22T03:52:28.809522+0000 2024-09-21T04:20:09.828 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/3598394913 2024-09-22T03:52:28.809522+0000 2024-09-21T04:20:09.828 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/4275033300 2024-09-22T03:52:02.449463+0000 2024-09-21T04:20:09.828 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/636257932 2024-09-22T03:52:02.449463+0000 2024-09-21T04:20:09.829 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/807920923 2024-09-22T03:52:02.449463+0000 2024-09-21T04:20:09.829 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/859526938 2024-09-22T03:52:02.449463+0000 2024-09-21T04:20:09.829 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1683797431 2024-09-22T03:52:28.809522+0000 2024-09-21T04:20:09.829 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/3598394913 2024-09-22T03:52:28.809522+0000 2024-09-21T04:20:09.829 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/859526938 2024-09-22T03:52:02.449463+0000 2024-09-21T04:20:09.829 INFO:teuthology.orchestra.run.smithi022.stderr:listed 10 entries 2024-09-21T04:20:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.827+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/249396008 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ffa4c0b6540 msgr2=0x7ffa4c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.827+0000 7ffa6b5ae640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ffa4c0b6540 0x7ffa4c0b8a50 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7ffa64103fa0 tx=0x7ffa58007730 comp rx=0 tx=0).stop 2024-09-21T04:20:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.827+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/249396008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa64102650 msgr2=0x7ffa6419c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.827+0000 7ffa6b5ae640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa64102650 0x7ffa6419c590 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c970 tx=0x7ffa5400ce30 comp rx=0 tx=0).stop 2024-09-21T04:20:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.827+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/249396008 shutdown_connections 2024-09-21T04:20:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.827+0000 7ffa6b5ae640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7ffa4c0b6540 0x7ffa4c0b8a50 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.827+0000 7ffa6b5ae640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7ffa64102fa0 0x7ffa6419cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.827+0000 7ffa6b5ae640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7ffa64110200 0x7ffa641a1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.827+0000 7ffa6b5ae640 1 --2- 172.21.15.22:0/249396008 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffa64102650 0x7ffa6419c590 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:09.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.827+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/249396008 >> 172.21.15.22:0/249396008 conn(0x7ffa64079730 msgr2=0x7ffa64108c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:09.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.828+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/249396008 shutdown_connections 2024-09-21T04:20:09.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:09.828+0000 7ffa6b5ae640 1 -- 172.21.15.22:0/249396008 wait complete. 2024-09-21T04:20:10.690 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-09-21T04:20:10.690 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T04:20:10.708 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd blocklist ls 2024-09-21T04:20:11.012 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:20:11.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:10 smithi022 ceph-mon[31015]: pgmap v905: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T04:20:11.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:10 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/249396008' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:20:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:10 smithi073 ceph-mon[34443]: pgmap v905: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T04:20:11.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:10 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/249396008' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:20:11.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:10 smithi060 ceph-mon[33722]: pgmap v905: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-09-21T04:20:11.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:10 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/249396008' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:20:11.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.515+0000 7f3e7157f640 1 -- 172.21.15.22:0/1103431452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e6c108cf0 msgr2=0x7f3e6c10f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:11.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.515+0000 7f3e7157f640 1 --2- 172.21.15.22:0/1103431452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e6c108cf0 0x7f3e6c10f520 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f3e64009ca0 tx=0x7f3e6402a8c0 comp rx=0 tx=0).stop 2024-09-21T04:20:11.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.515+0000 7f3e7157f640 1 -- 172.21.15.22:0/1103431452 shutdown_connections 2024-09-21T04:20:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.515+0000 7f3e7157f640 1 --2- 172.21.15.22:0/1103431452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e6c108cf0 0x7f3e6c10f520 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.515+0000 7f3e7157f640 1 --2- 172.21.15.22:0/1103431452 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e6c1083a0 0x7f3e6c1087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.515+0000 7f3e7157f640 1 --2- 172.21.15.22:0/1103431452 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e6c102a60 0x7f3e6c102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.515+0000 7f3e7157f640 1 -- 172.21.15.22:0/1103431452 >> 172.21.15.22:0/1103431452 conn(0x7f3e6c079730 msgr2=0x7f3e6c079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.515+0000 7f3e7157f640 1 -- 172.21.15.22:0/1103431452 shutdown_connections 2024-09-21T04:20:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.516+0000 7f3e7157f640 1 -- 172.21.15.22:0/1103431452 wait complete. 2024-09-21T04:20:11.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.516+0000 7f3e7157f640 1 Processor -- start 2024-09-21T04:20:11.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.516+0000 7f3e7157f640 1 -- start start 2024-09-21T04:20:11.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e7157f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e6c102a60 0x7f3e6c1992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:11.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e7157f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e6c1083a0 0x7f3e6c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:11.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e7157f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e6c108cf0 0x7f3e6c19eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e7157f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c112860 con 0x7f3e6c108cf0 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e7157f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c1126e0 con 0x7f3e6c1083a0 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e7157f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3e6c1129e0 con 0x7f3e6c102a60 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e6b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e6c108cf0 0x7f3e6c19eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e6b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e6c108cf0 0x7f3e6c19eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49162/0 (socket says 172.21.15.22:49162) 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e6b7fe640 1 -- 172.21.15.22:0/3262792352 learned_addr learned my addr 172.21.15.22:0/3262792352 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e6a7fc640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e6c1083a0 0x7f3e6c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e6affd640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e6c102a60 0x7f3e6c1992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e6b7fe640 1 -- 172.21.15.22:0/3262792352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e6c102a60 msgr2=0x7f3e6c1992d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e6b7fe640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e6c102a60 0x7f3e6c1992d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:11.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e6b7fe640 1 -- 172.21.15.22:0/3262792352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e6c1083a0 msgr2=0x7f3e6c199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e6b7fe640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e6c1083a0 0x7f3e6c199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.517+0000 7f3e6b7fe640 1 -- 172.21.15.22:0/3262792352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e6c19f240 con 0x7f3e6c108cf0 2024-09-21T04:20:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.518+0000 7f3e6b7fe640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e6c108cf0 0x7f3e6c19eb10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3e64005cc0 tx=0x7f3e64032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.518+0000 7f3e53fff640 1 -- 172.21.15.22:0/3262792352 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64032e00 con 0x7f3e6c108cf0 2024-09-21T04:20:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.518+0000 7f3e53fff640 1 -- 172.21.15.22:0/3262792352 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e640044d0 con 0x7f3e6c108cf0 2024-09-21T04:20:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.518+0000 7f3e7157f640 1 -- 172.21.15.22:0/3262792352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e6c19f4d0 con 0x7f3e6c108cf0 2024-09-21T04:20:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.518+0000 7f3e53fff640 1 -- 172.21.15.22:0/3262792352 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64030b70 con 0x7f3e6c108cf0 2024-09-21T04:20:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.518+0000 7f3e7157f640 1 -- 172.21.15.22:0/3262792352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e6c1a5c90 con 0x7f3e6c108cf0 2024-09-21T04:20:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.519+0000 7f3e7157f640 1 -- 172.21.15.22:0/3262792352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e6c102e70 con 0x7f3e6c108cf0 2024-09-21T04:20:11.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.521+0000 7f3e53fff640 1 -- 172.21.15.22:0/3262792352 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3e64030d10 con 0x7f3e6c108cf0 2024-09-21T04:20:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.522+0000 7f3e53fff640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3e540b6510 0x7f3e540b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.522+0000 7f3e6affd640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3e540b6510 0x7f3e540b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:11.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.522+0000 7f3e53fff640 1 -- 172.21.15.22:0/3262792352 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f3e64108b10 con 0x7f3e6c108cf0 2024-09-21T04:20:11.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.522+0000 7f3e6affd640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3e540b6510 0x7f3e540b8a20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c005fd0 tx=0x7f3e5c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:11.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.525+0000 7f3e53fff640 1 -- 172.21.15.22:0/3262792352 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e640cefe0 con 0x7f3e6c108cf0 2024-09-21T04:20:11.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.727+0000 7f3e7157f640 1 -- 172.21.15.22:0/3262792352 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3e6c10aae0 con 0x7f3e6c108cf0 2024-09-21T04:20:11.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.728+0000 7f3e53fff640 1 -- 172.21.15.22:0/3262792352 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v85) ==== 81+0+588 (secure 0 0 0) 0x7f3e640d33c0 con 0x7f3e6c108cf0 2024-09-21T04:20:11.731 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/2250622126 2024-09-22T03:52:28.809522+0000 2024-09-21T04:20:11.731 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1700605044 2024-09-22T03:52:28.809522+0000 2024-09-21T04:20:11.731 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/3598394913 2024-09-22T03:52:28.809522+0000 2024-09-21T04:20:11.731 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/4275033300 2024-09-22T03:52:02.449463+0000 2024-09-21T04:20:11.731 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/636257932 2024-09-22T03:52:02.449463+0000 2024-09-21T04:20:11.732 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/807920923 2024-09-22T03:52:02.449463+0000 2024-09-21T04:20:11.732 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6801/859526938 2024-09-22T03:52:02.449463+0000 2024-09-21T04:20:11.732 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:0/1683797431 2024-09-22T03:52:28.809522+0000 2024-09-21T04:20:11.732 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/3598394913 2024-09-22T03:52:28.809522+0000 2024-09-21T04:20:11.732 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.15.22:6800/859526938 2024-09-22T03:52:02.449463+0000 2024-09-21T04:20:11.732 INFO:teuthology.orchestra.run.smithi022.stderr:listed 10 entries 2024-09-21T04:20:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.730+0000 7f3e7157f640 1 -- 172.21.15.22:0/3262792352 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3e540b6510 msgr2=0x7f3e540b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.730+0000 7f3e7157f640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3e540b6510 0x7f3e540b8a20 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c005fd0 tx=0x7f3e5c005850 comp rx=0 tx=0).stop 2024-09-21T04:20:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.730+0000 7f3e7157f640 1 -- 172.21.15.22:0/3262792352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e6c108cf0 msgr2=0x7f3e6c19eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.730+0000 7f3e7157f640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e6c108cf0 0x7f3e6c19eb10 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f3e64005cc0 tx=0x7f3e64032a10 comp rx=0 tx=0).stop 2024-09-21T04:20:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.730+0000 7f3e7157f640 1 -- 172.21.15.22:0/3262792352 shutdown_connections 2024-09-21T04:20:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.730+0000 7f3e7157f640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f3e540b6510 0x7f3e540b8a20 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.730+0000 7f3e7157f640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e6c108cf0 0x7f3e6c19eb10 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.730+0000 7f3e7157f640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3e6c1083a0 0x7f3e6c199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.730+0000 7f3e7157f640 1 --2- 172.21.15.22:0/3262792352 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3e6c102a60 0x7f3e6c1992d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:11.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.730+0000 7f3e7157f640 1 -- 172.21.15.22:0/3262792352 >> 172.21.15.22:0/3262792352 conn(0x7f3e6c079730 msgr2=0x7f3e6c104410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:11.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.731+0000 7f3e7157f640 1 -- 172.21.15.22:0/3262792352 shutdown_connections 2024-09-21T04:20:11.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:11.731+0000 7f3e7157f640 1 -- 172.21.15.22:0/3262792352 wait complete. 2024-09-21T04:20:12.031 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:11 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/3262792352' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:20:12.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:11 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/3262792352' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:20:12.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:11 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/3262792352' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T04:20:12.456 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi022.front.sepia.ceph.com... 2024-09-21T04:20:12.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:20:12.457 DEBUG:teuthology.orchestra.run.smithi022:> sudo fusermount -u /tmp/cephfs 2024-09-21T04:20:12.491 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[85359]: fuse finished with error 0 and tester_r 0 2024-09-21T04:20:12.573 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T04:20:13.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:12 smithi022 ceph-mon[31015]: pgmap v906: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:20:13.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:12 smithi073 ceph-mon[34443]: pgmap v906: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:20:13.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:12 smithi060 ceph-mon[33722]: pgmap v906: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-09-21T04:20:15.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:14 smithi022 ceph-mon[31015]: pgmap v907: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:20:15.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:14 smithi073 ceph-mon[34443]: pgmap v907: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:20:15.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:14 smithi060 ceph-mon[33722]: pgmap v907: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-09-21T04:20:17.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:16 smithi022 ceph-mon[31015]: pgmap v908: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T04:20:17.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:16 smithi073 ceph-mon[34443]: pgmap v908: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T04:20:17.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:16 smithi060 ceph-mon[33722]: pgmap v908: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 597 B/s wr, 11 op/s 2024-09-21T04:20:18.675 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-09-21T04:20:18.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:20:18.675 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-09-21T04:20:18.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:20:18.702 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-09-21T04:20:18.835 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-09-21T04:20:18.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:20:18.835 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-09-21T04:20:18.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T04:20:18.866 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-09-21T04:20:18.966 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T04:20:18.975 INFO:tasks.cephadm:Teardown begin 2024-09-21T04:20:18.975 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-21T04:20:18.976 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:20:19.088 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:18 smithi022 ceph-mon[31015]: pgmap v909: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-21T04:20:19.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:18 smithi073 ceph-mon[34443]: pgmap v909: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-21T04:20:19.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:18 smithi060 ceph-mon[33722]: pgmap v909: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-21T04:20:19.245 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:20:19.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 -- 172.21.15.22:0/3851533892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc14c1052b0 msgr2=0x7fc14c10d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:19.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 --2- 172.21.15.22:0/3851533892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc14c1052b0 0x7fc14c10d8f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc138009900 tx=0x7fc13802a410 comp rx=0 tx=0).stop 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 -- 172.21.15.22:0/3851533892 shutdown_connections 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 --2- 172.21.15.22:0/3851533892 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc14c10de30 0x7fc14c110310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 --2- 172.21.15.22:0/3851533892 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc14c1052b0 0x7fc14c10d8f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 --2- 172.21.15.22:0/3851533892 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c104880 0x7fc14c104c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 -- 172.21.15.22:0/3851533892 >> 172.21.15.22:0/3851533892 conn(0x7fc14c079740 msgr2=0x7fc14c079b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 -- 172.21.15.22:0/3851533892 shutdown_connections 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 -- 172.21.15.22:0/3851533892 wait complete. 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 Processor -- start 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.759+0000 7fc15306a640 1 -- start start 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc15306a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc14c104880 0x7fc14c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:19.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc15306a640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c1052b0 0x7fc14c19a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc15306a640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc14c10de30 0x7fc14c19fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc15306a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c113930 con 0x7fc14c104880 2024-09-21T04:20:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc15306a640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c1137b0 con 0x7fc14c10de30 2024-09-21T04:20:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc15306a640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7fc14c113ab0 con 0x7fc14c1052b0 2024-09-21T04:20:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc150e06640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc14c104880 0x7fc14c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc150e06640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc14c104880 0x7fc14c19a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:49176/0 (socket says 172.21.15.22:49176) 2024-09-21T04:20:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc150e06640 1 -- 172.21.15.22:0/735484048 learned_addr learned my addr 172.21.15.22:0/735484048 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:20:19.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc14bfff640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c1052b0 0x7fc14c19a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc151607640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc14c10de30 0x7fc14c19fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc150e06640 1 -- 172.21.15.22:0/735484048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c1052b0 msgr2=0x7fc14c19a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc150e06640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c1052b0 0x7fc14c19a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc150e06640 1 -- 172.21.15.22:0/735484048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc14c10de30 msgr2=0x7fc14c19fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc150e06640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc14c10de30 0x7fc14c19fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc150e06640 1 -- 172.21.15.22:0/735484048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc14c1a0350 con 0x7fc14c104880 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc151607640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc14c10de30 0x7fc14c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.760+0000 7fc150e06640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc14c104880 0x7fc14c19a3e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc14000d950 tx=0x7fc14000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.761+0000 7fc149ffb640 1 -- 172.21.15.22:0/735484048 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc140017070 con 0x7fc14c104880 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.761+0000 7fc15306a640 1 -- 172.21.15.22:0/735484048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14c1a0640 con 0x7fc14c104880 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.761+0000 7fc149ffb640 1 -- 172.21.15.22:0/735484048 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc140009c30 con 0x7fc14c104880 2024-09-21T04:20:19.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.761+0000 7fc149ffb640 1 -- 172.21.15.22:0/735484048 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc14000f620 con 0x7fc14c104880 2024-09-21T04:20:19.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.761+0000 7fc15306a640 1 -- 172.21.15.22:0/735484048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc14c1a6da0 con 0x7fc14c104880 2024-09-21T04:20:19.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.762+0000 7fc15306a640 1 -- 172.21.15.22:0/735484048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc14c06c1c0 con 0x7fc14c104880 2024-09-21T04:20:19.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.763+0000 7fc149ffb640 1 -- 172.21.15.22:0/735484048 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7fc140005030 con 0x7fc14c104880 2024-09-21T04:20:19.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.764+0000 7fc149ffb640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc13c0b6510 0x7fc13c0b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:19.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.764+0000 7fc14bfff640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc13c0b6510 0x7fc13c0b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:19.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.764+0000 7fc149ffb640 1 -- 172.21.15.22:0/735484048 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7fc1400e72f0 con 0x7fc14c104880 2024-09-21T04:20:19.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.765+0000 7fc14bfff640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc13c0b6510 0x7fc13c0b8a20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc138005940 tx=0x7fc1380058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:19.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.767+0000 7fc149ffb640 1 -- 172.21.15.22:0/735484048 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc1400ad760 con 0x7fc14c104880 2024-09-21T04:20:19.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.995+0000 7fc15306a640 1 -- 172.21.15.22:0/735484048 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc14c104c90 con 0x7fc14c104880 2024-09-21T04:20:19.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.995+0000 7fc149ffb640 1 -- 172.21.15.22:0/735484048 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11967 (secure 0 0 0) 0x7fc140009de0 con 0x7fc14c104880 2024-09-21T04:20:19.999 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:20:19.999 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":53,"btime":"2024-09-21T04:19:56:730132+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:19:56.650338+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:20:20.000 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 53 2024-09-21T04:20:20.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 -- 172.21.15.22:0/735484048 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc13c0b6510 msgr2=0x7fc13c0b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:20.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc13c0b6510 0x7fc13c0b8a20 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fc138005940 tx=0x7fc1380058d0 comp rx=0 tx=0).stop 2024-09-21T04:20:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 -- 172.21.15.22:0/735484048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc14c104880 msgr2=0x7fc14c19a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc14c104880 0x7fc14c19a3e0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc14000d950 tx=0x7fc14000de10 comp rx=0 tx=0).stop 2024-09-21T04:20:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 -- 172.21.15.22:0/735484048 shutdown_connections 2024-09-21T04:20:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7fc13c0b6510 0x7fc13c0b8a20 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7fc14c1052b0 0x7fc14c19a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7fc14c10de30 0x7fc14c19fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 --2- 172.21.15.22:0/735484048 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc14c104880 0x7fc14c19a3e0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 -- 172.21.15.22:0/735484048 >> 172.21.15.22:0/735484048 conn(0x7fc14c079740 msgr2=0x7fc14c1009b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 -- 172.21.15.22:0/735484048 shutdown_connections 2024-09-21T04:20:20.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:19.998+0000 7fc15306a640 1 -- 172.21.15.22:0/735484048 wait complete. 2024-09-21T04:20:20.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs dump --format=json 2024-09-21T04:20:21.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:20 smithi022 ceph-mon[31015]: pgmap v910: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T04:20:21.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:20 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/735484048' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:20:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:20 smithi073 ceph-mon[34443]: pgmap v910: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T04:20:21.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:20 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/735484048' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:20:21.183 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:20:21.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:20 smithi060 ceph-mon[33722]: pgmap v910: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1.2 KiB/s wr, 11 op/s 2024-09-21T04:20:21.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:20 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/735484048' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:20:21.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.651+0000 7f020be07640 1 -- 172.21.15.22:0/4171012811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204103b60 msgr2=0x7f0204103f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:21.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.651+0000 7f020be07640 1 --2- 172.21.15.22:0/4171012811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204103b60 0x7f0204103f70 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f0200009900 tx=0x7f020002a410 comp rx=0 tx=0).stop 2024-09-21T04:20:21.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.651+0000 7f020be07640 1 -- 172.21.15.22:0/4171012811 shutdown_connections 2024-09-21T04:20:21.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.651+0000 7f020be07640 1 --2- 172.21.15.22:0/4171012811 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f02041094a0 0x7f02041098b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:21.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.651+0000 7f020be07640 1 --2- 172.21.15.22:0/4171012811 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f0204109df0 0x7f0204110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:21.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.651+0000 7f020be07640 1 --2- 172.21.15.22:0/4171012811 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204103b60 0x7f0204103f70 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.651+0000 7f020be07640 1 -- 172.21.15.22:0/4171012811 >> 172.21.15.22:0/4171012811 conn(0x7f020407b850 msgr2=0x7f020407bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.652+0000 7f020be07640 1 -- 172.21.15.22:0/4171012811 shutdown_connections 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.652+0000 7f020be07640 1 -- 172.21.15.22:0/4171012811 wait complete. 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.652+0000 7f020be07640 1 Processor -- start 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.652+0000 7f020be07640 1 -- start start 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f020be07640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204103b60 0x7f0204075710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f020be07640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02041094a0 0x7f0204075c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f020be07640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0204109df0 0x7f0204076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f020be07640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0204113960 con 0x7f0204103b60 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f020be07640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f02041137e0 con 0x7f02041094a0 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f020be07640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f0204113ae0 con 0x7f0204109df0 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f0209ba3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204103b60 0x7f0204075710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f0209ba3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204103b60 0x7f0204075710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54750/0 (socket says 172.21.15.22:54750) 2024-09-21T04:20:21.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f0209ba3640 1 -- 172.21.15.22:0/4011504535 learned_addr learned my addr 172.21.15.22:0/4011504535 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f020a3a4640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0204109df0 0x7f0204076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f02093a2640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02041094a0 0x7f0204075c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f0209ba3640 1 -- 172.21.15.22:0/4011504535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0204109df0 msgr2=0x7f0204076190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f0209ba3640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0204109df0 0x7f0204076190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f0209ba3640 1 -- 172.21.15.22:0/4011504535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02041094a0 msgr2=0x7f0204075c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f0209ba3640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02041094a0 0x7f0204075c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f0209ba3640 1 -- 172.21.15.22:0/4011504535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02041a8640 con 0x7f0204103b60 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.653+0000 7f0209ba3640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204103b60 0x7f0204075710 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0200009230 tx=0x7f0200004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.654+0000 7f01faffd640 1 -- 172.21.15.22:0/4011504535 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020003f030 con 0x7f0204103b60 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.654+0000 7f01faffd640 1 -- 172.21.15.22:0/4011504535 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0200003a80 con 0x7f0204103b60 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.654+0000 7f020be07640 1 -- 172.21.15.22:0/4011504535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02041a88d0 con 0x7f0204103b60 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.654+0000 7f01faffd640 1 -- 172.21.15.22:0/4011504535 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200035070 con 0x7f0204103b60 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.654+0000 7f020be07640 1 -- 172.21.15.22:0/4011504535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02041a8e00 con 0x7f0204103b60 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.655+0000 7f020be07640 1 -- 172.21.15.22:0/4011504535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0204103f70 con 0x7f0204103b60 2024-09-21T04:20:21.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.656+0000 7f01faffd640 1 -- 172.21.15.22:0/4011504535 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f0200042030 con 0x7f0204103b60 2024-09-21T04:20:21.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.657+0000 7f01faffd640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01f00b6590 0x7f01f00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:21.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.657+0000 7f02093a2640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01f00b6590 0x7f01f00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:21.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.657+0000 7f01faffd640 1 -- 172.21.15.22:0/4011504535 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f0200108270 con 0x7f0204103b60 2024-09-21T04:20:21.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.657+0000 7f02093a2640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01f00b6590 0x7f01f00b8aa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005fd0 tx=0x7f01f4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:21.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.660+0000 7f01faffd640 1 -- 172.21.15.22:0/4011504535 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f02000ce740 con 0x7f0204103b60 2024-09-21T04:20:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.889+0000 7f020be07640 1 -- 172.21.15.22:0/4011504535 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0204076a10 con 0x7f0204103b60 2024-09-21T04:20:21.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.889+0000 7f01faffd640 1 -- 172.21.15.22:0/4011504535 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) ==== 94+0+11967 (secure 0 0 0) 0x7f0204076a10 con 0x7f0204103b60 2024-09-21T04:20:21.893 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:20:21.893 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":53,"btime":"2024-09-21T04:19:56:730132+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14712,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/536633009","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":536633009},{"type":"v1","addr":"172.21.15.22:6835","nonce":536633009}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14724,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3675102872","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3675102872},{"type":"v1","addr":"172.21.15.22:6837","nonce":3675102872}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":53,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-21T04:00:04.669771+0000","modified":"2024-09-21T04:19:56.650338+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":24647,"mds_1":24634,"mds_2":24617,"mds_3":24616,"mds_4":24610},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14775":{"gid":14775,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6839/61235994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6838","nonce":61235994},{"type":"v1","addr":"172.21.15.22:6839","nonce":61235994}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14787":{"gid":14787,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.22:6841/2021253625","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6840","nonce":2021253625},{"type":"v1","addr":"172.21.15.22:6841","nonce":2021253625}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24566":{"gid":24566,"name":"k","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6833/2373240323","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6832","nonce":2373240323},{"type":"v1","addr":"172.21.15.60:6833","nonce":2373240323}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24571":{"gid":24571,"name":"l","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.73:6833/1353426950","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6832","nonce":1353426950},{"type":"v1","addr":"172.21.15.73:6833","nonce":1353426950}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24596":{"gid":24596,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.60:6835/2092262185","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6834","nonce":2092262185},{"type":"v1","addr":"172.21.15.60:6835","nonce":2092262185}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24610":{"gid":24610,"name":"f","rank":4,"incarnation":26,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6835/4117291653","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6834","nonce":4117291653},{"type":"v1","addr":"172.21.15.73:6835","nonce":4117291653}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24616":{"gid":24616,"name":"c","rank":3,"incarnation":24,"state":"up:active","state_seq":18,"addr":"172.21.15.73:6837/3229670499","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6836","nonce":3229670499},{"type":"v1","addr":"172.21.15.73:6837","nonce":3229670499}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24617":{"gid":24617,"name":"h","rank":2,"incarnation":22,"state":"up:active","state_seq":17,"addr":"172.21.15.60:6837/3007306472","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6836","nonce":3007306472},{"type":"v1","addr":"172.21.15.60:6837","nonce":3007306472}]},"join_fscid":-1,"export_targets":[0],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24634":{"gid":24634,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.73:6839/1883983314","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6838","nonce":1883983314},{"type":"v1","addr":"172.21.15.73:6839","nonce":1883983314}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24647":{"gid":24647,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.60:6839/3182487250","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6838","nonce":3182487250},{"type":"v1","addr":"172.21.15.60:6839","nonce":3182487250}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24647,"qdb_cluster":[24610,24616,24617,24634,24647]},"id":1}]} 2024-09-21T04:20:21.893 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 53 2024-09-21T04:20:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 -- 172.21.15.22:0/4011504535 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01f00b6590 msgr2=0x7f01f00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01f00b6590 0x7f01f00b8aa0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f01f4005fd0 tx=0x7f01f4005850 comp rx=0 tx=0).stop 2024-09-21T04:20:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 -- 172.21.15.22:0/4011504535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204103b60 msgr2=0x7f0204075710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204103b60 0x7f0204075710 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f0200009230 tx=0x7f0200004270 comp rx=0 tx=0).stop 2024-09-21T04:20:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 -- 172.21.15.22:0/4011504535 shutdown_connections 2024-09-21T04:20:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f01f00b6590 0x7f01f00b8aa0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:21.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f0204109df0 0x7f0204076190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f02041094a0 0x7f0204075c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 --2- 172.21.15.22:0/4011504535 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0204103b60 0x7f0204075710 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 -- 172.21.15.22:0/4011504535 >> 172.21.15.22:0/4011504535 conn(0x7f020407b850 msgr2=0x7f0204107640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 -- 172.21.15.22:0/4011504535 shutdown_connections 2024-09-21T04:20:21.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:21.892+0000 7f020be07640 1 -- 172.21.15.22:0/4011504535 wait complete. 2024-09-21T04:20:22.616 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd dump --format=json 2024-09-21T04:20:22.849 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:22 smithi022 ceph-mon[31015]: pgmap v911: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-21T04:20:22.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:22 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/4011504535' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:20:22.876 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:20:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:22 smithi073 ceph-mon[34443]: pgmap v911: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-21T04:20:23.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:22 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/4011504535' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:20:23.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:22 smithi060 ceph-mon[33722]: pgmap v911: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 1.2 KiB/s wr, 13 op/s 2024-09-21T04:20:23.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:22 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/4011504535' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T04:20:23.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 -- 172.21.15.22:0/4247730351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39181094a0 msgr2=0x7f39181098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 --2- 172.21.15.22:0/4247730351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39181094a0 0x7f39181098b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f3904009900 tx=0x7f390402a410 comp rx=0 tx=0).stop 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 -- 172.21.15.22:0/4247730351 shutdown_connections 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 --2- 172.21.15.22:0/4247730351 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3918109df0 0x7f3918110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 --2- 172.21.15.22:0/4247730351 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39181094a0 0x7f39181098b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 --2- 172.21.15.22:0/4247730351 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3918103b60 0x7f3918103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 -- 172.21.15.22:0/4247730351 >> 172.21.15.22:0/4247730351 conn(0x7f391807b850 msgr2=0x7f391807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 -- 172.21.15.22:0/4247730351 shutdown_connections 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 -- 172.21.15.22:0/4247730351 wait complete. 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 Processor -- start 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.379+0000 7f391eda2640 1 -- start start 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f391eda2640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3918103b60 0x7f391819a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:23.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f391eda2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39181094a0 0x7f391819a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f391eda2640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3918109df0 0x7f391819fc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f391eda2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3918113960 con 0x7f39181094a0 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f391eda2640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f39181137e0 con 0x7f3918109df0 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f391eda2640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f3918113ae0 con 0x7f3918103b60 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f3917fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39181094a0 0x7f391819a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f3917fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39181094a0 0x7f391819a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54772/0 (socket says 172.21.15.22:54772) 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f3917fff640 1 -- 172.21.15.22:0/1103064185 learned_addr learned my addr 172.21.15.22:0/1103064185 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f391cb3e640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3918103b60 0x7f391819a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f391d33f640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3918109df0 0x7f391819fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f3917fff640 1 -- 172.21.15.22:0/1103064185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3918103b60 msgr2=0x7f391819a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f3917fff640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3918103b60 0x7f391819a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f3917fff640 1 -- 172.21.15.22:0/1103064185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3918109df0 msgr2=0x7f391819fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f3917fff640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3918109df0 0x7f391819fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:23.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f3917fff640 1 -- 172.21.15.22:0/1103064185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39181a0380 con 0x7f39181094a0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.380+0000 7f3917fff640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39181094a0 0x7f391819a9b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3904005940 tx=0x7f39040040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.381+0000 7f3915ffb640 1 -- 172.21.15.22:0/1103064185 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f390403f030 con 0x7f39181094a0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.381+0000 7f391eda2640 1 -- 172.21.15.22:0/1103064185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39181a0610 con 0x7f39181094a0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.381+0000 7f3915ffb640 1 -- 172.21.15.22:0/1103064185 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3904003a80 con 0x7f39181094a0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.381+0000 7f3915ffb640 1 -- 172.21.15.22:0/1103064185 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3904035070 con 0x7f39181094a0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.381+0000 7f391eda2640 1 -- 172.21.15.22:0/1103064185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39181a6dd0 con 0x7f39181094a0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.382+0000 7f391eda2640 1 -- 172.21.15.22:0/1103064185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3918104de0 con 0x7f39181094a0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.383+0000 7f3915ffb640 1 -- 172.21.15.22:0/1103064185 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f3904042030 con 0x7f39181094a0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.384+0000 7f3915ffb640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39080b6510 0x7f39080b8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.384+0000 7f391cb3e640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39080b6510 0x7f39080b8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.384+0000 7f3915ffb640 1 -- 172.21.15.22:0/1103064185 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f3904107ff0 con 0x7f39181094a0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.385+0000 7f391cb3e640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39080b6510 0x7f39080b8a20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f390c005d00 tx=0x7f390c00b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:23.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.388+0000 7f3915ffb640 1 -- 172.21.15.22:0/1103064185 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39040ce4a0 con 0x7f39181094a0 2024-09-21T04:20:23.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.577+0000 7f391eda2640 1 -- 172.21.15.22:0/1103064185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f391810bbe0 con 0x7f39181094a0 2024-09-21T04:20:23.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.578+0000 7f3915ffb640 1 -- 172.21.15.22:0/1103064185 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) ==== 74+0+24751 (secure 0 0 0) 0x7f39040d2880 con 0x7f39181094a0 2024-09-21T04:20:23.582 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-09-21T04:20:23.582 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":85,"fsid":"ae19ad46-77cc-11ef-baf5-efdc52797490","created":"2024-09-21T03:51:32.216990+0000","modified":"2024-09-21T04:01:31.025432+0000","last_up_change":"2024-09-21T03:59:10.650298+0000","last_in_change":"2024-09-21T03:58:47.636874+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T03:55:19.289173+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-21T04:00:00.586018+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-21T04:00:02.887576+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"74","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-09-21T04:00:09.042452+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"83062b79-0279-4099-afb7-f1a51046ca56","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6803","nonce":360746726}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6805","nonce":360746726}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6809","nonce":360746726}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":360746726},{"type":"v1","addr":"172.21.15.22:6807","nonce":360746726}]},"public_addr":"172.21.15.22:6803/360746726","cluster_addr":"172.21.15.22:6805/360746726","heartbeat_back_addr":"172.21.15.22:6809/360746726","heartbeat_front_addr":"172.21.15.22:6807/360746726","state":["exists","up"]},{"osd":1,"uuid":"08151432-cfef-4b3d-88eb-5cd78d8eab0b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6800","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6801","nonce":1805383565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6802","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6803","nonce":1805383565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6806","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6807","nonce":1805383565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6804","nonce":1805383565},{"type":"v1","addr":"172.21.15.60:6805","nonce":1805383565}]},"public_addr":"172.21.15.60:6801/1805383565","cluster_addr":"172.21.15.60:6803/1805383565","heartbeat_back_addr":"172.21.15.60:6807/1805383565","heartbeat_front_addr":"172.21.15.60:6805/1805383565","state":["exists","up"]},{"osd":2,"uuid":"c6ac00d8-4358-45b9-85d2-c14921cdd053","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6800","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6801","nonce":3937108185}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6802","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6803","nonce":3937108185}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6806","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6807","nonce":3937108185}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6804","nonce":3937108185},{"type":"v1","addr":"172.21.15.73:6805","nonce":3937108185}]},"public_addr":"172.21.15.73:6801/3937108185","cluster_addr":"172.21.15.73:6803/3937108185","heartbeat_back_addr":"172.21.15.73:6807/3937108185","heartbeat_front_addr":"172.21.15.73:6805/3937108185","state":["exists","up"]},{"osd":3,"uuid":"c5b81662-58c9-4931-9377-b9bd9f18c6e4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":23,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6811","nonce":2768755547}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6813","nonce":2768755547}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6817","nonce":2768755547}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":2768755547},{"type":"v1","addr":"172.21.15.22:6815","nonce":2768755547}]},"public_addr":"172.21.15.22:6811/2768755547","cluster_addr":"172.21.15.22:6813/2768755547","heartbeat_back_addr":"172.21.15.22:6817/2768755547","heartbeat_front_addr":"172.21.15.22:6815/2768755547","state":["exists","up"]},{"osd":4,"uuid":"aa0cec75-47d4-4449-b928-fae79f9196e5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":29,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6808","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6809","nonce":1223928144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6810","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6811","nonce":1223928144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6814","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6815","nonce":1223928144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6812","nonce":1223928144},{"type":"v1","addr":"172.21.15.60:6813","nonce":1223928144}]},"public_addr":"172.21.15.60:6809/1223928144","cluster_addr":"172.21.15.60:6811/1223928144","heartbeat_back_addr":"172.21.15.60:6815/1223928144","heartbeat_front_addr":"172.21.15.60:6813/1223928144","state":["exists","up"]},{"osd":5,"uuid":"a273207d-bf1d-4931-913d-e23491b84857","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6808","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6809","nonce":1537788628}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6810","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6811","nonce":1537788628}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6814","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6815","nonce":1537788628}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6812","nonce":1537788628},{"type":"v1","addr":"172.21.15.73:6813","nonce":1537788628}]},"public_addr":"172.21.15.73:6809/1537788628","cluster_addr":"172.21.15.73:6811/1537788628","heartbeat_back_addr":"172.21.15.73:6815/1537788628","heartbeat_front_addr":"172.21.15.73:6813/1537788628","state":["exists","up"]},{"osd":6,"uuid":"d5061cbb-19ed-4027-9249-9c46cac4cf5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6819","nonce":998386094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6821","nonce":998386094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6825","nonce":998386094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":998386094},{"type":"v1","addr":"172.21.15.22:6823","nonce":998386094}]},"public_addr":"172.21.15.22:6819/998386094","cluster_addr":"172.21.15.22:6821/998386094","heartbeat_back_addr":"172.21.15.22:6825/998386094","heartbeat_front_addr":"172.21.15.22:6823/998386094","state":["exists","up"]},{"osd":7,"uuid":"3e922938-5d07-46fe-aa70-a2d9d34844d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":45,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6816","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6817","nonce":1887420372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6818","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6819","nonce":1887420372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6822","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6823","nonce":1887420372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6820","nonce":1887420372},{"type":"v1","addr":"172.21.15.60:6821","nonce":1887420372}]},"public_addr":"172.21.15.60:6817/1887420372","cluster_addr":"172.21.15.60:6819/1887420372","heartbeat_back_addr":"172.21.15.60:6823/1887420372","heartbeat_front_addr":"172.21.15.60:6821/1887420372","state":["exists","up"]},{"osd":8,"uuid":"0ec0cee7-24d3-4022-802c-506565544114","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":51,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6816","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6817","nonce":3798177718}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6818","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6819","nonce":3798177718}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6822","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6823","nonce":3798177718}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6820","nonce":3798177718},{"type":"v1","addr":"172.21.15.73:6821","nonce":3798177718}]},"public_addr":"172.21.15.73:6817/3798177718","cluster_addr":"172.21.15.73:6819/3798177718","heartbeat_back_addr":"172.21.15.73:6823/3798177718","heartbeat_front_addr":"172.21.15.73:6821/3798177718","state":["exists","up"]},{"osd":9,"uuid":"968b9387-432d-43fc-a2e7-76257b93cc83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":57,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6827","nonce":672345828}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6829","nonce":672345828}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6833","nonce":672345828}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":672345828},{"type":"v1","addr":"172.21.15.22:6831","nonce":672345828}]},"public_addr":"172.21.15.22:6827/672345828","cluster_addr":"172.21.15.22:6829/672345828","heartbeat_back_addr":"172.21.15.22:6833/672345828","heartbeat_front_addr":"172.21.15.22:6831/672345828","state":["exists","up"]},{"osd":10,"uuid":"b7c321ad-f83a-4d51-a4dc-65dfe62b59e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6824","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6825","nonce":1905936274}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6826","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6827","nonce":1905936274}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6830","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6831","nonce":1905936274}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.60:6828","nonce":1905936274},{"type":"v1","addr":"172.21.15.60:6829","nonce":1905936274}]},"public_addr":"172.21.15.60:6825/1905936274","cluster_addr":"172.21.15.60:6827/1905936274","heartbeat_back_addr":"172.21.15.60:6831/1905936274","heartbeat_front_addr":"172.21.15.60:6829/1905936274","state":["exists","up"]},{"osd":11,"uuid":"2c83d7da-b854-47cb-8768-48f57bd3ef85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6824","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6825","nonce":2116186038}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6826","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6827","nonce":2116186038}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6830","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6831","nonce":2116186038}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.73:6828","nonce":2116186038},{"type":"v1","addr":"172.21.15.73:6829","nonce":2116186038}]},"public_addr":"172.21.15.73:6825/2116186038","cluster_addr":"172.21.15.73:6827/2116186038","heartbeat_back_addr":"172.21.15.73:6831/2116186038","heartbeat_front_addr":"172.21.15.73:6829/2116186038","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:27.462202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:54:52.935365+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:17.447124+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:55:43.823262+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:09.509016+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:56:35.090809+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:01.465679+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:27.567926+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:57:52.777341+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:18.654103+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:58:44.113248+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T03:59:09.142968+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.0","mappings":[{"from":7,"to":11},{"from":5,"to":6}]},{"pgid":"2.6","mappings":[{"from":8,"to":11}]},{"pgid":"2.b","mappings":[{"from":2,"to":4}]},{"pgid":"2.1a","mappings":[{"from":8,"to":1}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.33","mappings":[{"from":5,"to":9}]},{"pgid":"4.6","mappings":[{"from":9,"to":11}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.e","mappings":[{"from":5,"to":8}]},{"pgid":"4.10","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.22:0/2250622126":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/1700605044":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6801/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:0/4275033300":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/636257932":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/807920923":"2024-09-22T03:52:02.449463+0000","172.21.15.22:6801/859526938":"2024-09-22T03:52:02.449463+0000","172.21.15.22:0/1683797431":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/3598394913":"2024-09-22T03:52:28.809522+0000","172.21.15.22:6800/859526938":"2024-09-22T03:52:02.449463+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T04:20:23.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 -- 172.21.15.22:0/1103064185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39080b6510 msgr2=0x7f39080b8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:23.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39080b6510 0x7f39080b8a20 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f390c005d00 tx=0x7f390c00b410 comp rx=0 tx=0).stop 2024-09-21T04:20:23.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 -- 172.21.15.22:0/1103064185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39181094a0 msgr2=0x7f391819a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:23.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39181094a0 0x7f391819a9b0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f3904005940 tx=0x7f39040040e0 comp rx=0 tx=0).stop 2024-09-21T04:20:23.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 -- 172.21.15.22:0/1103064185 shutdown_connections 2024-09-21T04:20:23.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f39080b6510 0x7f39080b8a20 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:23.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f3918109df0 0x7f391819fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:23.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f39181094a0 0x7f391819a9b0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:23.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 --2- 172.21.15.22:0/1103064185 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f3918103b60 0x7f391819a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:23.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 -- 172.21.15.22:0/1103064185 >> 172.21.15.22:0/1103064185 conn(0x7f391807b850 msgr2=0x7f39181075e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:23.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 -- 172.21.15.22:0/1103064185 shutdown_connections 2024-09-21T04:20:23.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:23.581+0000 7f391eda2640 1 -- 172.21.15.22:0/1103064185 wait complete. 2024-09-21T04:20:23.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:23 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1103064185' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:20:24.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:23 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1103064185' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:20:24.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:23 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1103064185' entity='client.admin' cmd={"prefix": "osd dump", "format": "json"} : dispatch 2024-09-21T04:20:24.417 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs fail cephfs 2024-09-21T04:20:24.685 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:20:25.075 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:24 smithi022 ceph-mon[31015]: pgmap v912: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T04:20:25.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:24 smithi073 ceph-mon[34443]: pgmap v912: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T04:20:25.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.165+0000 7f25a5f9f640 1 -- 172.21.15.22:0/884806671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a0102880 msgr2=0x7f25a0102c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:25.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.165+0000 7f25a5f9f640 1 --2- 172.21.15.22:0/884806671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a0102880 0x7f25a0102c90 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2588009900 tx=0x7f258802a410 comp rx=0 tx=0).stop 2024-09-21T04:20:25.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.165+0000 7f25a5f9f640 1 -- 172.21.15.22:0/884806671 shutdown_connections 2024-09-21T04:20:25.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.165+0000 7f25a5f9f640 1 --2- 172.21.15.22:0/884806671 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25a0108b10 0x7f25a010f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:25.183 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.165+0000 7f25a5f9f640 1 --2- 172.21.15.22:0/884806671 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25a01081c0 0x7f25a01085d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.165+0000 7f25a5f9f640 1 --2- 172.21.15.22:0/884806671 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a0102880 0x7f25a0102c90 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.165+0000 7f25a5f9f640 1 -- 172.21.15.22:0/884806671 >> 172.21.15.22:0/884806671 conn(0x7f25a00fe2d0 msgr2=0x7f25a0100720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.166+0000 7f25a5f9f640 1 -- 172.21.15.22:0/884806671 shutdown_connections 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.166+0000 7f25a5f9f640 1 -- 172.21.15.22:0/884806671 wait complete. 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.166+0000 7f25a5f9f640 1 Processor -- start 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.166+0000 7f25a5f9f640 1 -- start start 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a5f9f640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25a0102880 0x7f25a019a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a5f9f640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25a01081c0 0x7f25a019a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a5f9f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a0108b10 0x7f25a019fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a5f9f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25a0112670 con 0x7f25a0108b10 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a5f9f640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01124f0 con 0x7f25a01081c0 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a5f9f640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f25a01127f0 con 0x7f25a0102880 2024-09-21T04:20:25.184 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a579e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a0108b10 0x7f25a019fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a579e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a0108b10 0x7f25a019fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54790/0 (socket says 172.21.15.22:54790) 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a579e640 1 -- 172.21.15.22:0/354799828 learned_addr learned my addr 172.21.15.22:0/354799828 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f259ffff640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25a01081c0 0x7f25a019a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a4f9d640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25a0102880 0x7f25a019a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a579e640 1 -- 172.21.15.22:0/354799828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25a0102880 msgr2=0x7f25a019a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a579e640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25a0102880 0x7f25a019a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a579e640 1 -- 172.21.15.22:0/354799828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25a01081c0 msgr2=0x7f25a019a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a579e640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25a01081c0 0x7f25a019a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a579e640 1 -- 172.21.15.22:0/354799828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25a01a00e0 con 0x7f25a0108b10 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.167+0000 7f25a579e640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a0108b10 0x7f25a019fa70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f259800cce0 tx=0x7f259800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.168+0000 7f259dffb640 1 -- 172.21.15.22:0/354799828 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259800f450 con 0x7f25a0108b10 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.168+0000 7f259dffb640 1 -- 172.21.15.22:0/354799828 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f259800fa80 con 0x7f25a0108b10 2024-09-21T04:20:25.185 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.168+0000 7f25a5f9f640 1 -- 172.21.15.22:0/354799828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25a01a03d0 con 0x7f25a0108b10 2024-09-21T04:20:25.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.168+0000 7f259dffb640 1 -- 172.21.15.22:0/354799828 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2598018ad0 con 0x7f25a0108b10 2024-09-21T04:20:25.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.168+0000 7f25a5f9f640 1 -- 172.21.15.22:0/354799828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25a01a6bf0 con 0x7f25a0108b10 2024-09-21T04:20:25.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.169+0000 7f25a5f9f640 1 -- 172.21.15.22:0/354799828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25a0102c90 con 0x7f25a0108b10 2024-09-21T04:20:25.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.170+0000 7f259dffb640 1 -- 172.21.15.22:0/354799828 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f259800f5f0 con 0x7f25a0108b10 2024-09-21T04:20:25.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.171+0000 7f259dffb640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f258c0b6540 0x7f258c0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:25.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.171+0000 7f25a4f9d640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f258c0b6540 0x7f258c0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:25.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.171+0000 7f259dffb640 1 -- 172.21.15.22:0/354799828 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 9187+0+0 (secure 0 0 0) 0x7f25980e7a50 con 0x7f25a0108b10 2024-09-21T04:20:25.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.172+0000 7f25a4f9d640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f258c0b6540 0x7f258c0b8a50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:25.186 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.176+0000 7f259dffb640 1 -- 172.21.15.22:0/354799828 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2598014030 con 0x7f25a0108b10 2024-09-21T04:20:25.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:24 smithi060 ceph-mon[33722]: pgmap v912: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T04:20:25.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.403+0000 7f25a5f9f640 1 -- 172.21.15.22:0/354799828 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f25a01a6ed0 con 0x7f25a0108b10 2024-09-21T04:20:25.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.405+0000 7f259dffb640 1 -- 172.21.15.22:0/354799828 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v54) ==== 161+0+0 (secure 0 0 0) 0x7f25980adec0 con 0x7f25a0108b10 2024-09-21T04:20:25.409 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-21T04:20:25.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.409+0000 7f25a5f9f640 1 -- 172.21.15.22:0/354799828 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f258c0b6540 msgr2=0x7f258c0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.409+0000 7f25a5f9f640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f258c0b6540 0x7f258c0b8a50 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f2588000c00 tx=0x7f2588009680 comp rx=0 tx=0).stop 2024-09-21T04:20:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.409+0000 7f25a5f9f640 1 -- 172.21.15.22:0/354799828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a0108b10 msgr2=0x7f25a019fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.409+0000 7f25a5f9f640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a0108b10 0x7f25a019fa70 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f259800cce0 tx=0x7f259800a620 comp rx=0 tx=0).stop 2024-09-21T04:20:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.410+0000 7f25a5f9f640 1 -- 172.21.15.22:0/354799828 shutdown_connections 2024-09-21T04:20:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.410+0000 7f25a5f9f640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f258c0b6540 0x7f258c0b8a50 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.410+0000 7f25a5f9f640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25a0108b10 0x7f25a019fa70 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.410+0000 7f25a5f9f640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f25a01081c0 0x7f25a019a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.410+0000 7f25a5f9f640 1 --2- 172.21.15.22:0/354799828 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f25a0102880 0x7f25a019a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.410+0000 7f25a5f9f640 1 -- 172.21.15.22:0/354799828 >> 172.21.15.22:0/354799828 conn(0x7f25a00fe2d0 msgr2=0x7f25a01013c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.410+0000 7f25a5f9f640 1 -- 172.21.15.22:0/354799828 shutdown_connections 2024-09-21T04:20:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:25.411+0000 7f25a5f9f640 1 -- 172.21.15.22:0/354799828 wait complete. 2024-09-21T04:20:25.720 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a[31011]: 2024-09-21T04:20:25.404+0000 7f3ba5f2c640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T04:20:25.720 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a[72104]: ignoring --setuser ceph since I am not root 2024-09-21T04:20:25.720 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a[72104]: ignoring --setgroup ceph since I am not root 2024-09-21T04:20:25.721 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-mds[72108]: -- 172.21.15.22:0/3517050726 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55acbacdd860 con 0x55acbee85600 2024-09-21T04:20:25.721 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a[72104]: starting mds.a at 2024-09-21T04:20:25.721 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g[71737]: ignoring --setuser ceph since I am not root 2024-09-21T04:20:25.721 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g[71737]: ignoring --setgroup ceph since I am not root 2024-09-21T04:20:25.721 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-mds[71754]: -- 172.21.15.22:0/476875591 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559b7b2f9860 con 0x559b7f4a1600 2024-09-21T04:20:25.721 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g[71737]: starting mds.g at 2024-09-21T04:20:25.800 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c[62800]: ignoring --setuser ceph since I am not root 2024-09-21T04:20:25.800 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c[62800]: ignoring --setgroup ceph since I am not root 2024-09-21T04:20:25.800 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mds[62804]: -- 172.21.15.73:0/415826761 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fbbe7b1c20 con 0x55fbc2959600 2024-09-21T04:20:25.800 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c[62800]: starting mds.c at 2024-09-21T04:20:25.801 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b[61822]: ignoring --setuser ceph since I am not root 2024-09-21T04:20:25.801 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b[61822]: ignoring --setgroup ceph since I am not root 2024-09-21T04:20:25.801 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-mds[61826]: -- 172.21.15.60:0/4136424527 <== mon.0 v2:172.21.15.22:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562482ca7c20 con 0x562486e4fa80 2024-09-21T04:20:25.801 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b[61822]: starting mds.b at 2024-09-21T04:20:25.801 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i[63081]: ignoring --setuser ceph since I am not root 2024-09-21T04:20:25.801 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i[63081]: ignoring --setgroup ceph since I am not root 2024-09-21T04:20:25.801 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mds[63085]: -- 172.21.15.73:0/3192775404 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5630d357bc20 con 0x5630d7723600 2024-09-21T04:20:25.801 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i[63081]: starting mds.i at 2024-09-21T04:20:25.802 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h[61540]: ignoring --setuser ceph since I am not root 2024-09-21T04:20:25.802 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h[61540]: ignoring --setgroup ceph since I am not root 2024-09-21T04:20:25.802 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-mds[61544]: -- 172.21.15.60:0/1537401223 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5555a601d860 con 0x5555aa1c5600 2024-09-21T04:20:25.802 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h[61540]: starting mds.h at 2024-09-21T04:20:25.802 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f[62533]: ignoring --setuser ceph since I am not root 2024-09-21T04:20:25.802 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f[62533]: ignoring --setgroup ceph since I am not root 2024-09-21T04:20:25.802 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mds[62537]: --2- 172.21.15.73:0/2144757574 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x5602395db180 0x56023a1ca000 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x5602395ecba0 tx=0x560239512540 comp rx=0 tx=0).write_message sending message m=0x5602394a08c0 seq=3 auth(proto 2 2 bytes epoch 0) 2024-09-21T04:20:25.802 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mds[62537]: -- 172.21.15.73:0/2144757574 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560235433860 con 0x5602395db180 2024-09-21T04:20:25.802 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f[62533]: starting mds.f at 2024-09-21T04:20:25.803 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k[60989]: ignoring --setuser ceph since I am not root 2024-09-21T04:20:25.803 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k[60989]: ignoring --setgroup ceph since I am not root 2024-09-21T04:20:25.803 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-mds[60993]: -- 172.21.15.60:0/2383872302 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557b7c06d860 con 0x557b80215180 2024-09-21T04:20:25.803 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k[60989]: starting mds.k at 2024-09-21T04:20:25.803 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l[62266]: ignoring --setuser ceph since I am not root 2024-09-21T04:20:25.803 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l[62266]: ignoring --setgroup ceph since I am not root 2024-09-21T04:20:25.803 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mds[62270]: -- 172.21.15.73:0/3775697766 <== mon.1 v2:172.21.15.73:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x557151658ea0 con 0x5571557f7600 2024-09-21T04:20:25.803 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mds[62270]: -- 172.21.15.73:0/3775697766 <== mon.1 v2:172.21.15.73:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55715164f860 con 0x5571557f7600 2024-09-21T04:20:25.803 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l[62266]: starting mds.l at 2024-09-21T04:20:25.804 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e[61270]: ignoring --setuser ceph since I am not root 2024-09-21T04:20:25.804 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e[61270]: ignoring --setgroup ceph since I am not root 2024-09-21T04:20:25.804 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-mds[61274]: -- 172.21.15.60:0/747123000 <== mon.2 v2:172.21.15.60:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e9be2a3860 con 0x55e9c244b180 2024-09-21T04:20:25.804 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e[61270]: starting mds.e at 2024-09-21T04:20:26.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/354799828' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T04:20:26.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-mon[31015]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T04:20:26.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-mon[31015]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T04:20:26.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/354799828' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T04:20:26.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-mon[31015]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T04:20:26.090 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:25 smithi022 ceph-mon[31015]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T04:20:26.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/354799828' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T04:20:26.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mon[34443]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T04:20:26.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mon[34443]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T04:20:26.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/354799828' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T04:20:26.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mon[34443]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T04:20:26.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:25 smithi073 ceph-mon[34443]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T04:20:26.120 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-21T04:20:26.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/354799828' entity='client.admin' cmd={"prefix": "fs fail", "fs_name": "cephfs"} : dispatch 2024-09-21T04:20:26.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-mon[33722]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T04:20:26.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-mon[33722]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T04:20:26.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/354799828' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-21T04:20:26.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-mon[33722]: osdmap e86: 12 total, 12 up, 12 in 2024-09-21T04:20:26.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:25 smithi060 ceph-mon[33722]: fsmap cephfs:0/5 2 up:standby, 5 failed 2024-09-21T04:20:26.385 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:20:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.912+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/4052683934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d781094a0 msgr2=0x7f7d781098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.912+0000 7f7d7d9c1640 1 --2- 172.21.15.22:0/4052683934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d781094a0 0x7f7d781098b0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c009900 tx=0x7f7d6c02a3f0 comp rx=0 tx=0).stop 2024-09-21T04:20:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.912+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/4052683934 shutdown_connections 2024-09-21T04:20:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.912+0000 7f7d7d9c1640 1 --2- 172.21.15.22:0/4052683934 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d78109df0 0x7f7d78110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.912+0000 7f7d7d9c1640 1 --2- 172.21.15.22:0/4052683934 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d781094a0 0x7f7d781098b0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.912+0000 7f7d7d9c1640 1 --2- 172.21.15.22:0/4052683934 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d78103b60 0x7f7d78103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.912+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/4052683934 >> 172.21.15.22:0/4052683934 conn(0x7f7d7807b850 msgr2=0x7f7d7807bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.912+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/4052683934 shutdown_connections 2024-09-21T04:20:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.912+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/4052683934 wait complete. 2024-09-21T04:20:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d7d9c1640 1 Processor -- start 2024-09-21T04:20:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d7d9c1640 1 -- start start 2024-09-21T04:20:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d7d9c1640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d78103b60 0x7f7d7819a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d7d9c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d781094a0 0x7f7d7819a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d7d9c1640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d78109df0 0x7f7d7819fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d7d9c1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7d78113960 con 0x7f7d781094a0 2024-09-21T04:20:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d7d9c1640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f7d781137e0 con 0x7f7d78109df0 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d7d9c1640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f7d78113ae0 con 0x7f7d78103b60 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d781094a0 0x7f7d7819a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d767fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d781094a0 0x7f7d7819a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54846/0 (socket says 172.21.15.22:54846) 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d767fc640 1 -- 172.21.15.22:0/1368893940 learned_addr learned my addr 172.21.15.22:0/1368893940 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d777fe640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d78109df0 0x7f7d7819fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.913+0000 7f7d76ffd640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d78103b60 0x7f7d7819a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d767fc640 1 -- 172.21.15.22:0/1368893940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d78103b60 msgr2=0x7f7d7819a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d767fc640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d78103b60 0x7f7d7819a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d767fc640 1 -- 172.21.15.22:0/1368893940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d78109df0 msgr2=0x7f7d7819fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d767fc640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d78109df0 0x7f7d7819fbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d767fc640 1 -- 172.21.15.22:0/1368893940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d781a0220 con 0x7f7d781094a0 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d76ffd640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d78103b60 0x7f7d7819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d767fc640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d781094a0 0x7f7d7819a910 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c005940 tx=0x7f7d6c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d7c9bf640 1 -- 172.21.15.22:0/1368893940 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c03f030 con 0x7f7d781094a0 2024-09-21T04:20:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/1368893940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d781a04b0 con 0x7f7d781094a0 2024-09-21T04:20:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d7c9bf640 1 -- 172.21.15.22:0/1368893940 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d6c003c90 con 0x7f7d781094a0 2024-09-21T04:20:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d7c9bf640 1 -- 172.21.15.22:0/1368893940 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d6c035070 con 0x7f7d781094a0 2024-09-21T04:20:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.914+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/1368893940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d781a0990 con 0x7f7d781094a0 2024-09-21T04:20:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.915+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/1368893940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d78103f70 con 0x7f7d781094a0 2024-09-21T04:20:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.917+0000 7f7d7c9bf640 1 -- 172.21.15.22:0/1368893940 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f7d6c042030 con 0x7f7d781094a0 2024-09-21T04:20:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.918+0000 7f7d7c9bf640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7d600b6540 0x7f7d600b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.918+0000 7f7d76ffd640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7d600b6540 0x7f7d600b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.918+0000 7f7d7c9bf640 1 -- 172.21.15.22:0/1368893940 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9617+0+0 (secure 0 0 0) 0x7f7d6c108280 con 0x7f7d781094a0 2024-09-21T04:20:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.918+0000 7f7d76ffd640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7d600b6540 0x7f7d600b8a50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800abe0 tx=0x7f7d6800a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:26.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:26.921+0000 7f7d7c9bf640 1 -- 172.21.15.22:0/1368893940 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7d6c0ce540 con 0x7f7d781094a0 2024-09-21T04:20:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: pgmap v913: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T04:20:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6832/4079903017,v1:172.21.15.73:6833/4079903017] up:boot 2024-09-21T04:20:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6834/1602263814,v1:172.21.15.73:6835/1602263814] up:boot 2024-09-21T04:20:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6836/2070281616,v1:172.21.15.73:6838/2070281616] up:boot 2024-09-21T04:20:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.73:6837/3335625408,v1:172.21.15.73:6839/3335625408] up:boot 2024-09-21T04:20:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.60:6832/3345155870,v1:172.21.15.60:6834/3345155870] up:boot 2024-09-21T04:20:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.60:6833/3883438378,v1:172.21.15.60:6835/3883438378] up:boot 2024-09-21T04:20:27.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.60:6836/1338116744,v1:172.21.15.60:6838/1338116744] up:boot 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.60:6837/3586139902,v1:172.21.15.60:6839/3586139902] up:boot 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.22:6838/1040015351,v1:172.21.15.22:6840/1040015351] up:boot 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: mds.? [v2:172.21.15.22:6839/2160427343,v1:172.21.15.22:6841/2160427343] up:boot 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T04:20:27.101 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:26 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T04:20:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: pgmap v913: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T04:20:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6832/4079903017,v1:172.21.15.73:6833/4079903017] up:boot 2024-09-21T04:20:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6834/1602263814,v1:172.21.15.73:6835/1602263814] up:boot 2024-09-21T04:20:27.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6836/2070281616,v1:172.21.15.73:6838/2070281616] up:boot 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.73:6837/3335625408,v1:172.21.15.73:6839/3335625408] up:boot 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.60:6832/3345155870,v1:172.21.15.60:6834/3345155870] up:boot 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.60:6833/3883438378,v1:172.21.15.60:6835/3883438378] up:boot 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.60:6836/1338116744,v1:172.21.15.60:6838/1338116744] up:boot 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.60:6837/3586139902,v1:172.21.15.60:6839/3586139902] up:boot 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.22:6838/1040015351,v1:172.21.15.22:6840/1040015351] up:boot 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: mds.? [v2:172.21.15.22:6839/2160427343,v1:172.21.15.22:6841/2160427343] up:boot 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T04:20:27.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T04:20:27.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T04:20:27.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T04:20:27.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T04:20:27.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T04:20:27.107 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:26 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T04:20:27.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.153+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/1368893940 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f7d7802e640 con 0x7f7d781094a0 2024-09-21T04:20:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: pgmap v913: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.2 KiB/s wr, 12 op/s 2024-09-21T04:20:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6832/4079903017,v1:172.21.15.73:6833/4079903017] up:boot 2024-09-21T04:20:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6834/1602263814,v1:172.21.15.73:6835/1602263814] up:boot 2024-09-21T04:20:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6836/2070281616,v1:172.21.15.73:6838/2070281616] up:boot 2024-09-21T04:20:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.73:6837/3335625408,v1:172.21.15.73:6839/3335625408] up:boot 2024-09-21T04:20:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.60:6832/3345155870,v1:172.21.15.60:6834/3345155870] up:boot 2024-09-21T04:20:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.60:6833/3883438378,v1:172.21.15.60:6835/3883438378] up:boot 2024-09-21T04:20:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.60:6836/1338116744,v1:172.21.15.60:6838/1338116744] up:boot 2024-09-21T04:20:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.60:6837/3586139902,v1:172.21.15.60:6839/3586139902] up:boot 2024-09-21T04:20:27.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.22:6838/1040015351,v1:172.21.15.22:6840/1040015351] up:boot 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: mds.? [v2:172.21.15.22:6839/2160427343,v1:172.21.15.22:6841/2160427343] up:boot 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: fsmap cephfs:0/5 12 up:standby, 5 failed 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "k"} : dispatch 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "b"} : dispatch 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "c"} : dispatch 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "i"} : dispatch 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "l"} : dispatch 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "f"} : dispatch 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "h"} : dispatch 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "e"} : dispatch 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "g"} : dispatch 2024-09-21T04:20:27.204 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:26 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "mds metadata", "who": "a"} : dispatch 2024-09-21T04:20:27.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.803+0000 7f7d7c9bf640 1 -- 172.21.15.22:0/1368893940 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v56) ==== 104+0+0 (secure 0 0 0) 0x7f7d6c0d2920 con 0x7f7d781094a0 2024-09-21T04:20:27.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/1368893940 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7d600b6540 msgr2=0x7f7d600b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:27.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7d600b6540 0x7f7d600b8a50 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f7d6800abe0 tx=0x7f7d6800a5c0 comp rx=0 tx=0).stop 2024-09-21T04:20:27.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/1368893940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d781094a0 msgr2=0x7f7d7819a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:27.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d781094a0 0x7f7d7819a910 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f7d6c005940 tx=0x7f7d6c0042f0 comp rx=0 tx=0).stop 2024-09-21T04:20:27.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/1368893940 shutdown_connections 2024-09-21T04:20:27.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f7d600b6540 0x7f7d600b8a50 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:27.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f7d78109df0 0x7f7d7819fbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:27.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7d781094a0 0x7f7d7819a910 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:27.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 --2- 172.21.15.22:0/1368893940 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f7d78103b60 0x7f7d7819a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:27.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/1368893940 >> 172.21.15.22:0/1368893940 conn(0x7f7d7807b850 msgr2=0x7f7d781075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:27.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/1368893940 shutdown_connections 2024-09-21T04:20:27.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:27.806+0000 7f7d7d9c1640 1 -- 172.21.15.22:0/1368893940 wait complete. 2024-09-21T04:20:28.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:27 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1368893940' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T04:20:28.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:27 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:20:28.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:27 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1368893940' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T04:20:28.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:27 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:20:28.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:27 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1368893940' entity='client.admin' cmd={"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} : dispatch 2024-09-21T04:20:28.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:27 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T04:20:28.656 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-21T04:20:28.918 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:20:29.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:28 smithi022 ceph-mon[31015]: pgmap v915: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T04:20:29.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:28 smithi022 ceph-mon[31015]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T04:20:29.040 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:28 smithi022 ceph-mon[31015]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T04:20:29.041 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:28 smithi022 ceph-mon[31015]: Cluster is now healthy 2024-09-21T04:20:29.041 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:28 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1368893940' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T04:20:29.041 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:28 smithi022 ceph-mon[31015]: fsmap 12 up:standby 2024-09-21T04:20:29.041 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:20:29.041 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:20:29.041 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:28 smithi022 ceph-mon[31015]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:20:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:28 smithi073 ceph-mon[34443]: pgmap v915: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T04:20:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:28 smithi073 ceph-mon[34443]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T04:20:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:28 smithi073 ceph-mon[34443]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T04:20:29.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:28 smithi073 ceph-mon[34443]: Cluster is now healthy 2024-09-21T04:20:29.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:28 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1368893940' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T04:20:29.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:28 smithi073 ceph-mon[34443]: fsmap 12 up:standby 2024-09-21T04:20:29.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:20:29.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:20:29.106 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:28 smithi073 ceph-mon[34443]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:20:29.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:28 smithi060 ceph-mon[33722]: pgmap v915: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-09-21T04:20:29.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:28 smithi060 ceph-mon[33722]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T04:20:29.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:28 smithi060 ceph-mon[33722]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T04:20:29.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:28 smithi060 ceph-mon[33722]: Cluster is now healthy 2024-09-21T04:20:29.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:28 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1368893940' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-21T04:20:29.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:28 smithi060 ceph-mon[33722]: fsmap 12 up:standby 2024-09-21T04:20:29.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T04:20:29.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T04:20:29.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:28 smithi060 ceph-mon[33722]: from='mgr.14150 172.21.15.22:0/718253252' entity='mgr.x' 2024-09-21T04:20:29.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.415+0000 7f87054a0640 1 -- 172.21.15.22:0/1689302721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87001022a0 msgr2=0x7f87001026b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:29.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.415+0000 7f87054a0640 1 --2- 172.21.15.22:0/1689302721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87001022a0 0x7f87001026b0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f86f8009900 tx=0x7f86f802a3f0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.415+0000 7f87054a0640 1 -- 172.21.15.22:0/1689302721 shutdown_connections 2024-09-21T04:20:29.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.415+0000 7f87054a0640 1 --2- 172.21.15.22:0/1689302721 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8700108530 0x7f870010ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.415+0000 7f87054a0640 1 --2- 172.21.15.22:0/1689302721 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8700107be0 0x7f8700107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.415+0000 7f87054a0640 1 --2- 172.21.15.22:0/1689302721 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87001022a0 0x7f87001026b0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.415+0000 7f87054a0640 1 -- 172.21.15.22:0/1689302721 >> 172.21.15.22:0/1689302721 conn(0x7f8700079ec0 msgr2=0x7f870007a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.415+0000 7f87054a0640 1 -- 172.21.15.22:0/1689302721 shutdown_connections 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.415+0000 7f87054a0640 1 -- 172.21.15.22:0/1689302721 wait complete. 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.416+0000 7f87054a0640 1 Processor -- start 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.416+0000 7f87054a0640 1 -- start start 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.416+0000 7f87054a0640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87001022a0 0x7f870019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.416+0000 7f87054a0640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8700107be0 0x7f870019aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.416+0000 7f87054a0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8700108530 0x7f870019fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.416+0000 7f87054a0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8700112920 con 0x7f8700108530 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.416+0000 7f87054a0640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f87001127a0 con 0x7f87001022a0 2024-09-21T04:20:29.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.416+0000 7f87054a0640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8700112aa0 con 0x7f8700107be0 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86ff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8700108530 0x7f870019fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86ff7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8700108530 0x7f870019fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54870/0 (socket says 172.21.15.22:54870) 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86ff7fe640 1 -- 172.21.15.22:0/542281271 learned_addr learned my addr 172.21.15.22:0/542281271 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86fe7fc640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8700107be0 0x7f870019aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86feffd640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87001022a0 0x7f870019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86ff7fe640 1 -- 172.21.15.22:0/542281271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8700107be0 msgr2=0x7f870019aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86ff7fe640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8700107be0 0x7f870019aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86ff7fe640 1 -- 172.21.15.22:0/542281271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87001022a0 msgr2=0x7f870019a520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86ff7fe640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87001022a0 0x7f870019a520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86ff7fe640 1 -- 172.21.15.22:0/542281271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87001a03d0 con 0x7f8700108530 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86ff7fe640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8700108530 0x7f870019fd60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f86f000cad0 tx=0x7f86f000ced0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86f7fff640 1 -- 172.21.15.22:0/542281271 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f000ad60 con 0x7f8700108530 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f86f7fff640 1 -- 172.21.15.22:0/542281271 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f86f0005020 con 0x7f8700108530 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.417+0000 7f87054a0640 1 -- 172.21.15.22:0/542281271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87001a06c0 con 0x7f8700108530 2024-09-21T04:20:29.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.418+0000 7f86f7fff640 1 -- 172.21.15.22:0/542281271 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86f000f6b0 con 0x7f8700108530 2024-09-21T04:20:29.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.418+0000 7f87054a0640 1 -- 172.21.15.22:0/542281271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87001a6ee0 con 0x7f8700108530 2024-09-21T04:20:29.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.419+0000 7f87054a0640 1 -- 172.21.15.22:0/542281271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87001026b0 con 0x7f8700108530 2024-09-21T04:20:29.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.420+0000 7f86f7fff640 1 -- 172.21.15.22:0/542281271 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f86f00051d0 con 0x7f8700108530 2024-09-21T04:20:29.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.421+0000 7f86f7fff640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f86ec0b6540 0x7f86ec0b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:29.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.421+0000 7f86feffd640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f86ec0b6540 0x7f86ec0b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:29.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.421+0000 7f86f7fff640 1 -- 172.21.15.22:0/542281271 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 9617+0+0 (secure 0 0 0) 0x7f86f00e7a60 con 0x7f8700108530 2024-09-21T04:20:29.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.421+0000 7f86feffd640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f86ec0b6540 0x7f86ec0b8a50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f86f80057c0 tx=0x7f86f80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:29.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.425+0000 7f86f7fff640 1 -- 172.21.15.22:0/542281271 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86f0014030 con 0x7f8700108530 2024-09-21T04:20:29.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.614+0000 7f87054a0640 1 -- 172.21.15.22:0/542281271 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f870010b310 con 0x7f8700108530 2024-09-21T04:20:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.810+0000 7f86f7fff640 1 -- 172.21.15.22:0/542281271 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v87) ==== 181+0+0 (secure 0 0 0) 0x7f86f00add80 con 0x7f8700108530 2024-09-21T04:20:29.813 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2024-09-21T04:20:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.813+0000 7f87054a0640 1 -- 172.21.15.22:0/542281271 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f86ec0b6540 msgr2=0x7f86ec0b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.813+0000 7f87054a0640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f86ec0b6540 0x7f86ec0b8a50 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f86f80057c0 tx=0x7f86f80058d0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.813+0000 7f87054a0640 1 -- 172.21.15.22:0/542281271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8700108530 msgr2=0x7f870019fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.813+0000 7f87054a0640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8700108530 0x7f870019fd60 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f86f000cad0 tx=0x7f86f000ced0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.813+0000 7f87054a0640 1 -- 172.21.15.22:0/542281271 shutdown_connections 2024-09-21T04:20:29.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.813+0000 7f87054a0640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f86ec0b6540 0x7f86ec0b8a50 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.813+0000 7f87054a0640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8700107be0 0x7f870019aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.813+0000 7f87054a0640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8700108530 0x7f870019fd60 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.813+0000 7f87054a0640 1 --2- 172.21.15.22:0/542281271 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f87001022a0 0x7f870019a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.813+0000 7f87054a0640 1 -- 172.21.15.22:0/542281271 >> 172.21.15.22:0/542281271 conn(0x7f8700079ec0 msgr2=0x7f870010fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.814+0000 7f87054a0640 1 -- 172.21.15.22:0/542281271 shutdown_connections 2024-09-21T04:20:29.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:29.814+0000 7f87054a0640 1 -- 172.21.15.22:0/542281271 wait complete. 2024-09-21T04:20:30.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:29 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/542281271' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:20:30.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:29 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/542281271' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:20:30.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:29 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/542281271' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:20:30.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-21T04:20:30.785 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:20:31.082 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:30 smithi022 ceph-mon[31015]: pgmap v916: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T04:20:31.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:30 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/542281271' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:20:31.083 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:30 smithi022 ceph-mon[31015]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T04:20:31.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:30 smithi073 ceph-mon[34443]: pgmap v916: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T04:20:31.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:30 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/542281271' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:20:31.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:30 smithi073 ceph-mon[34443]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T04:20:31.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:30 smithi060 ceph-mon[33722]: pgmap v916: 129 pgs: 129 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-09-21T04:20:31.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:30 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/542281271' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:20:31.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:30 smithi060 ceph-mon[33722]: osdmap e87: 12 total, 12 up, 12 in 2024-09-21T04:20:31.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.298+0000 7f8d07f66640 1 -- 172.21.15.22:0/3286437392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d001094a0 msgr2=0x7f8d001098b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:31.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.298+0000 7f8d07f66640 1 --2- 172.21.15.22:0/3286437392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d001094a0 0x7f8d001098b0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0009900 tx=0x7f8cf002a410 comp rx=0 tx=0).stop 2024-09-21T04:20:31.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.298+0000 7f8d07f66640 1 -- 172.21.15.22:0/3286437392 shutdown_connections 2024-09-21T04:20:31.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.298+0000 7f8d07f66640 1 --2- 172.21.15.22:0/3286437392 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d00109df0 0x7f8d00110620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:31.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.298+0000 7f8d07f66640 1 --2- 172.21.15.22:0/3286437392 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d001094a0 0x7f8d001098b0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:31.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.298+0000 7f8d07f66640 1 --2- 172.21.15.22:0/3286437392 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d00103b60 0x7f8d00103f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:31.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.298+0000 7f8d07f66640 1 -- 172.21.15.22:0/3286437392 >> 172.21.15.22:0/3286437392 conn(0x7f8d0007b850 msgr2=0x7f8d0007bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:31.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.298+0000 7f8d07f66640 1 -- 172.21.15.22:0/3286437392 shutdown_connections 2024-09-21T04:20:31.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.298+0000 7f8d07f66640 1 -- 172.21.15.22:0/3286437392 wait complete. 2024-09-21T04:20:31.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.299+0000 7f8d07f66640 1 Processor -- start 2024-09-21T04:20:31.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.299+0000 7f8d07f66640 1 -- start start 2024-09-21T04:20:31.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.299+0000 7f8d07f66640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d00103b60 0x7f8d0019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:31.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.299+0000 7f8d07f66640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d001094a0 0x7f8d0019aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:31.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d07f66640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d00109df0 0x7f8d0019fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:31.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d07f66640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00113a00 con 0x7f8d00103b60 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d07f66640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00113880 con 0x7f8d00109df0 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d07f66640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f8d00113b80 con 0x7f8d001094a0 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05d02640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d00103b60 0x7f8d0019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05d02640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d00103b60 0x7f8d0019a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34694/0 (socket says 172.21.15.22:34694) 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05d02640 1 -- 172.21.15.22:0/358044499 learned_addr learned my addr 172.21.15.22:0/358044499 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d06503640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d00109df0 0x7f8d0019fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05501640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d001094a0 0x7f8d0019aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05d02640 1 -- 172.21.15.22:0/358044499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d001094a0 msgr2=0x7f8d0019aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05d02640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d001094a0 0x7f8d0019aaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05d02640 1 -- 172.21.15.22:0/358044499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d00109df0 msgr2=0x7f8d0019fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05d02640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d00109df0 0x7f8d0019fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:31.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05d02640 1 -- 172.21.15.22:0/358044499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d001a04c0 con 0x7f8d00103b60 2024-09-21T04:20:31.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05501640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d001094a0 0x7f8d0019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T04:20:31.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d05d02640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d00103b60 0x7f8d0019a550 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b4a0 tx=0x7f8cfc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:31.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8cf6ffd640 1 -- 172.21.15.22:0/358044499 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc014070 con 0x7f8d00103b60 2024-09-21T04:20:31.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8cf6ffd640 1 -- 172.21.15.22:0/358044499 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8cfc010aa0 con 0x7f8d00103b60 2024-09-21T04:20:31.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8d07f66640 1 -- 172.21.15.22:0/358044499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d001a07b0 con 0x7f8d00103b60 2024-09-21T04:20:31.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.300+0000 7f8cf6ffd640 1 -- 172.21.15.22:0/358044499 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc017b70 con 0x7f8d00103b60 2024-09-21T04:20:31.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.301+0000 7f8d07f66640 1 -- 172.21.15.22:0/358044499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d001a6f90 con 0x7f8d00103b60 2024-09-21T04:20:31.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.301+0000 7f8d07f66640 1 -- 172.21.15.22:0/358044499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d00103ff0 con 0x7f8d00103b60 2024-09-21T04:20:31.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.303+0000 7f8cf6ffd640 1 -- 172.21.15.22:0/358044499 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f8cfc017070 con 0x7f8d00103b60 2024-09-21T04:20:31.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.304+0000 7f8cf6ffd640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cec0b6590 0x7f8cec0b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:31.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.304+0000 7f8d05501640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cec0b6590 0x7f8cec0b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:31.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.304+0000 7f8cf6ffd640 1 -- 172.21.15.22:0/358044499 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 9026+0+0 (secure 0 0 0) 0x7f8cfc0e6b70 con 0x7f8d00103b60 2024-09-21T04:20:31.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.304+0000 7f8d05501640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cec0b6590 0x7f8cec0b8aa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0006010 tx=0x7f8cf0000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:31.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.307+0000 7f8cf6ffd640 1 -- 172.21.15.22:0/358044499 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8cfc0ad0e0 con 0x7f8d00103b60 2024-09-21T04:20:31.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.498+0000 7f8d07f66640 1 -- 172.21.15.22:0/358044499 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f8d0019b680 con 0x7f8d00103b60 2024-09-21T04:20:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.817+0000 7f8cf6ffd640 1 -- 172.21.15.22:0/358044499 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v88) ==== 169+0+0 (secure 0 0 0) 0x7f8d0019b680 con 0x7f8d00103b60 2024-09-21T04:20:31.821 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2024-09-21T04:20:31.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.821+0000 7f8d07f66640 1 -- 172.21.15.22:0/358044499 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cec0b6590 msgr2=0x7f8cec0b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.821+0000 7f8d07f66640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cec0b6590 0x7f8cec0b8aa0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f8cf0006010 tx=0x7f8cf0000bc0 comp rx=0 tx=0).stop 2024-09-21T04:20:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.821+0000 7f8d07f66640 1 -- 172.21.15.22:0/358044499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d00103b60 msgr2=0x7f8d0019a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.821+0000 7f8d07f66640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d00103b60 0x7f8d0019a550 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b4a0 tx=0x7f8cfc00b960 comp rx=0 tx=0).stop 2024-09-21T04:20:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.821+0000 7f8d07f66640 1 -- 172.21.15.22:0/358044499 shutdown_connections 2024-09-21T04:20:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.821+0000 7f8d07f66640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f8cec0b6590 0x7f8cec0b8aa0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.821+0000 7f8d07f66640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f8d001094a0 0x7f8d0019aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.821+0000 7f8d07f66640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f8d00109df0 0x7f8d0019fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.821+0000 7f8d07f66640 1 --2- 172.21.15.22:0/358044499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d00103b60 0x7f8d0019a550 secure :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc00b4a0 tx=0x7f8cfc00b960 comp rx=0 tx=0).stop 2024-09-21T04:20:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.821+0000 7f8d07f66640 1 -- 172.21.15.22:0/358044499 >> 172.21.15.22:0/358044499 conn(0x7f8d0007b850 msgr2=0x7f8d00107690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:31.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.822+0000 7f8d07f66640 1 -- 172.21.15.22:0/358044499 shutdown_connections 2024-09-21T04:20:31.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:31.822+0000 7f8d07f66640 1 -- 172.21.15.22:0/358044499 wait complete. 2024-09-21T04:20:32.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:31 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/358044499' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:20:32.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:31 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/358044499' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:20:32.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:31 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/358044499' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:20:32.542 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410 shell --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-09-21T04:20:32.802 INFO:teuthology.orchestra.run.smithi022.stderr:Inferring config /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/mon.a/config 2024-09-21T04:20:33.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:32 smithi022 ceph-mon[31015]: pgmap v918: 97 pgs: 97 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:20:33.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:32 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/358044499' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:20:33.100 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:32 smithi022 ceph-mon[31015]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T04:20:33.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:32 smithi073 ceph-mon[34443]: pgmap v918: 97 pgs: 97 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:20:33.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:32 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/358044499' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:20:33.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:32 smithi073 ceph-mon[34443]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T04:20:33.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:32 smithi060 ceph-mon[33722]: pgmap v918: 97 pgs: 97 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:20:33.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:32 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/358044499' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:20:33.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:32 smithi060 ceph-mon[33722]: osdmap e88: 12 total, 12 up, 12 in 2024-09-21T04:20:33.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.409+0000 7f26f9dce640 1 -- 172.21.15.22:0/3284251958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f4108cf0 msgr2=0x7f26f410f520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.409+0000 7f26f9dce640 1 --2- 172.21.15.22:0/3284251958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f4108cf0 0x7f26f410f520 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f26ec009ca0 tx=0x7f26ec02a8c0 comp rx=0 tx=0).stop 2024-09-21T04:20:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.409+0000 7f26f9dce640 1 -- 172.21.15.22:0/3284251958 shutdown_connections 2024-09-21T04:20:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.409+0000 7f26f9dce640 1 --2- 172.21.15.22:0/3284251958 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f4108cf0 0x7f26f410f520 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.409+0000 7f26f9dce640 1 --2- 172.21.15.22:0/3284251958 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f41083a0 0x7f26f41087b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.409+0000 7f26f9dce640 1 --2- 172.21.15.22:0/3284251958 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4102a60 0x7f26f4102e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.409+0000 7f26f9dce640 1 -- 172.21.15.22:0/3284251958 >> 172.21.15.22:0/3284251958 conn(0x7f26f4079730 msgr2=0x7f26f4079b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.409+0000 7f26f9dce640 1 -- 172.21.15.22:0/3284251958 shutdown_connections 2024-09-21T04:20:33.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.409+0000 7f26f9dce640 1 -- 172.21.15.22:0/3284251958 wait complete. 2024-09-21T04:20:33.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.410+0000 7f26f9dce640 1 Processor -- start 2024-09-21T04:20:33.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.410+0000 7f26f9dce640 1 -- start start 2024-09-21T04:20:33.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.410+0000 7f26f9dce640 1 --2- >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f4102a60 0x7f26f419c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:33.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26f9dce640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f41083a0 0x7f26f419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:33.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26f9dce640 1 --2- >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4108cf0 0x7f26f41a1e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:33.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26f9dce640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4112940 con 0x7f26f41083a0 2024-09-21T04:20:33.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26f9dce640 1 -- --> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] -- mon_getmap magic: 0 -- 0x7f26f41127c0 con 0x7f26f4102a60 2024-09-21T04:20:33.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26f9dce640 1 -- --> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] -- mon_getmap magic: 0 -- 0x7f26f4112ac0 con 0x7f26f4108cf0 2024-09-21T04:20:33.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f41083a0 0x7f26f419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:33.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26ebfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f41083a0 0x7f26f419cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34712/0 (socket says 172.21.15.22:34712) 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26ebfff640 1 -- 172.21.15.22:0/1650830819 learned_addr learned my addr 172.21.15.22:0/1650830819 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26f37fe640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f4102a60 0x7f26f419c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26f3fff640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4108cf0 0x7f26f41a1e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26ebfff640 1 -- 172.21.15.22:0/1650830819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4108cf0 msgr2=0x7f26f41a1e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26ebfff640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4108cf0 0x7f26f41a1e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26ebfff640 1 -- 172.21.15.22:0/1650830819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f4102a60 msgr2=0x7f26f419c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26ebfff640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f4102a60 0x7f26f419c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26ebfff640 1 -- 172.21.15.22:0/1650830819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f41a2580 con 0x7f26f41083a0 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26f37fe640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f4102a60 0x7f26f419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26ebfff640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f41083a0 0x7f26f419cbb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00b450 tx=0x7f26dc00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.411+0000 7f26f17fa640 1 -- 172.21.15.22:0/1650830819 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc015020 con 0x7f26f41083a0 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.412+0000 7f26f17fa640 1 -- 172.21.15.22:0/1650830819 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26dc011d20 con 0x7f26f41083a0 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.412+0000 7f26f17fa640 1 -- 172.21.15.22:0/1650830819 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26dc010e10 con 0x7f26f41083a0 2024-09-21T04:20:33.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.412+0000 7f26f9dce640 1 -- 172.21.15.22:0/1650830819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f41a2870 con 0x7f26f41083a0 2024-09-21T04:20:33.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.412+0000 7f26f9dce640 1 -- 172.21.15.22:0/1650830819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f41a8fd0 con 0x7f26f41083a0 2024-09-21T04:20:33.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.413+0000 7f26f9dce640 1 -- 172.21.15.22:0/1650830819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f4102e70 con 0x7f26f41083a0 2024-09-21T04:20:33.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.414+0000 7f26f17fa640 1 -- 172.21.15.22:0/1650830819 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 18) ==== 154512+0+0 (secure 0 0 0) 0x7f26dc018020 con 0x7f26f41083a0 2024-09-21T04:20:33.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.415+0000 7f26f17fa640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e00b6590 0x7f26e00b8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T04:20:33.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.416+0000 7f26f37fe640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e00b6590 0x7f26e00b8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T04:20:33.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.416+0000 7f26f17fa640 1 -- 172.21.15.22:0/1650830819 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8496+0+0 (secure 0 0 0) 0x7f26dc0e6e80 con 0x7f26f41083a0 2024-09-21T04:20:33.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.416+0000 7f26f37fe640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e00b6590 0x7f26e00b8aa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009930 tx=0x7f26e4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T04:20:33.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.420+0000 7f26f17fa640 1 -- 172.21.15.22:0/1650830819 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f26dc01f020 con 0x7f26f41083a0 2024-09-21T04:20:33.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.612+0000 7f26f9dce640 1 -- 172.21.15.22:0/1650830819 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f26f41a9360 con 0x7f26f41083a0 2024-09-21T04:20:33.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.826+0000 7f26f17fa640 1 -- 172.21.15.22:0/1650830819 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v89) ==== 178+0+0 (secure 0 0 0) 0x7f26dc00d040 con 0x7f26f41083a0 2024-09-21T04:20:33.829 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data_ec' removed 2024-09-21T04:20:33.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.830+0000 7f26f9dce640 1 -- 172.21.15.22:0/1650830819 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e00b6590 msgr2=0x7f26e00b8aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:33.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.830+0000 7f26f9dce640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e00b6590 0x7f26e00b8aa0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f26e4009930 tx=0x7f26e4008040 comp rx=0 tx=0).stop 2024-09-21T04:20:33.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.830+0000 7f26f9dce640 1 -- 172.21.15.22:0/1650830819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f41083a0 msgr2=0x7f26f419cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T04:20:33.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.830+0000 7f26f9dce640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f41083a0 0x7f26f419cbb0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00b450 tx=0x7f26dc00b910 comp rx=0 tx=0).stop 2024-09-21T04:20:33.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.831+0000 7f26f9dce640 1 -- 172.21.15.22:0/1650830819 shutdown_connections 2024-09-21T04:20:33.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.831+0000 7f26f9dce640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.22:6800/3402236759,v1:172.21.15.22:6801/3402236759] conn(0x7f26e00b6590 0x7f26e00b8aa0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:33.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.831+0000 7f26f9dce640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.73:3300/0,v1:172.21.15.73:6789/0] conn(0x7f26f4108cf0 0x7f26f41a1e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:33.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.831+0000 7f26f9dce640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26f41083a0 0x7f26f419cbb0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:33.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.831+0000 7f26f9dce640 1 --2- 172.21.15.22:0/1650830819 >> [v2:172.21.15.60:3300/0,v1:172.21.15.60:6789/0] conn(0x7f26f4102a60 0x7f26f419c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T04:20:33.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.831+0000 7f26f9dce640 1 -- 172.21.15.22:0/1650830819 >> 172.21.15.22:0/1650830819 conn(0x7f26f4079730 msgr2=0x7f26f4105360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T04:20:33.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.831+0000 7f26f9dce640 1 -- 172.21.15.22:0/1650830819 shutdown_connections 2024-09-21T04:20:33.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-09-21T04:20:33.831+0000 7f26f9dce640 1 -- 172.21.15.22:0/1650830819 wait complete. 2024-09-21T04:20:34.099 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:33 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1650830819' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:20:34.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:33 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1650830819' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:20:34.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:33 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1650830819' entity='client.admin' cmd={"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} : dispatch 2024-09-21T04:20:34.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:20:34.737 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:20:34.782 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:20:34.828 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T04:20:34.828 DEBUG:teuthology.orchestra.run.smithi022:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T04:20:34.868 DEBUG:teuthology.orchestra.run.smithi060:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T04:20:34.896 DEBUG:teuthology.orchestra.run.smithi073:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T04:20:34.922 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T04:20:34.922 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-21T04:20:34.922 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.a 2024-09-21T04:20:34.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:34 smithi022 ceph-mon[31015]: pgmap v920: 33 pgs: 33 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:20:34.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:34 smithi022 ceph-mon[31015]: from='client.? 172.21.15.22:0/1650830819' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:20:34.956 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:34 smithi022 ceph-mon[31015]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T04:20:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:34 smithi073 ceph-mon[34443]: pgmap v920: 33 pgs: 33 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:20:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:34 smithi073 ceph-mon[34443]: from='client.? 172.21.15.22:0/1650830819' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:20:35.105 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:34 smithi073 ceph-mon[34443]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T04:20:35.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:34 smithi060 ceph-mon[33722]: pgmap v920: 33 pgs: 33 active+clean; 1.4 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail 2024-09-21T04:20:35.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:34 smithi060 ceph-mon[33722]: from='client.? 172.21.15.22:0/1650830819' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T04:20:35.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:34 smithi060 ceph-mon[33722]: osdmap e89: 12 total, 12 up, 12 in 2024-09-21T04:20:35.350 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:34 smithi022 systemd[1]: Stopping Ceph mon.a for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:20:35.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:35 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a[31011]: 2024-09-21T04:20:35.441+0000 7f3bab737640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:20:35.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:35 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a[31011]: 2024-09-21T04:20:35.441+0000 7f3bab737640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-21T04:20:35.850 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:35 smithi022 podman[106475]: 2024-09-21 04:20:35.635961178 +0000 UTC m=+0.345477158 container died f3c4fd300993fc30636de0160a9c7947e35d463292dfbb0bc726d2d237a79c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T04:20:36.226 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:36 smithi022 podman[106475]: 2024-09-21 04:20:36.032503493 +0000 UTC m=+0.742019473 container cleanup f3c4fd300993fc30636de0160a9c7947e35d463292dfbb0bc726d2d237a79c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T04:20:36.226 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:36 smithi022 bash[106475]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a 2024-09-21T04:20:36.429 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.a.service' 2024-09-21T04:20:36.492 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:36 smithi022 podman[106486]: 2024-09-21 04:20:36.284454508 +0000 UTC m=+0.651684603 container remove f3c4fd300993fc30636de0160a9c7947e35d463292dfbb0bc726d2d237a79c85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-21T04:20:36.492 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:36 smithi022 systemd[1]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.a.service: Deactivated successfully. 2024-09-21T04:20:36.492 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:36 smithi022 systemd[1]: Stopped Ceph mon.a for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T04:20:36.492 INFO:journalctl@ceph.mon.a.smithi022.stdout:Sep 21 04:20:36 smithi022 systemd[1]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.a.service: Consumed 27.808s CPU time. 2024-09-21T04:20:36.524 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:20:36.524 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-21T04:20:36.524 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-21T04:20:36.524 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.b 2024-09-21T04:20:36.953 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:36 smithi060 systemd[1]: Stopping Ceph mon.b for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:20:37.557 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:37 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-b[33718]: 2024-09-21T04:20:37.289+0000 7fc19be63640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:20:37.558 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:37 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-b[33718]: 2024-09-21T04:20:37.289+0000 7fc19be63640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-21T04:20:37.935 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:37 smithi060 podman[66414]: 2024-09-21 04:20:37.555589568 +0000 UTC m=+0.698546962 container died 7f5455fe1e3f336b9fb107e33f631af5829496bf9c0f17570d5389d18a433af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-b, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:20:38.202 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:38 smithi060 podman[66414]: 2024-09-21 04:20:38.03152221 +0000 UTC m=+1.174479558 container cleanup 7f5455fe1e3f336b9fb107e33f631af5829496bf9c0f17570d5389d18a433af4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-b, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T04:20:38.203 INFO:journalctl@ceph.mon.b.smithi060.stdout:Sep 21 04:20:38 smithi060 bash[66414]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-b 2024-09-21T04:20:38.587 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.b.service' 2024-09-21T04:20:38.640 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:20:38.640 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-21T04:20:38.640 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-21T04:20:38.640 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.c 2024-09-21T04:20:38.993 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:38 smithi073 systemd[1]: Stopping Ceph mon.c for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:20:39.355 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:38 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-c[34439]: 2024-09-21T04:20:38.989+0000 7fbf752cd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:20:39.356 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:38 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-c[34439]: 2024-09-21T04:20:38.989+0000 7fbf752cd640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-21T04:20:39.356 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:39 smithi073 podman[67359]: 2024-09-21 04:20:39.16417412 +0000 UTC m=+0.302205644 container died 1da834a6f621adfbda7ab3763de96c1842d32bb67d9ce5d6954b0b7b7512d4c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-c, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-21T04:20:39.828 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:39 smithi073 podman[67359]: 2024-09-21 04:20:39.582641818 +0000 UTC m=+0.720673334 container cleanup 1da834a6f621adfbda7ab3763de96c1842d32bb67d9ce5d6954b0b7b7512d4c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-c, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:20:39.828 INFO:journalctl@ceph.mon.c.smithi073.stdout:Sep 21 04:20:39 smithi073 bash[67359]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mon-c 2024-09-21T04:20:40.042 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mon.c.service' 2024-09-21T04:20:40.093 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:20:40.093 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-21T04:20:40.093 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-21T04:20:40.094 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.x 2024-09-21T04:20:40.416 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:20:40 smithi022 systemd[1]: Stopping Ceph mgr.x for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:20:40.850 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:20:40 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T04:20:40.411+0000 7fcc839f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:20:40.850 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:20:40 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x[31243]: 2024-09-21T04:20:40.411+0000 7fcc839f5640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-09-21T04:20:40.850 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:20:40 smithi022 podman[106592]: 2024-09-21 04:20:40.444870808 +0000 UTC m=+0.145318649 container died b2c9cbad686bdc1881b92fb26da20f358f2a52012c9f27cceab44598b34f5505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-21T04:20:41.350 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:20:41 smithi022 podman[106592]: 2024-09-21 04:20:41.147845626 +0000 UTC m=+0.848293467 container cleanup b2c9cbad686bdc1881b92fb26da20f358f2a52012c9f27cceab44598b34f5505 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:1843221895adccfb3b692060251dd6a0183bc410, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T04:20:41.350 INFO:journalctl@ceph.mgr.x.smithi022.stdout:Sep 21 04:20:41 smithi022 bash[106592]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-x 2024-09-21T04:20:41.535 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.x.service' 2024-09-21T04:20:41.572 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:20:41.572 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-21T04:20:41.572 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-21T04:20:41.573 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.y 2024-09-21T04:20:41.918 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 21 04:20:41 smithi060 systemd[1]: Stopping Ceph mgr.y for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:20:42.203 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 21 04:20:41 smithi060 podman[66536]: 2024-09-21 04:20:41.916390178 +0000 UTC m=+0.146661378 container died ae3b2e9ed1d946d12293ea1b6012fc35f3a3757457dd23a4f9e312c339d2f9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-y, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T04:20:42.702 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 21 04:20:42 smithi060 podman[66536]: 2024-09-21 04:20:42.446192334 +0000 UTC m=+0.676463566 container cleanup ae3b2e9ed1d946d12293ea1b6012fc35f3a3757457dd23a4f9e312c339d2f9cc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-y, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T04:20:42.703 INFO:journalctl@ceph.mgr.y.smithi060.stdout:Sep 21 04:20:42 smithi060 bash[66536]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-y 2024-09-21T04:20:43.433 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.y.service' 2024-09-21T04:20:43.471 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:20:43.471 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-21T04:20:43.471 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-21T04:20:43.471 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.z 2024-09-21T04:20:43.811 INFO:journalctl@ceph.mgr.z.smithi073.stdout:Sep 21 04:20:43 smithi073 systemd[1]: Stopping Ceph mgr.z for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:20:44.105 INFO:journalctl@ceph.mgr.z.smithi073.stdout:Sep 21 04:20:43 smithi073 podman[67486]: 2024-09-21 04:20:43.809033507 +0000 UTC m=+0.141745306 container died 50dde4f04bd09d659aad17a3ed2092d01c81bc4ed980f8c99dbf951f48c1d847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-z, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T04:20:44.785 INFO:journalctl@ceph.mgr.z.smithi073.stdout:Sep 21 04:20:44 smithi073 podman[67486]: 2024-09-21 04:20:44.497693059 +0000 UTC m=+0.830404860 container cleanup 50dde4f04bd09d659aad17a3ed2092d01c81bc4ed980f8c99dbf951f48c1d847 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-z, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T04:20:44.785 INFO:journalctl@ceph.mgr.z.smithi073.stdout:Sep 21 04:20:44 smithi073 bash[67486]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mgr-z 2024-09-21T04:20:44.940 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mgr.z.service' 2024-09-21T04:20:44.978 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:20:44.978 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-21T04:20:44.979 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T04:20:44.979 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.0 2024-09-21T04:20:45.288 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:45 smithi022 systemd[1]: Stopping Ceph osd.0 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:20:45.600 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:45 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0[46878]: 2024-09-21T04:20:45.285+0000 7f7e629e9640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:20:45.600 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:45 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0[46878]: 2024-09-21T04:20:45.285+0000 7f7e629e9640 -1 osd.0 89 *** Got signal Terminated *** 2024-09-21T04:20:45.600 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:45 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0[46878]: 2024-09-21T04:20:45.285+0000 7f7e629e9640 -1 osd.0 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:20:51.223 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:50 smithi022 podman[106713]: 2024-09-21 04:20:50.919660999 +0000 UTC m=+5.747185887 container died 8668143e12b12cdabb01c6cd46ae8c9efa933e99c62ac2950cf3f3eb53a7f28f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T04:20:51.582 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:51 smithi022 podman[106713]: 2024-09-21 04:20:51.319989004 +0000 UTC m=+6.147513886 container cleanup 8668143e12b12cdabb01c6cd46ae8c9efa933e99c62ac2950cf3f3eb53a7f28f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T04:20:51.582 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:51 smithi022 bash[106713]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0 2024-09-21T04:20:51.850 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:51 smithi022 podman[106732]: 2024-09-21 04:20:51.580050056 +0000 UTC m=+0.660981451 container remove 8668143e12b12cdabb01c6cd46ae8c9efa933e99c62ac2950cf3f3eb53a7f28f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T04:20:52.203 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:51 smithi022 podman[106817]: 2024-09-21 04:20:51.800810281 +0000 UTC m=+0.016398463 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:20:52.203 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:51 smithi022 podman[106817]: 2024-09-21 04:20:51.922672552 +0000 UTC m=+0.138260785 container create e66cf718501f2cc3ee11ba1d473362b443a2b01f15be619e2b2b7b369c845258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:20:52.203 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:52 smithi022 podman[106817]: 2024-09-21 04:20:52.200497408 +0000 UTC m=+0.416085598 container init e66cf718501f2cc3ee11ba1d473362b443a2b01f15be619e2b2b7b369c845258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:20:52.600 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:52 smithi022 podman[106817]: 2024-09-21 04:20:52.204774141 +0000 UTC m=+0.420362313 container start e66cf718501f2cc3ee11ba1d473362b443a2b01f15be619e2b2b7b369c845258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T04:20:52.600 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:52 smithi022 podman[106817]: 2024-09-21 04:20:52.317379043 +0000 UTC m=+0.532967273 container attach e66cf718501f2cc3ee11ba1d473362b443a2b01f15be619e2b2b7b369c845258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T04:20:52.990 INFO:journalctl@ceph.osd.0.smithi022.stdout:Sep 21 04:20:52 smithi022 podman[106817]: 2024-09-21 04:20:52.628562466 +0000 UTC m=+0.844150637 container died e66cf718501f2cc3ee11ba1d473362b443a2b01f15be619e2b2b7b369c845258 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-0-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:20:53.318 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.0.service' 2024-09-21T04:20:53.363 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:20:53.364 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T04:20:53.364 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T04:20:53.364 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.1 2024-09-21T04:20:53.688 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:20:53 smithi060 systemd[1]: Stopping Ceph osd.1 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:20:53.952 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:20:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1[37657]: 2024-09-21T04:20:53.685+0000 7f3e9fd95640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:20:53.953 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:20:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1[37657]: 2024-09-21T04:20:53.685+0000 7f3e9fd95640 -1 osd.1 89 *** Got signal Terminated *** 2024-09-21T04:20:53.953 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:20:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1[37657]: 2024-09-21T04:20:53.685+0000 7f3e9fd95640 -1 osd.1 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:20:59.564 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:20:59 smithi060 podman[66673]: 2024-09-21 04:20:59.2747682 +0000 UTC m=+5.721228513 container died 7b51297caf7d7ca15ca6c4d0a1c54b51cf4599f0ba6e10c8b6c7bd9edf6e3ab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:20:59.923 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:20:59 smithi060 podman[66673]: 2024-09-21 04:20:59.652362412 +0000 UTC m=+6.098822724 container cleanup 7b51297caf7d7ca15ca6c4d0a1c54b51cf4599f0ba6e10c8b6c7bd9edf6e3ab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731) 2024-09-21T04:20:59.923 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:20:59 smithi060 bash[66673]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1 2024-09-21T04:21:00.202 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:20:59 smithi060 podman[66690]: 2024-09-21 04:20:59.920714702 +0000 UTC m=+0.645934007 container remove 7b51297caf7d7ca15ca6c4d0a1c54b51cf4599f0ba6e10c8b6c7bd9edf6e3ab1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T04:21:00.510 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:21:00 smithi060 podman[66776]: 2024-09-21 04:21:00.139606473 +0000 UTC m=+0.016329073 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:21:00.510 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:21:00 smithi060 podman[66776]: 2024-09-21 04:21:00.271754763 +0000 UTC m=+0.148477384 container create 489d88de277c11e88282530d8ebd18ffc3ff6bfaac02ac47595a9abe6b7bffd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T04:21:00.779 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:21:00 smithi060 podman[66776]: 2024-09-21 04:21:00.508072951 +0000 UTC m=+0.384795553 container init 489d88de277c11e88282530d8ebd18ffc3ff6bfaac02ac47595a9abe6b7bffd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:21:00.779 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:21:00 smithi060 podman[66776]: 2024-09-21 04:21:00.511702046 +0000 UTC m=+0.388424634 container start 489d88de277c11e88282530d8ebd18ffc3ff6bfaac02ac47595a9abe6b7bffd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:21:00.779 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:21:00 smithi060 podman[66776]: 2024-09-21 04:21:00.616379459 +0000 UTC m=+0.493102039 container attach 489d88de277c11e88282530d8ebd18ffc3ff6bfaac02ac47595a9abe6b7bffd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:21:01.047 INFO:journalctl@ceph.osd.1.smithi060.stdout:Sep 21 04:21:00 smithi060 podman[66776]: 2024-09-21 04:21:00.777008567 +0000 UTC m=+0.653731159 container died 489d88de277c11e88282530d8ebd18ffc3ff6bfaac02ac47595a9abe6b7bffd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T04:21:01.351 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.1.service' 2024-09-21T04:21:01.394 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:21:01.394 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T04:21:01.394 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T04:21:01.394 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.2 2024-09-21T04:21:01.856 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:01 smithi073 systemd[1]: Stopping Ceph osd.2 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:21:02.355 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:01 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2[38837]: 2024-09-21T04:21:01.993+0000 7ff4ae0d0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:21:02.355 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:01 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2[38837]: 2024-09-21T04:21:01.993+0000 7ff4ae0d0640 -1 osd.2 89 *** Got signal Terminated *** 2024-09-21T04:21:02.355 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:01 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2[38837]: 2024-09-21T04:21:01.993+0000 7ff4ae0d0640 -1 osd.2 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:21:07.990 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:07 smithi073 podman[67623]: 2024-09-21 04:21:07.683794104 +0000 UTC m=+6.094638103 container died 97acbfa2c2ac06029d166e5cacb2fec07a39e1b166dca00f6e0a9d13b3f3a504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2) 2024-09-21T04:21:08.340 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:08 smithi073 podman[67623]: 2024-09-21 04:21:08.086196167 +0000 UTC m=+6.497040155 container cleanup 97acbfa2c2ac06029d166e5cacb2fec07a39e1b166dca00f6e0a9d13b3f3a504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T04:21:08.340 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:08 smithi073 bash[67623]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2 2024-09-21T04:21:08.605 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:08 smithi073 podman[67640]: 2024-09-21 04:21:08.337839649 +0000 UTC m=+0.650470837 container remove 97acbfa2c2ac06029d166e5cacb2fec07a39e1b166dca00f6e0a9d13b3f3a504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T04:21:08.898 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:08 smithi073 podman[67728]: 2024-09-21 04:21:08.54683367 +0000 UTC m=+0.015469417 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:21:08.898 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:08 smithi073 podman[67728]: 2024-09-21 04:21:08.647192812 +0000 UTC m=+0.115828542 container create 0f3910517f9cc1791cb2610b8628d2b9965379ebb0bf083fcdfb668ee40e748f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-09-21T04:21:08.898 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:08 smithi073 podman[67728]: 2024-09-21 04:21:08.891772044 +0000 UTC m=+0.360407785 container init 0f3910517f9cc1791cb2610b8628d2b9965379ebb0bf083fcdfb668ee40e748f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True) 2024-09-21T04:21:09.149 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:08 smithi073 podman[67728]: 2024-09-21 04:21:08.895323816 +0000 UTC m=+0.363959547 container start 0f3910517f9cc1791cb2610b8628d2b9965379ebb0bf083fcdfb668ee40e748f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:21:09.149 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:09 smithi073 podman[67728]: 2024-09-21 04:21:09.000281644 +0000 UTC m=+0.468917389 container attach 0f3910517f9cc1791cb2610b8628d2b9965379ebb0bf083fcdfb668ee40e748f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T04:21:09.149 INFO:journalctl@ceph.osd.2.smithi073.stdout:Sep 21 04:21:09 smithi073 podman[67728]: 2024-09-21 04:21:09.129739584 +0000 UTC m=+0.598375327 container died 0f3910517f9cc1791cb2610b8628d2b9965379ebb0bf083fcdfb668ee40e748f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T04:21:09.838 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.2.service' 2024-09-21T04:21:09.876 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:21:09.877 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T04:21:09.877 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T04:21:09.877 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.3 2024-09-21T04:21:10.220 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:09 smithi022 systemd[1]: Stopping Ceph osd.3 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:21:10.600 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:10 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3[53180]: 2024-09-21T04:21:10.217+0000 7fdbbf1d4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:21:10.600 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:10 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3[53180]: 2024-09-21T04:21:10.217+0000 7fdbbf1d4640 -1 osd.3 89 *** Got signal Terminated *** 2024-09-21T04:21:10.600 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:10 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3[53180]: 2024-09-21T04:21:10.217+0000 7fdbbf1d4640 -1 osd.3 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:21:11.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:11 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:11.029+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:12.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:11 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:11.996+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:12.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:11 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:11.860+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:13.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:12 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:12.844+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:13.349 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:13 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:13.005+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:13.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:13 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:13.639+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:14.350 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:13 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3[53180]: 2024-09-21T04:21:13.935+0000 7fdbb77b7640 -1 osd.3 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.555405+0000 front 2024-09-21T04:20:47.555182+0000 (oldest deadline 2024-09-21T04:21:13.455283+0000) 2024-09-21T04:21:14.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:13 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:13.986+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:14.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:13 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:13.873+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:14.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:14 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:14.596+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:15.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:15 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:15.028+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:15.350 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:14 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3[53180]: 2024-09-21T04:21:14.903+0000 7fdbb77b7640 -1 osd.3 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.555405+0000 front 2024-09-21T04:20:47.555182+0000 (oldest deadline 2024-09-21T04:21:13.455283+0000) 2024-09-21T04:21:15.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:15 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:15.078+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:15.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:14.902+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:15.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:15 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:15.598+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:16.144 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:16 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:16.045+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:16.145 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:16 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:16.055+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:16.145 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:15 smithi022 podman[106930]: 2024-09-21 04:21:15.859032293 +0000 UTC m=+5.778173891 container died 065348046f1e06b162ed404d4e99701efad8692ef7ae7266397161b9b2dcc818 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T04:21:16.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:15 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:15.877+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:16.520 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:16 smithi022 podman[106930]: 2024-09-21 04:21:16.233374638 +0000 UTC m=+6.152516234 container cleanup 065348046f1e06b162ed404d4e99701efad8692ef7ae7266397161b9b2dcc818 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:21:16.520 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:16 smithi022 bash[106930]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3 2024-09-21T04:21:16.838 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:16 smithi022 podman[106946]: 2024-09-21 04:21:16.518341755 +0000 UTC m=+0.653092915 container remove 065348046f1e06b162ed404d4e99701efad8692ef7ae7266397161b9b2dcc818 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-21T04:21:16.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:16 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:16.601+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:17.100 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:17 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:17.034+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:17.100 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:17 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:17.017+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:17.100 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:16 smithi022 podman[107035]: 2024-09-21 04:21:16.739377296 +0000 UTC m=+0.016627037 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:21:17.100 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:16 smithi022 podman[107035]: 2024-09-21 04:21:16.852700557 +0000 UTC m=+0.129950320 container create 8e808ad64238ec762c6d47f4146c06498c1ad7d96db9e217c795fd5c62cc5c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T04:21:17.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:16 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:16.868+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:17.600 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:17 smithi022 podman[107035]: 2024-09-21 04:21:17.113701715 +0000 UTC m=+0.390951451 container init 8e808ad64238ec762c6d47f4146c06498c1ad7d96db9e217c795fd5c62cc5c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T04:21:17.600 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:17 smithi022 podman[107035]: 2024-09-21 04:21:17.117170017 +0000 UTC m=+0.394419741 container start 8e808ad64238ec762c6d47f4146c06498c1ad7d96db9e217c795fd5c62cc5c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T04:21:17.600 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:17 smithi022 podman[107035]: 2024-09-21 04:21:17.213624201 +0000 UTC m=+0.490873931 container attach 8e808ad64238ec762c6d47f4146c06498c1ad7d96db9e217c795fd5c62cc5c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:21:17.600 INFO:journalctl@ceph.osd.3.smithi022.stdout:Sep 21 04:21:17 smithi022 podman[107035]: 2024-09-21 04:21:17.316941937 +0000 UTC m=+0.594191672 container died 8e808ad64238ec762c6d47f4146c06498c1ad7d96db9e217c795fd5c62cc5c35 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-3-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:21:17.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:17 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:17.582+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:17.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.3.service' 2024-09-21T04:21:18.043 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:21:18.044 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T04:21:18.044 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T04:21:18.044 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.4 2024-09-21T04:21:18.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:18 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:18.040+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:18.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:18 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:18.033+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:18.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:17 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:17.888+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:18.368 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:18 smithi060 systemd[1]: Stopping Ceph osd.4 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:21:18.703 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:18 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:18.550+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:18.703 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:18 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4[43774]: 2024-09-21T04:21:18.365+0000 7fa3c9391640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:21:18.703 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:18 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4[43774]: 2024-09-21T04:21:18.365+0000 7fa3c9391640 -1 osd.4 89 *** Got signal Terminated *** 2024-09-21T04:21:18.703 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:18 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4[43774]: 2024-09-21T04:21:18.365+0000 7fa3c9391640 -1 osd.4 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:21:19.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:18.840+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:19.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:19 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:19.081+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:19.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:19 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:19.053+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:19.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:19 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:19.562+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:19.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:19 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:19.562+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:20.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:19 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:19.851+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:20.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:20 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:20.046+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:20.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:20 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:20.087+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:20.854 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:20 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:20.557+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:20.854 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:20 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:20.557+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:21.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:20 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:20.827+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:21.106 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:20 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:20.953+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:21.106 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:21 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:21.039+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:21.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:21 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:21.070+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:21.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:21 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:21.070+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:21.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:21 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:21.052+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:21.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:21 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:21.052+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:21.702 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:21 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:21.555+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:21.703 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:21 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:21.555+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:21.703 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:21 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:21.437+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:22.105 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:22 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:22.023+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:22.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:21 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:21.996+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:22.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:21 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:21.839+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:22.140 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:21 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4[43774]: 2024-09-21T04:21:21.717+0000 7fa3c597c640 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.624930+0000 front 2024-09-21T04:20:56.625135+0000 (oldest deadline 2024-09-21T04:21:21.325132+0000) 2024-09-21T04:21:22.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:22 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:22.115+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:22.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:22 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:22.115+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:22.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:22 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:22.030+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:22.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:22 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:22.030+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:22.702 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:22 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:22.398+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:22.703 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:22 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:22.547+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:22.703 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:22 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:22.547+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:23.105 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:23 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:23.073+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:23.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:22 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:22.990+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:23.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:22 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:22.837+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:23.152 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:22 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4[43774]: 2024-09-21T04:21:22.767+0000 7fa3c597c640 -1 osd.4 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.624930+0000 front 2024-09-21T04:20:56.625135+0000 (oldest deadline 2024-09-21T04:21:21.325132+0000) 2024-09-21T04:21:23.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:23 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:23.000+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:23.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:23 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:23.000+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:23.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:23 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:23.164+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:23.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:23 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:23.164+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:23.702 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:23 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:23.424+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:23.703 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:23 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:23.574+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:23.703 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:23 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:23.574+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:24.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:23 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:23.975+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:24.106 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:24 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:24.033+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:24.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:23 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:23.833+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:24.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:23 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:23.833+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:24.193 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:23 smithi060 podman[66880]: 2024-09-21 04:21:23.922937244 +0000 UTC m=+5.681061223 container died 7d51ff1542ec755977937d8181d0e757dcc7b38ec049ea5930b321b3a1f7fc06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T04:21:24.251 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:23 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:23.957+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:24.251 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:23 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:23.957+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:24.251 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:24 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:24.176+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:24.252 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:24 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:24.176+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:24.452 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:24 smithi060 podman[66880]: 2024-09-21 04:21:24.282504157 +0000 UTC m=+6.040628135 container cleanup 7d51ff1542ec755977937d8181d0e757dcc7b38ec049ea5930b321b3a1f7fc06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T04:21:24.452 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:24 smithi060 bash[66880]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4 2024-09-21T04:21:24.893 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:24 smithi060 podman[66912]: 2024-09-21 04:21:24.53394634 +0000 UTC m=+0.603873245 container remove 7d51ff1542ec755977937d8181d0e757dcc7b38ec049ea5930b321b3a1f7fc06 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:21:24.894 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:24 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:24.471+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:24.894 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:24 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:24.602+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:24.894 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:24 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:24.602+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:25.106 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:24 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:24.991+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:25.107 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:24 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:24.826+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:25.107 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:24 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:24.826+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:25.107 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:25.061+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:25.165 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:24 smithi060 podman[67000]: 2024-09-21 04:21:24.794276908 +0000 UTC m=+0.016472457 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:21:25.165 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:24 smithi060 podman[67000]: 2024-09-21 04:21:24.928053601 +0000 UTC m=+0.150249139 container create 5a76c70515479e30edcb4727983505f3e633df949d6895f77b34113aa19152dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-21T04:21:25.165 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:25 smithi060 podman[67000]: 2024-09-21 04:21:25.163014631 +0000 UTC m=+0.385210184 container init 5a76c70515479e30edcb4727983505f3e633df949d6895f77b34113aa19152dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T04:21:25.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:25.150+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:25.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:25.150+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:25.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:24 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:24.954+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:25.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:24 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:24.954+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:25.453 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:25 smithi060 podman[67000]: 2024-09-21 04:21:25.166381543 +0000 UTC m=+0.388577089 container start 5a76c70515479e30edcb4727983505f3e633df949d6895f77b34113aa19152dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:21:25.453 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:25 smithi060 podman[67000]: 2024-09-21 04:21:25.246243761 +0000 UTC m=+0.468439308 container attach 5a76c70515479e30edcb4727983505f3e633df949d6895f77b34113aa19152dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T04:21:25.453 INFO:journalctl@ceph.osd.4.smithi060.stdout:Sep 21 04:21:25 smithi060 podman[67000]: 2024-09-21 04:21:25.360515116 +0000 UTC m=+0.582710654 container died 5a76c70515479e30edcb4727983505f3e633df949d6895f77b34113aa19152dc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-09-21T04:21:25.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:25.469+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:25.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:25.569+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:25.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:25 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:25.569+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:25.980 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.4.service' 2024-09-21T04:21:26.023 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:21:26.024 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T04:21:26.024 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T04:21:26.024 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.5 2024-09-21T04:21:26.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:26 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:26.194+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:26.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:26 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:26.194+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:26.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:25.992+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:26.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:25 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:25.992+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:26.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:25.970+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:26.355 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:26 smithi073 systemd[1]: Stopping Ceph osd.5 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:21:26.355 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:26 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:26.082+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:26.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:25.867+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:26.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:25 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:25.867+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:26.831 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:26 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:26.366+0000 7f7b46f36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:21:26.831 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:26 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:26.366+0000 7f7b46f36640 -1 osd.5 89 *** Got signal Terminated *** 2024-09-21T04:21:26.831 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:26 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:26.366+0000 7f7b46f36640 -1 osd.5 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:21:26.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:26 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:26.515+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:26.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:26 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:26.536+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:26.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:26 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:26.536+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:27.091 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:26 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:26.923+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:27.092 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:26 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:26.828+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:27.092 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:26 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:26.828+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:27.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:27 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:27.238+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:27.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:27 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:27.238+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:27.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:26 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:26.995+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:27.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:26 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:26.995+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:27.355 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:27 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:27.089+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:27.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:27 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:27.510+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:27.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:27 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:27.557+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:27.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:27 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:27.557+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:28.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:27 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:27.971+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:28.106 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:28 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:28.060+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:28.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:27 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:27.836+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:28.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:27 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:27.836+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:28.266 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:27 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:27.998+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:28.267 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:27 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:27.998+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:28.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:28 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:28.263+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:28.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:28 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:28.263+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:28.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:28 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:28.489+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:28.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:28 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:28.519+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:28.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:28 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:28.519+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:28.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:28 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:28.519+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:29.300 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:28 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:28.991+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:29.300 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:28 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:28.991+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:29.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:28 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:28.928+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:29.355 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:29 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:29.028+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:29.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:28 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:28.881+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:29.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:28 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:28.881+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:29.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:28 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:28.881+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:29.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:29 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:29.297+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:29.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:29 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:29.297+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:29.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:29 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:29.297+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:29.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:29 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:29.536+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:29.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:29 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:29.527+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:29.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:29 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:29.527+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:29.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:29 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:29.527+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:30.314 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:30 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:30.003+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:30.314 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:30 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:30.003+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:30.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:29 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:29.891+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:30.355 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:30 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:30.021+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:30.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:29 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:29.867+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:30.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:29 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:29.867+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:30.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:29 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:29.867+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:30.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:30 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:30.311+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:30.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:30 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:30.311+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:30.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:30 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:30.311+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:30.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:30 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:30.532+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:30.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:30 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:30.517+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:30.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:30 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:30.517+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:30.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:30 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:30.517+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:31.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:30 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:30.861+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:31.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:30 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:30.844+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:31.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:30 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:30.844+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:31.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:30 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:30.844+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:31.106 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:30 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:30.997+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.512810+0000 front 2024-09-21T04:20:57.512850+0000 (oldest deadline 2024-09-21T04:21:20.412701+0000) 2024-09-21T04:21:31.106 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:30 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5[44930]: 2024-09-21T04:21:30.997+0000 7f7b3f519640 -1 osd.5 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.214391+0000 front 2024-09-21T04:21:06.214271+0000 (oldest deadline 2024-09-21T04:21:30.914478+0000) 2024-09-21T04:21:31.291 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:31.016+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:31.291 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:31.016+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:31.291 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:31.016+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:31.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:31.288+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:31.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:31.288+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:31.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:31.288+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:31.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:31 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:31.527+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:31.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:31 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:31.527+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:31.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:31 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:31.547+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:31.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:31 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:31.547+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:31.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:31 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:31.547+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:32.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:31 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:31.907+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:32.105 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:31 smithi073 podman[67843]: 2024-09-21 04:21:31.964072586 +0000 UTC m=+5.743488605 container died 3c7dc23667e444dbe7eed885a430775046e76ad8cc3a033e87cc00155359e855 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:21:32.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:31 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:31.812+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:32.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:31 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:31.812+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:32.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:31 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:31.812+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:32.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:32 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:32.284+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:32.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:32 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:32.284+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:32.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:32 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:32.284+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:32.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:32 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:32.056+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:32.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:32 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:32.056+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:32.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:32 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:32.056+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:32.605 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:32 smithi073 podman[67843]: 2024-09-21 04:21:32.333496734 +0000 UTC m=+6.112912750 container cleanup 3c7dc23667e444dbe7eed885a430775046e76ad8cc3a033e87cc00155359e855 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T04:21:32.605 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:32 smithi073 bash[67843]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5 2024-09-21T04:21:32.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:32 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:32.519+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:32.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:32 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:32.519+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:32.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:32 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:32.563+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:32.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:32 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:32.563+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:32.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:32 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:32.563+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:32.959 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:32 smithi073 podman[67859]: 2024-09-21 04:21:32.651993567 +0000 UTC m=+0.688563505 container remove 3c7dc23667e444dbe7eed885a430775046e76ad8cc3a033e87cc00155359e855 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True) 2024-09-21T04:21:32.960 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:32 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:32.865+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:32.960 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:32 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:32.865+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:32.960 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:32 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:32.772+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:32.960 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:32 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:32.772+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:32.960 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:32 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:32.772+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:33.233 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:32 smithi073 podman[67946]: 2024-09-21 04:21:32.860453062 +0000 UTC m=+0.015692993 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:21:33.233 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:32 smithi073 podman[67946]: 2024-09-21 04:21:32.961150808 +0000 UTC m=+0.116390741 container create 8f8576a78c7cf3b5ae2c33d827cceb17de45122a931db691b82caf1f0a408cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T04:21:33.233 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:33 smithi073 podman[67946]: 2024-09-21 04:21:33.230803962 +0000 UTC m=+0.386043900 container init 8f8576a78c7cf3b5ae2c33d827cceb17de45122a931db691b82caf1f0a408cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5-deactivate, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:21:33.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:33 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:33.274+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:33.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:33 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:33.274+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:33.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:33 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:33.274+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:33.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:33 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:33.060+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:33.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:33 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:33.060+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:33.351 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:33 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:33.060+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:33.606 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:33 smithi073 podman[67946]: 2024-09-21 04:21:33.234183553 +0000 UTC m=+0.389423485 container start 8f8576a78c7cf3b5ae2c33d827cceb17de45122a931db691b82caf1f0a408cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:21:33.606 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:33 smithi073 podman[67946]: 2024-09-21 04:21:33.314130707 +0000 UTC m=+0.469370654 container attach 8f8576a78c7cf3b5ae2c33d827cceb17de45122a931db691b82caf1f0a408cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:21:33.606 INFO:journalctl@ceph.osd.5.smithi073.stdout:Sep 21 04:21:33 smithi073 podman[67946]: 2024-09-21 04:21:33.425302083 +0000 UTC m=+0.580542015 container died 8f8576a78c7cf3b5ae2c33d827cceb17de45122a931db691b82caf1f0a408cd4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:21:33.608 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:33 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:33.472+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:33.609 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:33 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:33.472+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:33.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:33 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:33.606+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:33.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:33 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:33.606+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:33.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:33 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:33.606+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:33.995 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:33 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:33.886+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:33.995 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:33 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:33.886+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:33.995 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:33 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:33.814+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:33.996 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:33 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:33.814+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:33.996 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:33 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:33.814+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:34.017 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.5.service' 2024-09-21T04:21:34.056 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:21:34.056 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T04:21:34.056 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-21T04:21:34.057 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.6 2024-09-21T04:21:34.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:34.049+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:34.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:34.049+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:34.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:34.049+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:34.351 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:34 smithi022 systemd[1]: Stopping Ceph osd.6 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:21:34.351 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:34.269+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:34.351 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:34.269+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:34.351 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:34.269+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:34.850 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:34.370+0000 7efffeb90640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:21:34.850 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:34.370+0000 7efffeb90640 -1 osd.6 89 *** Got signal Terminated *** 2024-09-21T04:21:34.850 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:34.370+0000 7efffeb90640 -1 osd.6 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:21:34.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:34 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:34.457+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:34.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:34 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:34.457+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:34.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:34 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:34.630+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:34.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:34 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:34.630+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:34.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:34 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:34.630+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:35.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:34 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:34.896+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:35.106 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:34 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:34.896+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:35.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:34 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:34.792+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:35.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:34 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:34.792+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:35.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:34 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:34.792+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:35.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:35 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:35.058+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:35.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:35 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:35.058+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:35.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:35 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:35.058+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:35.351 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:35 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:35.234+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:35.351 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:35 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:35.234+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:35.351 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:35 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:35.234+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:35.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:35 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:35.460+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:35.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:35 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:35.460+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:35.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:35 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:35.670+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:35.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:35 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:35.670+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:35.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:35 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:35.670+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:36.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:35 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:35.893+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:36.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:35 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:35.893+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:36.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:35 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:35.757+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:36.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:35 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:35.757+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:36.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:35 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:35.757+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:36.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:36 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:36.245+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:36.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:36 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:36.245+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:36.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:36 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:36.245+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:36.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:36 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:36.091+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:36.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:36 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:36.091+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:36.351 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:36 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:36.091+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:36.697 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:36 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:36.438+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:36.697 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:36 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:36.438+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:36.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:36 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:36.695+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:36.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:36 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:36.695+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:36.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:36 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:36.695+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:37.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:36 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:36.910+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:37.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:36 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:36.910+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:37.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:36 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:36.787+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:37.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:36 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:36.787+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:37.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:36 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:36.787+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:37.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:37 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:37.215+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:37.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:37 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:37.215+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:37.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:37 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:37.215+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:37.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:37 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:37.130+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:37.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:37 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:37.130+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:37.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:37 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:37.130+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:37.702 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:37 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:37.658+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:37.703 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:37 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:37.658+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:37.703 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:37 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:37.658+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:37.703 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:37 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:37.450+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:37.703 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:37 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:37.450+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:38.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:37 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:37.934+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:38.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:37 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:37.934+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:38.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:37 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:37.754+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:38.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:37 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:37.754+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:38.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:37 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:37.754+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:38.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:38 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:38.173+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:38.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:38 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:38.173+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:38.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:38 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:38.173+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:38.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:38 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:38.112+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:38.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:38 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:38.112+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:38.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:38 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:38.112+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:38.686 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:38 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:38.429+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:38.686 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:38 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:38.429+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:38.686 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:38 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:38.429+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.376157+0000 front 2024-09-21T04:21:12.375862+0000 (oldest deadline 2024-09-21T04:21:37.675906+0000) 2024-09-21T04:21:38.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:38 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:38.683+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:38.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:38 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:38.683+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:38.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:38 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:38.683+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:38.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:38 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:38.683+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:39.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:38 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:38.918+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:39.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:38 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:38.918+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:39.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:38 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:38.707+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:39.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:38 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:38.707+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:39.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:38 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:38.707+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:39.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:39 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:39.144+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.390932+0000 front 2024-09-21T04:20:47.390958+0000 (oldest deadline 2024-09-21T04:21:14.991819+0000) 2024-09-21T04:21:39.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:39 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:39.144+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.992569+0000 front 2024-09-21T04:20:54.992656+0000 (oldest deadline 2024-09-21T04:21:20.292612+0000) 2024-09-21T04:21:39.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:39 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6[59497]: 2024-09-21T04:21:39.144+0000 7efff7173640 -1 osd.6 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:03.193913+0000 front 2024-09-21T04:21:03.193996+0000 (oldest deadline 2024-09-21T04:21:29.093827+0000) 2024-09-21T04:21:39.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:39 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:39.156+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:39.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:39 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:39.156+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:39.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:39 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:39.156+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:39.702 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:39 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:39.397+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:39.703 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:39 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:39.397+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:39.703 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:39 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:39.397+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.376157+0000 front 2024-09-21T04:21:12.375862+0000 (oldest deadline 2024-09-21T04:21:37.675906+0000) 2024-09-21T04:21:40.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:39 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:39.884+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:40.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:39 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:39.884+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:40.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:39 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:39.716+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:40.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:39 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:39.716+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:40.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:39 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:39.716+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:40.200 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:39 smithi022 podman[107149]: 2024-09-21 04:21:39.874924096 +0000 UTC m=+5.612664425 container died f1ded252e70b14bde3e1ca5a2e24de620af43b6bad82b3a8a7f046df60f8b68f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T04:21:40.200 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:40 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:40.118+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:40.201 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:40 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:40.118+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:40.201 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:40 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:40.118+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:40.201 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:40 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:40.118+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:40.202 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:39 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:39.715+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:40.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:39 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:39.715+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:40.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:39 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:39.715+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:40.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:39 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:39.716+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:40.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:40 smithi022 podman[107149]: 2024-09-21 04:21:40.396779026 +0000 UTC m=+6.134519354 container cleanup f1ded252e70b14bde3e1ca5a2e24de620af43b6bad82b3a8a7f046df60f8b68f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T04:21:40.600 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:40 smithi022 bash[107149]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6 2024-09-21T04:21:40.698 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:40 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:40.441+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:40.698 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:40 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:40.441+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:40.698 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:40 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:40.441+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.376157+0000 front 2024-09-21T04:21:12.375862+0000 (oldest deadline 2024-09-21T04:21:37.675906+0000) 2024-09-21T04:21:40.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:40 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:40.694+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:40.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:40 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:40.694+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:40.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:40 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:40.694+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:40.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:40 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:40.694+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:41.078 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:40 smithi022 podman[107164]: 2024-09-21 04:21:40.64026155 +0000 UTC m=+0.761516658 container remove f1ded252e70b14bde3e1ca5a2e24de620af43b6bad82b3a8a7f046df60f8b68f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T04:21:41.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:40 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:40.859+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:41.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:40 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:40.859+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:41.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:40 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:40.859+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:41.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:40 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:40.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:41.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:40 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:40.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:41.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:40 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:40.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:41.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:41 smithi022 podman[107254]: 2024-09-21 04:21:40.978849079 +0000 UTC m=+0.016460301 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:21:41.350 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:41 smithi022 podman[107254]: 2024-09-21 04:21:41.091051 +0000 UTC m=+0.128662206 container create 815f97211c15c09402a9f5ef309ccfcb6e3286151710ddcd33eb8d973b7420ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:21:41.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:41 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:41.166+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:41.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:41 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:41.166+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:41.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:41 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:41.166+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:41.351 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:41 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:41.166+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:41.850 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:41 smithi022 podman[107254]: 2024-09-21 04:21:41.364640114 +0000 UTC m=+0.402251330 container init 815f97211c15c09402a9f5ef309ccfcb6e3286151710ddcd33eb8d973b7420ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T04:21:41.851 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:41 smithi022 podman[107254]: 2024-09-21 04:21:41.368319576 +0000 UTC m=+0.405930782 container start 815f97211c15c09402a9f5ef309ccfcb6e3286151710ddcd33eb8d973b7420ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-21T04:21:41.851 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:41 smithi022 podman[107254]: 2024-09-21 04:21:41.452028108 +0000 UTC m=+0.489639334 container attach 815f97211c15c09402a9f5ef309ccfcb6e3286151710ddcd33eb8d973b7420ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T04:21:41.851 INFO:journalctl@ceph.osd.6.smithi022.stdout:Sep 21 04:21:41 smithi022 podman[107254]: 2024-09-21 04:21:41.557171545 +0000 UTC m=+0.594782763 container died 815f97211c15c09402a9f5ef309ccfcb6e3286151710ddcd33eb8d973b7420ac (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-6-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:21:41.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:41 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:41.485+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:41.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:41 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:41.485+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:41.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:41 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:41.485+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.376157+0000 front 2024-09-21T04:21:12.375862+0000 (oldest deadline 2024-09-21T04:21:37.675906+0000) 2024-09-21T04:21:41.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:41 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:41.686+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:41.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:41 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:41.686+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:41.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:41 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:41.686+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:41.954 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:41 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:41.686+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:42.105 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:41 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:41.910+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:42.106 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:41 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:41.910+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:42.106 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:41 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:41.910+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:42.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:41 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:41.666+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:42.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:41 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:41.666+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:42.107 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:41 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:41.666+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:42.233 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.6.service' 2024-09-21T04:21:42.278 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:21:42.278 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-21T04:21:42.279 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-21T04:21:42.279 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.7 2024-09-21T04:21:42.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:42 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:42.194+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:42.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:42 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:42.194+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:42.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:42 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:42.194+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:42.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:42 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:42.194+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:42.606 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:42 smithi060 systemd[1]: Stopping Ceph osd.7 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:21:42.606 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:42.534+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:42.606 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:42.534+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:42.606 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:42.534+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.376157+0000 front 2024-09-21T04:21:12.375862+0000 (oldest deadline 2024-09-21T04:21:37.675906+0000) 2024-09-21T04:21:42.606 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:42.603+0000 7f5ef3ce1640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:21:42.606 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:42.603+0000 7f5ef3ce1640 -1 osd.7 89 *** Got signal Terminated *** 2024-09-21T04:21:42.606 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:42.603+0000 7f5ef3ce1640 -1 osd.7 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:21:42.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:42.640+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:42.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:42.640+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:42.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:42.640+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:42.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:42.640+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:43.007 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:42 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:42.912+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:43.007 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:42 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:42.912+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:43.007 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:42 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:42.912+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:43.007 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:42 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:42.692+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:43.007 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:42 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:42.692+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:43.007 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:42 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:42.692+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:43.505 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:43 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:43.167+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:43.505 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:43 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:43.167+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:43.505 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:43 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:43.167+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:43.505 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:43 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:43.167+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:43.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:43 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:43.489+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:43.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:43 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:43.489+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:43.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:43 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:43.489+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.376157+0000 front 2024-09-21T04:21:12.375862+0000 (oldest deadline 2024-09-21T04:21:37.675906+0000) 2024-09-21T04:21:43.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:43 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:43.622+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:43.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:43 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:43.622+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:43.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:43 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:43.622+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:43.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:43 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:43.622+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:44.023 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:43 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:43.681+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:44.023 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:43 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:43.681+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:44.023 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:43 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:43.681+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:44.023 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:43 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:43.885+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:44.023 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:43 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:43.885+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:44.024 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:43 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:43.885+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:44.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:44 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:44.189+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:44.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:44 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:44.189+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:44.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:44 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:44.189+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:44.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:44 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:44.189+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:44.933 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:44 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:44.646+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:44.933 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:44 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:44.646+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:44.933 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:44 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:44.646+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:44.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:44 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:44.478+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:44.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:44 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:44.478+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:44.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:44 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:44.478+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.376157+0000 front 2024-09-21T04:21:12.375862+0000 (oldest deadline 2024-09-21T04:21:37.675906+0000) 2024-09-21T04:21:44.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:44 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:44.625+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:44.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:44 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:44.625+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:44.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:44 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:44.625+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:44.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:44 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:44.625+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:45.228 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:44 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:44.930+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:45.228 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:44 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:44.930+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:45.229 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:44 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:44.930+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:45.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:45 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:45.192+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:45.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:45 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:45.192+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:45.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:45 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:45.192+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:45.601 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:45 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:45.192+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:45.952 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:45 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:45.499+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:45.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:45 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:45.499+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:45.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:45 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:45.499+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.376157+0000 front 2024-09-21T04:21:12.375862+0000 (oldest deadline 2024-09-21T04:21:37.675906+0000) 2024-09-21T04:21:45.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:45 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:45.652+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:45.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:45 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:45.652+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:45.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:45 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:45.652+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:45.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:45 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:45.652+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:45.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:45 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:45.652+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:45.971 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:45 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:45.605+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:45.971 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:45 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:45.605+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:45.971 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:45 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:45.605+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:46.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:45 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:45.969+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:46.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:45 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:45.969+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:46.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:45 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:45.969+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:46.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:45 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:45.969+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.811166+0000 front 2024-09-21T04:21:22.811147+0000 (oldest deadline 2024-09-21T04:21:45.111052+0000) 2024-09-21T04:21:46.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:46 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:46.171+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:46.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:46 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:46.171+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:46.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:46 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:46.171+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:46.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:46 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:46.171+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:46.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:46 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:46.171+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:46.855 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:46 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:46.573+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:46.855 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:46 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:46.573+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:46.856 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:46 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:46.573+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:46.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:46 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:46.504+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:46.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:46 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:46.504+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:46.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:46 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:46.504+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.376157+0000 front 2024-09-21T04:21:12.375862+0000 (oldest deadline 2024-09-21T04:21:37.675906+0000) 2024-09-21T04:21:46.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:46 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:46.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:46.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:46 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:46.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:46.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:46 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:46.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:46.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:46 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:46.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:46.954 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:46 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:46.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:47.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:46 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:46.993+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:47.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:46 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:46.993+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:47.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:46 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:46.993+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:47.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:46 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:46.993+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.811166+0000 front 2024-09-21T04:21:22.811147+0000 (oldest deadline 2024-09-21T04:21:45.111052+0000) 2024-09-21T04:21:47.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:47 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:47.176+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:47.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:47 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:47.176+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:47.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:47 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:47.176+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:47.601 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:47 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:47.176+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:47.601 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:47 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:47.176+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:47.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:47 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:47.542+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:54.773426+0000 front 2024-09-21T04:20:54.773566+0000 (oldest deadline 2024-09-21T04:21:20.673570+0000) 2024-09-21T04:21:47.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:47 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:47.542+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.974638+0000 front 2024-09-21T04:21:05.974661+0000 (oldest deadline 2024-09-21T04:21:31.274716+0000) 2024-09-21T04:21:47.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:47 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:47.542+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.376157+0000 front 2024-09-21T04:21:12.375862+0000 (oldest deadline 2024-09-21T04:21:37.675906+0000) 2024-09-21T04:21:47.953 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:47 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7[49936]: 2024-09-21T04:21:47.542+0000 7f5ef02cc640 -1 osd.7 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:21.776769+0000 front 2024-09-21T04:21:21.776835+0000 (oldest deadline 2024-09-21T04:21:47.076840+0000) 2024-09-21T04:21:47.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:47 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:47.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:47.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:47 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:47.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:47.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:47 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:47.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:47.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:47 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:47.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:47.954 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:47 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:47.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:48.010 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:47 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:47.612+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:48.010 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:47 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:47.612+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:48.010 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:47 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:47.612+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:48.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:48.008+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:48.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:48.008+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:48.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:48.008+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:48.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:48.008+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.811166+0000 front 2024-09-21T04:21:22.811147+0000 (oldest deadline 2024-09-21T04:21:45.111052+0000) 2024-09-21T04:21:48.440 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:48 smithi060 podman[67104]: 2024-09-21 04:21:48.144882839 +0000 UTC m=+5.667330893 container died 8f8264fb6a78ba3d095db379aa8912d2426e3ae1603ceca5724a4579b239abcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:21:48.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:48 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:48.186+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:48.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:48 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:48.186+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:48.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:48 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:48.186+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:48.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:48 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:48.186+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:48.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:48 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:48.186+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:48.703 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:48 smithi060 podman[67104]: 2024-09-21 04:21:48.528502767 +0000 UTC m=+6.050950813 container cleanup 8f8264fb6a78ba3d095db379aa8912d2426e3ae1603ceca5724a4579b239abcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:21:48.730 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:48 smithi060 bash[67104]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7 2024-09-21T04:21:48.730 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:48 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:48.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:48.730 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:48 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:48.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:48.730 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:48 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:48.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:48.730 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:48 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:48.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:48.730 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:48 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:48.613+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:48.990 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:48.613+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:48.990 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:48.613+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:48.990 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:48.613+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:48.990 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:48.613+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:49.143 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:48 smithi060 podman[67119]: 2024-09-21 04:21:48.804903596 +0000 UTC m=+0.655589239 container remove 8f8264fb6a78ba3d095db379aa8912d2426e3ae1603ceca5724a4579b239abcc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T04:21:49.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:48.988+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:49.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:48.988+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:49.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:48.988+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:49.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:48 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:48.988+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.811166+0000 front 2024-09-21T04:21:22.811147+0000 (oldest deadline 2024-09-21T04:21:45.111052+0000) 2024-09-21T04:21:49.453 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:49 smithi060 podman[67206]: 2024-09-21 04:21:49.043897684 +0000 UTC m=+0.016149674 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:21:49.453 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:49 smithi060 podman[67206]: 2024-09-21 04:21:49.151504111 +0000 UTC m=+0.123756092 container create 9baf80d7302264e32ea107bd1eef90e19c127f86e78844316dc8618e79b21c39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T04:21:49.453 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:49 smithi060 podman[67206]: 2024-09-21 04:21:49.383139353 +0000 UTC m=+0.355391334 container init 9baf80d7302264e32ea107bd1eef90e19c127f86e78844316dc8618e79b21c39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7-deactivate, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:21:49.453 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:49 smithi060 podman[67206]: 2024-09-21 04:21:49.386453919 +0000 UTC m=+0.358705902 container start 9baf80d7302264e32ea107bd1eef90e19c127f86e78844316dc8618e79b21c39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T04:21:49.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:49 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:49.202+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:49.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:49 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:49.202+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:49.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:49 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:49.202+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:49.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:49 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:49.202+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:49.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:49 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:49.202+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:49.938 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:49 smithi060 podman[67206]: 2024-09-21 04:21:49.491467141 +0000 UTC m=+0.463719124 container attach 9baf80d7302264e32ea107bd1eef90e19c127f86e78844316dc8618e79b21c39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-21T04:21:49.939 INFO:journalctl@ceph.osd.7.smithi060.stdout:Sep 21 04:21:49 smithi060 podman[67206]: 2024-09-21 04:21:49.591204829 +0000 UTC m=+0.563456810 container died 9baf80d7302264e32ea107bd1eef90e19c127f86e78844316dc8618e79b21c39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-7-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T04:21:49.939 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:49 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:49.653+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:49.939 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:49 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:49.653+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:49.939 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:49 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:49.653+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:49.939 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:49 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:49.653+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:49.939 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:49 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:49.653+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:49.955 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:49 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:49.626+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:49.955 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:49 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:49.626+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:49.955 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:49 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:49.626+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:49.955 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:49 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:49.626+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:50.276 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.7.service' 2024-09-21T04:21:50.325 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:21:50.325 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-21T04:21:50.325 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-21T04:21:50.326 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.8 2024-09-21T04:21:50.354 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:49 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:49.951+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:50.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:49 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:49.951+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:50.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:49 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:49.951+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:50.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:49 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:49.951+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.811166+0000 front 2024-09-21T04:21:22.811147+0000 (oldest deadline 2024-09-21T04:21:45.111052+0000) 2024-09-21T04:21:50.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:50 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:50.160+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:50.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:50 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:50.160+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:50.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:50 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:50.160+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:50.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:50 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:50.160+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:50.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:50 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:50.160+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:50.605 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:50 smithi073 systemd[1]: Stopping Ceph osd.8 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:21:50.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:50 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:50.696+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:50.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:50 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:50.696+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:50.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:50 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:50.696+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:50.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:50 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:50.696+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:50.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:50 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:50.696+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:50.993 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:50.603+0000 7f92a64cf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:21:50.993 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:50.603+0000 7f92a64cf640 -1 osd.8 89 *** Got signal Terminated *** 2024-09-21T04:21:50.993 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:50.603+0000 7f92a64cf640 -1 osd.8 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:21:50.993 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:50.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:50.993 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:50.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:50.993 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:50.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:50.993 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:50.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:51.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:50.989+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:51.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:50.989+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:51.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:50.989+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:51.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:50 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:50.989+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.811166+0000 front 2024-09-21T04:21:22.811147+0000 (oldest deadline 2024-09-21T04:21:45.111052+0000) 2024-09-21T04:21:51.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:51 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:51.128+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:51.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:51 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:51.128+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:51.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:51 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:51.128+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:51.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:51 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:51.128+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:51.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:51 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:51.128+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:51.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:51 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:51.745+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:51.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:51 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:51.745+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:51.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:51 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:51.745+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:51.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:51 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:51.745+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:51.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:51 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:51.745+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:51.991 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:51 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:51.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:51.991 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:51 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:51.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:51.991 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:51 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:51.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:51.991 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:51 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:51.674+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:52.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:51 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:51.987+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:52.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:51 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:51.987+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:52.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:51 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:51.987+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:52.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:51 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:51.987+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.811166+0000 front 2024-09-21T04:21:22.811147+0000 (oldest deadline 2024-09-21T04:21:45.111052+0000) 2024-09-21T04:21:52.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:52 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:52.152+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:52.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:52 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:52.152+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:52.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:52 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:52.152+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:52.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:52 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:52.152+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:52.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:52 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:52.152+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:53.037 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:52 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:52.684+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:53.037 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:52 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:52.684+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:53.037 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:52 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:52.684+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:53.037 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:52 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:52.684+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:53.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:52 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:52.742+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:53.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:52 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:52.742+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:53.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:52 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:52.742+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:53.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:52 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:52.742+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:53.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:52 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:52.742+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:53.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:53 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:53.112+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:53.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:53 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:53.112+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:53.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:53 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:53.112+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:53.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:53 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:53.112+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:53.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:53 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:53.112+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:53.351 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:53 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:53.112+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:21:53.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:53.033+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:53.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:53.033+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:53.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:53.033+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:53.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:53.033+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.811166+0000 front 2024-09-21T04:21:22.811147+0000 (oldest deadline 2024-09-21T04:21:45.111052+0000) 2024-09-21T04:21:53.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:53.033+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:29.712471+0000 front 2024-09-21T04:21:29.712443+0000 (oldest deadline 2024-09-21T04:21:52.512804+0000) 2024-09-21T04:21:54.066 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:53.660+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:54.066 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:53.660+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:54.066 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:53.660+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:54.066 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:53.660+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:54.066 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:53 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:53.660+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:21:54.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:53.733+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:54.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:53.733+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:54.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:53.733+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:54.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:53.733+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:54.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:53.733+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:54.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:53 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:53.733+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:21:54.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:54.063+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:54.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:54.063+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:54.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:54.063+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:54.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:54.063+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.811166+0000 front 2024-09-21T04:21:22.811147+0000 (oldest deadline 2024-09-21T04:21:45.111052+0000) 2024-09-21T04:21:54.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:54.063+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:29.712471+0000 front 2024-09-21T04:21:29.712443+0000 (oldest deadline 2024-09-21T04:21:52.512804+0000) 2024-09-21T04:21:54.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:54 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:54.153+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:54.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:54 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:54.153+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:54.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:54 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:54.153+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:54.601 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:54 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:54.153+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:54.601 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:54 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:54.153+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:54.601 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:54 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:54.153+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:21:55.103 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:54.689+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:55.103 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:54.689+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:55.103 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:54.689+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:55.103 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:54.689+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:55.103 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:54.689+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:21:55.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:54 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:54.756+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:55.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:54 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:54.756+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:55.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:54 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:54.756+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:55.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:54 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:54.756+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:55.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:54 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:54.756+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:55.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:54 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:54.756+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:21:55.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:55 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:55.099+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:56.005763+0000 front 2024-09-21T04:20:56.005858+0000 (oldest deadline 2024-09-21T04:21:20.105822+0000) 2024-09-21T04:21:55.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:55 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:55.099+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.107939+0000 front 2024-09-21T04:21:04.107988+0000 (oldest deadline 2024-09-21T04:21:32.308734+0000) 2024-09-21T04:21:55.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:55 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:55.099+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.610105+0000 front 2024-09-21T04:21:14.610238+0000 (oldest deadline 2024-09-21T04:21:40.510208+0000) 2024-09-21T04:21:55.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:55 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:55.099+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.811166+0000 front 2024-09-21T04:21:22.811147+0000 (oldest deadline 2024-09-21T04:21:45.111052+0000) 2024-09-21T04:21:55.356 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:55 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8[51503]: 2024-09-21T04:21:55.099+0000 7f92a2aba640 -1 osd.8 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:29.712471+0000 front 2024-09-21T04:21:29.712443+0000 (oldest deadline 2024-09-21T04:21:52.512804+0000) 2024-09-21T04:21:55.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:55 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:55.193+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:55.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:55 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:55.193+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:55.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:55 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:55.193+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:55.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:55 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:55.193+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:55.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:55 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:55.193+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:55.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:55 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:55.193+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:21:56.087 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:55 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:55.696+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:56.087 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:55 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:55.696+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:56.087 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:55 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:55.696+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:56.087 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:55 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:55.696+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:56.087 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:55 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:55.696+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:21:56.202 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:55 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:55.791+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:56.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:55 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:55.791+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:56.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:55 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:55.791+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:56.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:55 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:55.791+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:56.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:55 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:55.791+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:56.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:55 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:55.791+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:21:56.355 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:56 smithi073 podman[68061]: 2024-09-21 04:21:56.084843826 +0000 UTC m=+5.568626752 container died 1dea37ae13be4d1acc9e84a1d09725818ca05016789c8581df4163e0b36db7ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:21:56.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:56 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:56.177+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:56.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:56 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:56.177+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:56.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:56 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:56.177+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:56.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:56 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:56.177+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:56.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:56 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:56.177+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:56.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:56 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:56.177+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:21:56.733 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:56 smithi073 podman[68061]: 2024-09-21 04:21:56.470827154 +0000 UTC m=+5.954610071 container cleanup 1dea37ae13be4d1acc9e84a1d09725818ca05016789c8581df4163e0b36db7ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0) 2024-09-21T04:21:56.733 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:56 smithi073 bash[68061]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8 2024-09-21T04:21:57.038 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:56 smithi073 podman[68077]: 2024-09-21 04:21:56.730971166 +0000 UTC m=+0.646829558 container remove 1dea37ae13be4d1acc9e84a1d09725818ca05016789c8581df4163e0b36db7ce (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, io.buildah.version=1.37.2) 2024-09-21T04:21:57.038 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:56 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:56.735+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:57.039 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:56 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:56.735+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:57.039 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:56 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:56.735+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:57.039 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:56 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:56.735+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:57.039 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:56 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:56.735+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:21:57.202 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:56 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:56.761+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:57.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:56 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:56.761+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:57.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:56 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:56.761+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:57.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:56 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:56.761+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:57.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:56 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:56.761+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:57.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:56 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:56.761+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:21:57.312 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:57 smithi073 podman[68165]: 2024-09-21 04:21:56.939099719 +0000 UTC m=+0.015743515 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:21:57.312 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:57 smithi073 podman[68165]: 2024-09-21 04:21:57.066826795 +0000 UTC m=+0.143470635 container create ba5b64e35a459ae26189ca3d67bd5b48ae666aa0afea9fa04155a8bad610621f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731) 2024-09-21T04:21:57.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:57 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:57.220+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:57.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:57 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:57.220+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:57.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:57 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:57.220+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:57.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:57 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:57.220+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:57.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:57 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:57.220+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:57.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:57 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:57.220+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:21:57.605 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:57 smithi073 podman[68165]: 2024-09-21 04:21:57.310021877 +0000 UTC m=+0.386665678 container init ba5b64e35a459ae26189ca3d67bd5b48ae666aa0afea9fa04155a8bad610621f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8-deactivate, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T04:21:57.605 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:57 smithi073 podman[68165]: 2024-09-21 04:21:57.313824895 +0000 UTC m=+0.390468690 container start ba5b64e35a459ae26189ca3d67bd5b48ae666aa0afea9fa04155a8bad610621f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-21T04:21:57.605 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:57 smithi073 podman[68165]: 2024-09-21 04:21:57.426452388 +0000 UTC m=+0.503096199 container attach ba5b64e35a459ae26189ca3d67bd5b48ae666aa0afea9fa04155a8bad610621f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-21T04:21:57.605 INFO:journalctl@ceph.osd.8.smithi073.stdout:Sep 21 04:21:57 smithi073 podman[68165]: 2024-09-21 04:21:57.506477867 +0000 UTC m=+0.583121662 container died ba5b64e35a459ae26189ca3d67bd5b48ae666aa0afea9fa04155a8bad610621f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-8-deactivate, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T04:21:58.074 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:57 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:57.774+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:58.075 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:57 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:57.774+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:58.075 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:57 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:57.774+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:58.075 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:57 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:57.774+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:58.075 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:57 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:57.774+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:21:58.093 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.8.service' 2024-09-21T04:21:58.174 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:21:58.174 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-21T04:21:58.174 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-21T04:21:58.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.9 2024-09-21T04:21:58.202 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:57 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:57.724+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:58.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:57 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:57.724+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:58.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:57 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:57.724+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:58.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:57 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:57.724+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:58.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:57 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:57.724+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:58.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:57 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:57.724+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:21:58.495 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:58 smithi022 systemd[1]: Stopping Ceph osd.9 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:21:58.495 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:58 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:58.258+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:58.495 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:58 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:58.258+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:58.495 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:58 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:58.258+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:58.495 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:58 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:58.258+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:58.495 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:58 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:58.258+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:58.495 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:58 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:58.258+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:21:58.496 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:58 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:58.491+0000 7f387258c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:21:58.496 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:58 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:58.491+0000 7f387258c640 -1 osd.9 89 *** Got signal Terminated *** 2024-09-21T04:21:58.496 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:58 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:58.491+0000 7f387258c640 -1 osd.9 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:21:58.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:58 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:58.687+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:58.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:58 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:58.687+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:58.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:58 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:58.687+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:58.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:58 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:58.687+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:58.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:58 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:58.687+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:58.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:58 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:58.687+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:21:59.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:58 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:58.797+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:21:59.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:58 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:58.797+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:21:59.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:58 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:58.797+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:21:59.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:58 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:58.797+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:21:59.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:58 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:58.797+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:21:59.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:59 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:59.270+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:21:59.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:59 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:59.270+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:21:59.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:59 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:59.270+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:21:59.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:59 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:59.270+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:21:59.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:59 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:59.270+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:21:59.601 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:21:59 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:21:59.270+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:21:59.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:59 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:59.699+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:21:59.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:59 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:59.699+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:21:59.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:59 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:59.699+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:21:59.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:59 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:59.699+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:21:59.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:59 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:59.699+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:21:59.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:21:59 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:21:59.699+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:00.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:59 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:59.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:00.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:59 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:59.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:00.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:59 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:59.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:00.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:59 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:59.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:00.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:21:59 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:21:59.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:00.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:00 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:00.305+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:22:00.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:00 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:00.305+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:22:00.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:00 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:00.305+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:22:00.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:00 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:00.305+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:22:00.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:00 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:00.305+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:22:00.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:00 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:00.305+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:22:01.053 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:00 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:00.731+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:01.053 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:00 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:00.731+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:01.053 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:00 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:00.731+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:01.053 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:00 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:00.731+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:01.053 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:00 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:00.731+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:01.053 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:00 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:00.731+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:01.053 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:00 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:00.731+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:01.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:00 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:00.849+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:01.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:00 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:00.849+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:01.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:00 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:00.849+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:01.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:00 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:00.849+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:01.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:00 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:00.849+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:01.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:01 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:01.332+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:22:01.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:01 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:01.332+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:22:01.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:01 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:01.332+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:22:01.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:01 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:01.332+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:22:01.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:01 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:01.332+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:22:01.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:01 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:01.332+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:22:01.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:01 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:01.777+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:01.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:01 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:01.777+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:01.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:01 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:01.777+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:01.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:01 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:01.777+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:01.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:01 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:01.777+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:01.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:01 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:01.777+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:01.953 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:01 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:01.777+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:02.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:01 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:01.870+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:02.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:01 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:01.870+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:02.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:01 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:01.870+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:02.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:01 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:01.870+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:02.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:01 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:01.870+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:02.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:02 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:02.302+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:22:02.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:02 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:02.302+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:22:02.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:02 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:02.302+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:22:02.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:02 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:02.302+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:22:02.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:02 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:02.302+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:22:02.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:02 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:02.302+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:22:03.202 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:02 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:02.787+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:03.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:02 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:02.787+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:03.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:02 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:02.787+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:03.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:02 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:02.787+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:03.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:02 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:02.787+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:03.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:02 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:02.787+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:03.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:02 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:02.787+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:03.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:02 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:02.901+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:03.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:02 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:02.901+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:03.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:02 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:02.901+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:03.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:02 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:02.901+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:03.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:02 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:02.901+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:03.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:03 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:03.338+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.063031+0000 front 2024-09-21T04:20:48.063192+0000 (oldest deadline 2024-09-21T04:21:10.963283+0000) 2024-09-21T04:22:03.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:03 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:03.338+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.766456+0000 front 2024-09-21T04:20:57.766505+0000 (oldest deadline 2024-09-21T04:21:20.666412+0000) 2024-09-21T04:22:03.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:03 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:03.338+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:04.767522+0000 front 2024-09-21T04:21:04.767533+0000 (oldest deadline 2024-09-21T04:21:30.667580+0000) 2024-09-21T04:22:03.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:03 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:03.338+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:14.669436+0000 front 2024-09-21T04:21:14.669468+0000 (oldest deadline 2024-09-21T04:21:39.969671+0000) 2024-09-21T04:22:03.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:03 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:03.338+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:19.970172+0000 front 2024-09-21T04:21:19.970259+0000 (oldest deadline 2024-09-21T04:21:45.270248+0000) 2024-09-21T04:22:03.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:03 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9[65714]: 2024-09-21T04:22:03.338+0000 7f386eb77640 -1 osd.9 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:30.472088+0000 front 2024-09-21T04:21:30.471997+0000 (oldest deadline 2024-09-21T04:21:52.772076+0000) 2024-09-21T04:22:04.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:03 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:03.792+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:04.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:03 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:03.792+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:04.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:03 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:03.792+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:04.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:03 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:03.792+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:04.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:03 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:03.792+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:04.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:03 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:03.792+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:04.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:03 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:03.792+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:04.302 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:04 smithi022 podman[107370]: 2024-09-21 04:22:04.032266242 +0000 UTC m=+5.658324989 container died 7c9116c9e1e14dfacdcdf394b13957661f414b904954a62c0d12627c117588e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-21T04:22:04.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:03 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:03.861+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:04.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:03 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:03.861+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:04.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:03 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:03.861+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:04.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:03 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:03.861+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:04.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:03 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:03.861+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:04.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:04 smithi022 podman[107370]: 2024-09-21 04:22:04.475354099 +0000 UTC m=+6.101412887 container cleanup 7c9116c9e1e14dfacdcdf394b13957661f414b904954a62c0d12627c117588e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:22:04.600 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:04 smithi022 bash[107370]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9 2024-09-21T04:22:05.096 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:04 smithi022 podman[107385]: 2024-09-21 04:22:04.676745687 +0000 UTC m=+0.639734203 container remove 7c9116c9e1e14dfacdcdf394b13957661f414b904954a62c0d12627c117588e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T04:22:05.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:04 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:04.823+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:05.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:04 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:04.823+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:05.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:04 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:04.823+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:05.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:04 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:04.823+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:05.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:04 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:04.823+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:05.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:04 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:04.823+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:05.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:04 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:04.823+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:05.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:05 smithi022 podman[107478]: 2024-09-21 04:22:04.996848574 +0000 UTC m=+0.016349152 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:22:05.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:05 smithi022 podman[107478]: 2024-09-21 04:22:05.119485806 +0000 UTC m=+0.138986429 container create b18adb3e8433c74b316795f5cc2698c94ad9c0e74759ee0a02cd3e2ca6041c5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T04:22:05.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:05 smithi022 podman[107478]: 2024-09-21 04:22:05.321920286 +0000 UTC m=+0.341420862 container init b18adb3e8433c74b316795f5cc2698c94ad9c0e74759ee0a02cd3e2ca6041c5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-21T04:22:05.350 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:05 smithi022 podman[107478]: 2024-09-21 04:22:05.325261051 +0000 UTC m=+0.344761619 container start b18adb3e8433c74b316795f5cc2698c94ad9c0e74759ee0a02cd3e2ca6041c5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS) 2024-09-21T04:22:05.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:04 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:04.896+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:05.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:04 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:04.896+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:05.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:04 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:04.896+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:05.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:04 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:04.896+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:05.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:04 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:04.896+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:05.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:04 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:04.896+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:05.818 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:05 smithi022 podman[107478]: 2024-09-21 04:22:05.388483906 +0000 UTC m=+0.407984483 container attach b18adb3e8433c74b316795f5cc2698c94ad9c0e74759ee0a02cd3e2ca6041c5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9-deactivate, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:22:05.818 INFO:journalctl@ceph.osd.9.smithi022.stdout:Sep 21 04:22:05 smithi022 podman[107478]: 2024-09-21 04:22:05.527242203 +0000 UTC m=+0.546742782 container died b18adb3e8433c74b316795f5cc2698c94ad9c0e74759ee0a02cd3e2ca6041c5f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T04:22:06.139 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.9.service' 2024-09-21T04:22:06.181 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:06.182 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-21T04:22:06.182 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-21T04:22:06.182 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.10 2024-09-21T04:22:06.202 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:05 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:05.847+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:06.202 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:05 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:05.847+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:06.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:05 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:05.847+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:06.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:05 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:05.847+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:06.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:05 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:05.847+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:06.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:05 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:05.847+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:06.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:05 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:05.847+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:06.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:05 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:05.918+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:06.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:05 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:05.918+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:06.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:05 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:05.918+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:06.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:05 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:05.918+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:06.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:05 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:05.918+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:06.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:05 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:05.918+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:06.501 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 systemd[1]: Stopping Ceph osd.10 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:06.869 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:06.497+0000 7fb153772640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:06.870 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:06.497+0000 7fb153772640 -1 osd.10 89 *** Got signal Terminated *** 2024-09-21T04:22:06.870 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:06.497+0000 7fb153772640 -1 osd.10 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:22:07.202 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:06.865+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:07.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:06.865+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:07.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:06.865+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:07.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:06.865+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:07.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:06.865+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:07.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:06.865+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:07.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:06 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:06.865+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:07.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:06 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:06.886+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:07.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:06 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:06.886+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:07.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:06 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:06.886+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:07.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:06 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:06.886+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:07.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:06 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:06.886+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:07.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:06 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:06.886+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:08.202 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:07 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:07.909+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:08.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:07 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:07.909+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:08.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:07 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:07.909+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:08.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:07 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:07.909+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:08.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:07 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:07.909+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:08.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:07 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:07.909+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:08.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:07 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:07.909+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:08.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:07 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:07.895+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:08.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:07 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:07.895+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:08.355 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:07 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:07.895+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:08.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:07 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:07.895+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:08.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:07 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:07.895+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:08.356 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:07 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:07.895+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:09.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:08 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:08.848+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:09.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:08 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:08.848+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:09.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:08 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:08.848+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:09.107 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:08 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:08.848+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:09.107 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:08 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:08.848+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:09.107 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:08 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:08.848+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:09.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:08 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:08.869+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:09.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:08 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:08.870+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:09.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:08 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:08.870+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:09.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:08 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:08.870+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:09.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:08 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:08.870+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:09.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:08 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:08.870+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:09.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:08 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:08.870+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:10.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:09 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:09.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:10.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:09 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:09.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:10.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:09 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:09.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:10.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:09 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:09.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:10.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:09 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:09.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:10.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:09 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:09.808+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:10.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:09 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:09.842+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:10.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:09 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:09.842+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:10.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:09 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:09.842+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:10.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:09 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:09.842+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:10.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:09 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:09.842+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:10.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:09 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:09.842+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:10.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:09 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:09.842+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:11.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:10 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:10.825+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:11.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:10 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:10.825+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:11.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:10 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:10.825+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:11.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:10 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:10.825+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:11.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:10 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:10.825+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:11.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:10 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:10.825+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:11.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:10 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:10.825+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:47.003775+0000 front 2024-09-21T04:20:47.003726+0000 (oldest deadline 2024-09-21T04:21:12.903655+0000) 2024-09-21T04:22:11.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:10 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:10.825+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:55.804697+0000 front 2024-09-21T04:20:55.804727+0000 (oldest deadline 2024-09-21T04:21:19.305021+0000) 2024-09-21T04:22:11.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:10 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:10.825+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:05.106977+0000 front 2024-09-21T04:21:05.106945+0000 (oldest deadline 2024-09-21T04:21:28.007184+0000) 2024-09-21T04:22:11.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:10 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:10.825+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6814 osd.3 since back 2024-09-21T04:21:12.108796+0000 front 2024-09-21T04:21:12.108819+0000 (oldest deadline 2024-09-21T04:21:38.008748+0000) 2024-09-21T04:22:11.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:10 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:10.825+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:20.309717+0000 front 2024-09-21T04:21:20.309743+0000 (oldest deadline 2024-09-21T04:21:45.009870+0000) 2024-09-21T04:22:11.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:10 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:10.825+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:25.510908+0000 front 2024-09-21T04:21:25.510872+0000 (oldest deadline 2024-09-21T04:21:53.111225+0000) 2024-09-21T04:22:11.203 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:10 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10[56513]: 2024-09-21T04:22:10.825+0000 7fb14fd5d640 -1 osd.10 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:35.412487+0000 front 2024-09-21T04:21:35.412574+0000 (oldest deadline 2024-09-21T04:22:00.712142+0000) 2024-09-21T04:22:12.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:11 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:11.831+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:12.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:11 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:11.831+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:12.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:11 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:11.831+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:12.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:11 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:11.831+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:12.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:11 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:11.831+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:12.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:11 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:11.831+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:12.302 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:12 smithi060 podman[67319]: 2024-09-21 04:22:12.014318656 +0000 UTC m=+5.621944989 container died e2944ee37b12d1e5d6740d54f4994f85d726196eea84ab3ca2e260c16b3f7ca0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:22:12.643 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:12 smithi060 podman[67319]: 2024-09-21 04:22:12.390014031 +0000 UTC m=+5.997640360 container cleanup e2944ee37b12d1e5d6740d54f4994f85d726196eea84ab3ca2e260c16b3f7ca0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T04:22:12.643 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:12 smithi060 bash[67319]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10 2024-09-21T04:22:12.952 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:12 smithi060 podman[67334]: 2024-09-21 04:22:12.641342835 +0000 UTC m=+0.625248494 container remove e2944ee37b12d1e5d6740d54f4994f85d726196eea84ab3ca2e260c16b3f7ca0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True) 2024-09-21T04:22:13.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:12 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:12.812+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:13.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:12 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:12.812+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:13.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:12 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:12.812+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:13.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:12 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:12.812+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:13.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:12 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:12.812+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:13.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:12 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:12.812+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:13.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:12 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:12.812+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-21T04:21:46.161101+0000 front 2024-09-21T04:21:46.161049+0000 (oldest deadline 2024-09-21T04:22:12.060909+0000) 2024-09-21T04:22:13.304 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:13 smithi060 podman[67424]: 2024-09-21 04:22:13.000443251 +0000 UTC m=+0.112491049 container create b680ace10cceda4a7bc39435286b34bb499b9e2d8dd63f151325d220b9f2c2a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-09-21T04:22:13.305 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:13 smithi060 podman[67424]: 2024-09-21 04:22:12.904604394 +0000 UTC m=+0.016652193 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:22:13.305 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:13 smithi060 podman[67424]: 2024-09-21 04:22:13.22786862 +0000 UTC m=+0.339916416 container init b680ace10cceda4a7bc39435286b34bb499b9e2d8dd63f151325d220b9f2c2a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T04:22:13.305 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:13 smithi060 podman[67424]: 2024-09-21 04:22:13.231310648 +0000 UTC m=+0.343358437 container start b680ace10cceda4a7bc39435286b34bb499b9e2d8dd63f151325d220b9f2c2a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:22:13.305 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:13 smithi060 podman[67424]: 2024-09-21 04:22:13.302588244 +0000 UTC m=+0.414636034 container attach b680ace10cceda4a7bc39435286b34bb499b9e2d8dd63f151325d220b9f2c2a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T04:22:13.703 INFO:journalctl@ceph.osd.10.smithi060.stdout:Sep 21 04:22:13 smithi060 podman[67424]: 2024-09-21 04:22:13.435522963 +0000 UTC m=+0.547570758 container died b680ace10cceda4a7bc39435286b34bb499b9e2d8dd63f151325d220b9f2c2a2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-10-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:22:14.017 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.10.service' 2024-09-21T04:22:14.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:14.099 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-21T04:22:14.099 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-21T04:22:14.100 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.11 2024-09-21T04:22:14.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:13 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:13.803+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:14.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:13 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:13.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:14.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:13 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:13.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:14.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:13 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:13.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:14.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:13 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:13.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:14.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:13 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:13.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:14.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:13 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:13.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-21T04:21:46.161101+0000 front 2024-09-21T04:21:46.161049+0000 (oldest deadline 2024-09-21T04:22:12.060909+0000) 2024-09-21T04:22:14.410 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 systemd[1]: Stopping Ceph osd.11 for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:14.411 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:14.407+0000 7f7f97265640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:14.411 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:14.407+0000 7f7f97265640 -1 osd.11 89 *** Got signal Terminated *** 2024-09-21T04:22:14.411 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:14.407+0000 7f7f97265640 -1 osd.11 89 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T04:22:15.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:14.765+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:15.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:14.765+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:15.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:14.765+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:15.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:14.765+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:15.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:14.765+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:15.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:14.765+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:15.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:14 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:14.765+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-21T04:21:46.161101+0000 front 2024-09-21T04:21:46.161049+0000 (oldest deadline 2024-09-21T04:22:12.060909+0000) 2024-09-21T04:22:16.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:15 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:15.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:16.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:15 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:15.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:16.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:15 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:15.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:16.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:15 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:15.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:16.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:15 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:15.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:16.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:15 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:15.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:16.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:15 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:15.804+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-21T04:21:46.161101+0000 front 2024-09-21T04:21:46.161049+0000 (oldest deadline 2024-09-21T04:22:12.060909+0000) 2024-09-21T04:22:17.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:16 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:16.788+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:17.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:16 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:16.788+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:17.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:16 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:16.788+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:17.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:16 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:16.788+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:17.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:16 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:16.788+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:17.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:16 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:16.788+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:17.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:16 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:16.788+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-21T04:21:46.161101+0000 front 2024-09-21T04:21:46.161049+0000 (oldest deadline 2024-09-21T04:22:12.060909+0000) 2024-09-21T04:22:18.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:17 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:17.801+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:18.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:17 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:17.801+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:18.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:17 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:17.801+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:18.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:17 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:17.801+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:18.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:17 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:17.801+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:18.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:17 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:17.801+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:18.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:17 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:17.801+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-21T04:21:46.161101+0000 front 2024-09-21T04:21:46.161049+0000 (oldest deadline 2024-09-21T04:22:12.060909+0000) 2024-09-21T04:22:18.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:17 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:17.801+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6820 osd.8 since back 2024-09-21T04:21:52.061351+0000 front 2024-09-21T04:21:52.061323+0000 (oldest deadline 2024-09-21T04:22:17.361362+0000) 2024-09-21T04:22:19.105 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:18.769+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6806 osd.0 since back 2024-09-21T04:20:48.650817+0000 front 2024-09-21T04:20:48.650835+0000 (oldest deadline 2024-09-21T04:21:11.550841+0000) 2024-09-21T04:22:19.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:18.769+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6804 osd.1 since back 2024-09-21T04:20:57.352624+0000 front 2024-09-21T04:20:57.352662+0000 (oldest deadline 2024-09-21T04:21:23.252582+0000) 2024-09-21T04:22:19.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:18.769+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6804 osd.2 since back 2024-09-21T04:21:06.753708+0000 front 2024-09-21T04:21:06.754043+0000 (oldest deadline 2024-09-21T04:21:28.453831+0000) 2024-09-21T04:22:19.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:18.769+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6812 osd.4 since back 2024-09-21T04:21:22.956680+0000 front 2024-09-21T04:21:22.956738+0000 (oldest deadline 2024-09-21T04:21:48.256812+0000) 2024-09-21T04:22:19.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:18.769+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6812 osd.5 since back 2024-09-21T04:21:28.257171+0000 front 2024-09-21T04:21:28.257271+0000 (oldest deadline 2024-09-21T04:21:52.957369+0000) 2024-09-21T04:22:19.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:18.769+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.22:6822 osd.6 since back 2024-09-21T04:21:39.159995+0000 front 2024-09-21T04:21:39.160067+0000 (oldest deadline 2024-09-21T04:22:04.459961+0000) 2024-09-21T04:22:19.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:18.769+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.60:6820 osd.7 since back 2024-09-21T04:21:46.161101+0000 front 2024-09-21T04:21:46.161049+0000 (oldest deadline 2024-09-21T04:22:12.060909+0000) 2024-09-21T04:22:19.106 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:18 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11[57873]: 2024-09-21T04:22:18.769+0000 7f7f8f848640 -1 osd.11 89 heartbeat_check: no reply from 172.21.15.73:6820 osd.8 since back 2024-09-21T04:21:52.061351+0000 front 2024-09-21T04:21:52.061323+0000 (oldest deadline 2024-09-21T04:22:17.361362+0000) 2024-09-21T04:22:20.286 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:20 smithi073 podman[68292]: 2024-09-21 04:22:20.010547351 +0000 UTC m=+5.706574220 container died b546d9b128f7e9d8093807a9cfe97569caa4e08106ac10add40d00763b3f6a18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T04:22:20.605 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:20 smithi073 podman[68292]: 2024-09-21 04:22:20.38248765 +0000 UTC m=+6.078514518 container cleanup b546d9b128f7e9d8093807a9cfe97569caa4e08106ac10add40d00763b3f6a18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T04:22:20.605 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:20 smithi073 bash[68292]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11 2024-09-21T04:22:20.947 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:20 smithi073 podman[68309]: 2024-09-21 04:22:20.634040034 +0000 UTC m=+0.616073609 container remove b546d9b128f7e9d8093807a9cfe97569caa4e08106ac10add40d00763b3f6a18 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-21T04:22:21.231 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:20 smithi073 podman[68399]: 2024-09-21 04:22:20.84715845 +0000 UTC m=+0.015618806 image pull ddce307e1f3263fb077b4f3902e15660050631dad4d2823a20ee3f72bf18d977 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262 2024-09-21T04:22:21.231 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:20 smithi073 podman[68399]: 2024-09-21 04:22:20.960011418 +0000 UTC m=+0.128471770 container create ac0bfacced6500324dbeefbacb93f68fe3dcd5d21c4ef9ca6c9c6a906f9a27aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T04:22:21.231 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:21 smithi073 podman[68399]: 2024-09-21 04:22:21.154202056 +0000 UTC m=+0.322662417 container init ac0bfacced6500324dbeefbacb93f68fe3dcd5d21c4ef9ca6c9c6a906f9a27aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T04:22:21.231 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:21 smithi073 podman[68399]: 2024-09-21 04:22:21.157445361 +0000 UTC m=+0.325905713 container start ac0bfacced6500324dbeefbacb93f68fe3dcd5d21c4ef9ca6c9c6a906f9a27aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T04:22:21.232 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:21 smithi073 podman[68399]: 2024-09-21 04:22:21.229119375 +0000 UTC m=+0.397579727 container attach ac0bfacced6500324dbeefbacb93f68fe3dcd5d21c4ef9ca6c9c6a906f9a27aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=) 2024-09-21T04:22:21.605 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:21 smithi073 podman[68399]: 2024-09-21 04:22:21.352157781 +0000 UTC m=+0.520618137 container died ac0bfacced6500324dbeefbacb93f68fe3dcd5d21c4ef9ca6c9c6a906f9a27aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-09-21T04:22:21.904 INFO:journalctl@ceph.osd.11.smithi073.stdout:Sep 21 04:22:21 smithi073 podman[68422]: 2024-09-21 04:22:21.890831394 +0000 UTC m=+0.528892488 container remove ac0bfacced6500324dbeefbacb93f68fe3dcd5d21c4ef9ca6c9c6a906f9a27aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-osd-11-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T04:22:21.909 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@osd.11.service' 2024-09-21T04:22:21.989 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:21.989 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-21T04:22:21.989 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-21T04:22:21.990 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.a 2024-09-21T04:22:22.288 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:22:22 smithi022 systemd[1]: Stopping Ceph mds.a for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:22.599 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:22:22 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a[72104]: 2024-09-21T04:22:22.285+0000 7ff5f5f0d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:22.600 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:22:22 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a[72104]: 2024-09-21T04:22:22.285+0000 7ff5f5f0d640 -1 mds.a *** got signal Terminated *** 2024-09-21T04:22:25.881 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:22:25 smithi022 podman[107580]: 2024-09-21 04:22:25.612085147 +0000 UTC m=+3.420772525 container died 90f20fbcc5b71d968f2203e7b8285822d53283b2162af4dd4b7c9c34cf38f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T04:22:26.231 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:22:26 smithi022 podman[107580]: 2024-09-21 04:22:26.027314228 +0000 UTC m=+3.836001593 container cleanup 90f20fbcc5b71d968f2203e7b8285822d53283b2162af4dd4b7c9c34cf38f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T04:22:26.231 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:22:26 smithi022 bash[107580]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a 2024-09-21T04:22:26.477 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.a.service' 2024-09-21T04:22:26.499 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:22:26 smithi022 podman[107593]: 2024-09-21 04:22:26.228973096 +0000 UTC m=+0.616511426 container remove 90f20fbcc5b71d968f2203e7b8285822d53283b2162af4dd4b7c9c34cf38f1a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-a, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-21T04:22:26.500 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:22:26 smithi022 systemd[1]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.a.service: Deactivated successfully. 2024-09-21T04:22:26.500 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:22:26 smithi022 systemd[1]: Stopped Ceph mds.a for ae19ad46-77cc-11ef-baf5-efdc52797490. 2024-09-21T04:22:26.500 INFO:journalctl@ceph.mds.a.smithi022.stdout:Sep 21 04:22:26 smithi022 systemd[1]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.a.service: Consumed 3.120s CPU time. 2024-09-21T04:22:26.512 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:26.512 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-21T04:22:26.513 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-21T04:22:26.513 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.d 2024-09-21T04:22:26.843 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 04:22:26 smithi022 systemd[1]: Stopping Ceph mds.d for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:27.100 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 04:22:26 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-d[70973]: 2024-09-21T04:22:26.839+0000 7feeb67e0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:27.100 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 04:22:26 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-d[70973]: 2024-09-21T04:22:26.839+0000 7feeb67e0640 -1 mds.d *** got signal Terminated *** 2024-09-21T04:22:31.110 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 04:22:30 smithi022 podman[107701]: 2024-09-21 04:22:30.851298866 +0000 UTC m=+4.114717875 container died 8a1cd8c88917fcba3dbef56db87a1804414494754fb3d0df3999e2c4a0b1323b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-d, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T04:22:31.468 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 04:22:31 smithi022 podman[107701]: 2024-09-21 04:22:31.206668445 +0000 UTC m=+4.470087452 container cleanup 8a1cd8c88917fcba3dbef56db87a1804414494754fb3d0df3999e2c4a0b1323b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-d, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T04:22:31.468 INFO:journalctl@ceph.mds.d.smithi022.stdout:Sep 21 04:22:31 smithi022 bash[107701]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-d 2024-09-21T04:22:31.599 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.d.service' 2024-09-21T04:22:31.636 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:31.637 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-21T04:22:31.637 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-21T04:22:31.637 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.g 2024-09-21T04:22:31.849 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:22:31 smithi022 systemd[1]: Stopping Ceph mds.g for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:32.350 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:22:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g[71737]: 2024-09-21T04:22:31.961+0000 7f9ec1a2b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:32.350 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:22:31 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g[71737]: 2024-09-21T04:22:31.961+0000 7f9ec1a2b640 -1 mds.g *** got signal Terminated *** 2024-09-21T04:22:33.921 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:22:33 smithi022 podman[107836]: 2024-09-21 04:22:33.60141016 +0000 UTC m=+1.741872581 container died a5d6deb87649bc417832b4237a398a8f424022114a5559ac9450209c32f34f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-21T04:22:33.921 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:22:33 smithi022 podman[107836]: 2024-09-21 04:22:33.91919054 +0000 UTC m=+2.059652951 container cleanup a5d6deb87649bc417832b4237a398a8f424022114a5559ac9450209c32f34f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T04:22:34.303 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:22:33 smithi022 bash[107836]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g 2024-09-21T04:22:34.304 INFO:journalctl@ceph.mds.g.smithi022.stdout:Sep 21 04:22:34 smithi022 podman[107849]: 2024-09-21 04:22:34.087637297 +0000 UTC m=+0.487147508 container remove a5d6deb87649bc417832b4237a398a8f424022114a5559ac9450209c32f34f0b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-g, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T04:22:34.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.g.service' 2024-09-21T04:22:34.359 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:34.360 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-21T04:22:34.360 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-21T04:22:34.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.j 2024-09-21T04:22:34.599 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 04:22:34 smithi022 systemd[1]: Stopping Ceph mds.j for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:35.100 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 04:22:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-j[70584]: 2024-09-21T04:22:34.690+0000 7fef6b0b6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:35.100 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 04:22:34 smithi022 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-j[70584]: 2024-09-21T04:22:34.690+0000 7fef6b0b6640 -1 mds.j *** got signal Terminated *** 2024-09-21T04:22:38.968 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 04:22:38 smithi022 podman[107959]: 2024-09-21 04:22:38.712726674 +0000 UTC m=+4.118207495 container died 808efe801ad4d455c1bfeb7580ed2ee2c60c0013c13d33ffcfb6f34cb5675da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-j, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-21T04:22:39.218 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 04:22:39 smithi022 podman[107959]: 2024-09-21 04:22:39.048352253 +0000 UTC m=+4.453833073 container cleanup 808efe801ad4d455c1bfeb7580ed2ee2c60c0013c13d33ffcfb6f34cb5675da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-j, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T04:22:39.218 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 04:22:39 smithi022 bash[107959]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-j 2024-09-21T04:22:39.470 INFO:journalctl@ceph.mds.j.smithi022.stdout:Sep 21 04:22:39 smithi022 podman[107972]: 2024-09-21 04:22:39.216194123 +0000 UTC m=+0.505317529 container remove 808efe801ad4d455c1bfeb7580ed2ee2c60c0013c13d33ffcfb6f34cb5675da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-j, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T04:22:39.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.j.service' 2024-09-21T04:22:39.508 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:39.508 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-21T04:22:39.508 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-21T04:22:39.508 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.b 2024-09-21T04:22:39.952 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:22:39 smithi060 systemd[1]: Stopping Ceph mds.b for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:39.953 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:22:39 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b[61822]: 2024-09-21T04:22:39.782+0000 7f19dd8e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:39.953 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:22:39 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b[61822]: 2024-09-21T04:22:39.782+0000 7f19dd8e3640 -1 mds.b *** got signal Terminated *** 2024-09-21T04:22:41.811 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:22:41 smithi060 podman[67524]: 2024-09-21 04:22:41.528104217 +0000 UTC m=+1.824423229 container died c174ba78bae85c96b249359c2a939ea8bf008fdb31a157dd2e8d88b93dcd5892 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T04:22:42.177 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:22:41 smithi060 podman[67524]: 2024-09-21 04:22:41.907281658 +0000 UTC m=+2.203600669 container cleanup c174ba78bae85c96b249359c2a939ea8bf008fdb31a157dd2e8d88b93dcd5892 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T04:22:42.177 INFO:journalctl@ceph.mds.b.smithi060.stdout:Sep 21 04:22:41 smithi060 bash[67524]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-b 2024-09-21T04:22:42.338 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.b.service' 2024-09-21T04:22:42.376 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:42.376 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-21T04:22:42.376 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-21T04:22:42.376 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.e 2024-09-21T04:22:42.697 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 04:22:42 smithi060 systemd[1]: Stopping Ceph mds.e for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:42.952 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 04:22:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e[61270]: 2024-09-21T04:22:42.694+0000 7fa3b7d3c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:42.953 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 04:22:42 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e[61270]: 2024-09-21T04:22:42.694+0000 7fa3b7d3c640 -1 mds.e *** got signal Terminated *** 2024-09-21T04:22:45.856 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 04:22:45 smithi060 podman[67655]: 2024-09-21 04:22:45.546608038 +0000 UTC m=+2.941855055 container died d36b2b6e68805ae54025da1d5949184faa7bf0c96d045ddb7e4628397309c5a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T04:22:46.132 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 04:22:45 smithi060 podman[67655]: 2024-09-21 04:22:45.928294491 +0000 UTC m=+3.323541500 container cleanup d36b2b6e68805ae54025da1d5949184faa7bf0c96d045ddb7e4628397309c5a3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T04:22:46.132 INFO:journalctl@ceph.mds.e.smithi060.stdout:Sep 21 04:22:45 smithi060 bash[67655]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-e 2024-09-21T04:22:46.267 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.e.service' 2024-09-21T04:22:46.301 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:46.302 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-21T04:22:46.302 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-21T04:22:46.302 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.h 2024-09-21T04:22:46.703 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 04:22:46 smithi060 systemd[1]: Stopping Ceph mds.h for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:46.703 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 04:22:46 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h[61540]: 2024-09-21T04:22:46.598+0000 7f4eb6200640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:46.703 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 04:22:46 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h[61540]: 2024-09-21T04:22:46.598+0000 7f4eb6200640 -1 mds.h *** got signal Terminated *** 2024-09-21T04:22:49.809 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 04:22:49 smithi060 podman[67775]: 2024-09-21 04:22:49.544728013 +0000 UTC m=+3.022317702 container died a283df23cc3dadb819a7277f158b48398194806ae329ae84ee6d492cdbdd8c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T04:22:50.185 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 04:22:49 smithi060 podman[67775]: 2024-09-21 04:22:49.907071691 +0000 UTC m=+3.384661380 container cleanup a283df23cc3dadb819a7277f158b48398194806ae329ae84ee6d492cdbdd8c45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T04:22:50.185 INFO:journalctl@ceph.mds.h.smithi060.stdout:Sep 21 04:22:49 smithi060 bash[67775]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-h 2024-09-21T04:22:50.317 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.h.service' 2024-09-21T04:22:50.351 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:50.351 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-21T04:22:50.351 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-21T04:22:50.351 DEBUG:teuthology.orchestra.run.smithi060:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.k 2024-09-21T04:22:50.703 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 04:22:50 smithi060 systemd[1]: Stopping Ceph mds.k for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:50.703 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 04:22:50 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k[60989]: 2024-09-21T04:22:50.677+0000 7f5c97d9f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:50.703 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 04:22:50 smithi060 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k[60989]: 2024-09-21T04:22:50.677+0000 7f5c97d9f640 -1 mds.k *** got signal Terminated *** 2024-09-21T04:22:53.816 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 04:22:53 smithi060 podman[67898]: 2024-09-21 04:22:53.530174511 +0000 UTC m=+2.953761907 container died 49f75a4572c0b76973ae5b8aaa21e189df0e795a3aa0541a27a4e091ecc56521 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T04:22:54.158 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 04:22:53 smithi060 podman[67898]: 2024-09-21 04:22:53.90501358 +0000 UTC m=+3.328600976 container cleanup 49f75a4572c0b76973ae5b8aaa21e189df0e795a3aa0541a27a4e091ecc56521 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-21T04:22:54.158 INFO:journalctl@ceph.mds.k.smithi060.stdout:Sep 21 04:22:53 smithi060 bash[67898]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-k 2024-09-21T04:22:54.285 DEBUG:teuthology.orchestra.run.smithi060:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.k.service' 2024-09-21T04:22:54.318 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:54.319 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-21T04:22:54.319 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-21T04:22:54.319 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.c 2024-09-21T04:22:54.605 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 04:22:54 smithi073 systemd[1]: Stopping Ceph mds.c for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:54.862 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 04:22:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c[62800]: 2024-09-21T04:22:54.616+0000 7fb75e179640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:54.863 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 04:22:54 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c[62800]: 2024-09-21T04:22:54.616+0000 7fb75e179640 -1 mds.c *** got signal Terminated *** 2024-09-21T04:22:57.768 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 04:22:57 smithi073 podman[68502]: 2024-09-21 04:22:57.504760091 +0000 UTC m=+2.987200425 container died 7db555eed38f8e5ae5d19b5ab15acedfabdee0f50b6b7e09717c247aaafacecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T04:22:58.052 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 04:22:57 smithi073 podman[68502]: 2024-09-21 04:22:57.849143022 +0000 UTC m=+3.331583290 container cleanup 7db555eed38f8e5ae5d19b5ab15acedfabdee0f50b6b7e09717c247aaafacecb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T04:22:58.052 INFO:journalctl@ceph.mds.c.smithi073.stdout:Sep 21 04:22:57 smithi073 bash[68502]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-c 2024-09-21T04:22:58.269 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.c.service' 2024-09-21T04:22:58.306 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:22:58.306 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-21T04:22:58.306 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-21T04:22:58.306 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.f 2024-09-21T04:22:58.605 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:22:58 smithi073 systemd[1]: Stopping Ceph mds.f for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:22:59.105 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:22:58 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f[62533]: 2024-09-21T04:22:58.630+0000 7f2c0a6da640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:22:59.105 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:22:58 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f[62533]: 2024-09-21T04:22:58.630+0000 7f2c0a6da640 -1 mds.f *** got signal Terminated *** 2024-09-21T04:23:01.790 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:23:01 smithi073 podman[68636]: 2024-09-21 04:23:01.515595726 +0000 UTC m=+2.993027875 container died 0d2eb9eae6154d573f02e001976969da3a7c48ff64069e8e63e19b028e58ce93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f, maintainer=Guillaume Abrioux , RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T04:23:02.105 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:23:01 smithi073 podman[68636]: 2024-09-21 04:23:01.877921844 +0000 UTC m=+3.355353992 container cleanup 0d2eb9eae6154d573f02e001976969da3a7c48ff64069e8e63e19b028e58ce93 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T04:23:02.105 INFO:journalctl@ceph.mds.f.smithi073.stdout:Sep 21 04:23:01 smithi073 bash[68636]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-f 2024-09-21T04:23:02.264 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.f.service' 2024-09-21T04:23:02.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:23:02.298 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-21T04:23:02.298 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-21T04:23:02.298 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.i 2024-09-21T04:23:02.710 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:23:02 smithi073 systemd[1]: Stopping Ceph mds.i for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:23:03.105 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:23:02 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i[63081]: 2024-09-21T04:23:02.707+0000 7f4bc5795640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:23:03.105 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:23:02 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i[63081]: 2024-09-21T04:23:02.707+0000 7f4bc5795640 -1 mds.i *** got signal Terminated *** 2024-09-21T04:23:05.605 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:23:05 smithi073 podman[68758]: 2024-09-21 04:23:05.510320163 +0000 UTC m=+2.998068734 container died d4733cff45788abd26bb9ab5c5a1fd2754dfba88cc9f3257e03dd5d17c700048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T04:23:06.105 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:23:05 smithi073 podman[68758]: 2024-09-21 04:23:05.832078903 +0000 UTC m=+3.319827476 container cleanup d4733cff45788abd26bb9ab5c5a1fd2754dfba88cc9f3257e03dd5d17c700048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T04:23:06.105 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:23:05 smithi073 bash[68758]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i 2024-09-21T04:23:06.105 INFO:journalctl@ceph.mds.i.smithi073.stdout:Sep 21 04:23:06 smithi073 podman[68770]: 2024-09-21 04:23:06.008505697 +0000 UTC m=+0.498355722 container remove d4733cff45788abd26bb9ab5c5a1fd2754dfba88cc9f3257e03dd5d17c700048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-i, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, ceph=True, io.buildah.version=1.37.2) 2024-09-21T04:23:06.262 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.i.service' 2024-09-21T04:23:06.294 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:23:06.294 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-21T04:23:06.294 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-21T04:23:06.294 DEBUG:teuthology.orchestra.run.smithi073:> sudo systemctl stop ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.l 2024-09-21T04:23:06.605 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:23:06 smithi073 systemd[1]: Stopping Ceph mds.l for ae19ad46-77cc-11ef-baf5-efdc52797490... 2024-09-21T04:23:06.855 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:23:06 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l[62266]: 2024-09-21T04:23:06.602+0000 7f482b2f3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T04:23:06.855 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:23:06 smithi073 ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l[62266]: 2024-09-21T04:23:06.602+0000 7f482b2f3640 -1 mds.l *** got signal Terminated *** 2024-09-21T04:23:09.896 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:23:09 smithi073 podman[68879]: 2024-09-21 04:23:09.612298347 +0000 UTC m=+3.105117057 container died 50b7701970fa614254bf4836f6693f89f690db4f51853318eeade1d3dd596938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T04:23:09.896 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:23:09 smithi073 podman[68879]: 2024-09-21 04:23:09.89388344 +0000 UTC m=+3.386702148 container cleanup 50b7701970fa614254bf4836f6693f89f690db4f51853318eeade1d3dd596938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221) 2024-09-21T04:23:10.234 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:23:09 smithi073 bash[68879]: ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l 2024-09-21T04:23:10.234 INFO:journalctl@ceph.mds.l.smithi073.stdout:Sep 21 04:23:10 smithi073 podman[68892]: 2024-09-21 04:23:10.128660163 +0000 UTC m=+0.518240810 container remove 50b7701970fa614254bf4836f6693f89f690db4f51853318eeade1d3dd596938 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:dd75f9b101bc316b5d0b4eba020bf68e946d78b16cc3e2ed75055abd1b43a262, name=ceph-ae19ad46-77cc-11ef-baf5-efdc52797490-mds-l, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-pdonnell-testing-20240920.212106-debug-1843221, GIT_CLEAN=True) 2024-09-21T04:23:10.249 DEBUG:teuthology.orchestra.run.smithi073:> sudo pkill -f 'journalctl -f -n 0 -u ceph-ae19ad46-77cc-11ef-baf5-efdc52797490@mds.l.service' 2024-09-21T04:23:10.280 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T04:23:10.281 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-21T04:23:10.281 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T04:23:10.495 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T04:23:13.151 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T04:23:13.364 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T04:23:15.873 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 --force --keep-logs 2024-09-21T04:23:16.075 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T04:23:18.422 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:23:18.457 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:23:18.490 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T04:23:18.517 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T04:23:18.519 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485/remote/smithi022/crash 2024-09-21T04:23:18.520 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/crash -- . 2024-09-21T04:23:18.560 INFO:teuthology.orchestra.run.smithi022.stderr:tar: /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T04:23:18.560 INFO:teuthology.orchestra.run.smithi022.stderr:tar: Error is not recoverable: exiting now 2024-09-21T04:23:18.562 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485/remote/smithi060/crash 2024-09-21T04:23:18.563 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/crash -- . 2024-09-21T04:23:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:tar: /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T04:23:18.603 INFO:teuthology.orchestra.run.smithi060.stderr:tar: Error is not recoverable: exiting now 2024-09-21T04:23:18.605 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/crash to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485/remote/smithi073/crash 2024-09-21T04:23:18.606 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/crash -- . 2024-09-21T04:23:18.644 INFO:teuthology.orchestra.run.smithi073.stderr:tar: /var/lib/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T04:23:18.644 INFO:teuthology.orchestra.run.smithi073.stderr:tar: Error is not recoverable: exiting now 2024-09-21T04:23:18.645 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T04:23:18.646 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T04:23:18.743 INFO:tasks.cephadm:Compressing logs... 2024-09-21T04:23:18.743 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T04:23:18.746 DEBUG:teuthology.orchestra.run.smithi060:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T04:23:18.749 DEBUG:teuthology.orchestra.run.smithi073:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T04:23:18.776 INFO:teuthology.orchestra.run.smithi022.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T04:23:18.777 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-09-21T04:23:18.777 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.0.log 2024-09-21T04:23:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.9.log 2024-09-21T04:23:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T04:23:18.778 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T04:23:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.a.log 2024-09-21T04:23:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T04:23:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mon.a.log 2024-09-21T04:23:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.g.log 2024-09-21T04:23:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.6.log 2024-09-21T04:23:18.782 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mon.a.log: /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.log 2024-09-21T04:23:18.782 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.d.log 2024-09-21T04:23:18.782 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mgr.x.log 2024-09-21T04:23:18.783 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.j.log 2024-09-21T04:23:18.783 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.d.log: /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.3.log 2024-09-21T04:23:18.783 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-21T04:23:18.783 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T04:23:18.783 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 87.0% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T04:23:18.786 INFO:teuthology.orchestra.run.smithi073.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-21T04:23:18.787 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T04:23:18.787 INFO:teuthology.orchestra.run.smithi073.stderr:gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T04:23:18.788 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.i.log 2024-09-21T04:23:18.789 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mon.c.log 2024-09-21T04:23:18.789 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T04:23:18.789 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.11.log 2024-09-21T04:23:18.792 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.2.log 2024-09-21T04:23:18.792 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.5.log 2024-09-21T04:23:18.792 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.log 2024-09-21T04:23:18.792 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.l.log 2024-09-21T04:23:18.792 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.8.log 2024-09-21T04:23:18.792 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.l.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mgr.z.log 2024-09-21T04:23:18.792 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.c.log 2024-09-21T04:23:18.792 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.f.log 2024-09-21T04:23:18.793 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T04:23:18.796 INFO:teuthology.orchestra.run.smithi060.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.10.log: No such file or directory 2024-09-21T04:23:18.796 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-21T04:23:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.1.log 2024-09-21T04:23:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.7.log 2024-09-21T04:23:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.10.log: /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-volume.log 2024-09-21T04:23:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.b.log 2024-09-21T04:23:18.798 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.k.log 2024-09-21T04:23:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.4.log 2024-09-21T04:23:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.audit.log 2024-09-21T04:23:18.799 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.cephadm.log 2024-09-21T04:23:18.800 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mgr.y.log 2024-09-21T04:23:18.801 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.audit.log: /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.log 2024-09-21T04:23:18.801 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.h.log 2024-09-21T04:23:18.801 INFO:teuthology.orchestra.run.smithi060.stderr:gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mon.b.log 2024-09-21T04:23:18.802 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.log: /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.e.log 2024-09-21T04:23:18.802 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T04:23:18.802 INFO:teuthology.orchestra.run.smithi022.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-09-21T04:23:18.817 INFO:teuthology.orchestra.run.smithi073.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.f.log: /var/log/ceph/cephadm.log: 83.3% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T04:23:18.861 INFO:teuthology.orchestra.run.smithi060.stderr:/var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.e.log: /var/log/ceph/cephadm.log: 83.4% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T04:23:18.908 INFO:teuthology.orchestra.run.smithi060.stderr: 90.3% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T04:23:18.921 INFO:teuthology.orchestra.run.smithi060.stderr: 92.9% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mgr.y.log.gz 2024-09-21T04:23:18.935 INFO:teuthology.orchestra.run.smithi060.stderr: 87.0% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T04:23:18.945 INFO:teuthology.orchestra.run.smithi060.stderr: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T04:23:18.946 INFO:teuthology.orchestra.run.smithi073.stderr: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T04:23:19.004 INFO:teuthology.orchestra.run.smithi073.stderr: 87.0% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.log.gz 2024-09-21T04:23:19.007 INFO:teuthology.orchestra.run.smithi022.stderr: 95.1% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.d.log.gz 2024-09-21T04:23:19.010 INFO:teuthology.orchestra.run.smithi022.stderr: 95.0% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.j.log.gz 2024-09-21T04:23:19.012 INFO:teuthology.orchestra.run.smithi073.stderr: 93.0% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mgr.z.log.gz 2024-09-21T04:23:19.098 INFO:teuthology.orchestra.run.smithi022.stderr: 82.9% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.cephadm.log.gz 2024-09-21T04:23:19.135 INFO:teuthology.orchestra.run.smithi022.stderr: 90.1% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T04:23:19.168 INFO:teuthology.orchestra.run.smithi073.stderr: 91.0% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T04:23:19.238 INFO:teuthology.orchestra.run.smithi060.stderr: 90.9% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T04:23:19.281 INFO:teuthology.orchestra.run.smithi073.stderr: 90.3% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph.audit.log.gz 2024-09-21T04:23:19.321 INFO:teuthology.orchestra.run.smithi022.stderr: 90.9% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-volume.log.gz 2024-09-21T04:23:19.365 INFO:teuthology.orchestra.run.smithi022.stderr: 93.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T04:23:19.659 INFO:teuthology.orchestra.run.smithi060.stderr: 91.8% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mon.b.log.gz 2024-09-21T04:23:19.696 INFO:teuthology.orchestra.run.smithi060.stderr: 94.7% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.e.log.gz 2024-09-21T04:23:20.220 INFO:teuthology.orchestra.run.smithi022.stderr: 90.6% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mgr.x.log.gz 2024-09-21T04:23:20.446 INFO:teuthology.orchestra.run.smithi060.stderr: 93.8% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.k.log.gz 2024-09-21T04:23:20.748 INFO:teuthology.orchestra.run.smithi022.stderr: 93.6% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.a.log.gz 2024-09-21T04:23:20.974 INFO:teuthology.orchestra.run.smithi073.stderr: 91.8% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mon.c.log.gz 2024-09-21T04:23:21.676 INFO:teuthology.orchestra.run.smithi022.stderr: 93.8% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.g.log.gz 2024-09-21T04:23:21.874 INFO:teuthology.orchestra.run.smithi073.stderr: 95.9% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.l.log.gz 2024-09-21T04:23:27.899 INFO:teuthology.orchestra.run.smithi060.stderr: 94.5% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.h.log.gz 2024-09-21T04:23:29.503 INFO:teuthology.orchestra.run.smithi073.stderr: 95.6% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.c.log.gz 2024-09-21T04:23:33.053 INFO:teuthology.orchestra.run.smithi073.stderr: 95.3% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.i.log.gz 2024-09-21T04:23:35.242 INFO:teuthology.orchestra.run.smithi022.stderr: 90.2% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mon.a.log.gz 2024-09-21T04:23:39.148 INFO:teuthology.orchestra.run.smithi073.stderr: 96.0% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.f.log.gz 2024-09-21T04:23:45.445 INFO:teuthology.orchestra.run.smithi060.stderr: 93.9% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-mds.b.log.gz 2024-09-21T04:24:25.033 INFO:teuthology.orchestra.run.smithi060.stderr: 90.7% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.10.log.gz 2024-09-21T04:25:09.782 INFO:teuthology.orchestra.run.smithi060.stderr: 90.7% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.1.log.gz 2024-09-21T04:25:30.046 INFO:teuthology.orchestra.run.smithi060.stderr: 90.6% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.7.log.gz 2024-09-21T04:25:31.587 INFO:teuthology.orchestra.run.smithi073.stderr: 90.8% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.8.log.gz 2024-09-21T04:25:35.372 INFO:teuthology.orchestra.run.smithi060.stderr: 90.8% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.4.log.gz 2024-09-21T04:25:35.374 INFO:teuthology.orchestra.run.smithi060.stderr: 2024-09-21T04:25:35.374 INFO:teuthology.orchestra.run.smithi060.stderr:real 2m16.610s 2024-09-21T04:25:35.374 INFO:teuthology.orchestra.run.smithi060.stderr:user 4m23.561s 2024-09-21T04:25:35.374 INFO:teuthology.orchestra.run.smithi060.stderr:sys 0m8.045s 2024-09-21T04:26:03.782 INFO:teuthology.orchestra.run.smithi073.stderr: 90.7% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.5.log.gz 2024-09-21T04:26:11.059 INFO:teuthology.orchestra.run.smithi073.stderr: 90.8% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.11.log.gz 2024-09-21T04:26:32.805 INFO:teuthology.orchestra.run.smithi073.stderr: 90.9% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.2.log.gz 2024-09-21T04:26:32.807 INFO:teuthology.orchestra.run.smithi073.stderr: 2024-09-21T04:26:32.807 INFO:teuthology.orchestra.run.smithi073.stderr:real 3m14.044s 2024-09-21T04:26:32.807 INFO:teuthology.orchestra.run.smithi073.stderr:user 4m44.228s 2024-09-21T04:26:32.807 INFO:teuthology.orchestra.run.smithi073.stderr:sys 0m10.029s 2024-09-21T04:35:53.814 INFO:teuthology.orchestra.run.smithi022.stderr: 90.7% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.0.log.gz 2024-09-21T04:37:05.656 INFO:teuthology.orchestra.run.smithi022.stderr: 90.7% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.6.log.gz 2024-09-21T04:39:47.627 INFO:teuthology.orchestra.run.smithi022.stderr: 90.7% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.9.log.gz 2024-09-21T04:40:39.200 INFO:teuthology.orchestra.run.smithi022.stderr: 90.7% -- replaced with /var/log/ceph/ae19ad46-77cc-11ef-baf5-efdc52797490/ceph-osd.3.log.gz 2024-09-21T04:40:40.683 INFO:teuthology.orchestra.run.smithi022.stderr: 94.4% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T04:40:40.683 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-09-21T04:40:40.683 INFO:teuthology.orchestra.run.smithi022.stderr:real 17m21.922s 2024-09-21T04:40:40.683 INFO:teuthology.orchestra.run.smithi022.stderr:user 6m55.353s 2024-09-21T04:40:40.683 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m18.504s 2024-09-21T04:40:40.683 INFO:tasks.cephadm:Archiving logs... 2024-09-21T04:40:40.684 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485/remote/smithi022/log 2024-09-21T04:40:40.685 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T04:41:43.548 DEBUG:teuthology.misc:Transferring archived files from smithi060:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485/remote/smithi060/log 2024-09-21T04:41:43.549 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T04:42:27.597 DEBUG:teuthology.misc:Transferring archived files from smithi073:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485/remote/smithi073/log 2024-09-21T04:42:27.598 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T04:43:16.614 INFO:tasks.cephadm:Removing cluster... 2024-09-21T04:43:16.614 DEBUG:teuthology.orchestra.run.smithi022:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 --force 2024-09-21T04:43:16.853 INFO:teuthology.orchestra.run.smithi022.stdout:Deleting cluster with fsid: ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T04:43:17.556 DEBUG:teuthology.orchestra.run.smithi060:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 --force 2024-09-21T04:43:17.771 INFO:teuthology.orchestra.run.smithi060.stdout:Deleting cluster with fsid: ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T04:43:18.398 DEBUG:teuthology.orchestra.run.smithi073:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid ae19ad46-77cc-11ef-baf5-efdc52797490 --force 2024-09-21T04:43:18.728 INFO:teuthology.orchestra.run.smithi073.stdout:Deleting cluster with fsid: ae19ad46-77cc-11ef-baf5-efdc52797490 2024-09-21T04:43:19.376 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T04:43:19.377 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T04:43:19.397 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T04:43:19.416 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T04:43:19.431 INFO:tasks.cephadm:Teardown complete 2024-09-21T04:43:19.432 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T04:43:19.442 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T04:43:19.443 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T04:43:19.445 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T04:43:19.459 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T04:43:19.580 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T04:43:19.598 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T04:43:19.599 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T04:43:19.602 DEBUG:teuthology.orchestra.run.smithi060:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T04:43:19.604 DEBUG:teuthology.orchestra.run.smithi073:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T04:43:19.617 INFO:teuthology.orchestra.run.smithi022.stderr:bash: line 1: ntpq: command not found 2024-09-21T04:43:19.619 INFO:teuthology.orchestra.run.smithi073.stderr:bash: line 1: ntpq: command not found 2024-09-21T04:43:19.619 INFO:teuthology.orchestra.run.smithi060.stderr:bash: line 1: ntpq: command not found 2024-09-21T04:43:19.634 INFO:teuthology.orchestra.run.smithi073.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T04:43:19.634 INFO:teuthology.orchestra.run.smithi073.stdout:=============================================================================== 2024-09-21T04:43:19.634 INFO:teuthology.orchestra.run.smithi073.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 -715us[ -712us] +/- 47ms 2024-09-21T04:43:19.634 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 47 +1483us[+1486us] +/- 58ms 2024-09-21T04:43:19.634 INFO:teuthology.orchestra.run.smithi073.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 43 -846us[ -846us] +/- 78ms 2024-09-21T04:43:19.634 INFO:teuthology.orchestra.run.smithi073.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T04:43:19.637 INFO:teuthology.orchestra.run.smithi060.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T04:43:19.637 INFO:teuthology.orchestra.run.smithi060.stdout:=============================================================================== 2024-09-21T04:43:19.637 INFO:teuthology.orchestra.run.smithi060.stdout:^* hv01.front.sepia.ceph.com 3 6 377 47 -714us[ -714us] +/- 47ms 2024-09-21T04:43:19.638 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 44 +1476us[+1476us] +/- 58ms 2024-09-21T04:43:19.638 INFO:teuthology.orchestra.run.smithi060.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 -868us[ -868us] +/- 78ms 2024-09-21T04:43:19.638 INFO:teuthology.orchestra.run.smithi060.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T04:43:19.648 INFO:teuthology.orchestra.run.smithi022.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T04:43:19.648 INFO:teuthology.orchestra.run.smithi022.stdout:=============================================================================== 2024-09-21T04:43:19.648 INFO:teuthology.orchestra.run.smithi022.stdout:^* hv01.front.sepia.ceph.com 3 6 377 46 -708us[ -701us] +/- 47ms 2024-09-21T04:43:19.648 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 +1510us[+1517us] +/- 58ms 2024-09-21T04:43:19.649 INFO:teuthology.orchestra.run.smithi022.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 47 -853us[ -846us] +/- 78ms 2024-09-21T04:43:19.649 INFO:teuthology.orchestra.run.smithi022.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T04:43:19.649 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T04:43:19.659 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T04:43:19.659 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T04:43:19.669 DEBUG:teuthology.orchestra.run.smithi022:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T04:43:19.846 DEBUG:teuthology.orchestra.run.smithi060:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T04:43:19.979 DEBUG:teuthology.orchestra.run.smithi073:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T04:43:20.072 DEBUG:teuthology.orchestra.run.smithi022:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T04:43:20.105 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:43:20.105 DEBUG:teuthology.orchestra.run.smithi060:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T04:43:20.136 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:43:20.137 DEBUG:teuthology.orchestra.run.smithi073:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T04:43:20.164 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:43:20.165 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T04:43:20.176 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T04:43:20.193 INFO:teuthology.task.internal:Duration was 3520.309731 seconds 2024-09-21T04:43:20.193 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T04:43:20.204 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T04:43:20.204 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T04:43:20.207 DEBUG:teuthology.orchestra.run.smithi060:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T04:43:20.209 DEBUG:teuthology.orchestra.run.smithi073:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T04:43:20.277 INFO:teuthology.orchestra.run.smithi022.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T04:43:20.299 INFO:teuthology.orchestra.run.smithi073.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T04:43:20.379 INFO:teuthology.orchestra.run.smithi060.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T04:43:20.758 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T04:43:20.758 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-09-21T04:43:20.759 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T04:43:20.784 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi060.front.sepia.ceph.com 2024-09-21T04:43:20.784 DEBUG:teuthology.orchestra.run.smithi060:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T04:43:20.815 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi073.front.sepia.ceph.com 2024-09-21T04:43:20.815 DEBUG:teuthology.orchestra.run.smithi073:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T04:43:20.851 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T04:43:20.851 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T04:43:20.853 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T04:43:20.858 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T04:43:20.918 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T04:43:20.918 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T04:43:20.925 DEBUG:teuthology.orchestra.run.smithi060:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T04:43:20.928 DEBUG:teuthology.orchestra.run.smithi073:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T04:43:21.799 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T04:43:21.810 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T04:43:21.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T04:43:21.837 DEBUG:teuthology.orchestra.run.smithi060:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T04:43:21.875 DEBUG:teuthology.orchestra.run.smithi073:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T04:43:21.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T04:43:21.933 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:43:21.936 DEBUG:teuthology.orchestra.run.smithi060:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:43:21.938 DEBUG:teuthology.orchestra.run.smithi073:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:43:21.964 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-09-21T04:43:21.964 INFO:teuthology.orchestra.run.smithi060.stdout:kernel.core_pattern = core 2024-09-21T04:43:21.966 INFO:teuthology.orchestra.run.smithi073.stdout:kernel.core_pattern = core 2024-09-21T04:43:21.996 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:43:22.037 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:43:22.037 DEBUG:teuthology.orchestra.run.smithi060:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:43:22.052 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:43:22.053 DEBUG:teuthology.orchestra.run.smithi073:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T04:43:22.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T04:43:22.068 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T04:43:22.080 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T04:43:22.081 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485/remote/smithi022 2024-09-21T04:43:22.081 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T04:43:22.138 DEBUG:teuthology.misc:Transferring archived files from smithi060:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485/remote/smithi060 2024-09-21T04:43:22.138 DEBUG:teuthology.orchestra.run.smithi060:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T04:43:22.178 DEBUG:teuthology.misc:Transferring archived files from smithi073:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-09-20_23:48:22-fs-wip-pdonnell-testing-20240920.212106-debug-distro-default-smithi/7913485/remote/smithi073 2024-09-21T04:43:22.179 DEBUG:teuthology.orchestra.run.smithi073:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T04:43:22.216 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T04:43:22.216 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T04:43:22.219 DEBUG:teuthology.orchestra.run.smithi060:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T04:43:22.221 DEBUG:teuthology.orchestra.run.smithi073:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T04:43:22.265 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T04:43:22.278 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T04:43:22.279 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T04:43:22.306 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T04:43:22.306 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T04:43:22.309 DEBUG:teuthology.orchestra.run.smithi060:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T04:43:22.312 DEBUG:teuthology.orchestra.run.smithi073:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T04:43:22.322 INFO:teuthology.orchestra.run.smithi022.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 04:43 /home/ubuntu/cephtest 2024-09-21T04:43:22.325 INFO:teuthology.orchestra.run.smithi060.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 04:43 /home/ubuntu/cephtest 2024-09-21T04:43:22.327 INFO:teuthology.orchestra.run.smithi073.stdout: 265613 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 21 04:43 /home/ubuntu/cephtest 2024-09-21T04:43:22.328 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T04:43:22.339 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T04:43:22.365 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-comp-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-quota} 1-check-counter 2-scrub/no 3-snaps/no 4-flush/no 5-quiesce/with-quiesce 6-workunit/postgres}} duration: 3520.309731245041 flavor: default owner: scheduled_pdonnell@teuthology success: true 2024-09-21T04:43:22.365 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T04:43:22.453 INFO:teuthology.run:pass